2026-03-28 14:00:09 [scrapy.utils.log] INFO: Scrapy 2.11.2 started (bot: SourcingV2)
2026-03-28 14:00:09 [scrapy.utils.log] INFO: Versions: lxml 5.2.2.0, libxml2 2.12.6, cssselect 1.2.0, parsel 1.9.1, w3lib 2.1.2, Twisted 24.3.0, Python 3.11.2 (main, Mar 13 2023, 12:18:29) [GCC 12.2.0], pyOpenSSL 24.1.0 (OpenSSL 3.2.1 30 Jan 2024), cryptography 42.0.7, Platform Linux-5.15.0-1098-azure-x86_64-with-glibc2.36
2026-03-28 14:00:09 [bca.uk] INFO: Starting spider bca.uk
2026-03-28 14:00:09 [azure.identity._credentials.environment] INFO: Incomplete environment configuration for EnvironmentCredential. These variables are set: AZURE_TENANT_ID, AZURE_CLIENT_ID
2026-03-28 14:00:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-03-28 14:00:10 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2118
2026-03-28 14:00:10 [azure.identity._credentials.chained] INFO: DefaultAzureCredential acquired a token from WorkloadIdentityCredential
2026-03-28 14:00:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxsourcingstorageprod.table.core.windows.net:443
2026-03-28 14:00:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:00:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /SpiderData()?$filter=PartitionKey%20eq%20%27BCAUk%27%20and%20RowKey%20eq%20%27cookies%27 HTTP/1.1" 200 None
2026-03-28 14:00:10 [bca.uk] INFO: No cached cookies found, will perform fresh login
2026-03-28 14:00:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:00:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /SpiderData()?$filter=PartitionKey%20eq%20%27BCAUk%27%20and%20RowKey%20eq%20%27auth_token%27 HTTP/1.1" 200 None
2026-03-28 14:00:10 [bca.uk] INFO: Loaded cached Auth0 token from Azure Tables (length=1492)
2026-03-28 14:00:10 [scrapy.addons] INFO: Enabled addons:
[]
2026-03-28 14:00:10 [asyncio] DEBUG: Using selector: EpollSelector
2026-03-28 14:00:10 [scrapy.utils.log] DEBUG: Using reactor: twisted.internet.asyncioreactor.AsyncioSelectorReactor
2026-03-28 14:00:10 [scrapy.utils.log] DEBUG: Using asyncio event loop: asyncio.unix_events._UnixSelectorEventLoop
2026-03-28 14:00:10 [scrapy.extensions.telnet] INFO: Telnet Password: a7a4e3dff6091933
2026-03-28 14:00:10 [scrapy.middleware] INFO: Enabled extensions:
['scrapy.extensions.corestats.CoreStats',
'scrapy.extensions.telnet.TelnetConsole',
'scrapy.extensions.memusage.MemoryUsage',
'scrapy.extensions.feedexport.FeedExporter',
'scrapy.extensions.logstats.LogStats',
'scrapy.extensions.closespider.CloseSpider']
2026-03-28 14:00:10 [scrapy.crawler] INFO: Overridden settings:
{'BOT_NAME': 'SourcingV2',
'CLOSESPIDER_TIMEOUT': 7200,
'DOWNLOAD_MAXSIZE': 52428800,
'DOWNLOAD_WARNSIZE': 10485760,
'FEED_EXPORT_ENCODING': 'utf-8',
'LOG_FILE': '/var/log/scrapyd/logs/sourcing_v2/bca.uk/task_51_2026-03-28T14_00_00.log',
'LOG_FORMATTER': 'crawlers.log_formatter.SourcingLogFormatter',
'MEMUSAGE_LIMIT_MB': 2048,
'MEMUSAGE_WARNING_MB': 1536,
'NEWSPIDER_MODULE': 'spiders',
'REQUEST_FINGERPRINTER_CLASS': 'scrapy_zyte_api.ScrapyZyteAPIRequestFingerprinter',
'REQUEST_FINGERPRINTER_IMPLEMENTATION': '2.7',
'SPIDER_MODULES': ['spiders', 'auth_check'],
'TWISTED_REACTOR': 'twisted.internet.asyncioreactor.AsyncioSelectorReactor',
'USER_AGENT': ''}
2026-03-28 14:00:10 [scrapy_zyte_api.handler] INFO: Using a Zyte API key starting with '5857011'
2026-03-28 14:00:10 [scrapy_zyte_api.handler] INFO: Using a Zyte API key starting with '5857011'
2026-03-28 14:00:10 [scrapy.middleware] INFO: Enabled downloader middlewares:
['scrapy.downloadermiddlewares.offsite.OffsiteMiddleware',
'scrapy.downloadermiddlewares.httpauth.HttpAuthMiddleware',
'scrapy.downloadermiddlewares.downloadtimeout.DownloadTimeoutMiddleware',
'scrapy.downloadermiddlewares.defaultheaders.DefaultHeadersMiddleware',
'scrapy.downloadermiddlewares.useragent.UserAgentMiddleware',
'scrapy_zyte_api.ScrapyZyteAPIDownloaderMiddleware',
'scrapy.downloadermiddlewares.retry.RetryMiddleware',
'scrapy.downloadermiddlewares.redirect.MetaRefreshMiddleware',
'scrapy.downloadermiddlewares.httpcompression.HttpCompressionMiddleware',
'scrapy.downloadermiddlewares.redirect.RedirectMiddleware',
'scrapy.downloadermiddlewares.cookies.CookiesMiddleware',
'scrapy.downloadermiddlewares.httpproxy.HttpProxyMiddleware',
'scrapy.downloadermiddlewares.stats.DownloaderStats']
2026-03-28 14:00:10 [crawlers.middlewares.id_gen_middleware] INFO: Setting up IdGenerationMiddleware
2026-03-28 14:00:10 [scrapy.middleware] INFO: Enabled spider middlewares:
['scrapy.spidermiddlewares.httperror.HttpErrorMiddleware',
'scrapy_zyte_api.ScrapyZyteAPISpiderMiddleware',
'crawlers.middlewares.monitoring_spider_middleware.MonitoringSpiderMiddleware',
'scrapy.spidermiddlewares.referer.RefererMiddleware',
'scrapy.spidermiddlewares.urllength.UrlLengthMiddleware',
'scrapy.spidermiddlewares.depth.DepthMiddleware',
'crawlers.middlewares.photo_download_middleware.PhotoDownloadMiddleware',
'crawlers.middlewares.report_download_middleware.ReportDownloadMiddleware',
'crawlers.middlewares.id_gen_middleware.IdGenMiddleware']
2026-03-28 14:00:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:00:10 [crawlers.pipelines.translation_pipeline] INFO: Loading translations for language: auto
2026-03-28 14:00:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /Translations()?$filter=PartitionKey%20eq%20%27auto%27%20and%20RowKey%20eq%20%27auto%27 HTTP/1.1" 200 None
2026-03-28 14:00:10 [crawlers.pipelines.item_rules_pipeline] INFO: Setting up ItemRules Pipeline
2026-03-28 14:00:10 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: invalid_location_for_country.json
2026-03-28 14:00:10 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: damaged_cars_from_auction_title.json
2026-03-28 14:00:10 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: puretech_for_country.json
2026-03-28 14:00:10 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: puretech_for_fr.json
2026-03-28 14:00:10 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: missing_photos.json
2026-03-28 14:00:10 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: damaged_from_info.json
2026-03-28 14:00:10 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: makes_not_allowed.json
2026-03-28 14:00:10 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: not_operable_from_info.json
2026-03-28 14:00:10 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: makes_models_not_allowed.json
2026-03-28 14:00:10 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: keywords_from_title.json
2026-03-28 14:00:10 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: imported_cars.json
2026-03-28 14:00:10 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: invalid_currency.json
2026-03-28 14:00:10 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: missing_mileage.json
2026-03-28 14:00:10 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: keywords_from_auction_title.json
2026-03-28 14:00:10 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: invalid_country_of_origin.json
2026-03-28 14:00:10 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: puretech_for_pt.json
2026-03-28 14:00:10 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: electric_cars.json
2026-03-28 14:00:10 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: missing_color.json
2026-03-28 14:00:10 [crawlers.pipelines.post_to_api] INFO: Setting up PostToApi Pipeline pointing to https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
2026-03-28 14:00:10 [scrapy.middleware] INFO: Enabled item pipelines:
['crawlers.pipelines.translation_pipeline.TranslationPipeline',
'crawlers.pipelines.item_rules_pipeline.ItemRulesPipeline',
'crawlers.pipelines.post_to_api.PostToApiPipeline']
2026-03-28 14:00:10 [scrapy.core.engine] INFO: Spider opened
2026-03-28 14:00:10 [scrapy.extensions.logstats] INFO: Crawled 0 pages (at 0 pages/min), scraped 0 items (at 0 items/min)
2026-03-28 14:00:10 [scrapy.extensions.telnet] INFO: Telnet console listening on 127.0.0.1:6024
2026-03-28 14:00:10 [scrapy.extensions.memusage] INFO: Peak memory usage is 141MiB
2026-03-28 14:00:10 [scrapy-playwright] INFO: Starting download handler
2026-03-28 14:00:10 [scrapy-playwright] INFO: Starting download handler
2026-03-28 14:00:11 [scrapy-playwright] INFO: Launching 1 startup context(s)
2026-03-28 14:00:11 [scrapy-playwright] INFO: Launching browser chromium
2026-03-28 14:00:12 [scrapy-playwright] INFO: Launching 1 startup context(s)
2026-03-28 14:00:12 [scrapy-playwright] INFO: Launching browser chromium
2026-03-28 14:00:12 [scrapy-playwright] INFO: Browser chromium launched
2026-03-28 14:00:12 [scrapy-playwright] DEBUG: Browser context started: 'default' (persistent=False, remote=False)
2026-03-28 14:00:12 [scrapy-playwright] INFO: Startup context(s) launched
2026-03-28 14:00:13 [scrapy-playwright] INFO: Browser chromium launched
2026-03-28 14:00:13 [scrapy-playwright] DEBUG: Browser context started: 'default' (persistent=False, remote=False)
2026-03-28 14:00:13 [scrapy-playwright] INFO: Startup context(s) launched
2026-03-28 14:00:15 [bca.uk] INFO: No cached cookies available, starting login process with credentials
2026-03-28 14:00:15 [bca.uk] INFO: Zyte login attempt 1/3
2026-03-28 14:00:15 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 14:00:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.bca.co.uk/> (referer: None) ['zyte-api']
2026-03-28 14:00:53 [bca.uk] INFO: Action 0 (waitForTimeout): status=success, elapsed=5.001s
2026-03-28 14:00:53 [bca.uk] INFO: Action 1 (waitForSelector): status=success, elapsed=0.01s
2026-03-28 14:00:53 [bca.uk] INFO: Action 2 (evaluate): status=success, elapsed=0.003s
2026-03-28 14:00:53 [bca.uk] INFO: Action 3 (waitForTimeout): status=success, elapsed=1s
2026-03-28 14:00:53 [bca.uk] INFO: Action 4 (click): status=success, elapsed=1.179s
2026-03-28 14:00:53 [bca.uk] INFO: Action 5 (waitForSelector): status=success, elapsed=1.005s
2026-03-28 14:00:53 [bca.uk] INFO: Action 6 (waitForTimeout): status=success, elapsed=1s
2026-03-28 14:00:53 [bca.uk] INFO: Action 7 (click): status=success, elapsed=2.578s
2026-03-28 14:00:53 [bca.uk] INFO: Action 8 (type): status=success, elapsed=0.068s
2026-03-28 14:00:53 [bca.uk] INFO: Action 9 (waitForTimeout): status=success, elapsed=1s
2026-03-28 14:00:53 [bca.uk] INFO: Action 10 (click): status=success, elapsed=1.742s
2026-03-28 14:00:53 [bca.uk] INFO: Action 11 (type): status=success, elapsed=0.016s
2026-03-28 14:00:53 [bca.uk] INFO: Action 12 (waitForTimeout): status=success, elapsed=1s
2026-03-28 14:00:53 [bca.uk] INFO: Action 13 (click): status=success, elapsed=2.601s
2026-03-28 14:00:53 [bca.uk] INFO: Action 14 (waitForSelector): status=success, elapsed=3.014s
2026-03-28 14:00:53 [bca.uk] INFO: Action 15 (evaluate): status=success, elapsed=0.002s
2026-03-28 14:00:53 [bca.uk] INFO: Action 16 (waitForTimeout): status=success, elapsed=10s
2026-03-28 14:00:53 [bca.uk] INFO: Action 17 (evaluate): status=success, elapsed=0.001s
2026-03-28 14:00:53 [bca.uk] INFO: Page URL after login: https://www.bca.co.uk/
2026-03-28 14:00:53 [bca.uk] INFO: Successfully logged in via Zyte API session
2026-03-28 14:00:53 [bca.uk] INFO: Scrapy-formatted cookies: [{'name': 'dtCookie', 'value': 'v_4_srv_2_sn_AFA309C213C2EA850BA8344E20008AC2_perc_100000_ol_0_mul_1_app-3A5d68a08db18e8bbb_1_app-3Aea7c4b59f27d43eb_1', 'domain': '.bca.co.uk', 'path': '/'}, {'name': 'ASLBSACORS', 'value': '000323392f7a18bd2b0ff7209c28bb25c0f06dee33a9cf62b65238d7d6868fdf5ddf', 'domain': 'www.bca.co.uk', 'path': '/'}, {'name': 'dest', 'value': 'https://www.bca.co.uk/', 'domain': '.bca.co.uk', 'path': '/'}, {'name': 'INGRESSCOOKIE', 'value': '3ca5901f445451cff7c573e48b96bb8f|17148814d3d29f21517da122aae4be83', 'domain': 'www.bca.co.uk', 'path': '/'}, {'name': 'csrf', 'value': '0NuzinTbkfQDBL5TvUk1pa1IjYnW7-foYN0TdPvFMGSYQ-ZdhpfUPRkdVraeJZ_q6KdXHiOn8503x6pEPCTk0w:AAABnTS-3fA:D6MYtoDypIRN8jGRuJIoCw', 'domain': 'www.bca.co.uk', 'path': '/'}, {'name': 'OptanonConsent', 'value': 'isGpcEnabled=0&datestamp=Sat+Mar+28+2026+10%3A00%3A41+GMT-0400+(Eastern+Daylight+Time)&version=202510.1.0&browserGpcFlag=0&isIABGlobal=false&hosts=&consentId=88ec36a3-2ffa-403a-ab38-f3d8bca453d5&interactionCount=1&isAnonUser=1&landingPath=NotLandingPage&groups=C0001%3A1%2CC0003%3A1%2CC0004%3A1%2CC0002%3A1&intType=1&geolocation=US%3BUT&AwaitingReconsent=false', 'domain': '.bca.co.uk', 'path': '/'}, {'name': 'rxvt', 'value': '1774708241906|1774706418720', 'domain': '.bca.co.uk', 'path': '/'}, {'name': 'ASLBSA', 'value': '000323392f7a18bd2b0ff7209c28bb25c0f06dee33a9cf62b65238d7d6868fdf5ddf', 'domain': 'www.bca.co.uk', 'path': '/'}, {'name': 'sc_dslv', 'value': '1774706442017', 'domain': '.bca.co.uk', 'path': '/'}, {'name': 'OptanonAlertBoxClosed', 'value': '2026-03-28T14:00:25.966Z', 'domain': '.bca.co.uk', 'path': '/'}, {'name': 'AMCV_E5F2C8A15481C0E20A4C98BC%40AdobeOrg', 'value': '179643557%7CMCIDTS%7C20541%7CMCMID%7C43157588564651495651779872108472344311%7CMCAAMLH-1775311229%7C7%7CMCAAMB-1775311229%7C6G1ynYcLPuiQxYZrsz_pkqfLG9yMXBpb2zX5dvJdYQJzPXImdj0y%7CMCOPTOUT-1774713629s%7CNONE%7CMCSYNCSOP%7C411-20548%7CvVersion%7C5.5.0', 'domain': '.bca.co.uk', 'path': '/'}, {'name': 's_getNewRepeat', 'value': '1774706442017-New', 'domain': '.bca.co.uk', 'path': '/'}, {'name': '_legacy_auth0.VS7z7E8b9vqJ2LYaGXEbb1f5CP1SGRLD.is.authenticated', 'value': 'true', 'domain': 'www.bca.co.uk', 'path': '/'}, {'name': 'dtPC', 'value': '2$506441126_831h-vUBTGVPFPCEMHUACCCOIABSMJSFTIPCAV-0e0', 'domain': '.bca.co.uk', 'path': '/'}, {'name': 'auth0.VS7z7E8b9vqJ2LYaGXEbb1f5CP1SGRLD.is.authenticated', 'value': 'true', 'domain': 'www.bca.co.uk', 'path': '/'}, {'name': 'gpv_pn', 'value': 'auctionview', 'domain': '.bca.co.uk', 'path': '/'}, {'name': '__cf_bm', 'value': 'jqazuKTGwK.UbXZ.cO_7cq3Zbb4vo2wV5bFTfzd3Hnw-1774706416.7409437-1.0.1.1-R0tDLkbYcU1u5RFOk.kLYFisUNEyEsC_7WYWcXxBOc1qX7N1x7eBgADrDf_GMIZiHL9GXijVDZ0asoK2vr47vgKb9c_FMuRz.O6mPQOVzpTvgIqYc2gt0wNf57l1pVDq1FSHZ6__W9ifmADT5sWy7Q', 'domain': '.bca.co.uk', 'path': '/'}, {'name': 'rxVisitor', 'value': '17747064187193MKHP2LQAQ2V4I8SQS771TBR9E29GED4', 'domain': '.bca.co.uk', 'path': '/'}, {'name': 's_sq', 'value': '%5B%5BB%5D%5D', 'domain': '.bca.co.uk', 'path': '/'}, {'name': 'AMCVS_E5F2C8A15481C0E20A4C98BC%40AdobeOrg', 'value': '1', 'domain': '.bca.co.uk', 'path': '/'}, {'name': 'sc_dslv_s', 'value': 'First%20Visit', 'domain': '.bca.co.uk', 'path': '/'}, {'name': 's_cc', 'value': 'true', 'domain': '.bca.co.uk', 'path': '/'}, {'name': 'JSESSIONID', 'value': '7010118FFE4151FAA04E696BE89BD075', 'domain': 'www.bca.co.uk', 'path': '/'}, {'name': 'dtSa', 'value': '-', 'domain': '.bca.co.uk', 'path': '/'}]
2026-03-28 14:00:53 [bca.uk] INFO: Extracted 24 cookies from Zyte login response
2026-03-28 14:00:53 [bca.uk] INFO: Merged 15 browser cookies, total: 24
2026-03-28 14:00:53 [bca.uk] INFO: Auth0 token capture: token=yes, error=client-created
2026-03-28 14:00:53 [bca.uk] INFO: Got Auth0 access token via dynamic SDK (length=1492)
2026-03-28 14:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /SpiderData(PartitionKey='BCAUk',RowKey='auth_token') HTTP/1.1" 204 0
2026-03-28 14:00:53 [bca.uk] INFO: Requesting URL: https://www.bca.co.uk/api/search?q=&pageSize=100&page=1&sort=MostRecentlyAdded
2026-03-28 14:00:53 [bca.uk] INFO: Sending search API request with Bearer token (length=1492)
2026-03-28 14:00:53 [scrapy_zyte_api._params] WARNING: Request <GET https://www.bca.co.uk/api/search?q=&pageSize=100&page=1&sort=MostRecentlyAdded> defines the Zyte API customHttpRequestHeaders parameter, overriding Request.headers. Use Request.headers instead.
2026-03-28 14:00:53 [scrapy_zyte_api._params] WARNING: Request <GET https://www.bca.co.uk/api/search?q=&pageSize=100&page=1&sort=MostRecentlyAdded> defines the Zyte API customHttpRequestHeaders parameter, overriding Request.headers. Use Request.headers instead.
2026-03-28 14:00:53 [scrapy_zyte_api._params] WARNING: Request <GET https://www.bca.co.uk/api/search?q=&pageSize=100&page=1&sort=MostRecentlyAdded> defines the Zyte API customHttpRequestHeaders parameter, overriding Request.headers. Use Request.headers instead.
2026-03-28 14:00:53 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 14:00:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.bca.co.uk/api/search?q=&pageSize=100&page=1&sort=MostRecentlyAdded> (referer: https://www.bca.co.uk/search) ['zyte-api']
2026-03-28 14:00:56 [bca.uk] INFO: Total items found: 100
2026-03-28 14:00:56 [bca.uk] INFO: Requesting URL: https://www.bca.co.uk/api/search?q=&pageSize=100&page=2&sort=MostRecentlyAdded
2026-03-28 14:00:56 [bca.uk] INFO: Sending search API request with Bearer token (length=1492)
2026-03-28 14:00:56 [scrapy_zyte_api._params] WARNING: Request <GET https://www.bca.co.uk/api/search?q=&pageSize=100&page=2&sort=MostRecentlyAdded> defines the Zyte API customHttpRequestHeaders parameter, overriding Request.headers. Use Request.headers instead.
2026-03-28 14:00:56 [bca.uk] INFO: Found listing with ID: BX06%20AVC
2026-03-28 14:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BX06%2520AVC%27 HTTP/1.1" 200 None
2026-03-28 14:00:56 [bca.uk] INFO: Scrape type for BX06%20AVC: 1
2026-03-28 14:00:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7086d3db-bd6a-5ab0-9b74-8f1cf370adf4 with identifier: BX06%20AVC
2026-03-28 14:00:56 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 7086d3db-bd6a-5ab0-9b74-8f1cf370adf4
2026-03-28 14:00:56 [scrapy_zyte_api._params] WARNING: Request <GET https://www.bca.co.uk/api/search?q=&pageSize=100&page=2&sort=MostRecentlyAdded> defines the Zyte API customHttpRequestHeaders parameter, overriding Request.headers. Use Request.headers instead.
2026-03-28 14:00:56 [scrapy_zyte_api._params] WARNING: Request <GET https://www.bca.co.uk/api/search?q=&pageSize=100&page=2&sort=MostRecentlyAdded> defines the Zyte API customHttpRequestHeaders parameter, overriding Request.headers. Use Request.headers instead.
2026-03-28 14:00:56 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 14:00:56 [bca.uk] INFO: Found listing with ID: VE10%20LDK
2026-03-28 14:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27VE10%2520LDK%27 HTTP/1.1" 200 None
2026-03-28 14:00:56 [bca.uk] INFO: Scrape type for VE10%20LDK: 0
2026-03-28 14:00:56 [bca.uk] INFO: Found listing with ID: SB63%20LRV
2026-03-28 14:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SB63%2520LRV%27 HTTP/1.1" 200 None
2026-03-28 14:00:57 [bca.uk] INFO: Scrape type for SB63%20LRV: 0
2026-03-28 14:00:57 [bca.uk] INFO: Found listing with ID: RO64%20FTF
2026-03-28 14:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27RO64%2520FTF%27 HTTP/1.1" 200 None
2026-03-28 14:00:57 [bca.uk] INFO: Scrape type for RO64%20FTF: 0
2026-03-28 14:00:57 [bca.uk] INFO: Found listing with ID: ND12%20HWP
2026-03-28 14:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27ND12%2520HWP%27 HTTP/1.1" 200 None
2026-03-28 14:00:57 [bca.uk] INFO: Scrape type for ND12%20HWP: 2
2026-03-28 14:00:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a1699770-36c1-5d95-b18c-0aa35ae9ae3d with identifier: ND12%20HWP
2026-03-28 14:00:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a1699770-36c1-5d95-b18c-0aa35ae9ae3d with scrape type 2
2026-03-28 14:00:57 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a1699770-36c1-5d95-b18c-0aa35ae9ae3d with scrape type 2
2026-03-28 14:00:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: a1699770-36c1-5d95-b18c-0aa35ae9ae3d, identifier: ND12%20HWP
2026-03-28 14:00:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: a1699770-36c1-5d95-b18c-0aa35ae9ae3d with identifier: ND12%20HWP
2026-03-28 14:00:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-28 14:00:57 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=red HTTP/1.1" 200 None
2026-03-28 14:00:57 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-28 14:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-28 14:00:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-28 14:00:57 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=Petrol HTTP/1.1" 200 None
2026-03-28 14:00:57 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-28 14:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-28 14:00:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: a1699770-36c1-5d95-b18c-0aa35ae9ae3d with identifier: ND12%20HWP
2026-03-28 14:00:57 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: a1699770-36c1-5d95-b18c-0aa35ae9ae3d with identifier: ND12%20HWP to the API
2026-03-28 14:00:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:00:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:00:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=1&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 129,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=ND12%20HWP-GB',
'category': 'Car',
'color': 'red',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.4L',
'expiration_date': '2026-03-29T10:00:00Z',
'fuel_type': 'Petrol',
'id': 'a1699770-36c1-5d95-b18c-0aa35ae9ae3d',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'ND12 HWP',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=ND12%20HWP&vehicleType=*',
'listing': 'auction',
'location': 'Nottingham',
'make': 'HONDA',
'model': 'CIVIC',
'odometer': 85794,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2012-01-01',
'seller_name': None,
'title': 'HONDA CIVIC 1.4 I-VTEC SE Hatchback',
'transmission': 'manual',
'trim': 'I-VTEC SE',
'vin': 'SHHFK1740CU008155',
'year': 2012}
2026-03-28 14:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27ND12%2520HWP%27 HTTP/1.1" 200 None
2026-03-28 14:00:57 [bca.uk] INFO: Saving data for ND12%20HWP: {'auction_closing_time': 1774778400.0, 'created_time': 1774365655.167617, 'last_price_update_time': 1774706457.9486}
2026-03-28 14:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='ND12%2520HWP') HTTP/1.1" 204 0
2026-03-28 14:00:57 [bca.uk] INFO: Found listing with ID: MA60%20AFO
2026-03-28 14:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MA60%2520AFO%27 HTTP/1.1" 200 None
2026-03-28 14:00:57 [bca.uk] INFO: Scrape type for MA60%20AFO: 2
2026-03-28 14:00:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c4083e17-0378-56b0-841b-a636c1a6219d with identifier: MA60%20AFO
2026-03-28 14:00:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c4083e17-0378-56b0-841b-a636c1a6219d with scrape type 2
2026-03-28 14:00:57 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c4083e17-0378-56b0-841b-a636c1a6219d with scrape type 2
2026-03-28 14:00:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: c4083e17-0378-56b0-841b-a636c1a6219d, identifier: MA60%20AFO
2026-03-28 14:00:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: c4083e17-0378-56b0-841b-a636c1a6219d with identifier: MA60%20AFO
2026-03-28 14:00:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-28 14:00:58 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=silver HTTP/1.1" 200 None
2026-03-28 14:00:58 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-28 14:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-28 14:00:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: c4083e17-0378-56b0-841b-a636c1a6219d with identifier: MA60%20AFO
2026-03-28 14:00:58 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: c4083e17-0378-56b0-841b-a636c1a6219d with identifier: MA60%20AFO to the API
2026-03-28 14:00:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:00:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:00:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=1&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 129,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=MA60%20AFO-GB',
'category': 'Car',
'color': 'silver',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.2L',
'expiration_date': '2026-03-29T10:00:00Z',
'fuel_type': 'Petrol',
'id': 'c4083e17-0378-56b0-841b-a636c1a6219d',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'MA60 AFO',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=MA60%20AFO&vehicleType=*',
'listing': 'auction',
'location': 'Nottingham',
'make': 'FORD',
'model': 'FIESTA',
'odometer': 72897,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2010-01-01',
'seller_name': None,
'title': 'FORD FIESTA 1.2 82 ZETEC Hatchback',
'transmission': 'manual',
'trim': '82 ZETEC',
'vin': 'WF0JXXWPJJAM58746',
'year': 2010}
2026-03-28 14:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MA60%2520AFO%27 HTTP/1.1" 200 None
2026-03-28 14:00:58 [bca.uk] INFO: Saving data for MA60%20AFO: {'auction_closing_time': 1774778400.0, 'created_time': 1774476328.913208, 'last_price_update_time': 1774706458.661427}
2026-03-28 14:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='MA60%2520AFO') HTTP/1.1" 204 0
2026-03-28 14:00:58 [bca.uk] INFO: Found listing with ID: EA12%20KGK
2026-03-28 14:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27EA12%2520KGK%27 HTTP/1.1" 200 None
2026-03-28 14:00:58 [bca.uk] INFO: Scrape type for EA12%20KGK: 2
2026-03-28 14:00:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d5fde88e-42a2-5167-a6ef-6381264feb18 with identifier: EA12%20KGK
2026-03-28 14:00:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d5fde88e-42a2-5167-a6ef-6381264feb18 with scrape type 2
2026-03-28 14:00:58 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d5fde88e-42a2-5167-a6ef-6381264feb18 with scrape type 2
2026-03-28 14:00:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: d5fde88e-42a2-5167-a6ef-6381264feb18, identifier: EA12%20KGK
2026-03-28 14:00:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: d5fde88e-42a2-5167-a6ef-6381264feb18 with identifier: EA12%20KGK
2026-03-28 14:00:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: d5fde88e-42a2-5167-a6ef-6381264feb18 with identifier: EA12%20KGK
2026-03-28 14:00:58 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: d5fde88e-42a2-5167-a6ef-6381264feb18 with identifier: EA12%20KGK to the API
2026-03-28 14:00:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:00:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:00:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=1&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 139,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=EA12%20KGK-GB',
'category': 'Car',
'color': 'silver',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.4L',
'expiration_date': '2026-03-29T10:00:00Z',
'fuel_type': 'Petrol',
'id': 'd5fde88e-42a2-5167-a6ef-6381264feb18',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'EA12 KGK',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=EA12%20KGK&vehicleType=*',
'listing': 'auction',
'location': 'Nottingham',
'make': 'HYUNDAI',
'model': 'I30',
'odometer': 101895,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2012-01-01',
'seller_name': None,
'title': 'HYUNDAI I30 1.4 CLASSIC Hatchback',
'transmission': 'manual',
'trim': 'CLASSIC',
'vin': 'TMAD251ALDJ005487',
'year': 2012}
2026-03-28 14:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27EA12%2520KGK%27 HTTP/1.1" 200 None
2026-03-28 14:00:59 [bca.uk] INFO: Saving data for EA12%20KGK: {'auction_closing_time': 1774778400.0, 'created_time': 1774365673.365551, 'last_price_update_time': 1774706459.157718}
2026-03-28 14:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='EA12%2520KGK') HTTP/1.1" 204 0
2026-03-28 14:00:59 [bca.uk] INFO: Found listing with ID: BT13%20OMV
2026-03-28 14:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BT13%2520OMV%27 HTTP/1.1" 200 None
2026-03-28 14:00:59 [bca.uk] INFO: Scrape type for BT13%20OMV: 0
2026-03-28 14:00:59 [bca.uk] INFO: Found listing with ID: BF63%20HVL
2026-03-28 14:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BF63%2520HVL%27 HTTP/1.1" 200 None
2026-03-28 14:00:59 [bca.uk] INFO: Scrape type for BF63%20HVL: 0
2026-03-28 14:00:59 [bca.uk] INFO: Found listing with ID: AO12%20UHH
2026-03-28 14:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27AO12%2520UHH%27 HTTP/1.1" 200 None
2026-03-28 14:00:59 [bca.uk] INFO: Scrape type for AO12%20UHH: 2
2026-03-28 14:00:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ce8fa73a-6c77-5116-a737-8db126d9022f with identifier: AO12%20UHH
2026-03-28 14:00:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ce8fa73a-6c77-5116-a737-8db126d9022f with scrape type 2
2026-03-28 14:00:59 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ce8fa73a-6c77-5116-a737-8db126d9022f with scrape type 2
2026-03-28 14:00:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: ce8fa73a-6c77-5116-a737-8db126d9022f, identifier: AO12%20UHH
2026-03-28 14:00:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: ce8fa73a-6c77-5116-a737-8db126d9022f with identifier: AO12%20UHH
2026-03-28 14:00:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-28 14:00:59 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=Diesel HTTP/1.1" 200 None
2026-03-28 14:00:59 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-28 14:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-28 14:00:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: ce8fa73a-6c77-5116-a737-8db126d9022f with identifier: AO12%20UHH
2026-03-28 14:00:59 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: ce8fa73a-6c77-5116-a737-8db126d9022f with identifier: AO12%20UHH to the API
2026-03-28 14:00:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:00:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:00:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=1&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 128,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=AO12%20UHH-GB',
'category': 'Car',
'color': 'silver',
'currency': 'GBP',
'doors_number': 5,
'engine': '2.0L',
'expiration_date': '2026-03-29T10:00:00Z',
'fuel_type': 'Diesel',
'id': 'ce8fa73a-6c77-5116-a737-8db126d9022f',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'AO12 UHH',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=AO12%20UHH&vehicleType=*',
'listing': 'auction',
'location': 'Nottingham',
'make': 'VOLKSWAGEN',
'model': 'GOLF',
'odometer': 153792,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2012-01-01',
'seller_name': None,
'title': 'VOLKSWAGEN GOLF 2.0 TDI 140 SE Estate',
'transmission': 'manual',
'trim': 'TDI 140 SE',
'vin': 'WVWZZZ1KZCM674765',
'year': 2012}
2026-03-28 14:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27AO12%2520UHH%27 HTTP/1.1" 200 None
2026-03-28 14:00:59 [bca.uk] INFO: Saving data for AO12%20UHH: {'auction_closing_time': 1774778400.0, 'created_time': 1774478603.044932, 'last_price_update_time': 1774706459.877047}
2026-03-28 14:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='AO12%2520UHH') HTTP/1.1" 204 0
2026-03-28 14:00:59 [bca.uk] INFO: Found listing with ID: YH13%20CHD
2026-03-28 14:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YH13%2520CHD%27 HTTP/1.1" 200 None
2026-03-28 14:00:59 [bca.uk] INFO: Scrape type for YH13%20CHD: 1
2026-03-28 14:00:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: dabe1fc4-09bf-52ef-9042-78b5e1d2db10 with identifier: YH13%20CHD
2026-03-28 14:00:59 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item dabe1fc4-09bf-52ef-9042-78b5e1d2db10
2026-03-28 14:00:59 [bca.uk] INFO: Found listing with ID: YF12%20LYA
2026-03-28 14:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YF12%2520LYA%27 HTTP/1.1" 200 None
2026-03-28 14:00:59 [bca.uk] INFO: Scrape type for YF12%20LYA: 2
2026-03-28 14:00:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 16fc0c0e-0df2-5e70-bc83-55a995f90a6b with identifier: YF12%20LYA
2026-03-28 14:00:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 16fc0c0e-0df2-5e70-bc83-55a995f90a6b with scrape type 2
2026-03-28 14:00:59 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 16fc0c0e-0df2-5e70-bc83-55a995f90a6b with scrape type 2
2026-03-28 14:01:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 16fc0c0e-0df2-5e70-bc83-55a995f90a6b, identifier: YF12%20LYA
2026-03-28 14:01:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 16fc0c0e-0df2-5e70-bc83-55a995f90a6b with identifier: YF12%20LYA
2026-03-28 14:01:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 16fc0c0e-0df2-5e70-bc83-55a995f90a6b with identifier: YF12%20LYA
2026-03-28 14:01:00 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 16fc0c0e-0df2-5e70-bc83-55a995f90a6b with identifier: YF12%20LYA to the API
2026-03-28 14:01:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:01:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:01:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=1&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 134,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=YF12%20LYA-GB',
'category': 'Car',
'color': 'silver',
'currency': 'GBP',
'doors_number': 5,
'engine': '2.0L',
'expiration_date': '2026-03-29T10:00:00Z',
'fuel_type': 'Diesel',
'id': '16fc0c0e-0df2-5e70-bc83-55a995f90a6b',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'YF12 LYA',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=YF12%20LYA&vehicleType=*',
'listing': 'auction',
'location': 'Nottingham',
'make': 'VAUXHALL',
'model': 'INSIGNIA',
'odometer': 120749,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2012-01-01',
'seller_name': None,
'title': 'VAUXHALL INSIGNIA 2.0 CDTI 160 SRI Hatchback',
'transmission': 'manual',
'trim': 'CDTI 160 SRI',
'vin': 'W0LGS6EM2C1127742',
'year': 2012}
2026-03-28 14:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YF12%2520LYA%27 HTTP/1.1" 200 None
2026-03-28 14:01:00 [bca.uk] INFO: Saving data for YF12%20LYA: {'auction_closing_time': 1774778400.0, 'created_time': 1774389706.138192, 'last_price_update_time': 1774706460.509389}
2026-03-28 14:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='YF12%2520LYA') HTTP/1.1" 204 0
2026-03-28 14:01:00 [bca.uk] INFO: Found listing with ID: SG09%20LCM
2026-03-28 14:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SG09%2520LCM%27 HTTP/1.1" 200 None
2026-03-28 14:01:00 [bca.uk] INFO: Scrape type for SG09%20LCM: 2
2026-03-28 14:01:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 75743bb0-bbdb-528a-bcfc-6c0557f5b61c with identifier: SG09%20LCM
2026-03-28 14:01:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 75743bb0-bbdb-528a-bcfc-6c0557f5b61c with scrape type 2
2026-03-28 14:01:00 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 75743bb0-bbdb-528a-bcfc-6c0557f5b61c with scrape type 2
2026-03-28 14:01:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 75743bb0-bbdb-528a-bcfc-6c0557f5b61c, identifier: SG09%20LCM
2026-03-28 14:01:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 75743bb0-bbdb-528a-bcfc-6c0557f5b61c with identifier: SG09%20LCM
2026-03-28 14:01:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 75743bb0-bbdb-528a-bcfc-6c0557f5b61c with identifier: SG09%20LCM
2026-03-28 14:01:00 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 75743bb0-bbdb-528a-bcfc-6c0557f5b61c with identifier: SG09%20LCM to the API
2026-03-28 14:01:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:01:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:01:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=1&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 178,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=SG09%20LCM-GB',
'category': 'Car',
'color': 'silver',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.6L',
'expiration_date': '2026-03-29T10:00:00Z',
'fuel_type': 'Petrol',
'id': '75743bb0-bbdb-528a-bcfc-6c0557f5b61c',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'SG09 LCM',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=SG09%20LCM&vehicleType=*',
'listing': 'auction',
'location': 'Nottingham',
'make': 'PEUGEOT',
'model': '308 SW',
'odometer': 95813,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2009-01-01',
'seller_name': None,
'title': 'PEUGEOT 308 SW 1.6 VTI 120 S MPV',
'transmission': 'automatic',
'trim': 'VTI 120 S',
'vin': 'VF34E5FWF9S020542',
'year': 2009}
2026-03-28 14:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SG09%2520LCM%27 HTTP/1.1" 200 None
2026-03-28 14:01:01 [bca.uk] INFO: Saving data for SG09%20LCM: {'auction_closing_time': 1774778400.0, 'created_time': 1774563866.400077, 'last_price_update_time': 1774706461.293318}
2026-03-28 14:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='SG09%2520LCM') HTTP/1.1" 204 0
2026-03-28 14:01:01 [bca.uk] INFO: Found listing with ID: BT54%20XOM
2026-03-28 14:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BT54%2520XOM%27 HTTP/1.1" 200 None
2026-03-28 14:01:01 [bca.uk] INFO: Scrape type for BT54%20XOM: 2
2026-03-28 14:01:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a0772758-511c-5d92-bb74-c2ccab03dc8b with identifier: BT54%20XOM
2026-03-28 14:01:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a0772758-511c-5d92-bb74-c2ccab03dc8b with scrape type 2
2026-03-28 14:01:01 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a0772758-511c-5d92-bb74-c2ccab03dc8b with scrape type 2
2026-03-28 14:01:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: a0772758-511c-5d92-bb74-c2ccab03dc8b, identifier: BT54%20XOM
2026-03-28 14:01:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: a0772758-511c-5d92-bb74-c2ccab03dc8b with identifier: BT54%20XOM
2026-03-28 14:01:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-28 14:01:01 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=black HTTP/1.1" 200 None
2026-03-28 14:01:01 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-28 14:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-28 14:01:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: a0772758-511c-5d92-bb74-c2ccab03dc8b with identifier: BT54%20XOM
2026-03-28 14:01:01 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: a0772758-511c-5d92-bb74-c2ccab03dc8b with identifier: BT54%20XOM to the API
2026-03-28 14:01:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:01:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:01:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=1&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 181,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=BT54%20XOM-GB',
'category': 'Car',
'color': 'black',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.6L',
'expiration_date': '2026-03-29T10:00:00Z',
'fuel_type': 'Petrol',
'id': 'a0772758-511c-5d92-bb74-c2ccab03dc8b',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'BT54 XOM',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=BT54%20XOM&vehicleType=*',
'listing': 'auction',
'location': 'Nottingham',
'make': 'BMW',
'model': '116I',
'odometer': 104019,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2004-01-01',
'seller_name': None,
'title': 'BMW 116I 1.6 SE Hatchback',
'transmission': 'manual',
'trim': 'SE',
'vin': 'WBAUF12050PN22923',
'year': 2004}
2026-03-28 14:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BT54%2520XOM%27 HTTP/1.1" 200 None
2026-03-28 14:01:01 [bca.uk] INFO: Saving data for BT54%20XOM: {'auction_closing_time': 1774778400.0, 'created_time': 1774389699.180083, 'last_price_update_time': 1774706461.989938}
2026-03-28 14:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='BT54%2520XOM') HTTP/1.1" 204 0
2026-03-28 14:01:02 [bca.uk] INFO: Found listing with ID: MW19%20MTX
2026-03-28 14:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MW19%2520MTX%27 HTTP/1.1" 200 None
2026-03-28 14:01:02 [bca.uk] INFO: Scrape type for MW19%20MTX: 0
2026-03-28 14:01:02 [bca.uk] INFO: Found listing with ID: ST24%20XOE
2026-03-28 14:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27ST24%2520XOE%27 HTTP/1.1" 200 None
2026-03-28 14:01:02 [bca.uk] INFO: Scrape type for ST24%20XOE: 0
2026-03-28 14:01:02 [bca.uk] INFO: Found listing with ID: RE59%20BXM
2026-03-28 14:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27RE59%2520BXM%27 HTTP/1.1" 200 None
2026-03-28 14:01:02 [bca.uk] INFO: Scrape type for RE59%20BXM: 1
2026-03-28 14:01:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5e732f50-42ac-5666-996c-316bc1354f8d with identifier: RE59%20BXM
2026-03-28 14:01:02 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 5e732f50-42ac-5666-996c-316bc1354f8d
2026-03-28 14:01:02 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/BX06AVC/42809716?sv=2020-08-04&st=2026-03-28T14%3A01%3A02Z&se=2026-03-28T14%3A26%3A02Z&sr=b&sp=r&sig=977AimHC9Bz1l7hKD9ZmlbFuhdYPzzwcOGUBuBpHaxA%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=BX06%20AVC-GB>
2026-03-28 14:01:02 [bca.uk] INFO: Found listing with ID: FX70%20HCZ
2026-03-28 14:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FX70%2520HCZ%27 HTTP/1.1" 200 None
2026-03-28 14:01:02 [bca.uk] INFO: Scrape type for FX70%20HCZ: 0
2026-03-28 14:01:02 [bca.uk] INFO: Found listing with ID: EN19%20JGV
2026-03-28 14:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27EN19%2520JGV%27 HTTP/1.1" 200 None
2026-03-28 14:01:02 [bca.uk] INFO: Scrape type for EN19%20JGV: 2
2026-03-28 14:01:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6cfbef38-beb0-5a20-be29-455f2b4a660d with identifier: EN19%20JGV
2026-03-28 14:01:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6cfbef38-beb0-5a20-be29-455f2b4a660d with scrape type 2
2026-03-28 14:01:02 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6cfbef38-beb0-5a20-be29-455f2b4a660d with scrape type 2
2026-03-28 14:01:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 6cfbef38-beb0-5a20-be29-455f2b4a660d, identifier: EN19%20JGV
2026-03-28 14:01:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 6cfbef38-beb0-5a20-be29-455f2b4a660d with identifier: EN19%20JGV
2026-03-28 14:01:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 6cfbef38-beb0-5a20-be29-455f2b4a660d with identifier: EN19%20JGV
2026-03-28 14:01:02 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 6cfbef38-beb0-5a20-be29-455f2b4a660d with identifier: EN19%20JGV to the API
2026-03-28 14:01:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:01:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:01:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=1&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 119,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=EN19%20JGV-GB',
'category': 'Car',
'color': 'black',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.2L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol',
'id': '6cfbef38-beb0-5a20-be29-455f2b4a660d',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'EN19 JGV',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=EN19%20JGV&vehicleType=*',
'listing': 'auction',
'location': 'Wolverhampton',
'make': 'PEUGEOT',
'model': '5008',
'odometer': 48593,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-01-01',
'seller_name': None,
'title': 'PEUGEOT 5008 1.2 P/T 130 ALLURE EAT8 StationWagon',
'transmission': 'automatic',
'trim': 'P/T 130 ALLURE EAT8',
'vin': 'VF3MRHNSUKS316055',
'year': 2019}
2026-03-28 14:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27EN19%2520JGV%27 HTTP/1.1" 200 None
2026-03-28 14:01:02 [bca.uk] INFO: Saving data for EN19%20JGV: {'auction_closing_time': 1774864800.0, 'created_time': 1774565236.650995, 'last_price_update_time': 1774706462.762263}
2026-03-28 14:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='EN19%2520JGV') HTTP/1.1" 204 0
2026-03-28 14:01:02 [bca.uk] INFO: Found listing with ID: KV60%20ZZA
2026-03-28 14:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KV60%2520ZZA%27 HTTP/1.1" 200 None
2026-03-28 14:01:02 [bca.uk] INFO: Scrape type for KV60%20ZZA: 1
2026-03-28 14:01:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3f54d261-9f82-51f4-9ce3-cc4413b8b6c4 with identifier: KV60%20ZZA
2026-03-28 14:01:02 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 3f54d261-9f82-51f4-9ce3-cc4413b8b6c4
2026-03-28 14:01:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.bca.co.uk/api/search?q=&pageSize=100&page=2&sort=MostRecentlyAdded> (referer: https://www.bca.co.uk/search) ['zyte-api']
2026-03-28 14:01:02 [bca.uk] INFO: Found listing with ID: OV64%20PLN
2026-03-28 14:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27OV64%2520PLN%27 HTTP/1.1" 200 None
2026-03-28 14:01:02 [bca.uk] INFO: Scrape type for OV64%20PLN: 1
2026-03-28 14:01:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d75bc751-3167-5395-a067-9fe76cc20a2d with identifier: OV64%20PLN
2026-03-28 14:01:02 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item d75bc751-3167-5395-a067-9fe76cc20a2d
2026-03-28 14:01:02 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/RE59BXM/42810393?sv=2020-08-04&st=2026-03-28T14%3A01%3A02Z&se=2026-03-28T14%3A26%3A02Z&sr=b&sp=r&sig=MksXwVSixqiZ62CEskJ2z5pOaVL%2BuYMKfzx3%2FgepvXw%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=RE59%20BXM-GB>
2026-03-28 14:01:02 [bca.uk] INFO: Found listing with ID: WV13%20ZTH
2026-03-28 14:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WV13%2520ZTH%27 HTTP/1.1" 200 None
2026-03-28 14:01:02 [bca.uk] INFO: Scrape type for WV13%20ZTH: 1
2026-03-28 14:01:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4766d63c-47f2-5b85-8b2c-c4d089a16b5c with identifier: WV13%20ZTH
2026-03-28 14:01:02 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 4766d63c-47f2-5b85-8b2c-c4d089a16b5c
2026-03-28 14:01:02 [bca.uk] INFO: Found listing with ID: EJ13%20JTO
2026-03-28 14:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27EJ13%2520JTO%27 HTTP/1.1" 200 None
2026-03-28 14:01:02 [bca.uk] INFO: Scrape type for EJ13%20JTO: 1
2026-03-28 14:01:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5be82b2b-6926-5451-8e0e-f3d801ad1cad with identifier: EJ13%20JTO
2026-03-28 14:01:02 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 5be82b2b-6926-5451-8e0e-f3d801ad1cad
2026-03-28 14:01:02 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YH13CHD/42807762?sv=2020-08-04&st=2026-03-28T14%3A01%3A02Z&se=2026-03-28T14%3A26%3A02Z&sr=b&sp=r&sig=Kk3ZnO0H7wXbnR6jzpTNZkeJ9EaoXS3djv9g6kExg8o%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=YH13%20CHD-GB>
2026-03-28 14:01:02 [bca.uk] INFO: Found listing with ID: BT24%20LKX
2026-03-28 14:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BT24%2520LKX%27 HTTP/1.1" 200 None
2026-03-28 14:01:02 [bca.uk] INFO: Scrape type for BT24%20LKX: 0
2026-03-28 14:01:02 [bca.uk] INFO: Found listing with ID: DG23%20HXH
2026-03-28 14:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DG23%2520HXH%27 HTTP/1.1" 200 None
2026-03-28 14:01:02 [bca.uk] INFO: Scrape type for DG23%20HXH: 0
2026-03-28 14:01:02 [bca.uk] INFO: Found listing with ID: FY68%20WNB
2026-03-28 14:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FY68%2520WNB%27 HTTP/1.1" 200 None
2026-03-28 14:01:03 [bca.uk] INFO: Scrape type for FY68%20WNB: 1
2026-03-28 14:01:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d8436e02-8218-5d88-bcc5-e01ffac7eb8e with identifier: FY68%20WNB
2026-03-28 14:01:03 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item d8436e02-8218-5d88-bcc5-e01ffac7eb8e
2026-03-28 14:01:03 [bca.uk] INFO: Found listing with ID: YC21%20EXV
2026-03-28 14:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YC21%2520EXV%27 HTTP/1.1" 200 None
2026-03-28 14:01:03 [bca.uk] INFO: Scrape type for YC21%20EXV: 0
2026-03-28 14:01:03 [bca.uk] INFO: Found listing with ID: Y200%20JDW
2026-03-28 14:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27Y200%2520JDW%27 HTTP/1.1" 200 None
2026-03-28 14:01:03 [bca.uk] INFO: Scrape type for Y200%20JDW: 0
2026-03-28 14:01:03 [bca.uk] INFO: Found listing with ID: VX19%20OYP
2026-03-28 14:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27VX19%2520OYP%27 HTTP/1.1" 200 None
2026-03-28 14:01:03 [bca.uk] INFO: Scrape type for VX19%20OYP: 1
2026-03-28 14:01:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b7b36a17-d5d4-5e94-9bbf-8a754ca74b60 with identifier: VX19%20OYP
2026-03-28 14:01:03 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item b7b36a17-d5d4-5e94-9bbf-8a754ca74b60
2026-03-28 14:01:03 [bca.uk] INFO: Total items found: 100
2026-03-28 14:01:03 [bca.uk] INFO: Requesting URL: https://www.bca.co.uk/api/search?q=&pageSize=100&page=3&sort=MostRecentlyAdded
2026-03-28 14:01:03 [bca.uk] INFO: Sending search API request with Bearer token (length=1492)
2026-03-28 14:01:03 [scrapy_zyte_api._params] WARNING: Request <GET https://www.bca.co.uk/api/search?q=&pageSize=100&page=3&sort=MostRecentlyAdded> defines the Zyte API customHttpRequestHeaders parameter, overriding Request.headers. Use Request.headers instead.
2026-03-28 14:01:03 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/OV64PLN/42810653?sv=2020-08-04&st=2026-03-28T14%3A01%3A03Z&se=2026-03-28T14%3A26%3A03Z&sr=b&sp=r&sig=APMfuiYXypC%2F8k81EUjJVNUqGlQEUGUldS81rN8I%2FN0%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=OV64%20PLN-GB>
2026-03-28 14:01:03 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/EJ13JTO/42810382?sv=2020-08-04&st=2026-03-28T14%3A01%3A03Z&se=2026-03-28T14%3A26%3A03Z&sr=b&sp=r&sig=9n5SmvjaM772xUjZdL0t%2BMeZRNBu1TSQPyTFa%2FZiaIA%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=EJ13%20JTO-GB>
2026-03-28 14:01:03 [bca.uk] INFO: Found listing with ID: DP19%20FWW
2026-03-28 14:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DP19%2520FWW%27 HTTP/1.1" 200 None
2026-03-28 14:01:03 [bca.uk] INFO: Scrape type for DP19%20FWW: 1
2026-03-28 14:01:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4b13d468-b932-5891-9e01-a66081b24d30 with identifier: DP19%20FWW
2026-03-28 14:01:03 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 4b13d468-b932-5891-9e01-a66081b24d30
2026-03-28 14:01:03 [scrapy_zyte_api._params] WARNING: Request <GET https://www.bca.co.uk/api/search?q=&pageSize=100&page=3&sort=MostRecentlyAdded> defines the Zyte API customHttpRequestHeaders parameter, overriding Request.headers. Use Request.headers instead.
2026-03-28 14:01:03 [scrapy_zyte_api._params] WARNING: Request <GET https://www.bca.co.uk/api/search?q=&pageSize=100&page=3&sort=MostRecentlyAdded> defines the Zyte API customHttpRequestHeaders parameter, overriding Request.headers. Use Request.headers instead.
2026-03-28 14:01:03 [bca.uk] INFO: Found listing with ID: SB10%20NEN
2026-03-28 14:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SB10%2520NEN%27 HTTP/1.1" 200 None
2026-03-28 14:01:03 [bca.uk] INFO: Scrape type for SB10%20NEN: 0
2026-03-28 14:01:03 [bca.uk] INFO: Found listing with ID: WD08%20NGO
2026-03-28 14:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WD08%2520NGO%27 HTTP/1.1" 200 None
2026-03-28 14:01:03 [bca.uk] INFO: Scrape type for WD08%20NGO: 0
2026-03-28 14:01:03 [bca.uk] INFO: Found listing with ID: WR10%20KTF
2026-03-28 14:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WR10%2520KTF%27 HTTP/1.1" 200 None
2026-03-28 14:01:03 [bca.uk] INFO: Scrape type for WR10%20KTF: 0
2026-03-28 14:01:03 [bca.uk] INFO: Found listing with ID: YF57%20LCP
2026-03-28 14:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YF57%2520LCP%27 HTTP/1.1" 200 None
2026-03-28 14:01:03 [bca.uk] INFO: Scrape type for YF57%20LCP: 0
2026-03-28 14:01:03 [bca.uk] INFO: Found listing with ID: DN07%20WUL
2026-03-28 14:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DN07%2520WUL%27 HTTP/1.1" 200 None
2026-03-28 14:01:03 [bca.uk] INFO: Scrape type for DN07%20WUL: 0
2026-03-28 14:01:03 [bca.uk] INFO: Found listing with ID: EF06%20AFZ
2026-03-28 14:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27EF06%2520AFZ%27 HTTP/1.1" 200 None
2026-03-28 14:01:03 [bca.uk] INFO: Scrape type for EF06%20AFZ: 0
2026-03-28 14:01:03 [bca.uk] INFO: Found listing with ID: GD05%20ESY
2026-03-28 14:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GD05%2520ESY%27 HTTP/1.1" 200 None
2026-03-28 14:01:03 [bca.uk] INFO: Scrape type for GD05%20ESY: 0
2026-03-28 14:01:03 [bca.uk] INFO: Found listing with ID: GP57%20RLY
2026-03-28 14:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GP57%2520RLY%27 HTTP/1.1" 200 None
2026-03-28 14:01:03 [bca.uk] INFO: Scrape type for GP57%20RLY: 0
2026-03-28 14:01:03 [bca.uk] INFO: Found listing with ID: GY08%20KVW
2026-03-28 14:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GY08%2520KVW%27 HTTP/1.1" 200 None
2026-03-28 14:01:03 [bca.uk] INFO: Scrape type for GY08%20KVW: 0
2026-03-28 14:01:03 [bca.uk] INFO: Found listing with ID: GY62%20LMK
2026-03-28 14:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GY62%2520LMK%27 HTTP/1.1" 200 None
2026-03-28 14:01:03 [bca.uk] INFO: Scrape type for GY62%20LMK: 0
2026-03-28 14:01:03 [bca.uk] INFO: Found listing with ID: HN09%20VCM
2026-03-28 14:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27HN09%2520VCM%27 HTTP/1.1" 200 None
2026-03-28 14:01:03 [bca.uk] INFO: Scrape type for HN09%20VCM: 0
2026-03-28 14:01:03 [bca.uk] INFO: Found listing with ID: J6%20RKG
2026-03-28 14:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27J6%2520RKG%27 HTTP/1.1" 200 None
2026-03-28 14:01:03 [bca.uk] INFO: Scrape type for J6%20RKG: 0
2026-03-28 14:01:03 [bca.uk] INFO: Found listing with ID: KP54%20RAX
2026-03-28 14:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KP54%2520RAX%27 HTTP/1.1" 200 None
2026-03-28 14:01:03 [bca.uk] INFO: Scrape type for KP54%20RAX: 0
2026-03-28 14:01:03 [bca.uk] INFO: Found listing with ID: LN10%20YCU
2026-03-28 14:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LN10%2520YCU%27 HTTP/1.1" 200 None
2026-03-28 14:01:03 [bca.uk] INFO: Scrape type for LN10%20YCU: 0
2026-03-28 14:01:03 [bca.uk] INFO: Found listing with ID: LT62%20PZA
2026-03-28 14:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LT62%2520PZA%27 HTTP/1.1" 200 None
2026-03-28 14:01:03 [bca.uk] INFO: Scrape type for LT62%20PZA: 0
2026-03-28 14:01:03 [bca.uk] INFO: Found listing with ID: AU09%20OOJ
2026-03-28 14:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27AU09%2520OOJ%27 HTTP/1.1" 200 None
2026-03-28 14:01:03 [bca.uk] INFO: Scrape type for AU09%20OOJ: 0
2026-03-28 14:01:03 [bca.uk] INFO: Found listing with ID: AX06%20BHJ
2026-03-28 14:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27AX06%2520BHJ%27 HTTP/1.1" 200 None
2026-03-28 14:01:03 [bca.uk] INFO: Scrape type for AX06%20BHJ: 0
2026-03-28 14:01:03 [bca.uk] INFO: Found listing with ID: BF08%20KXH
2026-03-28 14:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BF08%2520KXH%27 HTTP/1.1" 200 None
2026-03-28 14:01:03 [bca.uk] INFO: Scrape type for BF08%20KXH: 0
2026-03-28 14:01:03 [bca.uk] INFO: Found listing with ID: MJ03%20HOW
2026-03-28 14:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MJ03%2520HOW%27 HTTP/1.1" 200 None
2026-03-28 14:01:03 [bca.uk] INFO: Scrape type for MJ03%20HOW: 1
2026-03-28 14:01:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b75153fa-8bbc-5e83-87eb-81edd908fcda with identifier: MJ03%20HOW
2026-03-28 14:01:03 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item b75153fa-8bbc-5e83-87eb-81edd908fcda
2026-03-28 14:01:03 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 14:01:03 [bca.uk] INFO: Found listing with ID: DV19%20CZY
2026-03-28 14:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DV19%2520CZY%27 HTTP/1.1" 200 None
2026-03-28 14:01:03 [bca.uk] INFO: Scrape type for DV19%20CZY: 0
2026-03-28 14:01:03 [bca.uk] INFO: Found listing with ID: DV68%20TGN
2026-03-28 14:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DV68%2520TGN%27 HTTP/1.1" 200 None
2026-03-28 14:01:03 [bca.uk] INFO: Scrape type for DV68%20TGN: 0
2026-03-28 14:01:03 [bca.uk] INFO: Found listing with ID: EA24%20TKX
2026-03-28 14:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27EA24%2520TKX%27 HTTP/1.1" 200 None
2026-03-28 14:01:03 [bca.uk] INFO: Scrape type for EA24%20TKX: 1
2026-03-28 14:01:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a936dd22-4905-520e-8ef4-c3c73c56eba4 with identifier: EA24%20TKX
2026-03-28 14:01:03 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item a936dd22-4905-520e-8ef4-c3c73c56eba4
2026-03-28 14:01:03 [bca.uk] INFO: Found listing with ID: LM10%20GXA
2026-03-28 14:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LM10%2520GXA%27 HTTP/1.1" 200 None
2026-03-28 14:01:03 [bca.uk] INFO: Scrape type for LM10%20GXA: 2
2026-03-28 14:01:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3ef8c09d-e9aa-5097-856e-19d8375ee414 with identifier: LM10%20GXA
2026-03-28 14:01:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3ef8c09d-e9aa-5097-856e-19d8375ee414 with scrape type 2
2026-03-28 14:01:03 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3ef8c09d-e9aa-5097-856e-19d8375ee414 with scrape type 2
2026-03-28 14:01:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 3ef8c09d-e9aa-5097-856e-19d8375ee414, identifier: LM10%20GXA
2026-03-28 14:01:03 [bca.uk] INFO: Found listing with ID: J300%20WTY
2026-03-28 14:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27J300%2520WTY%27 HTTP/1.1" 200 None
2026-03-28 14:01:03 [bca.uk] INFO: Scrape type for J300%20WTY: 0
2026-03-28 14:01:03 [bca.uk] INFO: Found listing with ID: MA72%20VWE
2026-03-28 14:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MA72%2520VWE%27 HTTP/1.1" 200 None
2026-03-28 14:01:03 [bca.uk] INFO: Scrape type for MA72%20VWE: 0
2026-03-28 14:01:03 [bca.uk] INFO: Found listing with ID: MJ19%20UMV
2026-03-28 14:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MJ19%2520UMV%27 HTTP/1.1" 200 None
2026-03-28 14:01:03 [bca.uk] INFO: Scrape type for MJ19%20UMV: 0
2026-03-28 14:01:03 [bca.uk] INFO: Found listing with ID: ND17%20VGZ
2026-03-28 14:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27ND17%2520VGZ%27 HTTP/1.1" 200 None
2026-03-28 14:01:03 [bca.uk] INFO: Scrape type for ND17%20VGZ: 1
2026-03-28 14:01:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 03d2b309-0f29-57c0-bf73-2b86c16c227a with identifier: ND17%20VGZ
2026-03-28 14:01:03 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 03d2b309-0f29-57c0-bf73-2b86c16c227a
2026-03-28 14:01:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 3ef8c09d-e9aa-5097-856e-19d8375ee414 with identifier: LM10%20GXA
2026-03-28 14:01:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 3ef8c09d-e9aa-5097-856e-19d8375ee414 with identifier: LM10%20GXA
2026-03-28 14:01:04 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 3ef8c09d-e9aa-5097-856e-19d8375ee414 with identifier: LM10%20GXA to the API
2026-03-28 14:01:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:01:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:01:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=2&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 139,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=LM10%20GXA-GB',
'category': 'Car',
'color': 'black',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.4L',
'expiration_date': '2026-03-29T10:00:00Z',
'fuel_type': 'Petrol',
'id': '3ef8c09d-e9aa-5097-856e-19d8375ee414',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'LM10 GXA',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=LM10%20GXA&vehicleType=*',
'listing': 'auction',
'location': 'Paddock Wood',
'make': 'VOLKSWAGEN',
'model': 'POLO',
'odometer': 105832,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2010-01-01',
'seller_name': None,
'title': 'VOLKSWAGEN POLO 1.4 85 SE Hatchback',
'transmission': 'manual',
'trim': '85 SE',
'vin': 'WVWZZZ6RZAU007675',
'year': 2010}
2026-03-28 14:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LM10%2520GXA%27 HTTP/1.1" 200 None
2026-03-28 14:01:04 [bca.uk] INFO: Saving data for LM10%20GXA: {'auction_closing_time': 1774778400.0, 'created_time': 1774505384.698724, 'last_price_update_time': 1774706464.30598}
2026-03-28 14:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='LM10%2520GXA') HTTP/1.1" 204 0
2026-03-28 14:01:04 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/KV60ZZA/42810415?sv=2020-08-04&st=2026-03-28T14%3A01%3A03Z&se=2026-03-28T14%3A26%3A03Z&sr=b&sp=r&sig=IuzavW0HE55HWRn715zywGMWMJJZSa9qrno76VZ5d%2FU%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=KV60%20ZZA-GB>
2026-03-28 14:01:04 [bca.uk] INFO: Found listing with ID: LR11%20XWM
2026-03-28 14:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LR11%2520XWM%27 HTTP/1.1" 200 None
2026-03-28 14:01:04 [bca.uk] INFO: Scrape type for LR11%20XWM: 1
2026-03-28 14:01:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0b12c0fe-3ab8-5445-ad6b-256ccebc3b9e with identifier: LR11%20XWM
2026-03-28 14:01:04 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 0b12c0fe-3ab8-5445-ad6b-256ccebc3b9e
2026-03-28 14:01:04 [bca.uk] INFO: Found listing with ID: SB15%20ZPJ
2026-03-28 14:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SB15%2520ZPJ%27 HTTP/1.1" 200 None
2026-03-28 14:01:04 [bca.uk] INFO: Scrape type for SB15%20ZPJ: 1
2026-03-28 14:01:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1d8360e3-a541-58b3-8f63-2cf585362783 with identifier: SB15%20ZPJ
2026-03-28 14:01:04 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 1d8360e3-a541-58b3-8f63-2cf585362783
2026-03-28 14:01:04 [bca.uk] INFO: Found listing with ID: YK67%20BOU
2026-03-28 14:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YK67%2520BOU%27 HTTP/1.1" 200 None
2026-03-28 14:01:04 [bca.uk] INFO: Scrape type for YK67%20BOU: 1
2026-03-28 14:01:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 561c0b4f-3a2d-562b-bb16-d69244165df3 with identifier: YK67%20BOU
2026-03-28 14:01:04 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 561c0b4f-3a2d-562b-bb16-d69244165df3
2026-03-28 14:01:04 [bca.uk] INFO: Found listing with ID: X28%20AVE
2026-03-28 14:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27X28%2520AVE%27 HTTP/1.1" 200 None
2026-03-28 14:01:04 [bca.uk] INFO: Scrape type for X28%20AVE: 1
2026-03-28 14:01:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e788d11e-974b-5084-adb6-d49a23c42616 with identifier: X28%20AVE
2026-03-28 14:01:04 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item e788d11e-974b-5084-adb6-d49a23c42616
2026-03-28 14:01:04 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/WV13ZTH/42810161?sv=2020-08-04&st=2026-03-28T14%3A01%3A04Z&se=2026-03-28T14%3A26%3A04Z&sr=b&sp=r&sig=hbqIghhD97wvMs5qjsvBMdrtSptsqnkIa342PcMgOiA%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=WV13%20ZTH-GB>
2026-03-28 14:01:04 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/VX19OYP/42810376?sv=2020-08-04&st=2026-03-28T14%3A01%3A04Z&se=2026-03-28T14%3A26%3A04Z&sr=b&sp=r&sig=ZoloAWIhiMuraB8%2BrUA7GYd%2BDLx9PxJOBzKxmER1A8U%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=VX19%20OYP-GB>
2026-03-28 14:01:04 [bca.uk] INFO: Found listing with ID: BT13%20WXY
2026-03-28 14:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BT13%2520WXY%27 HTTP/1.1" 200 None
2026-03-28 14:01:04 [bca.uk] INFO: Scrape type for BT13%20WXY: 2
2026-03-28 14:01:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4722e40a-09ea-5f3e-80db-e5ea0f389d99 with identifier: BT13%20WXY
2026-03-28 14:01:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4722e40a-09ea-5f3e-80db-e5ea0f389d99 with scrape type 2
2026-03-28 14:01:04 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4722e40a-09ea-5f3e-80db-e5ea0f389d99 with scrape type 2
2026-03-28 14:01:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 4722e40a-09ea-5f3e-80db-e5ea0f389d99, identifier: BT13%20WXY
2026-03-28 14:01:04 [bca.uk] INFO: Found listing with ID: DW17%20HOA
2026-03-28 14:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DW17%2520HOA%27 HTTP/1.1" 200 None
2026-03-28 14:01:04 [bca.uk] INFO: Scrape type for DW17%20HOA: 1
2026-03-28 14:01:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 87ef9587-5533-59b0-8ea3-0f5483dca5ab with identifier: DW17%20HOA
2026-03-28 14:01:04 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 87ef9587-5533-59b0-8ea3-0f5483dca5ab
2026-03-28 14:01:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 4722e40a-09ea-5f3e-80db-e5ea0f389d99 with identifier: BT13%20WXY
2026-03-28 14:01:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-28 14:01:04 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=white HTTP/1.1" 200 None
2026-03-28 14:01:05 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-28 14:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-28 14:01:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 4722e40a-09ea-5f3e-80db-e5ea0f389d99 with identifier: BT13%20WXY
2026-03-28 14:01:05 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 4722e40a-09ea-5f3e-80db-e5ea0f389d99 with identifier: BT13%20WXY to the API
2026-03-28 14:01:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:01:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:01:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=2&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 99,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=BT13%20WXY-GB',
'category': 'Car',
'color': 'white',
'currency': 'GBP',
'doors_number': 3,
'engine': '1.0L',
'expiration_date': '2026-03-29T10:00:00Z',
'fuel_type': 'Petrol',
'id': '4722e40a-09ea-5f3e-80db-e5ea0f389d99',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'BT13 WXY',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=BT13%20WXY&vehicleType=*',
'listing': 'auction',
'location': 'Paddock Wood',
'make': 'FORD',
'model': 'FIESTA',
'odometer': 103510,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2013-01-01',
'seller_name': None,
'title': 'FORD FIESTA 1.0 E/B 125 TITANIUM Hatchback',
'transmission': 'manual',
'trim': 'E/B 125 TITANIUM',
'vin': 'WF0CXXGAKCDA11534',
'year': 2013}
2026-03-28 14:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BT13%2520WXY%27 HTTP/1.1" 200 None
2026-03-28 14:01:05 [bca.uk] INFO: Saving data for BT13%20WXY: {'auction_closing_time': 1774778400.0, 'created_time': 1774505368.040815, 'last_price_update_time': 1774706465.38214}
2026-03-28 14:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='BT13%2520WXY') HTTP/1.1" 204 0
2026-03-28 14:01:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/BX06AVC/42809716?sv=2020-08-04&st=2026-03-28T14%3A01%3A02Z&se=2026-03-28T14%3A26%3A02Z&sr=b&sp=r&sig=977AimHC9Bz1l7hKD9ZmlbFuhdYPzzwcOGUBuBpHaxA%3D> (referer: https://www.bca.co.uk/)
2026-03-28 14:01:05 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/FY68WNB/42810373?sv=2020-08-04&st=2026-03-28T14%3A01%3A04Z&se=2026-03-28T14%3A26%3A04Z&sr=b&sp=r&sig=H2pJB0hzNCFCiICFkGnSt1gr2sn1tExob5yrsc4d3Vs%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=FY68%20WNB-GB>
2026-03-28 14:01:05 [bca.uk] INFO: Found listing with ID: EX10%20BXE
2026-03-28 14:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27EX10%2520BXE%27 HTTP/1.1" 200 None
2026-03-28 14:01:05 [bca.uk] INFO: Scrape type for EX10%20BXE: 1
2026-03-28 14:01:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f5f9bed7-96bb-5ef8-8a52-e232dbf0b7d5 with identifier: EX10%20BXE
2026-03-28 14:01:05 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item f5f9bed7-96bb-5ef8-8a52-e232dbf0b7d5
2026-03-28 14:01:05 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/MJ03HOW/42810316?sv=2020-08-04&st=2026-03-28T14%3A01%3A04Z&se=2026-03-28T14%3A26%3A04Z&sr=b&sp=r&sig=72R4f35YDQDGGwN55srQJ3YRSQrnD%2FGMmCWnMvmfOLc%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=MJ03%20HOW-GB>
2026-03-28 14:01:05 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/DP19FWW/42810375?sv=2020-08-04&st=2026-03-28T14%3A01%3A04Z&se=2026-03-28T14%3A26%3A04Z&sr=b&sp=r&sig=DYlHwmmm%2BkuE1QC9GfsRlnyT74V8OO0Bfy5POGMlRcU%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=DP19%20FWW-GB>
2026-03-28 14:01:05 [bca.uk] INFO: Found listing with ID: YR64%20UNS
2026-03-28 14:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YR64%2520UNS%27 HTTP/1.1" 200 None
2026-03-28 14:01:05 [bca.uk] INFO: Scrape type for YR64%20UNS: 1
2026-03-28 14:01:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3934dfb8-a543-5520-9689-2c2abcde4923 with identifier: YR64%20UNS
2026-03-28 14:01:05 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 3934dfb8-a543-5520-9689-2c2abcde4923
2026-03-28 14:01:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/RE59BXM/42810393?sv=2020-08-04&st=2026-03-28T14%3A01%3A02Z&se=2026-03-28T14%3A26%3A02Z&sr=b&sp=r&sig=MksXwVSixqiZ62CEskJ2z5pOaVL%2BuYMKfzx3%2FgepvXw%3D> (referer: https://www.bca.co.uk/)
2026-03-28 14:01:05 [bca.uk] INFO: Found listing with ID: EX56%20XWU
2026-03-28 14:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27EX56%2520XWU%27 HTTP/1.1" 200 None
2026-03-28 14:01:05 [bca.uk] INFO: Scrape type for EX56%20XWU: 1
2026-03-28 14:01:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 887f7b9e-77d7-51db-af6a-fa1b530aa86c with identifier: EX56%20XWU
2026-03-28 14:01:05 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 887f7b9e-77d7-51db-af6a-fa1b530aa86c
2026-03-28 14:01:05 [bca.uk] INFO: Found listing with ID: BN15%20PYS
2026-03-28 14:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BN15%2520PYS%27 HTTP/1.1" 200 None
2026-03-28 14:01:05 [bca.uk] INFO: Scrape type for BN15%20PYS: 1
2026-03-28 14:01:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6e72fc19-6ef7-5735-a5b3-76a17aaa3159 with identifier: BN15%20PYS
2026-03-28 14:01:05 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 6e72fc19-6ef7-5735-a5b3-76a17aaa3159
2026-03-28 14:01:05 [bca.uk] INFO: Found listing with ID: GF10%20FSY
2026-03-28 14:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GF10%2520FSY%27 HTTP/1.1" 200 None
2026-03-28 14:01:05 [bca.uk] INFO: Scrape type for GF10%20FSY: 1
2026-03-28 14:01:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 758db1f9-d737-5506-abd8-56c685b3eaa7 with identifier: GF10%20FSY
2026-03-28 14:01:05 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 758db1f9-d737-5506-abd8-56c685b3eaa7
2026-03-28 14:01:05 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/EA24TKX/42810378?sv=2020-08-04&st=2026-03-28T14%3A01%3A05Z&se=2026-03-28T14%3A26%3A05Z&sr=b&sp=r&sig=Ajk9rVQfTHJs3R0cJnmP5VnSS5rSnHfV6UlI7D3mmDQ%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=EA24%20TKX-GB>
2026-03-28 14:01:05 [bca.uk] INFO: Found listing with ID: FE64%20YJN
2026-03-28 14:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FE64%2520YJN%27 HTTP/1.1" 200 None
2026-03-28 14:01:05 [bca.uk] INFO: Scrape type for FE64%20YJN: 1
2026-03-28 14:01:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 97eff0e6-5412-5368-b0a5-9cecd68061fb with identifier: FE64%20YJN
2026-03-28 14:01:05 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 97eff0e6-5412-5368-b0a5-9cecd68061fb
2026-03-28 14:01:05 [bca.uk] INFO: Found listing with ID: GF57%20MWW
2026-03-28 14:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GF57%2520MWW%27 HTTP/1.1" 200 None
2026-03-28 14:01:05 [bca.uk] INFO: Scrape type for GF57%20MWW: 1
2026-03-28 14:01:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cdcc838c-10d3-5f36-90c6-59ef07eececc with identifier: GF57%20MWW
2026-03-28 14:01:05 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item cdcc838c-10d3-5f36-90c6-59ef07eececc
2026-03-28 14:01:05 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-03-28 14:01:05 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-03-28 14:01:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:01:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c6e7290>
2026-03-28 14:01:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:01:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-03-28 14:01:05 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2113
2026-03-28 14:01:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-03-28 14:01:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:01:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:01:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7086d3db-bd6a-5ab0-9b74-8f1cf370adf4/7086d3db-bd6a-5ab0-9b74-8f1cf370adf4_expert_report_file_d0c000e8-6dbc-4fe4-9c37-2dd648bfcdf8.pdf HTTP/1.1" 201 0
2026-03-28 14:01:05 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item 7086d3db-bd6a-5ab0-9b74-8f1cf370adf4
2026-03-28 14:01:05 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 7086d3db-bd6a-5ab0-9b74-8f1cf370adf4, skipping ID generation
2026-03-28 14:01:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 7086d3db-bd6a-5ab0-9b74-8f1cf370adf4
2026-03-28 14:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DBX06AVC-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-28 14:01:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=BX06AVC-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-28 14:01:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/KV60ZZA/42810415?sv=2020-08-04&st=2026-03-28T14%3A01%3A03Z&se=2026-03-28T14%3A26%3A03Z&sr=b&sp=r&sig=IuzavW0HE55HWRn715zywGMWMJJZSa9qrno76VZ5d%2FU%3D> (referer: https://www.bca.co.uk/)
2026-03-28 14:01:05 [bca.uk] INFO: Found listing with ID: VO17%20FMZ
2026-03-28 14:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27VO17%2520FMZ%27 HTTP/1.1" 200 None
2026-03-28 14:01:06 [bca.uk] INFO: Scrape type for VO17%20FMZ: 1
2026-03-28 14:01:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7b233ce6-aa01-5f24-ac34-ccc770845b54 with identifier: VO17%20FMZ
2026-03-28 14:01:06 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 7b233ce6-aa01-5f24-ac34-ccc770845b54
2026-03-28 14:01:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/VX19OYP/42810376?sv=2020-08-04&st=2026-03-28T14%3A01%3A04Z&se=2026-03-28T14%3A26%3A04Z&sr=b&sp=r&sig=ZoloAWIhiMuraB8%2BrUA7GYd%2BDLx9PxJOBzKxmER1A8U%3D> (referer: https://www.bca.co.uk/)
2026-03-28 14:01:06 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/ND17VGZ/42810273?sv=2020-08-04&st=2026-03-28T14%3A01%3A05Z&se=2026-03-28T14%3A26%3A05Z&sr=b&sp=r&sig=Ddznt5rliWG2eSFSeV1iYUxjjPUcheWJt3FgNXERnUs%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=ND17%20VGZ-GB>
2026-03-28 14:01:06 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LR11XWM/42810294?sv=2020-08-04&st=2026-03-28T14%3A01%3A05Z&se=2026-03-28T14%3A26%3A05Z&sr=b&sp=r&sig=zHl%2Fkz2fSAoGVBY8ukVZULGVCGKqbTVidyooaEEBPNc%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=LR11%20XWM-GB>
2026-03-28 14:01:06 [bca.uk] INFO: Found listing with ID: GJ09%20XMV
2026-03-28 14:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GJ09%2520XMV%27 HTTP/1.1" 200 None
2026-03-28 14:01:06 [bca.uk] INFO: Scrape type for GJ09%20XMV: 1
2026-03-28 14:01:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2d976eab-045c-5285-ac76-8386a88e0d8f with identifier: GJ09%20XMV
2026-03-28 14:01:06 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 2d976eab-045c-5285-ac76-8386a88e0d8f
2026-03-28 14:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698920522%27 HTTP/1.1" 200 None
2026-03-28 14:01:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698920522 not downloaded yet
2026-03-28 14:01:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:01:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c6f2610>
2026-03-28 14:01:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:01:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:01:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:01:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5e732f50-42ac-5666-996c-316bc1354f8d/5e732f50-42ac-5666-996c-316bc1354f8d_expert_report_file_1018819e-74b5-4077-864b-b486fe97abe0.pdf HTTP/1.1" 201 0
2026-03-28 14:01:06 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item 5e732f50-42ac-5666-996c-316bc1354f8d
2026-03-28 14:01:06 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 5e732f50-42ac-5666-996c-316bc1354f8d, skipping ID generation
2026-03-28 14:01:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 5e732f50-42ac-5666-996c-316bc1354f8d
2026-03-28 14:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DRE59BXM-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-28 14:01:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=RE59BXM-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-28 14:01:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YH13CHD/42807762?sv=2020-08-04&st=2026-03-28T14%3A01%3A02Z&se=2026-03-28T14%3A26%3A02Z&sr=b&sp=r&sig=Kk3ZnO0H7wXbnR6jzpTNZkeJ9EaoXS3djv9g6kExg8o%3D> (referer: https://www.bca.co.uk/)
2026-03-28 14:01:06 [bca.uk] INFO: Found listing with ID: LT03%20BYN
2026-03-28 14:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LT03%2520BYN%27 HTTP/1.1" 200 None
2026-03-28 14:01:06 [bca.uk] INFO: Scrape type for LT03%20BYN: 0
2026-03-28 14:01:06 [bca.uk] INFO: Found listing with ID: WU61%20WUW
2026-03-28 14:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WU61%2520WUW%27 HTTP/1.1" 200 None
2026-03-28 14:01:06 [bca.uk] INFO: Scrape type for WU61%20WUW: 0
2026-03-28 14:01:06 [bca.uk] INFO: Found listing with ID: YB08%20OEU
2026-03-28 14:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YB08%2520OEU%27 HTTP/1.1" 200 None
2026-03-28 14:01:06 [bca.uk] INFO: Scrape type for YB08%20OEU: 0
2026-03-28 14:01:06 [bca.uk] INFO: Found listing with ID: YG61%20DFL
2026-03-28 14:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YG61%2520DFL%27 HTTP/1.1" 200 None
2026-03-28 14:01:06 [bca.uk] INFO: Scrape type for YG61%20DFL: 0
2026-03-28 14:01:06 [bca.uk] INFO: Found listing with ID: YJ63%20YJY
2026-03-28 14:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YJ63%2520YJY%27 HTTP/1.1" 200 None
2026-03-28 14:01:06 [bca.uk] INFO: Scrape type for YJ63%20YJY: 0
2026-03-28 14:01:06 [bca.uk] INFO: Found listing with ID: BG67%20GBE
2026-03-28 14:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BG67%2520GBE%27 HTTP/1.1" 200 None
2026-03-28 14:01:06 [bca.uk] INFO: Scrape type for BG67%20GBE: 0
2026-03-28 14:01:06 [bca.uk] INFO: Found listing with ID: BJ62%20JHX
2026-03-28 14:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BJ62%2520JHX%27 HTTP/1.1" 200 None
2026-03-28 14:01:06 [bca.uk] INFO: Scrape type for BJ62%20JHX: 2
2026-03-28 14:01:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2abdaeaf-0052-5274-b2cf-cf9f674a2642 with identifier: BJ62%20JHX
2026-03-28 14:01:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2abdaeaf-0052-5274-b2cf-cf9f674a2642 with scrape type 2
2026-03-28 14:01:06 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2abdaeaf-0052-5274-b2cf-cf9f674a2642 with scrape type 2
2026-03-28 14:01:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 2abdaeaf-0052-5274-b2cf-cf9f674a2642, identifier: BJ62%20JHX
2026-03-28 14:01:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 2abdaeaf-0052-5274-b2cf-cf9f674a2642 with identifier: BJ62%20JHX
2026-03-28 14:01:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 2abdaeaf-0052-5274-b2cf-cf9f674a2642 with identifier: BJ62%20JHX
2026-03-28 14:01:06 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 2abdaeaf-0052-5274-b2cf-cf9f674a2642 with identifier: BJ62%20JHX to the API
2026-03-28 14:01:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:01:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:01:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=1&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 139,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=BJ62%20JHX-GB',
'category': 'Car',
'color': 'red',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.6L',
'expiration_date': '2026-03-29T10:00:00Z',
'fuel_type': 'Petrol',
'id': '2abdaeaf-0052-5274-b2cf-cf9f674a2642',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'BJ62 JHX',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=BJ62%20JHX&vehicleType=*',
'listing': 'auction',
'location': 'Thurleigh',
'make': 'NISSAN',
'model': 'JUKE',
'odometer': 102526,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2012-01-01',
'seller_name': None,
'title': 'NISSAN JUKE 1.6 ACENTA PREMIUM Hatchback',
'transmission': 'manual',
'trim': 'ACENTA PREMIUM',
'vin': 'SJNFBAF15U6269899',
'year': 2012}
2026-03-28 14:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BJ62%2520JHX%27 HTTP/1.1" 200 None
2026-03-28 14:01:06 [bca.uk] INFO: Saving data for BJ62%20JHX: {'auction_closing_time': 1774778400.0, 'created_time': 1774418536.669246, 'last_price_update_time': 1774706466.784104}
2026-03-28 14:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='BJ62%2520JHX') HTTP/1.1" 204 0
2026-03-28 14:01:06 [bca.uk] INFO: Found listing with ID: FL69%20JZP
2026-03-28 14:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FL69%2520JZP%27 HTTP/1.1" 200 None
2026-03-28 14:01:06 [bca.uk] INFO: Scrape type for FL69%20JZP: 1
2026-03-28 14:01:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1a5bffef-b353-54bb-b673-ece7012c4726 with identifier: FL69%20JZP
2026-03-28 14:01:06 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 1a5bffef-b353-54bb-b673-ece7012c4726
2026-03-28 14:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698920529%27 HTTP/1.1" 200 None
2026-03-28 14:01:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698920529 not downloaded yet
2026-03-28 14:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698980671%27 HTTP/1.1" 200 None
2026-03-28 14:01:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698980671 not downloaded yet
2026-03-28 14:01:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/EJ13JTO/42810382?sv=2020-08-04&st=2026-03-28T14%3A01%3A03Z&se=2026-03-28T14%3A26%3A03Z&sr=b&sp=r&sig=9n5SmvjaM772xUjZdL0t%2BMeZRNBu1TSQPyTFa%2FZiaIA%3D> (referer: https://www.bca.co.uk/)
2026-03-28 14:01:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/OV64PLN/42810653?sv=2020-08-04&st=2026-03-28T14%3A01%3A03Z&se=2026-03-28T14%3A26%3A03Z&sr=b&sp=r&sig=APMfuiYXypC%2F8k81EUjJVNUqGlQEUGUldS81rN8I%2FN0%3D> (referer: https://www.bca.co.uk/)
2026-03-28 14:01:06 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/X28AVE/42809896?sv=2020-08-04&st=2026-03-28T14%3A01%3A06Z&se=2026-03-28T14%3A26%3A06Z&sr=b&sp=r&sig=AYxkyrr3IbeLdESXjdd9QmNEg4ZiUeF%2B%2BO3v1nuSrfg%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=X28%20AVE-GB>
2026-03-28 14:01:06 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YK67BOU/42810138?sv=2020-08-04&st=2026-03-28T14%3A01%3A06Z&se=2026-03-28T14%3A26%3A06Z&sr=b&sp=r&sig=lMZ3QjflOWAYgjfCxBohfGqFaZWJDMyvtEvO8nKSM7s%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=YK67%20BOU-GB>
2026-03-28 14:01:06 [bca.uk] INFO: Found listing with ID: CV13%20XYW
2026-03-28 14:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27CV13%2520XYW%27 HTTP/1.1" 200 None
2026-03-28 14:01:06 [bca.uk] INFO: Scrape type for CV13%20XYW: 0
2026-03-28 14:01:06 [bca.uk] INFO: Found listing with ID: EY56%20YMJ
2026-03-28 14:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27EY56%2520YMJ%27 HTTP/1.1" 200 None
2026-03-28 14:01:07 [bca.uk] INFO: Scrape type for EY56%20YMJ: 0
2026-03-28 14:01:07 [bca.uk] INFO: Found listing with ID: FY60%20KOJ
2026-03-28 14:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FY60%2520KOJ%27 HTTP/1.1" 200 None
2026-03-28 14:01:07 [bca.uk] INFO: Scrape type for FY60%20KOJ: 0
2026-03-28 14:01:07 [bca.uk] INFO: Found listing with ID: GU62%20GHN
2026-03-28 14:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GU62%2520GHN%27 HTTP/1.1" 200 None
2026-03-28 14:01:07 [bca.uk] INFO: Scrape type for GU62%20GHN: 0
2026-03-28 14:01:07 [bca.uk] INFO: Found listing with ID: LM59%20LFF
2026-03-28 14:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LM59%2520LFF%27 HTTP/1.1" 200 None
2026-03-28 14:01:07 [bca.uk] INFO: Scrape type for LM59%20LFF: 0
2026-03-28 14:01:07 [bca.uk] INFO: Found listing with ID: MM11%20JNV
2026-03-28 14:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MM11%2520JNV%27 HTTP/1.1" 200 None
2026-03-28 14:01:07 [bca.uk] INFO: Scrape type for MM11%20JNV: 0
2026-03-28 14:01:07 [bca.uk] INFO: Found listing with ID: MV09%20DYD
2026-03-28 14:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MV09%2520DYD%27 HTTP/1.1" 200 None
2026-03-28 14:01:07 [bca.uk] INFO: Scrape type for MV09%20DYD: 0
2026-03-28 14:01:07 [bca.uk] INFO: Found listing with ID: RE62%20CVJ
2026-03-28 14:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27RE62%2520CVJ%27 HTTP/1.1" 200 None
2026-03-28 14:01:07 [bca.uk] INFO: Scrape type for RE62%20CVJ: 0
2026-03-28 14:01:07 [bca.uk] INFO: Found listing with ID: WD62%20AOP
2026-03-28 14:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WD62%2520AOP%27 HTTP/1.1" 200 None
2026-03-28 14:01:07 [bca.uk] INFO: Scrape type for WD62%20AOP: 0
2026-03-28 14:01:07 [bca.uk] INFO: Found listing with ID: WN57%20EYX
2026-03-28 14:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WN57%2520EYX%27 HTTP/1.1" 200 None
2026-03-28 14:01:07 [bca.uk] INFO: Scrape type for WN57%20EYX: 0
2026-03-28 14:01:07 [bca.uk] INFO: Found listing with ID: AO58%20YLZ
2026-03-28 14:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27AO58%2520YLZ%27 HTTP/1.1" 200 None
2026-03-28 14:01:07 [bca.uk] INFO: Scrape type for AO58%20YLZ: 0
2026-03-28 14:01:07 [bca.uk] INFO: Found listing with ID: AP57%20OHZ
2026-03-28 14:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27AP57%2520OHZ%27 HTTP/1.1" 200 None
2026-03-28 14:01:07 [bca.uk] INFO: Scrape type for AP57%20OHZ: 0
2026-03-28 14:01:07 [bca.uk] INFO: Found listing with ID: GM25%20OJK
2026-03-28 14:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GM25%2520OJK%27 HTTP/1.1" 200 None
2026-03-28 14:01:07 [bca.uk] INFO: Scrape type for GM25%20OJK: 0
2026-03-28 14:01:07 [bca.uk] INFO: Found listing with ID: KV21%20CPF
2026-03-28 14:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KV21%2520CPF%27 HTTP/1.1" 200 None
2026-03-28 14:01:07 [bca.uk] INFO: Scrape type for KV21%20CPF: 0
2026-03-28 14:01:07 [bca.uk] INFO: Found listing with ID: WO68%20DUV
2026-03-28 14:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WO68%2520DUV%27 HTTP/1.1" 200 None
2026-03-28 14:01:07 [bca.uk] INFO: Scrape type for WO68%20DUV: 0
2026-03-28 14:01:07 [bca.uk] INFO: Found listing with ID: YF71%20LFZ
2026-03-28 14:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YF71%2520LFZ%27 HTTP/1.1" 200 None
2026-03-28 14:01:07 [bca.uk] INFO: Scrape type for YF71%20LFZ: 2
2026-03-28 14:01:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6afa5732-93d0-521a-aae0-d7a675873c82 with identifier: YF71%20LFZ
2026-03-28 14:01:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6afa5732-93d0-521a-aae0-d7a675873c82 with scrape type 2
2026-03-28 14:01:07 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6afa5732-93d0-521a-aae0-d7a675873c82 with scrape type 2
2026-03-28 14:01:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 6afa5732-93d0-521a-aae0-d7a675873c82, identifier: YF71%20LFZ
2026-03-28 14:01:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:01:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c6e4690>
2026-03-28 14:01:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:01:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:01:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:01:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3f54d261-9f82-51f4-9ce3-cc4413b8b6c4/3f54d261-9f82-51f4-9ce3-cc4413b8b6c4_expert_report_file_ddd71fdb-2a75-4e94-892e-2e0d6a2dc27b.pdf HTTP/1.1" 201 0
2026-03-28 14:01:07 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item 3f54d261-9f82-51f4-9ce3-cc4413b8b6c4
2026-03-28 14:01:07 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 3f54d261-9f82-51f4-9ce3-cc4413b8b6c4, skipping ID generation
2026-03-28 14:01:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 3f54d261-9f82-51f4-9ce3-cc4413b8b6c4
2026-03-28 14:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DKV60ZZA-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-28 14:01:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=KV60ZZA-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-28 14:01:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:01:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2d829450>
2026-03-28 14:01:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:01:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:01:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:01:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b7b36a17-d5d4-5e94-9bbf-8a754ca74b60/b7b36a17-d5d4-5e94-9bbf-8a754ca74b60_expert_report_file_94464021-096b-4ec5-b0de-fa0f6e6ab326.pdf HTTP/1.1" 201 0
2026-03-28 14:01:07 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item b7b36a17-d5d4-5e94-9bbf-8a754ca74b60
2026-03-28 14:01:07 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: b7b36a17-d5d4-5e94-9bbf-8a754ca74b60, skipping ID generation
2026-03-28 14:01:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item b7b36a17-d5d4-5e94-9bbf-8a754ca74b60
2026-03-28 14:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DVX19OYP-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-28 14:01:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=VX19OYP-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-28 14:01:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/FY68WNB/42810373?sv=2020-08-04&st=2026-03-28T14%3A01%3A04Z&se=2026-03-28T14%3A26%3A04Z&sr=b&sp=r&sig=H2pJB0hzNCFCiICFkGnSt1gr2sn1tExob5yrsc4d3Vs%3D> (referer: https://www.bca.co.uk/)
2026-03-28 14:01:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 6afa5732-93d0-521a-aae0-d7a675873c82 with identifier: YF71%20LFZ
2026-03-28 14:01:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-28 14:01:07 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=Electric HTTP/1.1" 200 None
2026-03-28 14:01:07 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-28 14:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-28 14:01:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 6afa5732-93d0-521a-aae0-d7a675873c82 with identifier: YF71%20LFZ
2026-03-28 14:01:07 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 6afa5732-93d0-521a-aae0-d7a675873c82 with identifier: YF71%20LFZ to the API
2026-03-28 14:01:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:01:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:01:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=1&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': None,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=YF71%20LFZ-GB',
'category': 'Car',
'color': 'white',
'currency': 'GBP',
'doors_number': 5,
'engine': '0.0L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Electric',
'id': '6afa5732-93d0-521a-aae0-d7a675873c82',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'YF71 LFZ',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=YF71%20LFZ&vehicleType=*',
'listing': 'auction',
'location': 'Thurleigh',
'make': 'AUDI',
'model': 'Q4 E-TRON',
'odometer': 73965,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-01-01',
'seller_name': None,
'title': 'AUDI Q4 E-TRON 35 125KW 55KWH SPORT StationWagon',
'transmission': 'automatic',
'trim': '35 125KW 55KWH SPORT',
'vin': 'WAUZZZFZ3NP018253',
'year': 2021}
2026-03-28 14:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YF71%2520LFZ%27 HTTP/1.1" 200 None
2026-03-28 14:01:08 [bca.uk] INFO: Saving data for YF71%20LFZ: {'auction_closing_time': 1774864800.0, 'created_time': 1774390073.860606, 'last_price_update_time': 1774706468.143641}
2026-03-28 14:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='YF71%2520LFZ') HTTP/1.1" 204 0
2026-03-28 14:01:08 [bca.uk] INFO: Found listing with ID: AK64%20MOR
2026-03-28 14:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27AK64%2520MOR%27 HTTP/1.1" 200 None
2026-03-28 14:01:08 [bca.uk] INFO: Scrape type for AK64%20MOR: 0
2026-03-28 14:01:08 [bca.uk] INFO: Found listing with ID: DY19%20EYK
2026-03-28 14:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DY19%2520EYK%27 HTTP/1.1" 200 None
2026-03-28 14:01:08 [bca.uk] INFO: Scrape type for DY19%20EYK: 0
2026-03-28 14:01:08 [bca.uk] INFO: Found listing with ID: GK21%20KBU
2026-03-28 14:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GK21%2520KBU%27 HTTP/1.1" 200 None
2026-03-28 14:01:08 [bca.uk] INFO: Scrape type for GK21%20KBU: 2
2026-03-28 14:01:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 48400897-a431-55ee-9dda-e2a85fb7457d with identifier: GK21%20KBU
2026-03-28 14:01:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 48400897-a431-55ee-9dda-e2a85fb7457d with scrape type 2
2026-03-28 14:01:08 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 48400897-a431-55ee-9dda-e2a85fb7457d with scrape type 2
2026-03-28 14:01:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 48400897-a431-55ee-9dda-e2a85fb7457d, identifier: GK21%20KBU
2026-03-28 14:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698920539%27 HTTP/1.1" 200 None
2026-03-28 14:01:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698920539 not downloaded yet
2026-03-28 14:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698980694%27 HTTP/1.1" 200 None
2026-03-28 14:01:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698980694 not downloaded yet
2026-03-28 14:01:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/DP19FWW/42810375?sv=2020-08-04&st=2026-03-28T14%3A01%3A04Z&se=2026-03-28T14%3A26%3A04Z&sr=b&sp=r&sig=DYlHwmmm%2BkuE1QC9GfsRlnyT74V8OO0Bfy5POGMlRcU%3D> (referer: https://www.bca.co.uk/)
2026-03-28 14:01:08 [bca.uk] INFO: Found listing with ID: KW68%20KFK
2026-03-28 14:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KW68%2520KFK%27 HTTP/1.1" 200 None
2026-03-28 14:01:08 [bca.uk] INFO: Scrape type for KW68%20KFK: 0
2026-03-28 14:01:08 [bca.uk] INFO: Found listing with ID: AF24%20KLL
2026-03-28 14:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27AF24%2520KLL%27 HTTP/1.1" 200 None
2026-03-28 14:01:08 [bca.uk] INFO: Scrape type for AF24%20KLL: 0
2026-03-28 14:01:08 [bca.uk] INFO: Found listing with ID: AF69%20BZY
2026-03-28 14:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27AF69%2520BZY%27 HTTP/1.1" 200 None
2026-03-28 14:01:08 [bca.uk] INFO: Scrape type for AF69%20BZY: 2
2026-03-28 14:01:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b2705eb1-6cd8-5773-8603-166508eeecc1 with identifier: AF69%20BZY
2026-03-28 14:01:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b2705eb1-6cd8-5773-8603-166508eeecc1 with scrape type 2
2026-03-28 14:01:08 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b2705eb1-6cd8-5773-8603-166508eeecc1 with scrape type 2
2026-03-28 14:01:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: b2705eb1-6cd8-5773-8603-166508eeecc1, identifier: AF69%20BZY
2026-03-28 14:01:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 48400897-a431-55ee-9dda-e2a85fb7457d with identifier: GK21%20KBU
2026-03-28 14:01:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 48400897-a431-55ee-9dda-e2a85fb7457d with identifier: GK21%20KBU
2026-03-28 14:01:08 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 48400897-a431-55ee-9dda-e2a85fb7457d with identifier: GK21%20KBU to the API
2026-03-28 14:01:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:01:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:01:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=2&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 129,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=GK21%20KBU-GB',
'category': 'Car',
'color': 'black',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.0L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol',
'id': '48400897-a431-55ee-9dda-e2a85fb7457d',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'GK21 KBU',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=GK21%20KBU&vehicleType=*',
'listing': 'auction',
'location': 'Paddock Wood',
'make': 'NISSAN',
'model': 'MICRA',
'odometer': 56439,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-01-01',
'seller_name': None,
'title': 'NISSAN MICRA 1.0 IG-T 92 N-SPORT Hatchback',
'transmission': 'manual',
'trim': 'IG-T 92 N-SPORT',
'vin': 'VNVK1400X67176433',
'year': 2021}
2026-03-28 14:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GK21%2520KBU%27 HTTP/1.1" 200 None
2026-03-28 14:01:09 [bca.uk] INFO: Saving data for GK21%20KBU: {'auction_closing_time': 1774864800.0, 'created_time': 1774438120.260446, 'last_price_update_time': 1774706469.152212}
2026-03-28 14:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='GK21%2520KBU') HTTP/1.1" 204 0
2026-03-28 14:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698934294%27 HTTP/1.1" 200 None
2026-03-28 14:01:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698934294 not downloaded yet
2026-03-28 14:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698250996%27 HTTP/1.1" 200 None
2026-03-28 14:01:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698250996 not downloaded yet
2026-03-28 14:01:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:01:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c5dea50>
2026-03-28 14:01:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:01:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:01:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:01:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dabe1fc4-09bf-52ef-9042-78b5e1d2db10/dabe1fc4-09bf-52ef-9042-78b5e1d2db10_expert_report_file_2c7c09c8-f35d-498f-b348-65d352895a22.pdf HTTP/1.1" 201 0
2026-03-28 14:01:09 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item dabe1fc4-09bf-52ef-9042-78b5e1d2db10
2026-03-28 14:01:09 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: dabe1fc4-09bf-52ef-9042-78b5e1d2db10, skipping ID generation
2026-03-28 14:01:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item dabe1fc4-09bf-52ef-9042-78b5e1d2db10
2026-03-28 14:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DYH13CHD-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-28 14:01:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=YH13CHD-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-28 14:01:09 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/EX10BXE/42809799?sv=2020-08-04&st=2026-03-28T14%3A01%3A07Z&se=2026-03-28T14%3A26%3A07Z&sr=b&sp=r&sig=xoEQIFwTRaF8ZPdiio47BQcwaxFkt4KEonwRoN8KxQM%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=EX10%20BXE-GB>
2026-03-28 14:01:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: b2705eb1-6cd8-5773-8603-166508eeecc1 with identifier: AF69%20BZY
2026-03-28 14:01:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: b2705eb1-6cd8-5773-8603-166508eeecc1 with identifier: AF69%20BZY
2026-03-28 14:01:09 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: b2705eb1-6cd8-5773-8603-166508eeecc1 with identifier: AF69%20BZY to the API
2026-03-28 14:01:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:01:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:01:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=1&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 139,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=AF69%20BZY-GB',
'category': 'Car',
'color': 'red',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.3L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol',
'id': 'b2705eb1-6cd8-5773-8603-166508eeecc1',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'AF69 BZY',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=AF69%20BZY&vehicleType=*',
'listing': 'auction',
'location': 'Thurleigh',
'make': 'DACIA',
'model': 'DUSTER',
'odometer': 28588,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-01-01',
'seller_name': None,
'title': 'DACIA DUSTER 1.3 TCE 130 TECHROAD StationWagon',
'transmission': 'manual',
'trim': 'TCE 130 TECHROAD',
'vin': 'VF1HJD20463909434',
'year': 2019}
2026-03-28 14:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27AF69%2520BZY%27 HTTP/1.1" 200 None
2026-03-28 14:01:09 [bca.uk] INFO: Saving data for AF69%20BZY: {'auction_closing_time': 1774864800.0, 'created_time': 1774476244.641621, 'last_price_update_time': 1774706469.687114}
2026-03-28 14:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='AF69%2520BZY') HTTP/1.1" 204 0
2026-03-28 14:01:09 [bca.uk] INFO: Found listing with ID: GM19%20WGU
2026-03-28 14:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GM19%2520WGU%27 HTTP/1.1" 200 None
2026-03-28 14:01:09 [bca.uk] INFO: Scrape type for GM19%20WGU: 1
2026-03-28 14:01:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 45fb38d6-e2a8-57d4-8493-3dc79c4a4423 with identifier: GM19%20WGU
2026-03-28 14:01:09 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 45fb38d6-e2a8-57d4-8493-3dc79c4a4423
2026-03-28 14:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698920543%27 HTTP/1.1" 200 None
2026-03-28 14:01:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698920543 not downloaded yet
2026-03-28 14:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698980736%27 HTTP/1.1" 200 None
2026-03-28 14:01:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698980736 not downloaded yet
2026-03-28 14:01:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/MJ03HOW/42810316?sv=2020-08-04&st=2026-03-28T14%3A01%3A04Z&se=2026-03-28T14%3A26%3A04Z&sr=b&sp=r&sig=72R4f35YDQDGGwN55srQJ3YRSQrnD%2FGMmCWnMvmfOLc%3D> (referer: https://www.bca.co.uk/)
2026-03-28 14:01:09 [bca.uk] INFO: Found listing with ID: GW69%20WAW
2026-03-28 14:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GW69%2520WAW%27 HTTP/1.1" 200 None
2026-03-28 14:01:09 [bca.uk] INFO: Scrape type for GW69%20WAW: 1
2026-03-28 14:01:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: afad1f26-88af-57eb-94f9-a5b1a59b67b0 with identifier: GW69%20WAW
2026-03-28 14:01:09 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item afad1f26-88af-57eb-94f9-a5b1a59b67b0
2026-03-28 14:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698934308%27 HTTP/1.1" 200 None
2026-03-28 14:01:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698934308 not downloaded yet
2026-03-28 14:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698251003%27 HTTP/1.1" 200 None
2026-03-28 14:01:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698251003 not downloaded yet
2026-03-28 14:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698786490%27 HTTP/1.1" 200 None
2026-03-28 14:01:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698786490 not downloaded yet
2026-03-28 14:01:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:01:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c624cd0>
2026-03-28 14:01:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:01:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:01:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:01:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5be82b2b-6926-5451-8e0e-f3d801ad1cad/5be82b2b-6926-5451-8e0e-f3d801ad1cad_expert_report_file_6194f05a-ce6d-4156-9d36-05a05514a335.pdf HTTP/1.1" 201 0
2026-03-28 14:01:09 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item 5be82b2b-6926-5451-8e0e-f3d801ad1cad
2026-03-28 14:01:09 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 5be82b2b-6926-5451-8e0e-f3d801ad1cad, skipping ID generation
2026-03-28 14:01:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 5be82b2b-6926-5451-8e0e-f3d801ad1cad
2026-03-28 14:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DEJ13JTO-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-28 14:01:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=EJ13JTO-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-28 14:01:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:01:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c6259d0>
2026-03-28 14:01:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:01:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:01:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:01:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d75bc751-3167-5395-a067-9fe76cc20a2d/d75bc751-3167-5395-a067-9fe76cc20a2d_expert_report_file_1e11f536-e007-4083-889f-ba49c0317bb6.pdf HTTP/1.1" 201 0
2026-03-28 14:01:09 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item d75bc751-3167-5395-a067-9fe76cc20a2d
2026-03-28 14:01:09 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: d75bc751-3167-5395-a067-9fe76cc20a2d, skipping ID generation
2026-03-28 14:01:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item d75bc751-3167-5395-a067-9fe76cc20a2d
2026-03-28 14:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DOV64PLN-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-28 14:01:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=OV64PLN-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-28 14:01:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:01:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c501590>
2026-03-28 14:01:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:01:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:01:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:01:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d8436e02-8218-5d88-bcc5-e01ffac7eb8e/d8436e02-8218-5d88-bcc5-e01ffac7eb8e_expert_report_file_14739d13-8179-43d4-8d5a-9f400691bcbe.pdf HTTP/1.1" 201 0
2026-03-28 14:01:09 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item d8436e02-8218-5d88-bcc5-e01ffac7eb8e
2026-03-28 14:01:09 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: d8436e02-8218-5d88-bcc5-e01ffac7eb8e, skipping ID generation
2026-03-28 14:01:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item d8436e02-8218-5d88-bcc5-e01ffac7eb8e
2026-03-28 14:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DFY68WNB-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-28 14:01:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=FY68WNB-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-28 14:01:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/EA24TKX/42810378?sv=2020-08-04&st=2026-03-28T14%3A01%3A05Z&se=2026-03-28T14%3A26%3A05Z&sr=b&sp=r&sig=Ajk9rVQfTHJs3R0cJnmP5VnSS5rSnHfV6UlI7D3mmDQ%3D> (referer: https://www.bca.co.uk/)
2026-03-28 14:01:09 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/GF57MWW/42810309?sv=2020-08-04&st=2026-03-28T14%3A01%3A09Z&se=2026-03-28T14%3A26%3A09Z&sr=b&sp=r&sig=hJTqt8SLdbJfAcgzLjUmqtORuHZL2E6pw%2FRYFmCkjK4%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=GF57%20MWW-GB>
2026-03-28 14:01:09 [bca.uk] INFO: Found listing with ID: VU70%20ZLO
2026-03-28 14:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27VU70%2520ZLO%27 HTTP/1.1" 200 None
2026-03-28 14:01:09 [bca.uk] INFO: Scrape type for VU70%20ZLO: 1
2026-03-28 14:01:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2ba7722a-587f-552f-9000-fec714f3bbb3 with identifier: VU70%20ZLO
2026-03-28 14:01:09 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 2ba7722a-587f-552f-9000-fec714f3bbb3
2026-03-28 14:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698920547%27 HTTP/1.1" 200 None
2026-03-28 14:01:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698920547 not downloaded yet
2026-03-28 14:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698980761%27 HTTP/1.1" 200 None
2026-03-28 14:01:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698980761 not downloaded yet
2026-03-28 14:01:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LR11XWM/42810294?sv=2020-08-04&st=2026-03-28T14%3A01%3A05Z&se=2026-03-28T14%3A26%3A05Z&sr=b&sp=r&sig=zHl%2Fkz2fSAoGVBY8ukVZULGVCGKqbTVidyooaEEBPNc%3D> (referer: https://www.bca.co.uk/)
2026-03-28 14:01:10 [bca.uk] INFO: Found listing with ID: KY22%20VLX
2026-03-28 14:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KY22%2520VLX%27 HTTP/1.1" 200 None
2026-03-28 14:01:10 [bca.uk] INFO: Scrape type for KY22%20VLX: 0
2026-03-28 14:01:10 [bca.uk] INFO: Found listing with ID: MT58%20FGX
2026-03-28 14:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MT58%2520FGX%27 HTTP/1.1" 200 None
2026-03-28 14:01:10 [bca.uk] INFO: Scrape type for MT58%20FGX: 2
2026-03-28 14:01:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e76fc7f1-093f-5529-a714-072c3cc82d8b with identifier: MT58%20FGX
2026-03-28 14:01:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e76fc7f1-093f-5529-a714-072c3cc82d8b with scrape type 2
2026-03-28 14:01:10 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e76fc7f1-093f-5529-a714-072c3cc82d8b with scrape type 2
2026-03-28 14:01:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: e76fc7f1-093f-5529-a714-072c3cc82d8b, identifier: MT58%20FGX
2026-03-28 14:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698934317%27 HTTP/1.1" 200 None
2026-03-28 14:01:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698934317 not downloaded yet
2026-03-28 14:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698251010%27 HTTP/1.1" 200 None
2026-03-28 14:01:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698251010 not downloaded yet
2026-03-28 14:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698786496%27 HTTP/1.1" 200 None
2026-03-28 14:01:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698786496 not downloaded yet
2026-03-28 14:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698540217%27 HTTP/1.1" 200 None
2026-03-28 14:01:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698540217 not downloaded yet
2026-03-28 14:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698965990%27 HTTP/1.1" 200 None
2026-03-28 14:01:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698965990 not downloaded yet
2026-03-28 14:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698106294%27 HTTP/1.1" 200 None
2026-03-28 14:01:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698106294 not downloaded yet
2026-03-28 14:01:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:01:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c51b210>
2026-03-28 14:01:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:01:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:01:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:01:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4b13d468-b932-5891-9e01-a66081b24d30/4b13d468-b932-5891-9e01-a66081b24d30_expert_report_file_a7db4fc7-1a01-4690-b45a-bd4f0f227953.pdf HTTP/1.1" 201 0
2026-03-28 14:01:10 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item 4b13d468-b932-5891-9e01-a66081b24d30
2026-03-28 14:01:10 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 4b13d468-b932-5891-9e01-a66081b24d30, skipping ID generation
2026-03-28 14:01:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 4b13d468-b932-5891-9e01-a66081b24d30
2026-03-28 14:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DDP19FWW-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-28 14:01:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=DP19FWW-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-28 14:01:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: e76fc7f1-093f-5529-a714-072c3cc82d8b with identifier: MT58%20FGX
2026-03-28 14:01:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: e76fc7f1-093f-5529-a714-072c3cc82d8b with identifier: MT58%20FGX
2026-03-28 14:01:10 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: e76fc7f1-093f-5529-a714-072c3cc82d8b with identifier: MT58%20FGX to the API
2026-03-28 14:01:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:01:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:01:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=1&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 288,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=MT58%20FGX-GB',
'category': 'Car',
'color': 'white',
'currency': 'GBP',
'doors_number': 2,
'engine': '4.2L',
'expiration_date': '2026-03-31T10:00:00Z',
'fuel_type': 'Petrol',
'id': 'e76fc7f1-093f-5529-a714-072c3cc82d8b',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'MT58 FGX',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=MT58%20FGX&vehicleType=*',
'listing': 'auction',
'location': 'Thurleigh',
'make': 'AUDI',
'model': 'S5',
'odometer': 78598,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2008-01-01',
'seller_name': None,
'title': 'AUDI S5 4.2 QUATTRO Coupe',
'transmission': 'manual',
'trim': 'QUATTRO',
'vin': 'WAUZZZ8T49A025780',
'year': 2008}
2026-03-28 14:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MT58%2520FGX%27 HTTP/1.1" 200 None
2026-03-28 14:01:10 [bca.uk] INFO: Saving data for MT58%20FGX: {'auction_closing_time': 1774951200.0, 'created_time': 1774363789.301299, 'last_price_update_time': 1774706470.661855}
2026-03-28 14:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='MT58%2520FGX') HTTP/1.1" 204 0
2026-03-28 14:01:10 [bca.uk] INFO: Found listing with ID: GL23%20VZB
2026-03-28 14:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GL23%2520VZB%27 HTTP/1.1" 200 None
2026-03-28 14:01:10 [bca.uk] INFO: Scrape type for GL23%20VZB: 1
2026-03-28 14:01:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ff1ca2ee-3094-5da2-ab74-133cc0e9f7e3 with identifier: GL23%20VZB
2026-03-28 14:01:10 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item ff1ca2ee-3094-5da2-ab74-133cc0e9f7e3
2026-03-28 14:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698920560%27 HTTP/1.1" 200 None
2026-03-28 14:01:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698920560 not downloaded yet
2026-03-28 14:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698980777%27 HTTP/1.1" 200 None
2026-03-28 14:01:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698980777 not downloaded yet
2026-03-28 14:01:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.bca.co.uk/api/search?q=&pageSize=100&page=3&sort=MostRecentlyAdded> (referer: https://www.bca.co.uk/search) ['zyte-api']
2026-03-28 14:01:10 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/VO17FMZ/42810377?sv=2020-08-04&st=2026-03-28T14%3A01%3A10Z&se=2026-03-28T14%3A26%3A10Z&sr=b&sp=r&sig=PEm9gdKL%2BNRnVtrVK0%2F5sWr2YcEbrtVNzeob8CJbr3c%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=VO17%20FMZ-GB>
2026-03-28 14:01:10 [bca.uk] INFO: Found listing with ID: NK54%20DDF
2026-03-28 14:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27NK54%2520DDF%27 HTTP/1.1" 200 None
2026-03-28 14:01:10 [bca.uk] INFO: Scrape type for NK54%20DDF: 0
2026-03-28 14:01:10 [bca.uk] INFO: Found listing with ID: FH08%20KSZ
2026-03-28 14:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FH08%2520KSZ%27 HTTP/1.1" 200 None
2026-03-28 14:01:10 [bca.uk] INFO: Scrape type for FH08%20KSZ: 0
2026-03-28 14:01:10 [bca.uk] INFO: Found listing with ID: FV64%20FNX
2026-03-28 14:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FV64%2520FNX%27 HTTP/1.1" 200 None
2026-03-28 14:01:10 [bca.uk] INFO: Scrape type for FV64%20FNX: 0
2026-03-28 14:01:10 [bca.uk] INFO: Found listing with ID: ML60%20JDF
2026-03-28 14:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27ML60%2520JDF%27 HTTP/1.1" 200 None
2026-03-28 14:01:10 [bca.uk] INFO: Scrape type for ML60%20JDF: 0
2026-03-28 14:01:10 [bca.uk] INFO: Found listing with ID: WJ61%20HNH
2026-03-28 14:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WJ61%2520HNH%27 HTTP/1.1" 200 None
2026-03-28 14:01:10 [bca.uk] INFO: Scrape type for WJ61%20HNH: 0
2026-03-28 14:01:10 [bca.uk] INFO: Found listing with ID: YN15%20RWX
2026-03-28 14:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YN15%2520RWX%27 HTTP/1.1" 200 None
2026-03-28 14:01:10 [bca.uk] INFO: Scrape type for YN15%20RWX: 0
2026-03-28 14:01:10 [bca.uk] INFO: Found listing with ID: BV68%20KXR
2026-03-28 14:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BV68%2520KXR%27 HTTP/1.1" 200 None
2026-03-28 14:01:10 [bca.uk] INFO: Scrape type for BV68%20KXR: 2
2026-03-28 14:01:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 99a827d8-172d-56d6-81e0-6a15f753fbcb with identifier: BV68%20KXR
2026-03-28 14:01:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 99a827d8-172d-56d6-81e0-6a15f753fbcb with scrape type 2
2026-03-28 14:01:10 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 99a827d8-172d-56d6-81e0-6a15f753fbcb with scrape type 2
2026-03-28 14:01:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 99a827d8-172d-56d6-81e0-6a15f753fbcb, identifier: BV68%20KXR
2026-03-28 14:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698934330%27 HTTP/1.1" 200 None
2026-03-28 14:01:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698934330 not downloaded yet
2026-03-28 14:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698251018%27 HTTP/1.1" 200 None
2026-03-28 14:01:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698251018 not downloaded yet
2026-03-28 14:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698786503%27 HTTP/1.1" 200 None
2026-03-28 14:01:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698786503 not downloaded yet
2026-03-28 14:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698540228%27 HTTP/1.1" 200 None
2026-03-28 14:01:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698540228 not downloaded yet
2026-03-28 14:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698953393%27 HTTP/1.1" 200 None
2026-03-28 14:01:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698953393 not downloaded yet
2026-03-28 14:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698106303%27 HTTP/1.1" 200 None
2026-03-28 14:01:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698106303 not downloaded yet
2026-03-28 14:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698227056%27 HTTP/1.1" 200 None
2026-03-28 14:01:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698227056 not downloaded yet
2026-03-28 14:01:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:01:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c5021d0>
2026-03-28 14:01:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:01:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:01:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:01:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b75153fa-8bbc-5e83-87eb-81edd908fcda/b75153fa-8bbc-5e83-87eb-81edd908fcda_expert_report_file_8a164623-af1c-4110-924b-850b613eb934.pdf HTTP/1.1" 201 0
2026-03-28 14:01:11 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item b75153fa-8bbc-5e83-87eb-81edd908fcda
2026-03-28 14:01:11 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: b75153fa-8bbc-5e83-87eb-81edd908fcda, skipping ID generation
2026-03-28 14:01:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item b75153fa-8bbc-5e83-87eb-81edd908fcda
2026-03-28 14:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DMJ03HOW-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-28 14:01:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=MJ03HOW-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-28 14:01:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 99a827d8-172d-56d6-81e0-6a15f753fbcb with identifier: BV68%20KXR
2026-03-28 14:01:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 99a827d8-172d-56d6-81e0-6a15f753fbcb with identifier: BV68%20KXR
2026-03-28 14:01:11 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 99a827d8-172d-56d6-81e0-6a15f753fbcb with identifier: BV68%20KXR to the API
2026-03-28 14:01:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:01:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:01:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=1&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 117,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=BV68%20KXR-GB',
'category': 'Car',
'color': 'black',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.2L',
'expiration_date': '2026-03-29T10:00:00Z',
'fuel_type': 'Petrol',
'id': '99a827d8-172d-56d6-81e0-6a15f753fbcb',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'BV68 KXR',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=BV68%20KXR&vehicleType=*',
'listing': 'auction',
'location': 'Preston',
'make': 'VAUXHALL',
'model': 'CROSSLAND X',
'odometer': 67542,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-01-01',
'seller_name': None,
'title': 'VAUXHALL CROSSLAND X 1.2 SE Hatchback',
'transmission': 'manual',
'trim': 'SE',
'vin': 'W0V7D9EE5K4143197',
'year': 2018}
2026-03-28 14:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BV68%2520KXR%27 HTTP/1.1" 200 None
2026-03-28 14:01:11 [bca.uk] INFO: Saving data for BV68%20KXR: {'auction_closing_time': 1774778400.0, 'created_time': 1774390850.444456, 'last_price_update_time': 1774706471.701812}
2026-03-28 14:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='BV68%2520KXR') HTTP/1.1" 204 0
2026-03-28 14:01:11 [bca.uk] INFO: Found listing with ID: GD68%20OVL
2026-03-28 14:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GD68%2520OVL%27 HTTP/1.1" 200 None
2026-03-28 14:01:11 [bca.uk] INFO: Scrape type for GD68%20OVL: 1
2026-03-28 14:01:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3e5c16aa-2566-5ea1-94fc-6830c97bb44a with identifier: GD68%20OVL
2026-03-28 14:01:11 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 3e5c16aa-2566-5ea1-94fc-6830c97bb44a
2026-03-28 14:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698920574%27 HTTP/1.1" 200 None
2026-03-28 14:01:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698920574 not downloaded yet
2026-03-28 14:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698980811%27 HTTP/1.1" 200 None
2026-03-28 14:01:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698980811 not downloaded yet
2026-03-28 14:01:11 [scrapy.extensions.logstats] INFO: Crawled 16 pages (at 16 pages/min), scraped 16 items (at 16 items/min)
2026-03-28 14:01:11 [scrapy.extensions.memusage] INFO: Peak memory usage is 186MiB
2026-03-28 14:01:11 [bca.uk] INFO: Found listing with ID: BU69%20FKW
2026-03-28 14:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BU69%2520FKW%27 HTTP/1.1" 200 None
2026-03-28 14:01:11 [bca.uk] INFO: Scrape type for BU69%20FKW: 2
2026-03-28 14:01:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 946a23f8-78ef-55d3-8b66-4e1184e0b2df with identifier: BU69%20FKW
2026-03-28 14:01:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 946a23f8-78ef-55d3-8b66-4e1184e0b2df with scrape type 2
2026-03-28 14:01:11 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 946a23f8-78ef-55d3-8b66-4e1184e0b2df with scrape type 2
2026-03-28 14:01:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 946a23f8-78ef-55d3-8b66-4e1184e0b2df, identifier: BU69%20FKW
2026-03-28 14:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698934340%27 HTTP/1.1" 200 None
2026-03-28 14:01:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698934340 not downloaded yet
2026-03-28 14:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698251025%27 HTTP/1.1" 200 None
2026-03-28 14:01:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698251025 not downloaded yet
2026-03-28 14:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698786511%27 HTTP/1.1" 200 None
2026-03-28 14:01:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698786511 not downloaded yet
2026-03-28 14:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698540235%27 HTTP/1.1" 200 None
2026-03-28 14:01:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698540235 not downloaded yet
2026-03-28 14:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698965996%27 HTTP/1.1" 200 None
2026-03-28 14:01:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698965996 not downloaded yet
2026-03-28 14:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698106313%27 HTTP/1.1" 200 None
2026-03-28 14:01:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698106313 not downloaded yet
2026-03-28 14:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698227061%27 HTTP/1.1" 200 None
2026-03-28 14:01:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698227061 not downloaded yet
2026-03-28 14:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698444370%27 HTTP/1.1" 200 None
2026-03-28 14:01:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698444370 not downloaded yet
2026-03-28 14:01:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:01:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c82cdd0>
2026-03-28 14:01:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:01:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:01:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:01:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a936dd22-4905-520e-8ef4-c3c73c56eba4/a936dd22-4905-520e-8ef4-c3c73c56eba4_expert_report_file_931472ff-e8a5-4528-96ee-0cd863dcf8eb.pdf HTTP/1.1" 201 0
2026-03-28 14:01:12 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item a936dd22-4905-520e-8ef4-c3c73c56eba4
2026-03-28 14:01:12 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: a936dd22-4905-520e-8ef4-c3c73c56eba4, skipping ID generation
2026-03-28 14:01:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item a936dd22-4905-520e-8ef4-c3c73c56eba4
2026-03-28 14:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DEA24TKX-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-28 14:01:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=EA24TKX-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-28 14:01:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:01:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c6c7010>
2026-03-28 14:01:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:01:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:01:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:01:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0b12c0fe-3ab8-5445-ad6b-256ccebc3b9e/0b12c0fe-3ab8-5445-ad6b-256ccebc3b9e_expert_report_file_d950e954-40ad-4176-871c-63bc52c2ab0f.pdf HTTP/1.1" 201 0
2026-03-28 14:01:12 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item 0b12c0fe-3ab8-5445-ad6b-256ccebc3b9e
2026-03-28 14:01:12 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 0b12c0fe-3ab8-5445-ad6b-256ccebc3b9e, skipping ID generation
2026-03-28 14:01:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 0b12c0fe-3ab8-5445-ad6b-256ccebc3b9e
2026-03-28 14:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DLR11XWM-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-28 14:01:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=LR11XWM-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-28 14:01:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YK67BOU/42810138?sv=2020-08-04&st=2026-03-28T14%3A01%3A06Z&se=2026-03-28T14%3A26%3A06Z&sr=b&sp=r&sig=lMZ3QjflOWAYgjfCxBohfGqFaZWJDMyvtEvO8nKSM7s%3D> (referer: https://www.bca.co.uk/)
2026-03-28 14:01:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/X28AVE/42809896?sv=2020-08-04&st=2026-03-28T14%3A01%3A06Z&se=2026-03-28T14%3A26%3A06Z&sr=b&sp=r&sig=AYxkyrr3IbeLdESXjdd9QmNEg4ZiUeF%2B%2BO3v1nuSrfg%3D> (referer: https://www.bca.co.uk/)
2026-03-28 14:01:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 946a23f8-78ef-55d3-8b66-4e1184e0b2df with identifier: BU69%20FKW
2026-03-28 14:01:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 946a23f8-78ef-55d3-8b66-4e1184e0b2df with identifier: BU69%20FKW
2026-03-28 14:01:12 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 946a23f8-78ef-55d3-8b66-4e1184e0b2df with identifier: BU69%20FKW to the API
2026-03-28 14:01:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:01:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:01:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=1&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 142,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=BU69%20FKW-GB',
'category': 'Car',
'color': 'black',
'currency': 'GBP',
'doors_number': 5,
'engine': '2.0L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol',
'id': '946a23f8-78ef-55d3-8b66-4e1184e0b2df',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'BU69 FKW',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=BU69%20FKW&vehicleType=*',
'listing': 'auction',
'location': 'Preston',
'make': 'MERCEDES-BENZ',
'model': 'CLA 220 S/B',
'odometer': 60359,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-01-01',
'seller_name': None,
'title': 'MERCEDES-BENZ CLA 220 S/B 2.0 AMG LINE PREMIUM DCT Estate',
'transmission': 'automatic',
'trim': 'AMG LINE PREMIUM DCT',
'vin': 'WDD1186442N022712',
'year': 2019}
2026-03-28 14:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BU69%2520FKW%27 HTTP/1.1" 200 None
2026-03-28 14:01:12 [bca.uk] INFO: Saving data for BU69%20FKW: {'auction_closing_time': 1774864800.0, 'created_time': 1774332549.443375, 'last_price_update_time': 1774706472.698789}
2026-03-28 14:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='BU69%2520FKW') HTTP/1.1" 204 0
2026-03-28 14:01:12 [bca.uk] INFO: Found listing with ID: LN68%20RBY
2026-03-28 14:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LN68%2520RBY%27 HTTP/1.1" 200 None
2026-03-28 14:01:12 [bca.uk] INFO: Scrape type for LN68%20RBY: 1
2026-03-28 14:01:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 04fa14f2-714c-5033-a1fe-bd0c784e7d7e with identifier: LN68%20RBY
2026-03-28 14:01:12 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 04fa14f2-714c-5033-a1fe-bd0c784e7d7e
2026-03-28 14:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698920585%27 HTTP/1.1" 200 None
2026-03-28 14:01:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698920585 not downloaded yet
2026-03-28 14:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698980842%27 HTTP/1.1" 200 None
2026-03-28 14:01:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698980842 not downloaded yet
2026-03-28 14:01:12 [bca.uk] INFO: Found listing with ID: PK74%20YSW
2026-03-28 14:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27PK74%2520YSW%27 HTTP/1.1" 200 None
2026-03-28 14:01:12 [bca.uk] INFO: Scrape type for PK74%20YSW: 0
2026-03-28 14:01:12 [bca.uk] INFO: Found listing with ID: DA21%20SOU
2026-03-28 14:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DA21%2520SOU%27 HTTP/1.1" 200 None
2026-03-28 14:01:12 [bca.uk] INFO: Scrape type for DA21%20SOU: 1
2026-03-28 14:01:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1534762c-5952-5a28-84f7-7b27016558ac with identifier: DA21%20SOU
2026-03-28 14:01:12 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 1534762c-5952-5a28-84f7-7b27016558ac
2026-03-28 14:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698934365%27 HTTP/1.1" 200 None
2026-03-28 14:01:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698934365 not downloaded yet
2026-03-28 14:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698251041%27 HTTP/1.1" 200 None
2026-03-28 14:01:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698251041 not downloaded yet
2026-03-28 14:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698786525%27 HTTP/1.1" 200 None
2026-03-28 14:01:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698786525 not downloaded yet
2026-03-28 14:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698540241%27 HTTP/1.1" 200 None
2026-03-28 14:01:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698540241 not downloaded yet
2026-03-28 14:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698953411%27 HTTP/1.1" 200 None
2026-03-28 14:01:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698953411 not downloaded yet
2026-03-28 14:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698106324%27 HTTP/1.1" 200 None
2026-03-28 14:01:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698106324 not downloaded yet
2026-03-28 14:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698227066%27 HTTP/1.1" 200 None
2026-03-28 14:01:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698227066 not downloaded yet
2026-03-28 14:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698444377%27 HTTP/1.1" 200 None
2026-03-28 14:01:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698444377 not downloaded yet
2026-03-28 14:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698296235%27 HTTP/1.1" 200 None
2026-03-28 14:01:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698296235 not downloaded yet
2026-03-28 14:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D697880544%27 HTTP/1.1" 200 None
2026-03-28 14:01:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=697880544 not downloaded yet
2026-03-28 14:01:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/WV13ZTH/42810161?sv=2020-08-04&st=2026-03-28T14%3A01%3A04Z&se=2026-03-28T14%3A26%3A04Z&sr=b&sp=r&sig=hbqIghhD97wvMs5qjsvBMdrtSptsqnkIa342PcMgOiA%3D> (referer: https://www.bca.co.uk/)
2026-03-28 14:01:12 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BX06AVC/698920515/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=BX06AVC-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-28 14:01:12 [bca.uk] INFO: Found listing with ID: LV23%20RXA
2026-03-28 14:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LV23%2520RXA%27 HTTP/1.1" 200 None
2026-03-28 14:01:12 [bca.uk] INFO: Scrape type for LV23%20RXA: 0
2026-03-28 14:01:12 [bca.uk] INFO: Found listing with ID: LY69%20PXN
2026-03-28 14:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LY69%2520PXN%27 HTTP/1.1" 200 None
2026-03-28 14:01:13 [bca.uk] INFO: Scrape type for LY69%20PXN: 0
2026-03-28 14:01:13 [bca.uk] INFO: Found listing with ID: NX20%20NZM
2026-03-28 14:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27NX20%2520NZM%27 HTTP/1.1" 200 None
2026-03-28 14:01:13 [bca.uk] INFO: Scrape type for NX20%20NZM: 1
2026-03-28 14:01:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 24a9472e-5aa6-51b8-909f-9ce395651227 with identifier: NX20%20NZM
2026-03-28 14:01:13 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 24a9472e-5aa6-51b8-909f-9ce395651227
2026-03-28 14:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698920594%27 HTTP/1.1" 200 None
2026-03-28 14:01:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698920594 not downloaded yet
2026-03-28 14:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698980881%27 HTTP/1.1" 200 None
2026-03-28 14:01:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698980881 not downloaded yet
2026-03-28 14:01:13 [bca.uk] INFO: Total items found: 100
2026-03-28 14:01:13 [bca.uk] INFO: Requesting URL: https://www.bca.co.uk/api/search?q=&pageSize=100&page=4&sort=MostRecentlyAdded
2026-03-28 14:01:13 [bca.uk] INFO: Sending search API request with Bearer token (length=1492)
2026-03-28 14:01:13 [scrapy_zyte_api._params] WARNING: Request <GET https://www.bca.co.uk/api/search?q=&pageSize=100&page=4&sort=MostRecentlyAdded> defines the Zyte API customHttpRequestHeaders parameter, overriding Request.headers. Use Request.headers instead.
2026-03-28 14:01:13 [bca.uk] INFO: Found listing with ID: FL20%20XHA
2026-03-28 14:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FL20%2520XHA%27 HTTP/1.1" 200 None
2026-03-28 14:01:13 [bca.uk] INFO: Scrape type for FL20%20XHA: 2
2026-03-28 14:01:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d68b2fbf-911b-52b2-90a6-2af1a3e4ae0a with identifier: FL20%20XHA
2026-03-28 14:01:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d68b2fbf-911b-52b2-90a6-2af1a3e4ae0a with scrape type 2
2026-03-28 14:01:13 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d68b2fbf-911b-52b2-90a6-2af1a3e4ae0a with scrape type 2
2026-03-28 14:01:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: d68b2fbf-911b-52b2-90a6-2af1a3e4ae0a, identifier: FL20%20XHA
2026-03-28 14:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698934378%27 HTTP/1.1" 200 None
2026-03-28 14:01:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698934378 not downloaded yet
2026-03-28 14:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698251056%27 HTTP/1.1" 200 None
2026-03-28 14:01:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698251056 not downloaded yet
2026-03-28 14:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698786544%27 HTTP/1.1" 200 None
2026-03-28 14:01:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698786544 not downloaded yet
2026-03-28 14:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698540250%27 HTTP/1.1" 200 None
2026-03-28 14:01:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698540250 not downloaded yet
2026-03-28 14:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698966003%27 HTTP/1.1" 200 None
2026-03-28 14:01:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698966003 not downloaded yet
2026-03-28 14:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698106333%27 HTTP/1.1" 200 None
2026-03-28 14:01:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698106333 not downloaded yet
2026-03-28 14:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698227072%27 HTTP/1.1" 200 None
2026-03-28 14:01:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698227072 not downloaded yet
2026-03-28 14:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698444382%27 HTTP/1.1" 200 None
2026-03-28 14:01:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698444382 not downloaded yet
2026-03-28 14:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698296238%27 HTTP/1.1" 200 None
2026-03-28 14:01:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698296238 not downloaded yet
2026-03-28 14:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D697880562%27 HTTP/1.1" 200 None
2026-03-28 14:01:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=697880562 not downloaded yet
2026-03-28 14:01:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: d68b2fbf-911b-52b2-90a6-2af1a3e4ae0a with identifier: FL20%20XHA
2026-03-28 14:01:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: d68b2fbf-911b-52b2-90a6-2af1a3e4ae0a with identifier: FL20%20XHA
2026-03-28 14:01:13 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: d68b2fbf-911b-52b2-90a6-2af1a3e4ae0a with identifier: FL20%20XHA to the API
2026-03-28 14:01:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:01:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:01:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=1&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 136,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=FL20%20XHA-GB',
'category': 'Car',
'color': 'white',
'currency': 'GBP',
'doors_number': 5,
'engine': '2.0L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Diesel',
'id': 'd68b2fbf-911b-52b2-90a6-2af1a3e4ae0a',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'FL20 XHA',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=FL20%20XHA&vehicleType=*',
'listing': 'auction',
'location': 'Preston',
'make': 'FORD',
'model': 'KUGA',
'odometer': 60329,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-01-01',
'seller_name': None,
'title': 'FORD KUGA 2.0 EBL MHEV 150 ST-LINE X StationWagon',
'transmission': 'manual',
'trim': 'EBL MHEV 150 ST-LINE X',
'vin': 'WF0FXXWPMFLK86296',
'year': 2020}
2026-03-28 14:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FL20%2520XHA%27 HTTP/1.1" 200 None
2026-03-28 14:01:13 [bca.uk] INFO: Saving data for FL20%20XHA: {'auction_closing_time': 1774864800.0, 'created_time': 1774534270.474329, 'last_price_update_time': 1774706473.713318}
2026-03-28 14:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='FL20%2520XHA') HTTP/1.1" 204 0
2026-03-28 14:01:13 [bca.uk] INFO: Found listing with ID: SC69%20SYA
2026-03-28 14:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SC69%2520SYA%27 HTTP/1.1" 200 None
2026-03-28 14:01:13 [bca.uk] INFO: Scrape type for SC69%20SYA: 1
2026-03-28 14:01:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0943e31d-5a39-5fc7-b0f9-f571748a60fc with identifier: SC69%20SYA
2026-03-28 14:01:13 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 0943e31d-5a39-5fc7-b0f9-f571748a60fc
2026-03-28 14:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698980927%27 HTTP/1.1" 200 None
2026-03-28 14:01:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698980927 not downloaded yet
2026-03-28 14:01:13 [bca.uk] INFO: Found listing with ID: HK18%20KTD
2026-03-28 14:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27HK18%2520KTD%27 HTTP/1.1" 200 None
2026-03-28 14:01:13 [bca.uk] INFO: Scrape type for HK18%20KTD: 1
2026-03-28 14:01:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a5eb24be-0f0d-5d52-8354-e9c746a38f6e with identifier: HK18%20KTD
2026-03-28 14:01:13 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item a5eb24be-0f0d-5d52-8354-e9c746a38f6e
2026-03-28 14:01:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:01:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c58e990>
2026-03-28 14:01:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:01:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:01:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:01:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_561c0b4f-3a2d-562b-bb16-d69244165df3/561c0b4f-3a2d-562b-bb16-d69244165df3_expert_report_file_5126bbe4-0c57-43ee-ad38-9ce95f645122.pdf HTTP/1.1" 201 0
2026-03-28 14:01:13 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item 561c0b4f-3a2d-562b-bb16-d69244165df3
2026-03-28 14:01:13 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 561c0b4f-3a2d-562b-bb16-d69244165df3, skipping ID generation
2026-03-28 14:01:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 561c0b4f-3a2d-562b-bb16-d69244165df3
2026-03-28 14:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DYK67BOU-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-28 14:01:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=YK67BOU-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-28 14:01:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:01:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a1fd75990>
2026-03-28 14:01:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:01:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:01:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:01:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e788d11e-974b-5084-adb6-d49a23c42616/e788d11e-974b-5084-adb6-d49a23c42616_expert_report_file_c7a29757-1c87-4996-bb5d-156d4871053f.pdf HTTP/1.1" 201 0
2026-03-28 14:01:13 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item e788d11e-974b-5084-adb6-d49a23c42616
2026-03-28 14:01:13 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: e788d11e-974b-5084-adb6-d49a23c42616, skipping ID generation
2026-03-28 14:01:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item e788d11e-974b-5084-adb6-d49a23c42616
2026-03-28 14:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DX28AVE-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-28 14:01:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=X28AVE-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-28 14:01:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/ND17VGZ/42810273?sv=2020-08-04&st=2026-03-28T14%3A01%3A05Z&se=2026-03-28T14%3A26%3A05Z&sr=b&sp=r&sig=Ddznt5rliWG2eSFSeV1iYUxjjPUcheWJt3FgNXERnUs%3D> (referer: https://www.bca.co.uk/)
2026-03-28 14:01:13 [bca.uk] INFO: Found listing with ID: NV69%20KPO
2026-03-28 14:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27NV69%2520KPO%27 HTTP/1.1" 200 None
2026-03-28 14:01:14 [bca.uk] INFO: Scrape type for NV69%20KPO: 0
2026-03-28 14:01:14 [bca.uk] INFO: Found listing with ID: PY71%20HPP
2026-03-28 14:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27PY71%2520HPP%27 HTTP/1.1" 200 None
2026-03-28 14:01:14 [bca.uk] INFO: Scrape type for PY71%20HPP: 1
2026-03-28 14:01:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c02444db-1872-560a-9a4f-c32517c42d55 with identifier: PY71%20HPP
2026-03-28 14:01:14 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item c02444db-1872-560a-9a4f-c32517c42d55
2026-03-28 14:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698934394%27 HTTP/1.1" 200 None
2026-03-28 14:01:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698934394 not downloaded yet
2026-03-28 14:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698251071%27 HTTP/1.1" 200 None
2026-03-28 14:01:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698251071 not downloaded yet
2026-03-28 14:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698786572%27 HTTP/1.1" 200 None
2026-03-28 14:01:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698786572 not downloaded yet
2026-03-28 14:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698540268%27 HTTP/1.1" 200 None
2026-03-28 14:01:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698540268 not downloaded yet
2026-03-28 14:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698953427%27 HTTP/1.1" 200 None
2026-03-28 14:01:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698953427 not downloaded yet
2026-03-28 14:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698106357%27 HTTP/1.1" 200 None
2026-03-28 14:01:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698106357 not downloaded yet
2026-03-28 14:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698227082%27 HTTP/1.1" 200 None
2026-03-28 14:01:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698227082 not downloaded yet
2026-03-28 14:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698444388%27 HTTP/1.1" 200 None
2026-03-28 14:01:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698444388 not downloaded yet
2026-03-28 14:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698296242%27 HTTP/1.1" 200 None
2026-03-28 14:01:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698296242 not downloaded yet
2026-03-28 14:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D697880578%27 HTTP/1.1" 200 None
2026-03-28 14:01:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=697880578 not downloaded yet
2026-03-28 14:01:14 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BX06AVC/698920522/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698920522>
2026-03-28 14:01:14 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RE59BXM/698980638/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=RE59BXM-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-28 14:01:14 [bca.uk] INFO: Found listing with ID: WR21%20RBV
2026-03-28 14:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WR21%2520RBV%27 HTTP/1.1" 200 None
2026-03-28 14:01:14 [bca.uk] INFO: Scrape type for WR21%20RBV: 1
2026-03-28 14:01:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a29fef22-1343-5214-87a8-25c25aa3608e with identifier: WR21%20RBV
2026-03-28 14:01:14 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item a29fef22-1343-5214-87a8-25c25aa3608e
2026-03-28 14:01:14 [bca.uk] INFO: Found listing with ID: JG15%20TAN
2026-03-28 14:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27JG15%2520TAN%27 HTTP/1.1" 200 None
2026-03-28 14:01:14 [bca.uk] INFO: Scrape type for JG15%20TAN: 2
2026-03-28 14:01:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 14ca5336-4471-5f4b-9216-17127441e0ef with identifier: JG15%20TAN
2026-03-28 14:01:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 14ca5336-4471-5f4b-9216-17127441e0ef with scrape type 2
2026-03-28 14:01:14 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 14ca5336-4471-5f4b-9216-17127441e0ef with scrape type 2
2026-03-28 14:01:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 14ca5336-4471-5f4b-9216-17127441e0ef, identifier: JG15%20TAN
2026-03-28 14:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698928794%27 HTTP/1.1" 200 None
2026-03-28 14:01:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698928794 not downloaded yet
2026-03-28 14:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698923705%27 HTTP/1.1" 200 None
2026-03-28 14:01:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698923705 not downloaded yet
2026-03-28 14:01:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:01:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a1fd78d90>
2026-03-28 14:01:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:01:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:01:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:01:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4766d63c-47f2-5b85-8b2c-c4d089a16b5c/4766d63c-47f2-5b85-8b2c-c4d089a16b5c_expert_report_file_eeebd9eb-b6de-4293-9cd5-d6c3572c2a80.pdf HTTP/1.1" 201 0
2026-03-28 14:01:14 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item 4766d63c-47f2-5b85-8b2c-c4d089a16b5c
2026-03-28 14:01:14 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 4766d63c-47f2-5b85-8b2c-c4d089a16b5c, skipping ID generation
2026-03-28 14:01:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 4766d63c-47f2-5b85-8b2c-c4d089a16b5c
2026-03-28 14:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DWV13ZTH-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-28 14:01:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=WV13ZTH-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-28 14:01:14 [bca.uk] INFO: Found listing with ID: YL69%20MMV
2026-03-28 14:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YL69%2520MMV%27 HTTP/1.1" 200 None
2026-03-28 14:01:14 [bca.uk] INFO: Scrape type for YL69%20MMV: 1
2026-03-28 14:01:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3bc89657-c659-5489-9b8d-2c0e3a987c9c with identifier: YL69%20MMV
2026-03-28 14:01:14 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 3bc89657-c659-5489-9b8d-2c0e3a987c9c
2026-03-28 14:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698934409%27 HTTP/1.1" 200 None
2026-03-28 14:01:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698934409 not downloaded yet
2026-03-28 14:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698251084%27 HTTP/1.1" 200 None
2026-03-28 14:01:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698251084 not downloaded yet
2026-03-28 14:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698786598%27 HTTP/1.1" 200 None
2026-03-28 14:01:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698786598 not downloaded yet
2026-03-28 14:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698540291%27 HTTP/1.1" 200 None
2026-03-28 14:01:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698540291 not downloaded yet
2026-03-28 14:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698966009%27 HTTP/1.1" 200 None
2026-03-28 14:01:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698966009 not downloaded yet
2026-03-28 14:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698106384%27 HTTP/1.1" 200 None
2026-03-28 14:01:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698106384 not downloaded yet
2026-03-28 14:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698227092%27 HTTP/1.1" 200 None
2026-03-28 14:01:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698227092 not downloaded yet
2026-03-28 14:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698444392%27 HTTP/1.1" 200 None
2026-03-28 14:01:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698444392 not downloaded yet
2026-03-28 14:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698296251%27 HTTP/1.1" 200 None
2026-03-28 14:01:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698296251 not downloaded yet
2026-03-28 14:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D697880599%27 HTTP/1.1" 200 None
2026-03-28 14:01:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=697880599 not downloaded yet
2026-03-28 14:01:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 14ca5336-4471-5f4b-9216-17127441e0ef with identifier: JG15%20TAN
2026-03-28 14:01:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 14ca5336-4471-5f4b-9216-17127441e0ef with identifier: JG15%20TAN
2026-03-28 14:01:14 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 14ca5336-4471-5f4b-9216-17127441e0ef with identifier: JG15%20TAN to the API
2026-03-28 14:01:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:01:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:01:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=3&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 143,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=JG15%20TAN-GB',
'category': 'Car',
'color': 'black',
'currency': 'GBP',
'doors_number': 5,
'engine': '2.0L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Diesel',
'id': '14ca5336-4471-5f4b-9216-17127441e0ef',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'JG15 TAN',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=JG15%20TAN&vehicleType=*',
'listing': 'auction',
'location': 'Leeds',
'make': 'BMW',
'model': 'X4',
'odometer': 55332,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-01-01',
'seller_name': None,
'title': 'BMW X4 2.0 XDRIVE 20D SPORT STEP Coupe',
'transmission': 'manual',
'trim': 'XDRIVE 20D SPORT STEP',
'vin': 'WBAVJ92060LE78538',
'year': 2019}
2026-03-28 14:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27JG15%2520TAN%27 HTTP/1.1" 200 None
2026-03-28 14:01:15 [bca.uk] INFO: Saving data for JG15%20TAN: {'auction_closing_time': 1774864800.0, 'created_time': 1773958832.69551, 'last_price_update_time': 1774706475.03007}
2026-03-28 14:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='JG15%2520TAN') HTTP/1.1" 204 0
2026-03-28 14:01:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/EX10BXE/42809799?sv=2020-08-04&st=2026-03-28T14%3A01%3A07Z&se=2026-03-28T14%3A26%3A07Z&sr=b&sp=r&sig=xoEQIFwTRaF8ZPdiio47BQcwaxFkt4KEonwRoN8KxQM%3D> (referer: https://www.bca.co.uk/)
2026-03-28 14:01:15 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VX19OYP/698250987/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=VX19OYP-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-28 14:01:15 [bca.uk] INFO: Found listing with ID: YM68%20ZFO
2026-03-28 14:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YM68%2520ZFO%27 HTTP/1.1" 200 None
2026-03-28 14:01:15 [bca.uk] INFO: Scrape type for YM68%20ZFO: 1
2026-03-28 14:01:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 16700d5d-3bb0-5d53-97b0-526970b8dd7a with identifier: YM68%20ZFO
2026-03-28 14:01:15 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 16700d5d-3bb0-5d53-97b0-526970b8dd7a
2026-03-28 14:01:15 [bca.uk] INFO: Found listing with ID: VO69%20FZU
2026-03-28 14:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27VO69%2520FZU%27 HTTP/1.1" 200 None
2026-03-28 14:01:15 [bca.uk] INFO: Scrape type for VO69%20FZU: 2
2026-03-28 14:01:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bb1d1a90-805c-5299-bded-1e0c1c362434 with identifier: VO69%20FZU
2026-03-28 14:01:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bb1d1a90-805c-5299-bded-1e0c1c362434 with scrape type 2
2026-03-28 14:01:15 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item bb1d1a90-805c-5299-bded-1e0c1c362434 with scrape type 2
2026-03-28 14:01:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: bb1d1a90-805c-5299-bded-1e0c1c362434, identifier: VO69%20FZU
2026-03-28 14:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698928817%27 HTTP/1.1" 200 None
2026-03-28 14:01:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698928817 not downloaded yet
2026-03-28 14:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698923722%27 HTTP/1.1" 200 None
2026-03-28 14:01:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698923722 not downloaded yet
2026-03-28 14:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698929286%27 HTTP/1.1" 200 None
2026-03-28 14:01:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698929286 not downloaded yet
2026-03-28 14:01:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/GF57MWW/42810309?sv=2020-08-04&st=2026-03-28T14%3A01%3A09Z&se=2026-03-28T14%3A26%3A09Z&sr=b&sp=r&sig=hJTqt8SLdbJfAcgzLjUmqtORuHZL2E6pw%2FRYFmCkjK4%3D> (referer: https://www.bca.co.uk/)
2026-03-28 14:01:15 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FY68WNB/698106282/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=FY68WNB-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-28 14:01:15 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/OV64PLN/698965982/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=OV64PLN-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-28 14:01:15 [bca.uk] INFO: Found listing with ID: FG22%20EFZ
2026-03-28 14:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FG22%2520EFZ%27 HTTP/1.1" 200 None
2026-03-28 14:01:15 [bca.uk] INFO: Scrape type for FG22%20EFZ: 1
2026-03-28 14:01:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 08bf8f74-9225-5902-b2d3-8dce4ca2dbfe with identifier: FG22%20EFZ
2026-03-28 14:01:15 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 08bf8f74-9225-5902-b2d3-8dce4ca2dbfe
2026-03-28 14:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698786622%27 HTTP/1.1" 200 None
2026-03-28 14:01:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698786622 not downloaded yet
2026-03-28 14:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698540323%27 HTTP/1.1" 200 None
2026-03-28 14:01:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698540323 not downloaded yet
2026-03-28 14:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698953438%27 HTTP/1.1" 200 None
2026-03-28 14:01:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698953438 not downloaded yet
2026-03-28 14:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698106404%27 HTTP/1.1" 200 None
2026-03-28 14:01:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698106404 not downloaded yet
2026-03-28 14:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698227107%27 HTTP/1.1" 200 None
2026-03-28 14:01:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698227107 not downloaded yet
2026-03-28 14:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698444403%27 HTTP/1.1" 200 None
2026-03-28 14:01:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698444403 not downloaded yet
2026-03-28 14:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698296254%27 HTTP/1.1" 200 None
2026-03-28 14:01:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698296254 not downloaded yet
2026-03-28 14:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D697880617%27 HTTP/1.1" 200 None
2026-03-28 14:01:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=697880617 not downloaded yet
2026-03-28 14:01:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: bb1d1a90-805c-5299-bded-1e0c1c362434 with identifier: VO69%20FZU
2026-03-28 14:01:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-28 14:01:15 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=multicoloured HTTP/1.1" 200 None
2026-03-28 14:01:15 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-28 14:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-28 14:01:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: bb1d1a90-805c-5299-bded-1e0c1c362434 with identifier: VO69%20FZU
2026-03-28 14:01:15 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: bb1d1a90-805c-5299-bded-1e0c1c362434 with identifier: VO69%20FZU to the API
2026-03-28 14:01:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:01:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:01:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=3&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 128,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=VO69%20FZU-GB',
'category': 'Car',
'color': 'multicoloured',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.3L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol',
'id': 'bb1d1a90-805c-5299-bded-1e0c1c362434',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'VO69 FZU',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=VO69%20FZU&vehicleType=*',
'listing': 'auction',
'location': 'Leeds',
'make': 'RENAULT',
'model': 'CAPTUR',
'odometer': 25889,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-01-01',
'seller_name': None,
'title': 'RENAULT CAPTUR 1.3 TCE 130 ICONIC Hatchback',
'transmission': 'manual',
'trim': 'TCE 130 ICONIC',
'vin': 'VF1R8700563942740',
'year': 2019}
2026-03-28 14:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27VO69%2520FZU%27 HTTP/1.1" 200 None
2026-03-28 14:01:15 [bca.uk] INFO: Saving data for VO69%20FZU: {'auction_closing_time': 1774864800.0, 'created_time': 1774562717.843475, 'last_price_update_time': 1774706475.940134}
2026-03-28 14:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='VO69%2520FZU') HTTP/1.1" 204 0
2026-03-28 14:01:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:01:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c863290>
2026-03-28 14:01:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:01:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:01:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:01:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_03d2b309-0f29-57c0-bf73-2b86c16c227a/03d2b309-0f29-57c0-bf73-2b86c16c227a_expert_report_file_bdb6cb51-6d35-4b6c-8ad3-62f4b946f3a3.pdf HTTP/1.1" 201 0
2026-03-28 14:01:15 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item 03d2b309-0f29-57c0-bf73-2b86c16c227a
2026-03-28 14:01:15 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 03d2b309-0f29-57c0-bf73-2b86c16c227a, skipping ID generation
2026-03-28 14:01:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 03d2b309-0f29-57c0-bf73-2b86c16c227a
2026-03-28 14:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DND17VGZ-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-28 14:01:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=ND17VGZ-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-28 14:01:16 [bca.uk] INFO: Found listing with ID: AO69%20YDV
2026-03-28 14:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27AO69%2520YDV%27 HTTP/1.1" 200 None
2026-03-28 14:01:16 [bca.uk] INFO: Scrape type for AO69%20YDV: 1
2026-03-28 14:01:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 05dbf1b7-4974-55c1-bc1d-1c2597466589 with identifier: AO69%20YDV
2026-03-28 14:01:16 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 05dbf1b7-4974-55c1-bc1d-1c2597466589
2026-03-28 14:01:16 [bca.uk] INFO: Found listing with ID: YX22%20KOA
2026-03-28 14:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YX22%2520KOA%27 HTTP/1.1" 200 None
2026-03-28 14:01:16 [bca.uk] INFO: Scrape type for YX22%20KOA: 0
2026-03-28 14:01:16 [bca.uk] INFO: Found listing with ID: YY22%20BDE
2026-03-28 14:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YY22%2520BDE%27 HTTP/1.1" 200 None
2026-03-28 14:01:16 [bca.uk] INFO: Scrape type for YY22%20BDE: 0
2026-03-28 14:01:16 [bca.uk] INFO: Found listing with ID: YY70%20LWT
2026-03-28 14:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YY70%2520LWT%27 HTTP/1.1" 200 None
2026-03-28 14:01:16 [bca.uk] INFO: Scrape type for YY70%20LWT: 1
2026-03-28 14:01:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 05627c71-8f78-5f09-9412-0b2354bea98e with identifier: YY70%20LWT
2026-03-28 14:01:16 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 05627c71-8f78-5f09-9412-0b2354bea98e
2026-03-28 14:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698928843%27 HTTP/1.1" 200 None
2026-03-28 14:01:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698928843 not downloaded yet
2026-03-28 14:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698923736%27 HTTP/1.1" 200 None
2026-03-28 14:01:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698923736 not downloaded yet
2026-03-28 14:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698929295%27 HTTP/1.1" 200 None
2026-03-28 14:01:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698929295 not downloaded yet
2026-03-28 14:01:16 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KV60ZZA/698934278/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=KV60ZZA-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-28 14:01:16 [bca.uk] INFO: Found listing with ID: DG65%20GXU
2026-03-28 14:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DG65%2520GXU%27 HTTP/1.1" 200 None
2026-03-28 14:01:16 [bca.uk] INFO: Scrape type for DG65%20GXU: 1
2026-03-28 14:01:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d8f0d404-7eeb-556b-ba0e-71ee720847de with identifier: DG65%20GXU
2026-03-28 14:01:16 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item d8f0d404-7eeb-556b-ba0e-71ee720847de
2026-03-28 14:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698540362%27 HTTP/1.1" 200 None
2026-03-28 14:01:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698540362 not downloaded yet
2026-03-28 14:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698966015%27 HTTP/1.1" 200 None
2026-03-28 14:01:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698966015 not downloaded yet
2026-03-28 14:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698106426%27 HTTP/1.1" 200 None
2026-03-28 14:01:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698106426 not downloaded yet
2026-03-28 14:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698227117%27 HTTP/1.1" 200 None
2026-03-28 14:01:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698227117 not downloaded yet
2026-03-28 14:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698444414%27 HTTP/1.1" 200 None
2026-03-28 14:01:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698444414 not downloaded yet
2026-03-28 14:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698296262%27 HTTP/1.1" 200 None
2026-03-28 14:01:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698296262 not downloaded yet
2026-03-28 14:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D697880656%27 HTTP/1.1" 200 None
2026-03-28 14:01:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=697880656 not downloaded yet
2026-03-28 14:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698929237%27 HTTP/1.1" 200 None
2026-03-28 14:01:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698929237 not downloaded yet
2026-03-28 14:01:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:01:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c6a8290>
2026-03-28 14:01:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:01:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:01:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:01:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f5f9bed7-96bb-5ef8-8a52-e232dbf0b7d5/f5f9bed7-96bb-5ef8-8a52-e232dbf0b7d5_expert_report_file_068aa374-a5bd-44bc-aa5b-2047a1a6ecb1.pdf HTTP/1.1" 201 0
2026-03-28 14:01:16 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item f5f9bed7-96bb-5ef8-8a52-e232dbf0b7d5
2026-03-28 14:01:16 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: f5f9bed7-96bb-5ef8-8a52-e232dbf0b7d5, skipping ID generation
2026-03-28 14:01:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item f5f9bed7-96bb-5ef8-8a52-e232dbf0b7d5
2026-03-28 14:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DEX10BXE-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-28 14:01:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=EX10BXE-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-28 14:01:16 [bca.uk] INFO: Found listing with ID: DU19%20WRR
2026-03-28 14:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DU19%2520WRR%27 HTTP/1.1" 200 None
2026-03-28 14:01:16 [bca.uk] INFO: Scrape type for DU19%20WRR: 1
2026-03-28 14:01:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 25ea238e-697d-5563-a2fc-e7cf5710c862 with identifier: DU19%20WRR
2026-03-28 14:01:16 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 25ea238e-697d-5563-a2fc-e7cf5710c862
2026-03-28 14:01:16 [bca.uk] INFO: Found listing with ID: YY74%20VXV
2026-03-28 14:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YY74%2520VXV%27 HTTP/1.1" 200 None
2026-03-28 14:01:16 [bca.uk] INFO: Scrape type for YY74%20VXV: 0
2026-03-28 14:01:16 [bca.uk] INFO: Found listing with ID: AD19%20LDZ
2026-03-28 14:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27AD19%2520LDZ%27 HTTP/1.1" 200 None
2026-03-28 14:01:16 [bca.uk] INFO: Scrape type for AD19%20LDZ: 0
2026-03-28 14:01:16 [bca.uk] INFO: Found listing with ID: RF21%20EBD
2026-03-28 14:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27RF21%2520EBD%27 HTTP/1.1" 200 None
2026-03-28 14:01:16 [bca.uk] INFO: Scrape type for RF21%20EBD: 1
2026-03-28 14:01:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 32911a92-e281-56af-bde9-3b2fa177bca3 with identifier: RF21%20EBD
2026-03-28 14:01:16 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 32911a92-e281-56af-bde9-3b2fa177bca3
2026-03-28 14:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698928864%27 HTTP/1.1" 200 None
2026-03-28 14:01:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698928864 not downloaded yet
2026-03-28 14:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698923746%27 HTTP/1.1" 200 None
2026-03-28 14:01:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698923746 not downloaded yet
2026-03-28 14:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698929305%27 HTTP/1.1" 200 None
2026-03-28 14:01:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698929305 not downloaded yet
2026-03-28 14:01:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:01:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c5fae90>
2026-03-28 14:01:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:01:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:01:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:01:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cdcc838c-10d3-5f36-90c6-59ef07eececc/cdcc838c-10d3-5f36-90c6-59ef07eececc_expert_report_file_584752f6-bc46-4485-a626-77559eb47905.pdf HTTP/1.1" 201 0
2026-03-28 14:01:16 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item cdcc838c-10d3-5f36-90c6-59ef07eececc
2026-03-28 14:01:16 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: cdcc838c-10d3-5f36-90c6-59ef07eececc, skipping ID generation
2026-03-28 14:01:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item cdcc838c-10d3-5f36-90c6-59ef07eececc
2026-03-28 14:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DGF57MWW-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-28 14:01:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=GF57MWW-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-28 14:01:16 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YH13CHD/698786485/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=YH13CHD-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-28 14:01:16 [bca.uk] INFO: Found listing with ID: SD18%20YWW
2026-03-28 14:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SD18%2520YWW%27 HTTP/1.1" 200 None
2026-03-28 14:01:16 [bca.uk] INFO: Scrape type for SD18%20YWW: 1
2026-03-28 14:01:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 12688ef2-2fc1-5a39-9796-e8677733238c with identifier: SD18%20YWW
2026-03-28 14:01:16 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 12688ef2-2fc1-5a39-9796-e8677733238c
2026-03-28 14:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698227127%27 HTTP/1.1" 200 None
2026-03-28 14:01:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698227127 not downloaded yet
2026-03-28 14:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698444427%27 HTTP/1.1" 200 None
2026-03-28 14:01:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698444427 not downloaded yet
2026-03-28 14:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698296270%27 HTTP/1.1" 200 None
2026-03-28 14:01:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698296270 not downloaded yet
2026-03-28 14:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D697880683%27 HTTP/1.1" 200 None
2026-03-28 14:01:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=697880683 not downloaded yet
2026-03-28 14:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698929257%27 HTTP/1.1" 200 None
2026-03-28 14:01:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698929257 not downloaded yet
2026-03-28 14:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698923368%27 HTTP/1.1" 200 None
2026-03-28 14:01:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698923368 not downloaded yet
2026-03-28 14:01:16 [bca.uk] INFO: Found listing with ID: EN73%20ZXH
2026-03-28 14:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27EN73%2520ZXH%27 HTTP/1.1" 200 None
2026-03-28 14:01:16 [bca.uk] INFO: Scrape type for EN73%20ZXH: 0
2026-03-28 14:01:16 [bca.uk] INFO: Found listing with ID: GF23%20LJX
2026-03-28 14:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GF23%2520LJX%27 HTTP/1.1" 200 None
2026-03-28 14:01:16 [bca.uk] INFO: Scrape type for GF23%20LJX: 1
2026-03-28 14:01:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e2169724-1950-5652-92b2-0f3da8b4bfbb with identifier: GF23%20LJX
2026-03-28 14:01:16 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item e2169724-1950-5652-92b2-0f3da8b4bfbb
2026-03-28 14:01:16 [bca.uk] INFO: Found listing with ID: WO21%20TKX
2026-03-28 14:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WO21%2520TKX%27 HTTP/1.1" 200 None
2026-03-28 14:01:16 [bca.uk] INFO: Scrape type for WO21%20TKX: 0
2026-03-28 14:01:16 [bca.uk] INFO: Found listing with ID: RA16%20HNC
2026-03-28 14:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27RA16%2520HNC%27 HTTP/1.1" 200 None
2026-03-28 14:01:16 [bca.uk] INFO: Scrape type for RA16%20HNC: 1
2026-03-28 14:01:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a241d4e5-9ba8-591a-8b8d-858d5e5adfe4 with identifier: RA16%20HNC
2026-03-28 14:01:16 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item a241d4e5-9ba8-591a-8b8d-858d5e5adfe4
2026-03-28 14:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698928881%27 HTTP/1.1" 200 None
2026-03-28 14:01:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698928881 not downloaded yet
2026-03-28 14:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698923758%27 HTTP/1.1" 200 None
2026-03-28 14:01:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698923758 not downloaded yet
2026-03-28 14:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698929313%27 HTTP/1.1" 200 None
2026-03-28 14:01:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698929313 not downloaded yet
2026-03-28 14:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698928776%27 HTTP/1.1" 200 None
2026-03-28 14:01:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698928776 not downloaded yet
2026-03-28 14:01:16 [bca.uk] INFO: Found listing with ID: PJ59%20WXK
2026-03-28 14:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27PJ59%2520WXK%27 HTTP/1.1" 200 None
2026-03-28 14:01:17 [bca.uk] INFO: Scrape type for PJ59%20WXK: 1
2026-03-28 14:01:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b90da0a6-3ad2-591a-8a5c-936884592342 with identifier: PJ59%20WXK
2026-03-28 14:01:17 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item b90da0a6-3ad2-591a-8a5c-936884592342
2026-03-28 14:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698444440%27 HTTP/1.1" 200 None
2026-03-28 14:01:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698444440 not downloaded yet
2026-03-28 14:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698296274%27 HTTP/1.1" 200 None
2026-03-28 14:01:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698296274 not downloaded yet
2026-03-28 14:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D697880714%27 HTTP/1.1" 200 None
2026-03-28 14:01:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=697880714 not downloaded yet
2026-03-28 14:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698929269%27 HTTP/1.1" 200 None
2026-03-28 14:01:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698929269 not downloaded yet
2026-03-28 14:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698923388%27 HTTP/1.1" 200 None
2026-03-28 14:01:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698923388 not downloaded yet
2026-03-28 14:01:17 [bca.uk] INFO: Found listing with ID: GJ69%20TMO
2026-03-28 14:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GJ69%2520TMO%27 HTTP/1.1" 200 None
2026-03-28 14:01:17 [bca.uk] INFO: Scrape type for GJ69%20TMO: 1
2026-03-28 14:01:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bf5f6c66-7fca-54d7-9dbf-87d60cf357d5 with identifier: GJ69%20TMO
2026-03-28 14:01:17 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item bf5f6c66-7fca-54d7-9dbf-87d60cf357d5
2026-03-28 14:01:17 [bca.uk] INFO: Found listing with ID: FY18%20CYT
2026-03-28 14:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FY18%2520CYT%27 HTTP/1.1" 200 None
2026-03-28 14:01:17 [bca.uk] INFO: Scrape type for FY18%20CYT: 1
2026-03-28 14:01:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 567b324e-2678-5f7b-ae48-9d6f040ce03b with identifier: FY18%20CYT
2026-03-28 14:01:17 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 567b324e-2678-5f7b-ae48-9d6f040ce03b
2026-03-28 14:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698928908%27 HTTP/1.1" 200 None
2026-03-28 14:01:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698928908 not downloaded yet
2026-03-28 14:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698923783%27 HTTP/1.1" 200 None
2026-03-28 14:01:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698923783 not downloaded yet
2026-03-28 14:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698929321%27 HTTP/1.1" 200 None
2026-03-28 14:01:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698929321 not downloaded yet
2026-03-28 14:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698928797%27 HTTP/1.1" 200 None
2026-03-28 14:01:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698928797 not downloaded yet
2026-03-28 14:01:17 [bca.uk] INFO: Found listing with ID: KM62%20HVG
2026-03-28 14:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KM62%2520HVG%27 HTTP/1.1" 200 None
2026-03-28 14:01:17 [bca.uk] INFO: Scrape type for KM62%20HVG: 2
2026-03-28 14:01:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 72b001c3-5511-57e9-a9b4-06705e5eb472 with identifier: KM62%20HVG
2026-03-28 14:01:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 72b001c3-5511-57e9-a9b4-06705e5eb472 with scrape type 2
2026-03-28 14:01:17 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 72b001c3-5511-57e9-a9b4-06705e5eb472 with scrape type 2
2026-03-28 14:01:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 72b001c3-5511-57e9-a9b4-06705e5eb472, identifier: KM62%20HVG
2026-03-28 14:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698296277%27 HTTP/1.1" 200 None
2026-03-28 14:01:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698296277 not downloaded yet
2026-03-28 14:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D697880795%27 HTTP/1.1" 200 None
2026-03-28 14:01:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=697880795 not downloaded yet
2026-03-28 14:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698929290%27 HTTP/1.1" 200 None
2026-03-28 14:01:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698929290 not downloaded yet
2026-03-28 14:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698923402%27 HTTP/1.1" 200 None
2026-03-28 14:01:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698923402 not downloaded yet
2026-03-28 14:01:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 72b001c3-5511-57e9-a9b4-06705e5eb472 with identifier: KM62%20HVG
2026-03-28 14:01:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 72b001c3-5511-57e9-a9b4-06705e5eb472 with identifier: KM62%20HVG
2026-03-28 14:01:17 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 72b001c3-5511-57e9-a9b4-06705e5eb472 with identifier: KM62%20HVG to the API
2026-03-28 14:01:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:01:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:01:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=1&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 174,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=KM62%20HVG-GB',
'category': 'Car',
'color': 'black',
'currency': 'GBP',
'doors_number': 5,
'engine': '2.2L',
'expiration_date': '2026-03-29T10:00:00Z',
'fuel_type': 'Diesel',
'id': '72b001c3-5511-57e9-a9b4-06705e5eb472',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'KM62 HVG',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=KM62%20HVG&vehicleType=*',
'listing': 'auction',
'location': 'Preston',
'make': 'LAND ROVER',
'model': 'R/R EVOQUE',
'odometer': 140054,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2012-01-01',
'seller_name': None,
'title': 'LAND ROVER R/R EVOQUE 2.2 SD4 4WD PRESTIGE Hatchback',
'transmission': 'automatic',
'trim': 'SD4 4WD PRESTIGE',
'vin': 'SALVA2AE4DH743298',
'year': 2012}
2026-03-28 14:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KM62%2520HVG%27 HTTP/1.1" 200 None
2026-03-28 14:01:18 [bca.uk] INFO: Saving data for KM62%20HVG: {'auction_closing_time': 1774778400.0, 'created_time': 1774476120.525143, 'last_price_update_time': 1774706478.1187}
2026-03-28 14:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='KM62%2520HVG') HTTP/1.1" 204 0
2026-03-28 14:01:18 [bca.uk] INFO: Found listing with ID: LV22%20XPR
2026-03-28 14:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LV22%2520XPR%27 HTTP/1.1" 200 None
2026-03-28 14:01:18 [bca.uk] INFO: Scrape type for LV22%20XPR: 0
2026-03-28 14:01:18 [bca.uk] INFO: Found listing with ID: GV16%20HBD
2026-03-28 14:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GV16%2520HBD%27 HTTP/1.1" 200 None
2026-03-28 14:01:18 [bca.uk] INFO: Scrape type for GV16%20HBD: 1
2026-03-28 14:01:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0c77c9a7-bec0-528f-95be-edf653516a09 with identifier: GV16%20HBD
2026-03-28 14:01:18 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 0c77c9a7-bec0-528f-95be-edf653516a09
2026-03-28 14:01:18 [bca.uk] INFO: Found listing with ID: GF64%20UPV
2026-03-28 14:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GF64%2520UPV%27 HTTP/1.1" 200 None
2026-03-28 14:01:18 [bca.uk] INFO: Scrape type for GF64%20UPV: 1
2026-03-28 14:01:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 68af04a9-eec4-52ae-b536-68c72f8fddc4 with identifier: GF64%20UPV
2026-03-28 14:01:18 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 68af04a9-eec4-52ae-b536-68c72f8fddc4
2026-03-28 14:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698928934%27 HTTP/1.1" 200 None
2026-03-28 14:01:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698928934 not downloaded yet
2026-03-28 14:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698923798%27 HTTP/1.1" 200 None
2026-03-28 14:01:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698923798 not downloaded yet
2026-03-28 14:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698929332%27 HTTP/1.1" 200 None
2026-03-28 14:01:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698929332 not downloaded yet
2026-03-28 14:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698928823%27 HTTP/1.1" 200 None
2026-03-28 14:01:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698928823 not downloaded yet
2026-03-28 14:01:18 [bca.uk] INFO: Found listing with ID: MJ62%20HDO
2026-03-28 14:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MJ62%2520HDO%27 HTTP/1.1" 200 None
2026-03-28 14:01:18 [bca.uk] INFO: Scrape type for MJ62%20HDO: 1
2026-03-28 14:01:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c697e335-b937-5194-8aed-71297a871cbe with identifier: MJ62%20HDO
2026-03-28 14:01:18 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item c697e335-b937-5194-8aed-71297a871cbe
2026-03-28 14:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698929297%27 HTTP/1.1" 200 None
2026-03-28 14:01:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698929297 not downloaded yet
2026-03-28 14:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698923423%27 HTTP/1.1" 200 None
2026-03-28 14:01:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698923423 not downloaded yet
2026-03-28 14:01:18 [bca.uk] INFO: Found listing with ID: PO15%20XUV
2026-03-28 14:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27PO15%2520XUV%27 HTTP/1.1" 200 None
2026-03-28 14:01:18 [bca.uk] INFO: Scrape type for PO15%20XUV: 1
2026-03-28 14:01:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 325fe017-882a-52af-b1a0-8b2b107ef73e with identifier: PO15%20XUV
2026-03-28 14:01:18 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 325fe017-882a-52af-b1a0-8b2b107ef73e
2026-03-28 14:01:18 [bca.uk] INFO: Found listing with ID: KN15%20HKZ
2026-03-28 14:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KN15%2520HKZ%27 HTTP/1.1" 200 None
2026-03-28 14:01:18 [bca.uk] INFO: Scrape type for KN15%20HKZ: 1
2026-03-28 14:01:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9708014f-5ed6-5f8a-955b-235d568bd501 with identifier: KN15%20HKZ
2026-03-28 14:01:18 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 9708014f-5ed6-5f8a-955b-235d568bd501
2026-03-28 14:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698928964%27 HTTP/1.1" 200 None
2026-03-28 14:01:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698928964 not downloaded yet
2026-03-28 14:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698923819%27 HTTP/1.1" 200 None
2026-03-28 14:01:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698923819 not downloaded yet
2026-03-28 14:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698929340%27 HTTP/1.1" 200 None
2026-03-28 14:01:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698929340 not downloaded yet
2026-03-28 14:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698928844%27 HTTP/1.1" 200 None
2026-03-28 14:01:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698928844 not downloaded yet
2026-03-28 14:01:18 [bca.uk] INFO: Found listing with ID: YF12%20JGU
2026-03-28 14:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YF12%2520JGU%27 HTTP/1.1" 200 None
2026-03-28 14:01:18 [bca.uk] INFO: Scrape type for YF12%20JGU: 2
2026-03-28 14:01:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 050412ff-8b37-5d55-8c9b-0a34cf929c3d with identifier: YF12%20JGU
2026-03-28 14:01:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 050412ff-8b37-5d55-8c9b-0a34cf929c3d with scrape type 2
2026-03-28 14:01:18 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 050412ff-8b37-5d55-8c9b-0a34cf929c3d with scrape type 2
2026-03-28 14:01:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 050412ff-8b37-5d55-8c9b-0a34cf929c3d, identifier: YF12%20JGU
2026-03-28 14:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698929315%27 HTTP/1.1" 200 None
2026-03-28 14:01:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698929315 not downloaded yet
2026-03-28 14:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698923441%27 HTTP/1.1" 200 None
2026-03-28 14:01:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698923441 not downloaded yet
2026-03-28 14:01:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 050412ff-8b37-5d55-8c9b-0a34cf929c3d with identifier: YF12%20JGU
2026-03-28 14:01:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 050412ff-8b37-5d55-8c9b-0a34cf929c3d with identifier: YF12%20JGU
2026-03-28 14:01:18 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 050412ff-8b37-5d55-8c9b-0a34cf929c3d with identifier: YF12%20JGU to the API
2026-03-28 14:01:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:01:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:01:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=1&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 118,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=YF12%20JGU-GB',
'category': 'Car',
'color': 'red',
'currency': 'GBP',
'doors_number': 4,
'engine': '2.0L',
'expiration_date': '2026-03-29T10:00:00Z',
'fuel_type': 'Diesel',
'id': '050412ff-8b37-5d55-8c9b-0a34cf929c3d',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'YF12 JGU',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=YF12%20JGU&vehicleType=*',
'listing': 'auction',
'location': 'Preston',
'make': 'BMW',
'model': '320D',
'odometer': 141954,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2012-01-01',
'seller_name': None,
'title': 'BMW 320D 2.0 SPORT STEP Saloon',
'transmission': 'automatic',
'trim': 'SPORT STEP',
'vin': 'WBA3D32090J380575',
'year': 2012}
2026-03-28 14:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YF12%2520JGU%27 HTTP/1.1" 200 None
2026-03-28 14:01:19 [bca.uk] INFO: Saving data for YF12%20JGU: {'auction_closing_time': 1774778400.0, 'created_time': 1774535175.165684, 'last_price_update_time': 1774706479.038316}
2026-03-28 14:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='YF12%2520JGU') HTTP/1.1" 204 0
2026-03-28 14:01:19 [bca.uk] INFO: Found listing with ID: AV65%20GXF
2026-03-28 14:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27AV65%2520GXF%27 HTTP/1.1" 200 None
2026-03-28 14:01:19 [bca.uk] INFO: Scrape type for AV65%20GXF: 1
2026-03-28 14:01:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3178ef9b-a5d4-5f26-baa7-4b0b7cfd9561 with identifier: AV65%20GXF
2026-03-28 14:01:19 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 3178ef9b-a5d4-5f26-baa7-4b0b7cfd9561
2026-03-28 14:01:19 [bca.uk] INFO: Found listing with ID: AK12%20LBY
2026-03-28 14:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27AK12%2520LBY%27 HTTP/1.1" 200 None
2026-03-28 14:01:19 [bca.uk] INFO: Scrape type for AK12%20LBY: 1
2026-03-28 14:01:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ea08653a-82f6-5e2e-9b8f-caf8f656653f with identifier: AK12%20LBY
2026-03-28 14:01:19 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item ea08653a-82f6-5e2e-9b8f-caf8f656653f
2026-03-28 14:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698928994%27 HTTP/1.1" 200 None
2026-03-28 14:01:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698928994 not downloaded yet
2026-03-28 14:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698923832%27 HTTP/1.1" 200 None
2026-03-28 14:01:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698923832 not downloaded yet
2026-03-28 14:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698929353%27 HTTP/1.1" 200 None
2026-03-28 14:01:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698929353 not downloaded yet
2026-03-28 14:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698928862%27 HTTP/1.1" 200 None
2026-03-28 14:01:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698928862 not downloaded yet
2026-03-28 14:01:19 [bca.uk] INFO: Found listing with ID: KU69%20HXY
2026-03-28 14:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KU69%2520HXY%27 HTTP/1.1" 200 None
2026-03-28 14:01:19 [bca.uk] INFO: Scrape type for KU69%20HXY: 0
2026-03-28 14:01:19 [bca.uk] INFO: Found listing with ID: ST11%20LWD
2026-03-28 14:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27ST11%2520LWD%27 HTTP/1.1" 200 None
2026-03-28 14:01:19 [bca.uk] INFO: Scrape type for ST11%20LWD: 0
2026-03-28 14:01:19 [bca.uk] INFO: Found listing with ID: BV09%20OZT
2026-03-28 14:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BV09%2520OZT%27 HTTP/1.1" 200 None
2026-03-28 14:01:19 [bca.uk] INFO: Scrape type for BV09%20OZT: 2
2026-03-28 14:01:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 739a470f-ce8d-51c6-83ce-2bacf42e9c8d with identifier: BV09%20OZT
2026-03-28 14:01:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 739a470f-ce8d-51c6-83ce-2bacf42e9c8d with scrape type 2
2026-03-28 14:01:19 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 739a470f-ce8d-51c6-83ce-2bacf42e9c8d with scrape type 2
2026-03-28 14:01:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 739a470f-ce8d-51c6-83ce-2bacf42e9c8d, identifier: BV09%20OZT
2026-03-28 14:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698929328%27 HTTP/1.1" 200 None
2026-03-28 14:01:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698929328 not downloaded yet
2026-03-28 14:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698923471%27 HTTP/1.1" 200 None
2026-03-28 14:01:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698923471 not downloaded yet
2026-03-28 14:01:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 739a470f-ce8d-51c6-83ce-2bacf42e9c8d with identifier: BV09%20OZT
2026-03-28 14:01:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 739a470f-ce8d-51c6-83ce-2bacf42e9c8d with identifier: BV09%20OZT
2026-03-28 14:01:19 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 739a470f-ce8d-51c6-83ce-2bacf42e9c8d with identifier: BV09%20OZT to the API
2026-03-28 14:01:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:01:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:01:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=1&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 184,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=BV09%20OZT-GB',
'category': 'Car',
'color': 'black',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.8L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol',
'id': '739a470f-ce8d-51c6-83ce-2bacf42e9c8d',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'BV09 OZT',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=BV09%20OZT&vehicleType=*',
'listing': 'auction',
'location': 'Crawley',
'make': 'VAUXHALL',
'model': 'ASTRA',
'odometer': 98439,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2009-01-01',
'seller_name': None,
'title': 'VAUXHALL ASTRA 1.8 VVT CLUB Hatchback',
'transmission': 'automatic',
'trim': 'VVT CLUB',
'vin': 'W0L0AHL4898032924',
'year': 2009}
2026-03-28 14:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BV09%2520OZT%27 HTTP/1.1" 200 None
2026-03-28 14:01:19 [bca.uk] INFO: Saving data for BV09%20OZT: {'auction_closing_time': 1774864800.0, 'created_time': 1774390311.621498, 'last_price_update_time': 1774706479.714077}
2026-03-28 14:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='BV09%2520OZT') HTTP/1.1" 204 0
2026-03-28 14:01:19 [bca.uk] INFO: Found listing with ID: EA67%20PUX
2026-03-28 14:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27EA67%2520PUX%27 HTTP/1.1" 200 None
2026-03-28 14:01:19 [bca.uk] INFO: Scrape type for EA67%20PUX: 1
2026-03-28 14:01:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: efe9536c-07f4-51cc-8c8c-b67b73b93c1d with identifier: EA67%20PUX
2026-03-28 14:01:19 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item efe9536c-07f4-51cc-8c8c-b67b73b93c1d
2026-03-28 14:01:19 [bca.uk] INFO: Found listing with ID: LM11%20RXV
2026-03-28 14:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LM11%2520RXV%27 HTTP/1.1" 200 None
2026-03-28 14:01:19 [bca.uk] INFO: Scrape type for LM11%20RXV: 1
2026-03-28 14:01:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8d240778-137c-5daf-bc26-32539d983300 with identifier: LM11%20RXV
2026-03-28 14:01:19 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 8d240778-137c-5daf-bc26-32539d983300
2026-03-28 14:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698929371%27 HTTP/1.1" 200 None
2026-03-28 14:01:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698929371 not downloaded yet
2026-03-28 14:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698928890%27 HTTP/1.1" 200 None
2026-03-28 14:01:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698928890 not downloaded yet
2026-03-28 14:01:19 [bca.uk] INFO: Found listing with ID: LX10%20XUF
2026-03-28 14:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LX10%2520XUF%27 HTTP/1.1" 200 None
2026-03-28 14:01:19 [bca.uk] INFO: Scrape type for LX10%20XUF: 0
2026-03-28 14:01:19 [bca.uk] INFO: Found listing with ID: MF62%20LBL
2026-03-28 14:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MF62%2520LBL%27 HTTP/1.1" 200 None
2026-03-28 14:01:19 [bca.uk] INFO: Scrape type for MF62%20LBL: 0
2026-03-28 14:01:19 [bca.uk] INFO: Found listing with ID: RE59%20MXM
2026-03-28 14:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27RE59%2520MXM%27 HTTP/1.1" 200 None
2026-03-28 14:01:19 [bca.uk] INFO: Scrape type for RE59%20MXM: 0
2026-03-28 14:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698929339%27 HTTP/1.1" 200 None
2026-03-28 14:01:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698929339 not downloaded yet
2026-03-28 14:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698923494%27 HTTP/1.1" 200 None
2026-03-28 14:01:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698923494 not downloaded yet
2026-03-28 14:01:19 [bca.uk] INFO: Found listing with ID: GU14%20USS
2026-03-28 14:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GU14%2520USS%27 HTTP/1.1" 200 None
2026-03-28 14:01:20 [bca.uk] INFO: Scrape type for GU14%20USS: 1
2026-03-28 14:01:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 356c7b48-0ca4-5934-ba83-5b447228ae4f with identifier: GU14%20USS
2026-03-28 14:01:20 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 356c7b48-0ca4-5934-ba83-5b447228ae4f
2026-03-28 14:01:20 [bca.uk] INFO: Found listing with ID: DT16%20AWH
2026-03-28 14:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DT16%2520AWH%27 HTTP/1.1" 200 None
2026-03-28 14:01:20 [bca.uk] INFO: Scrape type for DT16%20AWH: 1
2026-03-28 14:01:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 92f1052e-2c5b-500c-801d-40376c1b4f7c with identifier: DT16%20AWH
2026-03-28 14:01:20 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 92f1052e-2c5b-500c-801d-40376c1b4f7c
2026-03-28 14:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698928920%27 HTTP/1.1" 200 None
2026-03-28 14:01:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698928920 not downloaded yet
2026-03-28 14:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698929349%27 HTTP/1.1" 200 None
2026-03-28 14:01:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698929349 not downloaded yet
2026-03-28 14:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698923517%27 HTTP/1.1" 200 None
2026-03-28 14:01:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698923517 not downloaded yet
2026-03-28 14:01:20 [bca.uk] INFO: Found listing with ID: ND17%20WHW
2026-03-28 14:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27ND17%2520WHW%27 HTTP/1.1" 200 None
2026-03-28 14:01:20 [bca.uk] INFO: Scrape type for ND17%20WHW: 1
2026-03-28 14:01:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 31c4dc0e-1523-5c6f-a08c-e446dee9483c with identifier: ND17%20WHW
2026-03-28 14:01:20 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 31c4dc0e-1523-5c6f-a08c-e446dee9483c
2026-03-28 14:01:20 [bca.uk] INFO: Found listing with ID: VK20%20NNO
2026-03-28 14:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27VK20%2520NNO%27 HTTP/1.1" 200 None
2026-03-28 14:01:20 [bca.uk] INFO: Scrape type for VK20%20NNO: 0
2026-03-28 14:01:20 [bca.uk] INFO: Found listing with ID: PE68%20ZNM
2026-03-28 14:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27PE68%2520ZNM%27 HTTP/1.1" 200 None
2026-03-28 14:01:20 [bca.uk] INFO: Scrape type for PE68%20ZNM: 0
2026-03-28 14:01:20 [bca.uk] INFO: Found listing with ID: SB72%20GWA
2026-03-28 14:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SB72%2520GWA%27 HTTP/1.1" 200 None
2026-03-28 14:01:20 [bca.uk] INFO: Scrape type for SB72%20GWA: 1
2026-03-28 14:01:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 76904bbf-2ca2-5c17-a3c3-eefa3b562aab with identifier: SB72%20GWA
2026-03-28 14:01:20 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 76904bbf-2ca2-5c17-a3c3-eefa3b562aab
2026-03-28 14:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698928941%27 HTTP/1.1" 200 None
2026-03-28 14:01:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698928941 not downloaded yet
2026-03-28 14:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698923535%27 HTTP/1.1" 200 None
2026-03-28 14:01:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698923535 not downloaded yet
2026-03-28 14:01:20 [bca.uk] INFO: Found listing with ID: WA15%20XTF
2026-03-28 14:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WA15%2520XTF%27 HTTP/1.1" 200 None
2026-03-28 14:01:20 [bca.uk] INFO: Scrape type for WA15%20XTF: 1
2026-03-28 14:01:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 012921cb-8763-5e72-9bbe-1684326c9a1d with identifier: WA15%20XTF
2026-03-28 14:01:20 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 012921cb-8763-5e72-9bbe-1684326c9a1d
2026-03-28 14:01:20 [bca.uk] INFO: Found listing with ID: SJ22%20EHM
2026-03-28 14:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SJ22%2520EHM%27 HTTP/1.1" 200 None
2026-03-28 14:01:20 [bca.uk] INFO: Scrape type for SJ22%20EHM: 0
2026-03-28 14:01:20 [bca.uk] INFO: Found listing with ID: C5%20BLJ
2026-03-28 14:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27C5%2520BLJ%27 HTTP/1.1" 200 None
2026-03-28 14:01:20 [bca.uk] INFO: Scrape type for C5%20BLJ: 2
2026-03-28 14:01:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 47405fe7-0903-5af2-a9cf-1594e57b263d with identifier: C5%20BLJ
2026-03-28 14:01:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 47405fe7-0903-5af2-a9cf-1594e57b263d with scrape type 2
2026-03-28 14:01:20 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 47405fe7-0903-5af2-a9cf-1594e57b263d with scrape type 2
2026-03-28 14:01:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 47405fe7-0903-5af2-a9cf-1594e57b263d, identifier: C5%20BLJ
2026-03-28 14:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698928965%27 HTTP/1.1" 200 None
2026-03-28 14:01:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698928965 not downloaded yet
2026-03-28 14:01:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 47405fe7-0903-5af2-a9cf-1594e57b263d with identifier: C5%20BLJ
2026-03-28 14:01:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-28 14:01:20 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=grey HTTP/1.1" 200 None
2026-03-28 14:01:20 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-28 14:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-28 14:01:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 47405fe7-0903-5af2-a9cf-1594e57b263d with identifier: C5%20BLJ
2026-03-28 14:01:20 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 47405fe7-0903-5af2-a9cf-1594e57b263d with identifier: C5%20BLJ to the API
2026-03-28 14:01:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:01:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:01:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=3&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 150,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=C5%20BLJ-GB',
'category': 'Car',
'color': 'grey',
'currency': 'GBP',
'doors_number': 5,
'engine': '3.0L',
'expiration_date': '2026-03-31T10:00:00Z',
'fuel_type': 'Diesel',
'id': '47405fe7-0903-5af2-a9cf-1594e57b263d',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'C5 BLJ',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=C5%20BLJ&vehicleType=*',
'listing': 'auction',
'location': 'Glasgow - East',
'make': 'AUDI',
'model': 'A7 SPORTBACK',
'odometer': 41952,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-01-01',
'seller_name': None,
'title': 'AUDI A7 SPORTBACK 3.0 50 TDI QUATTRO S LINE TIP Hatchback',
'transmission': 'manual',
'trim': '50 TDI QUATTRO S LINE TIP',
'vin': 'WAUZZZF21LN005870',
'year': 2019}
2026-03-28 14:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27C5%2520BLJ%27 HTTP/1.1" 200 None
2026-03-28 14:01:20 [bca.uk] INFO: Saving data for C5%20BLJ: {'auction_closing_time': 1774951200.0, 'created_time': 1774562677.866061, 'last_price_update_time': 1774706480.934058}
2026-03-28 14:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='C5%2520BLJ') HTTP/1.1" 204 0
2026-03-28 14:01:21 [bca.uk] INFO: Found listing with ID: YW64%20DGU
2026-03-28 14:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YW64%2520DGU%27 HTTP/1.1" 200 None
2026-03-28 14:01:21 [bca.uk] INFO: Scrape type for YW64%20DGU: 1
2026-03-28 14:01:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5b546abb-9cfb-537e-b2ac-6d60a5514e55 with identifier: YW64%20DGU
2026-03-28 14:01:21 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 5b546abb-9cfb-537e-b2ac-6d60a5514e55
2026-03-28 14:01:21 [bca.uk] INFO: Found listing with ID: DN19%20HKK
2026-03-28 14:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DN19%2520HKK%27 HTTP/1.1" 200 None
2026-03-28 14:01:21 [bca.uk] INFO: Scrape type for DN19%20HKK: 0
2026-03-28 14:01:21 [bca.uk] INFO: Found listing with ID: SC18%20HNF
2026-03-28 14:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SC18%2520HNF%27 HTTP/1.1" 200 None
2026-03-28 14:01:21 [bca.uk] INFO: Scrape type for SC18%20HNF: 0
2026-03-28 14:01:21 [bca.uk] INFO: Found listing with ID: SM22%20URS
2026-03-28 14:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SM22%2520URS%27 HTTP/1.1" 200 None
2026-03-28 14:01:21 [bca.uk] INFO: Scrape type for SM22%20URS: 0
2026-03-28 14:01:21 [bca.uk] INFO: Found listing with ID: SF65%20MRS
2026-03-28 14:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SF65%2520MRS%27 HTTP/1.1" 200 None
2026-03-28 14:01:21 [bca.uk] INFO: Scrape type for SF65%20MRS: 1
2026-03-28 14:01:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 228041df-5797-5c8f-89c8-2a337a640ead with identifier: SF65%20MRS
2026-03-28 14:01:21 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 228041df-5797-5c8f-89c8-2a337a640ead
2026-03-28 14:01:21 [bca.uk] INFO: Found listing with ID: AM58%20MHU
2026-03-28 14:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27AM58%2520MHU%27 HTTP/1.1" 200 None
2026-03-28 14:01:21 [bca.uk] INFO: Scrape type for AM58%20MHU: 1
2026-03-28 14:01:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 29da6c1c-854f-50ff-9030-4ad1ff36e423 with identifier: AM58%20MHU
2026-03-28 14:01:21 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 29da6c1c-854f-50ff-9030-4ad1ff36e423
2026-03-28 14:01:21 [bca.uk] INFO: Found listing with ID: SH14%20BOU
2026-03-28 14:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SH14%2520BOU%27 HTTP/1.1" 200 None
2026-03-28 14:01:21 [bca.uk] INFO: Scrape type for SH14%20BOU: 1
2026-03-28 14:01:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7ca8ff92-ba13-58b4-8b9a-c74a2e2ed8c1 with identifier: SH14%20BOU
2026-03-28 14:01:21 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 7ca8ff92-ba13-58b4-8b9a-c74a2e2ed8c1
2026-03-28 14:01:21 [bca.uk] INFO: Found listing with ID: GU10%20UYN
2026-03-28 14:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GU10%2520UYN%27 HTTP/1.1" 200 None
2026-03-28 14:01:21 [bca.uk] INFO: Scrape type for GU10%20UYN: 1
2026-03-28 14:01:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 24b3d1e2-9046-567a-ba39-2d683a6b4342 with identifier: GU10%20UYN
2026-03-28 14:01:21 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 24b3d1e2-9046-567a-ba39-2d683a6b4342
2026-03-28 14:01:21 [bca.uk] INFO: Found listing with ID: SB65%20CAX
2026-03-28 14:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SB65%2520CAX%27 HTTP/1.1" 200 None
2026-03-28 14:01:21 [bca.uk] INFO: Scrape type for SB65%20CAX: 1
2026-03-28 14:01:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 05412951-b5cb-5847-b7df-8f166615ed23 with identifier: SB65%20CAX
2026-03-28 14:01:21 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 05412951-b5cb-5847-b7df-8f166615ed23
2026-03-28 14:01:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BX06AVC/698920515/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/BX06AVC/42809716?sv=2020-08-04&st=2026-03-28T14%3A01%3A02Z&se=2026-03-28T14%3A26%3A02Z&sr=b&sp=r&sig=977AimHC9Bz1l7hKD9ZmlbFuhdYPzzwcOGUBuBpHaxA%3D)
2026-03-28 14:01:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VX19OYP/698250987/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/VX19OYP/42810376?sv=2020-08-04&st=2026-03-28T14%3A01%3A04Z&se=2026-03-28T14%3A26%3A04Z&sr=b&sp=r&sig=ZoloAWIhiMuraB8%2BrUA7GYd%2BDLx9PxJOBzKxmER1A8U%3D)
2026-03-28 14:01:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FY68WNB/698106282/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/FY68WNB/42810373?sv=2020-08-04&st=2026-03-28T14%3A01%3A04Z&se=2026-03-28T14%3A26%3A04Z&sr=b&sp=r&sig=H2pJB0hzNCFCiICFkGnSt1gr2sn1tExob5yrsc4d3Vs%3D)
2026-03-28 14:01:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/OV64PLN/698965982/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/OV64PLN/42810653?sv=2020-08-04&st=2026-03-28T14%3A01%3A03Z&se=2026-03-28T14%3A26%3A03Z&sr=b&sp=r&sig=APMfuiYXypC%2F8k81EUjJVNUqGlQEUGUldS81rN8I%2FN0%3D)
2026-03-28 14:01:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KV60ZZA/698934278/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/KV60ZZA/42810415?sv=2020-08-04&st=2026-03-28T14%3A01%3A03Z&se=2026-03-28T14%3A26%3A03Z&sr=b&sp=r&sig=IuzavW0HE55HWRn715zywGMWMJJZSa9qrno76VZ5d%2FU%3D)
2026-03-28 14:01:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YH13CHD/698786485/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YH13CHD/42807762?sv=2020-08-04&st=2026-03-28T14%3A01%3A02Z&se=2026-03-28T14%3A26%3A02Z&sr=b&sp=r&sig=Kk3ZnO0H7wXbnR6jzpTNZkeJ9EaoXS3djv9g6kExg8o%3D)
2026-03-28 14:01:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RE59BXM/698980638/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/RE59BXM/42810393?sv=2020-08-04&st=2026-03-28T14%3A01%3A02Z&se=2026-03-28T14%3A26%3A02Z&sr=b&sp=r&sig=MksXwVSixqiZ62CEskJ2z5pOaVL%2BuYMKfzx3%2FgepvXw%3D)
2026-03-28 14:01:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BX06AVC/698920522/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/BX06AVC/42809716?sv=2020-08-04&st=2026-03-28T14%3A01%3A02Z&se=2026-03-28T14%3A26%3A02Z&sr=b&sp=r&sig=977AimHC9Bz1l7hKD9ZmlbFuhdYPzzwcOGUBuBpHaxA%3D)
2026-03-28 14:01:21 [bca.uk] INFO: Found listing with ID: KM67%20WBP
2026-03-28 14:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KM67%2520WBP%27 HTTP/1.1" 200 None
2026-03-28 14:01:21 [bca.uk] INFO: Scrape type for KM67%20WBP: 1
2026-03-28 14:01:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e944d65b-4e9e-513c-a6ae-acea2437087d with identifier: KM67%20WBP
2026-03-28 14:01:21 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item e944d65b-4e9e-513c-a6ae-acea2437087d
2026-03-28 14:01:21 [bca.uk] INFO: Found listing with ID: WP61%20YGA
2026-03-28 14:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WP61%2520YGA%27 HTTP/1.1" 200 None
2026-03-28 14:01:21 [bca.uk] INFO: Scrape type for WP61%20YGA: 0
2026-03-28 14:01:21 [bca.uk] INFO: Found listing with ID: YF08%20KHP
2026-03-28 14:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YF08%2520KHP%27 HTTP/1.1" 200 None
2026-03-28 14:01:21 [bca.uk] INFO: Scrape type for YF08%20KHP: 0
2026-03-28 14:01:21 [bca.uk] INFO: Found listing with ID: YH60%20WLJ
2026-03-28 14:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YH60%2520WLJ%27 HTTP/1.1" 200 None
2026-03-28 14:01:21 [bca.uk] INFO: Scrape type for YH60%20WLJ: 0
2026-03-28 14:01:21 [bca.uk] INFO: Found listing with ID: YS61%20PYP
2026-03-28 14:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YS61%2520PYP%27 HTTP/1.1" 200 None
2026-03-28 14:01:21 [bca.uk] INFO: Scrape type for YS61%20PYP: 0
2026-03-28 14:01:21 [bca.uk] INFO: Found listing with ID: BO55%20VOP
2026-03-28 14:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BO55%2520VOP%27 HTTP/1.1" 200 None
2026-03-28 14:01:21 [bca.uk] INFO: Scrape type for BO55%20VOP: 1
2026-03-28 14:01:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0df2aa72-34d7-5e00-86eb-dff801f0634b with identifier: BO55%20VOP
2026-03-28 14:01:21 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 0df2aa72-34d7-5e00-86eb-dff801f0634b
2026-03-28 14:01:21 [bca.uk] INFO: Found listing with ID: LX66%20XGU
2026-03-28 14:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LX66%2520XGU%27 HTTP/1.1" 200 None
2026-03-28 14:01:21 [bca.uk] INFO: Scrape type for LX66%20XGU: 1
2026-03-28 14:01:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 59e0d1bf-73d7-5811-a0ff-a2a694262d4e with identifier: LX66%20XGU
2026-03-28 14:01:21 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 59e0d1bf-73d7-5811-a0ff-a2a694262d4e
2026-03-28 14:01:21 [bca.uk] INFO: Found listing with ID: DN62%20LRA
2026-03-28 14:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DN62%2520LRA%27 HTTP/1.1" 200 None
2026-03-28 14:01:21 [bca.uk] INFO: Scrape type for DN62%20LRA: 0
2026-03-28 14:01:21 [bca.uk] INFO: Found listing with ID: KS11%20MJV
2026-03-28 14:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KS11%2520MJV%27 HTTP/1.1" 200 None
2026-03-28 14:01:21 [bca.uk] INFO: Scrape type for KS11%20MJV: 0
2026-03-28 14:01:21 [bca.uk] INFO: Found listing with ID: MF12%20UUT
2026-03-28 14:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MF12%2520UUT%27 HTTP/1.1" 200 None
2026-03-28 14:01:21 [bca.uk] INFO: Scrape type for MF12%20UUT: 2
2026-03-28 14:01:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 84896659-99c4-56b4-ba12-a6ae9ed61b99 with identifier: MF12%20UUT
2026-03-28 14:01:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 84896659-99c4-56b4-ba12-a6ae9ed61b99 with scrape type 2
2026-03-28 14:01:21 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 84896659-99c4-56b4-ba12-a6ae9ed61b99 with scrape type 2
2026-03-28 14:01:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 84896659-99c4-56b4-ba12-a6ae9ed61b99, identifier: MF12%20UUT
2026-03-28 14:01:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 84896659-99c4-56b4-ba12-a6ae9ed61b99 with identifier: MF12%20UUT
2026-03-28 14:01:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 84896659-99c4-56b4-ba12-a6ae9ed61b99 with identifier: MF12%20UUT
2026-03-28 14:01:21 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 84896659-99c4-56b4-ba12-a6ae9ed61b99 with identifier: MF12%20UUT to the API
2026-03-28 14:01:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:01:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:01:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=3&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 129,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=MF12%20UUT-GB',
'category': 'Car',
'color': 'silver',
'currency': 'GBP',
'doors_number': 4,
'engine': '2.1L',
'expiration_date': '2026-03-29T10:00:00Z',
'fuel_type': 'Diesel',
'id': '84896659-99c4-56b4-ba12-a6ae9ed61b99',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'MF12 UUT',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=MF12%20UUT&vehicleType=*',
'listing': 'auction',
'location': 'Glasgow - East',
'make': 'MERCEDES-BENZ',
'model': 'C200',
'odometer': 52266,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2012-01-01',
'seller_name': None,
'title': 'MERCEDES-BENZ C200 2.1 CDI B/E SE Saloon',
'transmission': 'manual',
'trim': 'CDI B/E SE',
'vin': 'WDD2040012A676061',
'year': 2012}
2026-03-28 14:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MF12%2520UUT%27 HTTP/1.1" 200 None
2026-03-28 14:01:22 [bca.uk] INFO: Saving data for MF12%20UUT: {'auction_closing_time': 1774778400.0, 'created_time': 1773931056.782606, 'last_price_update_time': 1774706482.125934}
2026-03-28 14:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='MF12%2520UUT') HTTP/1.1" 204 0
2026-03-28 14:01:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:01:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c6f3ad0>
2026-03-28 14:01:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:01:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:01:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:01:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7086d3db-bd6a-5ab0-9b74-8f1cf370adf4/7086d3db-bd6a-5ab0-9b74-8f1cf370adf4_image_0.jpg HTTP/1.1" 201 0
2026-03-28 14:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FBX06AVC%252F698920515%252F600') HTTP/1.1" 204 0
2026-03-28 14:01:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BX06AVC/698920515/600 saved to cache
2026-03-28 14:01:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 7086d3db-bd6a-5ab0-9b74-8f1cf370adf4
2026-03-28 14:01:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:01:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c52aad0>
2026-03-28 14:01:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:01:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:01:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:01:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b7b36a17-d5d4-5e94-9bbf-8a754ca74b60/b7b36a17-d5d4-5e94-9bbf-8a754ca74b60_image_0.jpg HTTP/1.1" 201 0
2026-03-28 14:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FVX19OYP%252F698250987%252F600') HTTP/1.1" 204 0
2026-03-28 14:01:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VX19OYP/698250987/600 saved to cache
2026-03-28 14:01:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item b7b36a17-d5d4-5e94-9bbf-8a754ca74b60
2026-03-28 14:01:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:01:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c727e50>
2026-03-28 14:01:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:01:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:01:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:01:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d8436e02-8218-5d88-bcc5-e01ffac7eb8e/d8436e02-8218-5d88-bcc5-e01ffac7eb8e_image_0.jpg HTTP/1.1" 201 0
2026-03-28 14:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FFY68WNB%252F698106282%252F600') HTTP/1.1" 204 0
2026-03-28 14:01:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FY68WNB/698106282/600 saved to cache
2026-03-28 14:01:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item d8436e02-8218-5d88-bcc5-e01ffac7eb8e
2026-03-28 14:01:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:01:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c6f2810>
2026-03-28 14:01:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:01:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:01:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:01:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d75bc751-3167-5395-a067-9fe76cc20a2d/d75bc751-3167-5395-a067-9fe76cc20a2d_image_0.jpg HTTP/1.1" 201 0
2026-03-28 14:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FOV64PLN%252F698965982%252F600') HTTP/1.1" 204 0
2026-03-28 14:01:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/OV64PLN/698965982/600 saved to cache
2026-03-28 14:01:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item d75bc751-3167-5395-a067-9fe76cc20a2d
2026-03-28 14:01:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:01:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c38d250>
2026-03-28 14:01:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:01:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:01:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:01:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3f54d261-9f82-51f4-9ce3-cc4413b8b6c4/3f54d261-9f82-51f4-9ce3-cc4413b8b6c4_image_0.jpg HTTP/1.1" 201 0
2026-03-28 14:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FKV60ZZA%252F698934278%252F600') HTTP/1.1" 204 0
2026-03-28 14:01:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KV60ZZA/698934278/600 saved to cache
2026-03-28 14:01:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 3f54d261-9f82-51f4-9ce3-cc4413b8b6c4
2026-03-28 14:01:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:01:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a1fd35a90>
2026-03-28 14:01:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:01:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:01:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:01:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dabe1fc4-09bf-52ef-9042-78b5e1d2db10/dabe1fc4-09bf-52ef-9042-78b5e1d2db10_image_0.jpg HTTP/1.1" 201 0
2026-03-28 14:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FYH13CHD%252F698786485%252F600') HTTP/1.1" 204 0
2026-03-28 14:01:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YH13CHD/698786485/600 saved to cache
2026-03-28 14:01:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item dabe1fc4-09bf-52ef-9042-78b5e1d2db10
2026-03-28 14:01:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:01:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c52bb90>
2026-03-28 14:01:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:01:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:01:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:01:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5e732f50-42ac-5666-996c-316bc1354f8d/5e732f50-42ac-5666-996c-316bc1354f8d_image_0.jpg HTTP/1.1" 201 0
2026-03-28 14:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FRE59BXM%252F698980638%252F600') HTTP/1.1" 204 0
2026-03-28 14:01:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RE59BXM/698980638/600 saved to cache
2026-03-28 14:01:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 5e732f50-42ac-5666-996c-316bc1354f8d
2026-03-28 14:01:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:01:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a1fd618d0>
2026-03-28 14:01:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:01:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:01:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:01:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7086d3db-bd6a-5ab0-9b74-8f1cf370adf4/7086d3db-bd6a-5ab0-9b74-8f1cf370adf4_image_1.jpg HTTP/1.1" 201 0
2026-03-28 14:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FBX06AVC%252F698920522%252F600') HTTP/1.1" 204 0
2026-03-28 14:01:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BX06AVC/698920522/600 saved to cache
2026-03-28 14:01:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 7086d3db-bd6a-5ab0-9b74-8f1cf370adf4
2026-03-28 14:01:22 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LR11XWM/697880795/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=697880795>
2026-03-28 14:01:22 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/ND17VGZ/698929290/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698929290>
2026-03-28 14:01:22 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EX10BXE/698923402/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698923402>
2026-03-28 14:01:22 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EA24TKX/698296277/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698296277>
2026-03-28 14:01:22 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GF57MWW/698928797/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698928797>
2026-03-28 14:01:22 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WV13ZTH/698929321/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698929321>
2026-03-28 14:01:22 [bca.uk] INFO: Found listing with ID: RE12%20OHA
2026-03-28 14:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27RE12%2520OHA%27 HTTP/1.1" 200 None
2026-03-28 14:01:22 [bca.uk] INFO: Scrape type for RE12%20OHA: 1
2026-03-28 14:01:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f1c7ee15-186c-50e6-9aec-cc206e8adf16 with identifier: RE12%20OHA
2026-03-28 14:01:22 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item f1c7ee15-186c-50e6-9aec-cc206e8adf16
2026-03-28 14:01:22 [bca.uk] INFO: Found listing with ID: SC16%20MWA
2026-03-28 14:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SC16%2520MWA%27 HTTP/1.1" 200 None
2026-03-28 14:01:22 [bca.uk] INFO: Scrape type for SC16%20MWA: 0
2026-03-28 14:01:22 [bca.uk] INFO: Found listing with ID: SC61%20EHM
2026-03-28 14:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SC61%2520EHM%27 HTTP/1.1" 200 None
2026-03-28 14:01:22 [bca.uk] INFO: Scrape type for SC61%20EHM: 0
2026-03-28 14:01:22 [bca.uk] INFO: Found listing with ID: SL60%20AKU
2026-03-28 14:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SL60%2520AKU%27 HTTP/1.1" 200 None
2026-03-28 14:01:22 [bca.uk] INFO: Scrape type for SL60%20AKU: 0
2026-03-28 14:01:22 [bca.uk] INFO: Found listing with ID: SW60%20LHD
2026-03-28 14:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SW60%2520LHD%27 HTTP/1.1" 200 None
2026-03-28 14:01:22 [bca.uk] INFO: Scrape type for SW60%20LHD: 0
2026-03-28 14:01:22 [bca.uk] INFO: Found listing with ID: VA67%20MVC
2026-03-28 14:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27VA67%2520MVC%27 HTTP/1.1" 200 None
2026-03-28 14:01:22 [bca.uk] INFO: Scrape type for VA67%20MVC: 0
2026-03-28 14:01:22 [bca.uk] INFO: Found listing with ID: MJ61%20CYK
2026-03-28 14:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MJ61%2520CYK%27 HTTP/1.1" 200 None
2026-03-28 14:01:22 [bca.uk] INFO: Scrape type for MJ61%20CYK: 0
2026-03-28 14:01:22 [bca.uk] INFO: Found listing with ID: OE60%20WYJ
2026-03-28 14:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27OE60%2520WYJ%27 HTTP/1.1" 200 None
2026-03-28 14:01:22 [bca.uk] INFO: Scrape type for OE60%20WYJ: 0
2026-03-28 14:01:22 [bca.uk] INFO: Found listing with ID: KO15%20JZW
2026-03-28 14:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KO15%2520JZW%27 HTTP/1.1" 200 None
2026-03-28 14:01:23 [bca.uk] INFO: Scrape type for KO15%20JZW: 1
2026-03-28 14:01:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7cdb5790-795c-503b-b01e-2ccf288a1773 with identifier: KO15%20JZW
2026-03-28 14:01:23 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 7cdb5790-795c-503b-b01e-2ccf288a1773
2026-03-28 14:01:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/VO17FMZ/42810377?sv=2020-08-04&st=2026-03-28T14%3A01%3A10Z&se=2026-03-28T14%3A26%3A10Z&sr=b&sp=r&sig=PEm9gdKL%2BNRnVtrVK0%2F5sWr2YcEbrtVNzeob8CJbr3c%3D> (referer: https://www.bca.co.uk/)
2026-03-28 14:01:23 [bca.uk] INFO: Found listing with ID: VE67%20DLJ
2026-03-28 14:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27VE67%2520DLJ%27 HTTP/1.1" 200 None
2026-03-28 14:01:23 [bca.uk] INFO: Scrape type for VE67%20DLJ: 1
2026-03-28 14:01:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 306d9676-19ce-5840-84c5-e10231e34614 with identifier: VE67%20DLJ
2026-03-28 14:01:23 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 306d9676-19ce-5840-84c5-e10231e34614
2026-03-28 14:01:23 [bca.uk] INFO: Found listing with ID: HV58%20YJY
2026-03-28 14:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27HV58%2520YJY%27 HTTP/1.1" 200 None
2026-03-28 14:01:23 [bca.uk] INFO: Scrape type for HV58%20YJY: 1
2026-03-28 14:01:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8b64f21f-1ee3-5237-8105-b88b835030a8 with identifier: HV58%20YJY
2026-03-28 14:01:23 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 8b64f21f-1ee3-5237-8105-b88b835030a8
2026-03-28 14:01:23 [bca.uk] INFO: Found listing with ID: FA18%20OJS
2026-03-28 14:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FA18%2520OJS%27 HTTP/1.1" 200 None
2026-03-28 14:01:23 [bca.uk] INFO: Scrape type for FA18%20OJS: 1
2026-03-28 14:01:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 73dc1fed-646a-544c-b3e5-ff1b6aff4358 with identifier: FA18%20OJS
2026-03-28 14:01:23 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 73dc1fed-646a-544c-b3e5-ff1b6aff4358
2026-03-28 14:01:23 [bca.uk] INFO: Found listing with ID: EP19%20XHA
2026-03-28 14:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27EP19%2520XHA%27 HTTP/1.1" 200 None
2026-03-28 14:01:23 [bca.uk] INFO: Scrape type for EP19%20XHA: 1
2026-03-28 14:01:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 85df4e80-1e5a-5573-ad99-0445a298364d with identifier: EP19%20XHA
2026-03-28 14:01:23 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 85df4e80-1e5a-5573-ad99-0445a298364d
2026-03-28 14:01:23 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/SF65MRS/42810141?sv=2020-08-04&st=2026-03-28T14%3A01%3A23Z&se=2026-03-28T14%3A26%3A23Z&sr=b&sp=r&sig=pKcKPXIMRDrpvR7qgfCAU8Cghh7jF%2FL25jpHeT9Gs0U%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=SF65%20MRS-GB>
2026-03-28 14:01:23 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/GU10UYN/42810320?sv=2020-08-04&st=2026-03-28T14%3A01%3A23Z&se=2026-03-28T14%3A26%3A23Z&sr=b&sp=r&sig=mGNhX9MAfZVu5g6PpXH03XgVnNc%2FnLjEd8Y2gqIppCM%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=GU10%20UYN-GB>
2026-03-28 14:01:23 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/AM58MHU/42810635?sv=2020-08-04&st=2026-03-28T14%3A01%3A23Z&se=2026-03-28T14%3A26%3A23Z&sr=b&sp=r&sig=MTxN3XqRDWL9DG88ixDAxTc9KDbrCYbR3DQJ2mNHaYw%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=AM58%20MHU-GB>
2026-03-28 14:01:23 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/SB65CAX/42810123?sv=2020-08-04&st=2026-03-28T14%3A01%3A23Z&se=2026-03-28T14%3A26%3A23Z&sr=b&sp=r&sig=vTzzhGIuSP84%2BuZVufy4vR0mq7%2F9VRE2bdnD30Ub%2FBU%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=SB65%20CAX-GB>
2026-03-28 14:01:23 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/SH14BOU/42810142?sv=2020-08-04&st=2026-03-28T14%3A01%3A23Z&se=2026-03-28T14%3A26%3A23Z&sr=b&sp=r&sig=qF%2Fj8vLm9uL8z4mTnCxa7QRX8NL1HO0if01okEQdE50%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=SH14%20BOU-GB>
2026-03-28 14:01:23 [bca.uk] INFO: Found listing with ID: YN20%20XDY
2026-03-28 14:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YN20%2520XDY%27 HTTP/1.1" 200 None
2026-03-28 14:01:23 [bca.uk] INFO: Scrape type for YN20%20XDY: 0
2026-03-28 14:01:23 [bca.uk] INFO: Found listing with ID: CY68%20EOB
2026-03-28 14:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27CY68%2520EOB%27 HTTP/1.1" 200 None
2026-03-28 14:01:23 [bca.uk] INFO: Scrape type for CY68%20EOB: 1
2026-03-28 14:01:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 299c12ca-ac8c-5489-8f0d-0d144c80340f with identifier: CY68%20EOB
2026-03-28 14:01:23 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 299c12ca-ac8c-5489-8f0d-0d144c80340f
2026-03-28 14:01:23 [bca.uk] INFO: Found listing with ID: WM19%20BFN
2026-03-28 14:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WM19%2520BFN%27 HTTP/1.1" 200 None
2026-03-28 14:01:23 [bca.uk] INFO: Scrape type for WM19%20BFN: 1
2026-03-28 14:01:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 94badcac-d91d-5664-a6fe-32adc35ee01a with identifier: WM19%20BFN
2026-03-28 14:01:23 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 94badcac-d91d-5664-a6fe-32adc35ee01a
2026-03-28 14:01:23 [bca.uk] INFO: Found listing with ID: FH21%20UNX
2026-03-28 14:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FH21%2520UNX%27 HTTP/1.1" 200 None
2026-03-28 14:01:23 [bca.uk] INFO: Scrape type for FH21%20UNX: 1
2026-03-28 14:01:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a610f6fb-a046-5c2e-8701-0fcb295f97f1 with identifier: FH21%20UNX
2026-03-28 14:01:23 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item a610f6fb-a046-5c2e-8701-0fcb295f97f1
2026-03-28 14:01:23 [bca.uk] INFO: Found listing with ID: EJ19%20URS
2026-03-28 14:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27EJ19%2520URS%27 HTTP/1.1" 200 None
2026-03-28 14:01:23 [bca.uk] INFO: Scrape type for EJ19%20URS: 1
2026-03-28 14:01:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 755baf27-b55d-5033-a837-c4d9f3659c0e with identifier: EJ19%20URS
2026-03-28 14:01:23 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 755baf27-b55d-5033-a837-c4d9f3659c0e
2026-03-28 14:01:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:01:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2de545d0>
2026-03-28 14:01:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:01:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:01:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:01:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7b233ce6-aa01-5f24-ac34-ccc770845b54/7b233ce6-aa01-5f24-ac34-ccc770845b54_expert_report_file_2e38ca68-b965-4ee1-8df0-4bb2b832560c.pdf HTTP/1.1" 201 0
2026-03-28 14:01:23 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item 7b233ce6-aa01-5f24-ac34-ccc770845b54
2026-03-28 14:01:23 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 7b233ce6-aa01-5f24-ac34-ccc770845b54, skipping ID generation
2026-03-28 14:01:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 7b233ce6-aa01-5f24-ac34-ccc770845b54
2026-03-28 14:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DVO17FMZ-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-28 14:01:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=VO17FMZ-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-28 14:01:23 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GF57MWW/698928965/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698928965>
2026-03-28 14:01:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GF57MWW/698928797/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/GF57MWW/42810309?sv=2020-08-04&st=2026-03-28T14%3A01%3A09Z&se=2026-03-28T14%3A26%3A09Z&sr=b&sp=r&sig=hJTqt8SLdbJfAcgzLjUmqtORuHZL2E6pw%2FRYFmCkjK4%3D)
2026-03-28 14:01:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WV13ZTH/698929321/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/WV13ZTH/42810161?sv=2020-08-04&st=2026-03-28T14%3A01%3A04Z&se=2026-03-28T14%3A26%3A04Z&sr=b&sp=r&sig=hbqIghhD97wvMs5qjsvBMdrtSptsqnkIa342PcMgOiA%3D)
2026-03-28 14:01:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EX10BXE/698923402/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/EX10BXE/42809799?sv=2020-08-04&st=2026-03-28T14%3A01%3A07Z&se=2026-03-28T14%3A26%3A07Z&sr=b&sp=r&sig=xoEQIFwTRaF8ZPdiio47BQcwaxFkt4KEonwRoN8KxQM%3D)
2026-03-28 14:01:23 [bca.uk] INFO: Found listing with ID: UIG%204202
2026-03-28 14:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27UIG%25204202%27 HTTP/1.1" 200 None
2026-03-28 14:01:23 [bca.uk] INFO: Scrape type for UIG%204202: 0
2026-03-28 14:01:23 [bca.uk] INFO: Found listing with ID: YV19%20MBU
2026-03-28 14:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YV19%2520MBU%27 HTTP/1.1" 200 None
2026-03-28 14:01:23 [bca.uk] INFO: Scrape type for YV19%20MBU: 0
2026-03-28 14:01:23 [bca.uk] INFO: Found listing with ID: KR14%20OUW
2026-03-28 14:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KR14%2520OUW%27 HTTP/1.1" 200 None
2026-03-28 14:01:23 [bca.uk] INFO: Scrape type for KR14%20OUW: 1
2026-03-28 14:01:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5096b957-ac5c-5cc4-a891-49042e75677e with identifier: KR14%20OUW
2026-03-28 14:01:23 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 5096b957-ac5c-5cc4-a891-49042e75677e
2026-03-28 14:01:23 [bca.uk] INFO: Found listing with ID: HJ69%20WRA
2026-03-28 14:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27HJ69%2520WRA%27 HTTP/1.1" 200 None
2026-03-28 14:01:23 [bca.uk] INFO: Scrape type for HJ69%20WRA: 0
2026-03-28 14:01:23 [bca.uk] INFO: Found listing with ID: RE03%20XJT
2026-03-28 14:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27RE03%2520XJT%27 HTTP/1.1" 200 None
2026-03-28 14:01:23 [bca.uk] INFO: Scrape type for RE03%20XJT: 1
2026-03-28 14:01:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0d8a0ea5-df55-5526-b46c-23b49b8e0dc3 with identifier: RE03%20XJT
2026-03-28 14:01:23 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 0d8a0ea5-df55-5526-b46c-23b49b8e0dc3
2026-03-28 14:01:23 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/WA15XTF/42809463?sv=2020-08-04&st=2026-03-28T14%3A01%3A23Z&se=2026-03-28T14%3A26%3A23Z&sr=b&sp=r&sig=OVT1XXFunRJjcV5jy5Zgfxxi5O1xAq2cfTX%2F%2FcIif88%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=WA15%20XTF-GB>
2026-03-28 14:01:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EA24TKX/698296277/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/EA24TKX/42810378?sv=2020-08-04&st=2026-03-28T14%3A01%3A05Z&se=2026-03-28T14%3A26%3A05Z&sr=b&sp=r&sig=Ajk9rVQfTHJs3R0cJnmP5VnSS5rSnHfV6UlI7D3mmDQ%3D)
2026-03-28 14:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698274394%27 HTTP/1.1" 200 None
2026-03-28 14:01:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698274394 not downloaded yet
2026-03-28 14:01:23 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/X28AVE/698923783/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698923783>
2026-03-28 14:01:23 [bca.uk] INFO: Found listing with ID: NG74%20PZW
2026-03-28 14:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27NG74%2520PZW%27 HTTP/1.1" 200 None
2026-03-28 14:01:23 [bca.uk] INFO: Scrape type for NG74%20PZW: 0
2026-03-28 14:01:23 [bca.uk] INFO: Found listing with ID: NK68%20VWG
2026-03-28 14:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27NK68%2520VWG%27 HTTP/1.1" 200 None
2026-03-28 14:01:23 [bca.uk] INFO: Scrape type for NK68%20VWG: 0
2026-03-28 14:01:23 [bca.uk] INFO: Found listing with ID: OE74%20XKB
2026-03-28 14:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27OE74%2520XKB%27 HTTP/1.1" 200 None
2026-03-28 14:01:23 [bca.uk] INFO: Scrape type for OE74%20XKB: 0
2026-03-28 14:01:23 [bca.uk] INFO: Found listing with ID: NA69%20WCT
2026-03-28 14:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27NA69%2520WCT%27 HTTP/1.1" 200 None
2026-03-28 14:01:23 [bca.uk] INFO: Scrape type for NA69%20WCT: 0
2026-03-28 14:01:23 [bca.uk] INFO: Found listing with ID: ND70%20LZE
2026-03-28 14:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27ND70%2520LZE%27 HTTP/1.1" 200 None
2026-03-28 14:01:23 [bca.uk] INFO: Scrape type for ND70%20LZE: 0
2026-03-28 14:01:23 [bca.uk] INFO: Found listing with ID: NJ64%20DZS
2026-03-28 14:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27NJ64%2520DZS%27 HTTP/1.1" 200 None
2026-03-28 14:01:23 [bca.uk] INFO: Scrape type for NJ64%20DZS: 0
2026-03-28 14:01:23 [bca.uk] INFO: Found listing with ID: VK65%20XNW
2026-03-28 14:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27VK65%2520XNW%27 HTTP/1.1" 200 None
2026-03-28 14:01:23 [bca.uk] INFO: Scrape type for VK65%20XNW: 1
2026-03-28 14:01:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: defab1ac-857d-50f7-901c-50783b029725 with identifier: VK65%20XNW
2026-03-28 14:01:23 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item defab1ac-857d-50f7-901c-50783b029725
2026-03-28 14:01:23 [bca.uk] INFO: Found listing with ID: VO62%20RAU
2026-03-28 14:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27VO62%2520RAU%27 HTTP/1.1" 200 None
2026-03-28 14:01:23 [bca.uk] INFO: Scrape type for VO62%20RAU: 1
2026-03-28 14:01:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 60bcb64c-26b9-5747-8fc6-986efaa78996 with identifier: VO62%20RAU
2026-03-28 14:01:23 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 60bcb64c-26b9-5747-8fc6-986efaa78996
2026-03-28 14:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698274399%27 HTTP/1.1" 200 None
2026-03-28 14:01:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698274399 not downloaded yet
2026-03-28 14:01:23 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YW64DGU/42810194?sv=2020-08-04&st=2026-03-28T14%3A01%3A23Z&se=2026-03-28T14%3A26%3A23Z&sr=b&sp=r&sig=bKUUxkl%2FQOTN6xP3oKLYX53uOLW1seBVRfhSdF3FtAg%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=YW64%20DGU-GB>
2026-03-28 14:01:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/ND17VGZ/698929290/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/ND17VGZ/42810273?sv=2020-08-04&st=2026-03-28T14%3A01%3A05Z&se=2026-03-28T14%3A26%3A05Z&sr=b&sp=r&sig=Ddznt5rliWG2eSFSeV1iYUxjjPUcheWJt3FgNXERnUs%3D)
2026-03-28 14:01:23 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/KO15JZW/42809875?sv=2020-08-04&st=2026-03-28T14%3A01%3A23Z&se=2026-03-28T14%3A26%3A23Z&sr=b&sp=r&sig=WtTYXpKYofDjFDmXev3jjoySms%2BztrBA4DkuQ5Y14aQ%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=KO15%20JZW-GB>
2026-03-28 14:01:23 [bca.uk] INFO: Found listing with ID: YD66%20KFF
2026-03-28 14:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YD66%2520KFF%27 HTTP/1.1" 200 None
2026-03-28 14:01:23 [bca.uk] INFO: Scrape type for YD66%20KFF: 1
2026-03-28 14:01:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c163b1cf-cc62-5193-9026-6cea3a049e80 with identifier: YD66%20KFF
2026-03-28 14:01:23 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item c163b1cf-cc62-5193-9026-6cea3a049e80
2026-03-28 14:01:23 [bca.uk] INFO: Found listing with ID: SV23%20HXP
2026-03-28 14:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SV23%2520HXP%27 HTTP/1.1" 200 None
2026-03-28 14:01:23 [bca.uk] INFO: Scrape type for SV23%20HXP: 2
2026-03-28 14:01:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6b2e62a8-d39e-500b-8811-fdf071fe1b08 with identifier: SV23%20HXP
2026-03-28 14:01:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6b2e62a8-d39e-500b-8811-fdf071fe1b08 with scrape type 2
2026-03-28 14:01:23 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6b2e62a8-d39e-500b-8811-fdf071fe1b08 with scrape type 2
2026-03-28 14:01:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 6b2e62a8-d39e-500b-8811-fdf071fe1b08, identifier: SV23%20HXP
2026-03-28 14:01:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LR11XWM/697880795/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LR11XWM/42810294?sv=2020-08-04&st=2026-03-28T14%3A01%3A05Z&se=2026-03-28T14%3A26%3A05Z&sr=b&sp=r&sig=zHl%2Fkz2fSAoGVBY8ukVZULGVCGKqbTVidyooaEEBPNc%3D)
2026-03-28 14:01:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 6b2e62a8-d39e-500b-8811-fdf071fe1b08 with identifier: SV23%20HXP
2026-03-28 14:01:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-28 14:01:24 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=green HTTP/1.1" 200 None
2026-03-28 14:01:24 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-28 14:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-28 14:01:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 6b2e62a8-d39e-500b-8811-fdf071fe1b08 with identifier: SV23%20HXP
2026-03-28 14:01:24 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 6b2e62a8-d39e-500b-8811-fdf071fe1b08 with identifier: SV23%20HXP to the API
2026-03-28 14:01:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:01:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:01:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=3&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 151,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=SV23%20HXP-GB',
'category': 'Car',
'color': 'green',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.5L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol',
'id': '6b2e62a8-d39e-500b-8811-fdf071fe1b08',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'SV23 HXP',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=SV23%20HXP&vehicleType=*',
'listing': 'auction',
'location': 'Edinburgh',
'make': 'FORD',
'model': 'FIESTA',
'odometer': 24133,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2023-01-01',
'seller_name': None,
'title': 'FORD FIESTA 1.5 E/B 200 ST-3 Hatchback',
'transmission': 'manual',
'trim': 'E/B 200 ST-3',
'vin': 'WF0JXXGAHJNR76720',
'year': 2023}
2026-03-28 14:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SV23%2520HXP%27 HTTP/1.1" 200 None
2026-03-28 14:01:24 [bca.uk] INFO: Saving data for SV23%20HXP: {'auction_closing_time': 1774864800.0, 'created_time': 1774565272.854824, 'last_price_update_time': 1774706484.55342}
2026-03-28 14:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='SV23%2520HXP') HTTP/1.1" 204 0
2026-03-28 14:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698274406%27 HTTP/1.1" 200 None
2026-03-28 14:01:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698274406 not downloaded yet
2026-03-28 14:01:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:01:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2d9dd5d0>
2026-03-28 14:01:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:01:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:01:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:01:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cdcc838c-10d3-5f36-90c6-59ef07eececc/cdcc838c-10d3-5f36-90c6-59ef07eececc_image_2.jpg HTTP/1.1" 201 0
2026-03-28 14:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FGF57MWW%252F698928797%252F600') HTTP/1.1" 204 0
2026-03-28 14:01:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GF57MWW/698928797/600 saved to cache
2026-03-28 14:01:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item cdcc838c-10d3-5f36-90c6-59ef07eececc
2026-03-28 14:01:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:01:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c40dc50>
2026-03-28 14:01:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:01:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:01:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:01:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4766d63c-47f2-5b85-8b2c-c4d089a16b5c/4766d63c-47f2-5b85-8b2c-c4d089a16b5c_image_5.jpg HTTP/1.1" 201 0
2026-03-28 14:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FWV13ZTH%252F698929321%252F600') HTTP/1.1" 204 0
2026-03-28 14:01:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WV13ZTH/698929321/600 saved to cache
2026-03-28 14:01:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 4766d63c-47f2-5b85-8b2c-c4d089a16b5c
2026-03-28 14:01:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:01:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c40ffd0>
2026-03-28 14:01:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:01:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:01:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:01:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f5f9bed7-96bb-5ef8-8a52-e232dbf0b7d5/f5f9bed7-96bb-5ef8-8a52-e232dbf0b7d5_image_3.jpg HTTP/1.1" 201 0
2026-03-28 14:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FEX10BXE%252F698923402%252F600') HTTP/1.1" 204 0
2026-03-28 14:01:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EX10BXE/698923402/600 saved to cache
2026-03-28 14:01:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item f5f9bed7-96bb-5ef8-8a52-e232dbf0b7d5
2026-03-28 14:01:25 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:01:25 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:01:25 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:01:25 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:01:25 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:01:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:01:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c559110>
2026-03-28 14:01:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:01:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:01:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:01:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a936dd22-4905-520e-8ef4-c3c73c56eba4/a936dd22-4905-520e-8ef4-c3c73c56eba4_image_9.jpg HTTP/1.1" 201 0
2026-03-28 14:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FEA24TKX%252F698296277%252F600') HTTP/1.1" 204 0
2026-03-28 14:01:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EA24TKX/698296277/600 saved to cache
2026-03-28 14:01:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item a936dd22-4905-520e-8ef4-c3c73c56eba4
2026-03-28 14:01:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/AM58MHU/42810635?sv=2020-08-04&st=2026-03-28T14%3A01%3A23Z&se=2026-03-28T14%3A26%3A23Z&sr=b&sp=r&sig=MTxN3XqRDWL9DG88ixDAxTc9KDbrCYbR3DQJ2mNHaYw%3D> (referer: https://www.bca.co.uk/)
2026-03-28 14:01:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/SB65CAX/42810123?sv=2020-08-04&st=2026-03-28T14%3A01%3A23Z&se=2026-03-28T14%3A26%3A23Z&sr=b&sp=r&sig=vTzzhGIuSP84%2BuZVufy4vR0mq7%2F9VRE2bdnD30Ub%2FBU%3D> (referer: https://www.bca.co.uk/)
2026-03-28 14:01:25 [bca.uk] INFO: Found listing with ID: BL16%20UUB
2026-03-28 14:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BL16%2520UUB%27 HTTP/1.1" 200 None
2026-03-28 14:01:25 [bca.uk] INFO: Scrape type for BL16%20UUB: 1
2026-03-28 14:01:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fc54a12c-7c43-5241-baa9-136ed93039c1 with identifier: BL16%20UUB
2026-03-28 14:01:25 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item fc54a12c-7c43-5241-baa9-136ed93039c1
2026-03-28 14:01:25 [bca.uk] INFO: Found listing with ID: V30%20NGA
2026-03-28 14:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27V30%2520NGA%27 HTTP/1.1" 200 None
2026-03-28 14:01:25 [bca.uk] INFO: Scrape type for V30%20NGA: 2
2026-03-28 14:01:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 45eb5a82-5d64-5969-a428-4cfc65f000b9 with identifier: V30%20NGA
2026-03-28 14:01:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 45eb5a82-5d64-5969-a428-4cfc65f000b9 with scrape type 2
2026-03-28 14:01:25 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 45eb5a82-5d64-5969-a428-4cfc65f000b9 with scrape type 2
2026-03-28 14:01:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 45eb5a82-5d64-5969-a428-4cfc65f000b9, identifier: V30%20NGA
2026-03-28 14:01:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 45eb5a82-5d64-5969-a428-4cfc65f000b9 with identifier: V30%20NGA
2026-03-28 14:01:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 45eb5a82-5d64-5969-a428-4cfc65f000b9 with identifier: V30%20NGA
2026-03-28 14:01:25 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 45eb5a82-5d64-5969-a428-4cfc65f000b9 with identifier: V30%20NGA to the API
2026-03-28 14:01:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:01:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:01:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=3&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 185,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=V30%20NGA-GB',
'category': 'Car',
'color': 'grey',
'currency': 'GBP',
'doors_number': 5,
'engine': '2.0L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Diesel',
'id': '45eb5a82-5d64-5969-a428-4cfc65f000b9',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'V30 NGA',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=V30%20NGA&vehicleType=*',
'listing': 'auction',
'location': 'Edinburgh',
'make': 'VOLKSWAGEN',
'model': 'CARAVELLE',
'odometer': 55333,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-01-01',
'seller_name': None,
'title': 'VOLKSWAGEN CARAVELLE 2.0 TDI 199 BMT EXECUTIVE DSG MPV',
'transmission': 'automatic',
'trim': 'TDI 199 BMT EXECUTIVE DSG',
'vin': 'WV2ZZZ7HZKH099332',
'year': 2019}
2026-03-28 14:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27V30%2520NGA%27 HTTP/1.1" 200 None
2026-03-28 14:01:25 [bca.uk] INFO: Saving data for V30%20NGA: {'auction_closing_time': 1774864800.0, 'created_time': 1774447692.376257, 'last_price_update_time': 1774706485.746133}
2026-03-28 14:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='V30%2520NGA') HTTP/1.1" 204 0
2026-03-28 14:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698274413%27 HTTP/1.1" 200 None
2026-03-28 14:01:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698274413 not downloaded yet
2026-03-28 14:01:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:01:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2d7fa590>
2026-03-28 14:01:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:01:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:01:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:01:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_03d2b309-0f29-57c0-bf73-2b86c16c227a/03d2b309-0f29-57c0-bf73-2b86c16c227a_image_4.jpg HTTP/1.1" 201 0
2026-03-28 14:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FND17VGZ%252F698929290%252F600') HTTP/1.1" 204 0
2026-03-28 14:01:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/ND17VGZ/698929290/600 saved to cache
2026-03-28 14:01:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 03d2b309-0f29-57c0-bf73-2b86c16c227a
2026-03-28 14:01:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/SH14BOU/42810142?sv=2020-08-04&st=2026-03-28T14%3A01%3A23Z&se=2026-03-28T14%3A26%3A23Z&sr=b&sp=r&sig=qF%2Fj8vLm9uL8z4mTnCxa7QRX8NL1HO0if01okEQdE50%3D> (referer: https://www.bca.co.uk/)
2026-03-28 14:01:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/GU10UYN/42810320?sv=2020-08-04&st=2026-03-28T14%3A01%3A23Z&se=2026-03-28T14%3A26%3A23Z&sr=b&sp=r&sig=mGNhX9MAfZVu5g6PpXH03XgVnNc%2FnLjEd8Y2gqIppCM%3D> (referer: https://www.bca.co.uk/)
2026-03-28 14:01:25 [bca.uk] INFO: Found listing with ID: FL59%20VTF
2026-03-28 14:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FL59%2520VTF%27 HTTP/1.1" 200 None
2026-03-28 14:01:25 [bca.uk] INFO: Scrape type for FL59%20VTF: 1
2026-03-28 14:01:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3007384c-6a41-5ced-bc4c-10b628334249 with identifier: FL59%20VTF
2026-03-28 14:01:25 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 3007384c-6a41-5ced-bc4c-10b628334249
2026-03-28 14:01:25 [bca.uk] INFO: Found listing with ID: Y22%20MSN
2026-03-28 14:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27Y22%2520MSN%27 HTTP/1.1" 200 None
2026-03-28 14:01:25 [bca.uk] INFO: Scrape type for Y22%20MSN: 2
2026-03-28 14:01:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 530a18c0-273b-5ba6-8724-567fa719cd56 with identifier: Y22%20MSN
2026-03-28 14:01:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 530a18c0-273b-5ba6-8724-567fa719cd56 with scrape type 2
2026-03-28 14:01:25 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 530a18c0-273b-5ba6-8724-567fa719cd56 with scrape type 2
2026-03-28 14:01:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 530a18c0-273b-5ba6-8724-567fa719cd56, identifier: Y22%20MSN
2026-03-28 14:01:25 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VO17FMZ/698274387/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=VO17FMZ-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-28 14:01:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GF57MWW/698928965/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/GF57MWW/42810309?sv=2020-08-04&st=2026-03-28T14%3A01%3A09Z&se=2026-03-28T14%3A26%3A09Z&sr=b&sp=r&sig=hJTqt8SLdbJfAcgzLjUmqtORuHZL2E6pw%2FRYFmCkjK4%3D)
2026-03-28 14:01:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 530a18c0-273b-5ba6-8724-567fa719cd56 with identifier: Y22%20MSN
2026-03-28 14:01:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 530a18c0-273b-5ba6-8724-567fa719cd56 with identifier: Y22%20MSN
2026-03-28 14:01:26 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 530a18c0-273b-5ba6-8724-567fa719cd56 with identifier: Y22%20MSN to the API
2026-03-28 14:01:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:01:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:01:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=3&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 109,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=Y22%20MSN-GB',
'category': 'Car',
'color': 'red',
'currency': 'GBP',
'doors_number': 4,
'engine': '2.2L',
'expiration_date': '2026-03-29T10:00:00Z',
'fuel_type': 'Diesel',
'id': '530a18c0-273b-5ba6-8724-567fa719cd56',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'Y22 MSN',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=Y22%20MSN&vehicleType=*',
'listing': 'auction',
'location': 'Edinburgh',
'make': 'ALFA ROMEO',
'model': 'GIULIA',
'odometer': 81400,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-01-01',
'seller_name': None,
'title': 'ALFA ROMEO GIULIA 2.2 JTDM-2 150 SUPER Saloon',
'transmission': 'automatic',
'trim': 'JTDM-2 150 SUPER',
'vin': 'ZAREAEKU3J7594176',
'year': 2018}
2026-03-28 14:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27Y22%2520MSN%27 HTTP/1.1" 200 None
2026-03-28 14:01:26 [bca.uk] INFO: Saving data for Y22%20MSN: {'auction_closing_time': 1774778400.0, 'created_time': 1774563652.554456, 'last_price_update_time': 1774706486.348915}
2026-03-28 14:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='Y22%2520MSN') HTTP/1.1" 204 0
2026-03-28 14:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698274418%27 HTTP/1.1" 200 None
2026-03-28 14:01:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698274418 not downloaded yet
2026-03-28 14:01:26 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/EJ19URS/42798170?sv=2020-08-04&st=2026-03-28T14%3A01%3A25Z&se=2026-03-28T14%3A26%3A25Z&sr=b&sp=r&sig=rAxmzY9RDaFtqRrL9CfX2gFSW4Q22XPI9rfpZk%2B4AL4%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=EJ19%20URS-GB>
2026-03-28 14:01:26 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/FH21UNX/42809938?sv=2020-08-04&st=2026-03-28T14%3A01%3A25Z&se=2026-03-28T14%3A26%3A25Z&sr=b&sp=r&sig=DX6Iqw0wYrgXXc1Kaaa%2FZcBpc9wYL%2BSdFRwB6BQgkeE%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=FH21%20UNX-GB>
2026-03-28 14:01:26 [bca.uk] INFO: Found listing with ID: SM67%20VNV
2026-03-28 14:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SM67%2520VNV%27 HTTP/1.1" 200 None
2026-03-28 14:01:26 [bca.uk] INFO: Scrape type for SM67%20VNV: 1
2026-03-28 14:01:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e4b35cfb-486e-55d8-b302-6ece660ab632 with identifier: SM67%20VNV
2026-03-28 14:01:26 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item e4b35cfb-486e-55d8-b302-6ece660ab632
2026-03-28 14:01:26 [bca.uk] INFO: Found listing with ID: SR19%20GGU
2026-03-28 14:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SR19%2520GGU%27 HTTP/1.1" 200 None
2026-03-28 14:01:26 [bca.uk] INFO: Scrape type for SR19%20GGU: 0
2026-03-28 14:01:26 [bca.uk] INFO: Found listing with ID: VX68%20HBE
2026-03-28 14:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27VX68%2520HBE%27 HTTP/1.1" 200 None
2026-03-28 14:01:26 [bca.uk] INFO: Scrape type for VX68%20HBE: 0
2026-03-28 14:01:26 [bca.uk] INFO: Found listing with ID: AF20%20DFX
2026-03-28 14:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27AF20%2520DFX%27 HTTP/1.1" 200 None
2026-03-28 14:01:26 [bca.uk] INFO: Scrape type for AF20%20DFX: 0
2026-03-28 14:01:26 [bca.uk] INFO: Found listing with ID: BL19%20WJA
2026-03-28 14:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BL19%2520WJA%27 HTTP/1.1" 200 None
2026-03-28 14:01:26 [bca.uk] INFO: Scrape type for BL19%20WJA: 0
2026-03-28 14:01:26 [bca.uk] INFO: Found listing with ID: HF19%20JKU
2026-03-28 14:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27HF19%2520JKU%27 HTTP/1.1" 200 None
2026-03-28 14:01:26 [bca.uk] INFO: Scrape type for HF19%20JKU: 2
2026-03-28 14:01:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 531c999a-f9d9-5f71-91e2-27f9f11516e0 with identifier: HF19%20JKU
2026-03-28 14:01:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 531c999a-f9d9-5f71-91e2-27f9f11516e0 with scrape type 2
2026-03-28 14:01:26 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 531c999a-f9d9-5f71-91e2-27f9f11516e0 with scrape type 2
2026-03-28 14:01:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 531c999a-f9d9-5f71-91e2-27f9f11516e0, identifier: HF19%20JKU
2026-03-28 14:01:26 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:01:26 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:01:26 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:01:26 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:01:26 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:01:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:01:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a1feff290>
2026-03-28 14:01:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:01:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:01:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:01:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0b12c0fe-3ab8-5445-ad6b-256ccebc3b9e/0b12c0fe-3ab8-5445-ad6b-256ccebc3b9e_image_9.jpg HTTP/1.1" 201 0
2026-03-28 14:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLR11XWM%252F697880795%252F600') HTTP/1.1" 204 0
2026-03-28 14:01:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LR11XWM/697880795/600 saved to cache
2026-03-28 14:01:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 0b12c0fe-3ab8-5445-ad6b-256ccebc3b9e
2026-03-28 14:01:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:01:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a1feed910>
2026-03-28 14:01:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:01:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:01:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:01:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_29da6c1c-854f-50ff-9030-4ad1ff36e423/29da6c1c-854f-50ff-9030-4ad1ff36e423_expert_report_file_072d043a-61b7-4d4e-98a6-87b13383474d.pdf HTTP/1.1" 201 0
2026-03-28 14:01:26 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item 29da6c1c-854f-50ff-9030-4ad1ff36e423
2026-03-28 14:01:26 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 29da6c1c-854f-50ff-9030-4ad1ff36e423, skipping ID generation
2026-03-28 14:01:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 29da6c1c-854f-50ff-9030-4ad1ff36e423
2026-03-28 14:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DAM58MHU-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-28 14:01:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=AM58MHU-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-28 14:01:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:01:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2de86a10>
2026-03-28 14:01:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:01:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:01:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:01:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_05412951-b5cb-5847-b7df-8f166615ed23/05412951-b5cb-5847-b7df-8f166615ed23_expert_report_file_d81d8a19-c379-46b3-b63d-6301476be8d3.pdf HTTP/1.1" 201 0
2026-03-28 14:01:26 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item 05412951-b5cb-5847-b7df-8f166615ed23
2026-03-28 14:01:26 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 05412951-b5cb-5847-b7df-8f166615ed23, skipping ID generation
2026-03-28 14:01:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 05412951-b5cb-5847-b7df-8f166615ed23
2026-03-28 14:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DSB65CAX-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-28 14:01:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=SB65CAX-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-28 14:01:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/SF65MRS/42810141?sv=2020-08-04&st=2026-03-28T14%3A01%3A23Z&se=2026-03-28T14%3A26%3A23Z&sr=b&sp=r&sig=pKcKPXIMRDrpvR7qgfCAU8Cghh7jF%2FL25jpHeT9Gs0U%3D> (referer: https://www.bca.co.uk/)
2026-03-28 14:01:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/WA15XTF/42809463?sv=2020-08-04&st=2026-03-28T14%3A01%3A23Z&se=2026-03-28T14%3A26%3A23Z&sr=b&sp=r&sig=OVT1XXFunRJjcV5jy5Zgfxxi5O1xAq2cfTX%2F%2FcIif88%3D> (referer: https://www.bca.co.uk/)
2026-03-28 14:01:26 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/WM19BFN/42804238?sv=2020-08-04&st=2026-03-28T14%3A01%3A26Z&se=2026-03-28T14%3A26%3A26Z&sr=b&sp=r&sig=EfjfS2OdrtC4SA3uZ5XRiTu1xsVnQ9sqSYyb4MkUK3s%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=WM19%20BFN-GB>
2026-03-28 14:01:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 531c999a-f9d9-5f71-91e2-27f9f11516e0 with identifier: HF19%20JKU
2026-03-28 14:01:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 531c999a-f9d9-5f71-91e2-27f9f11516e0 with identifier: HF19%20JKU
2026-03-28 14:01:26 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 531c999a-f9d9-5f71-91e2-27f9f11516e0 with identifier: HF19%20JKU to the API
2026-03-28 14:01:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:01:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:01:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=3&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 151,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=HF19%20JKU-GB',
'category': 'Car',
'color': 'red',
'currency': 'GBP',
'doors_number': 3,
'engine': '1.4L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol',
'id': '531c999a-f9d9-5f71-91e2-27f9f11516e0',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'HF19 JKU',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=HF19%20JKU&vehicleType=*',
'listing': 'auction',
'location': 'Edinburgh',
'make': 'ABARTH',
'model': '595',
'odometer': 42156,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-01-01',
'seller_name': None,
'title': 'ABARTH 595 1.4 T-JET 145 Hatchback',
'transmission': 'manual',
'trim': 'T-JET 145',
'vin': 'ZFA3120000JC05397',
'year': 2019}
2026-03-28 14:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27HF19%2520JKU%27 HTTP/1.1" 200 None
2026-03-28 14:01:27 [bca.uk] INFO: Saving data for HF19%20JKU: {'auction_closing_time': 1774864800.0, 'created_time': 1774563265.462078, 'last_price_update_time': 1774706487.092305}
2026-03-28 14:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='HF19%2520JKU') HTTP/1.1" 204 0
2026-03-28 14:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698274432%27 HTTP/1.1" 200 None
2026-03-28 14:01:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698274432 not downloaded yet
2026-03-28 14:01:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/X28AVE/698923783/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/X28AVE/42809896?sv=2020-08-04&st=2026-03-28T14%3A01%3A06Z&se=2026-03-28T14%3A26%3A06Z&sr=b&sp=r&sig=AYxkyrr3IbeLdESXjdd9QmNEg4ZiUeF%2B%2BO3v1nuSrfg%3D)
2026-03-28 14:01:27 [bca.uk] INFO: Found listing with ID: WP62%20XCK
2026-03-28 14:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WP62%2520XCK%27 HTTP/1.1" 200 None
2026-03-28 14:01:27 [bca.uk] INFO: Scrape type for WP62%20XCK: 1
2026-03-28 14:01:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 017f335f-f1b9-5de8-8cb9-bc79c2d2f45f with identifier: WP62%20XCK
2026-03-28 14:01:27 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 017f335f-f1b9-5de8-8cb9-bc79c2d2f45f
2026-03-28 14:01:27 [bca.uk] INFO: Found listing with ID: SD68%20WCY
2026-03-28 14:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SD68%2520WCY%27 HTTP/1.1" 200 None
2026-03-28 14:01:27 [bca.uk] INFO: Scrape type for SD68%20WCY: 2
2026-03-28 14:01:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1899af50-942b-5588-84cb-51815fcfa158 with identifier: SD68%20WCY
2026-03-28 14:01:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1899af50-942b-5588-84cb-51815fcfa158 with scrape type 2
2026-03-28 14:01:27 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1899af50-942b-5588-84cb-51815fcfa158 with scrape type 2
2026-03-28 14:01:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 1899af50-942b-5588-84cb-51815fcfa158, identifier: SD68%20WCY
2026-03-28 14:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698970521%27 HTTP/1.1" 200 None
2026-03-28 14:01:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698970521 not downloaded yet
2026-03-28 14:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D697544320%27 HTTP/1.1" 200 None
2026-03-28 14:01:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=697544320 not downloaded yet
2026-03-28 14:01:27 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/VO62RAU/42809976?sv=2020-08-04&st=2026-03-28T14%3A01%3A26Z&se=2026-03-28T14%3A26%3A26Z&sr=b&sp=r&sig=ajraupx01hOhBxj83xq2SeA0U6vZ89qgzfl3QZ0K0u0%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=VO62%20RAU-GB>
2026-03-28 14:01:27 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VO17FMZ/698274399/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698274399>
2026-03-28 14:01:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 1899af50-942b-5588-84cb-51815fcfa158 with identifier: SD68%20WCY
2026-03-28 14:01:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 1899af50-942b-5588-84cb-51815fcfa158 with identifier: SD68%20WCY
2026-03-28 14:01:27 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 1899af50-942b-5588-84cb-51815fcfa158 with identifier: SD68%20WCY to the API
2026-03-28 14:01:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:01:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:01:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=3&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 104,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=SD68%20WCY-GB',
'category': 'Car',
'color': 'grey',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.0L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol',
'id': '1899af50-942b-5588-84cb-51815fcfa158',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'SD68 WCY',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=SD68%20WCY&vehicleType=*',
'listing': 'auction',
'location': 'Edinburgh',
'make': 'VOLKSWAGEN',
'model': 'POLO',
'odometer': 48395,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-01-01',
'seller_name': None,
'title': 'VOLKSWAGEN POLO 1.0 TSI 95 SE Hatchback',
'transmission': 'manual',
'trim': 'TSI 95 SE',
'vin': 'WVWZZZAWZKU007994',
'year': 2018}
2026-03-28 14:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SD68%2520WCY%27 HTTP/1.1" 200 None
2026-03-28 14:01:27 [bca.uk] INFO: Saving data for SD68%20WCY: {'auction_closing_time': 1774864800.0, 'created_time': 1774390251.775944, 'last_price_update_time': 1774706487.66095}
2026-03-28 14:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='SD68%2520WCY') HTTP/1.1" 204 0
2026-03-28 14:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698274440%27 HTTP/1.1" 200 None
2026-03-28 14:01:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698274440 not downloaded yet
2026-03-28 14:01:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:01:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c52c890>
2026-03-28 14:01:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:01:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:01:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:01:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7ca8ff92-ba13-58b4-8b9a-c74a2e2ed8c1/7ca8ff92-ba13-58b4-8b9a-c74a2e2ed8c1_expert_report_file_7de6dcb5-3925-40b5-ab52-0ca5e0adffad.pdf HTTP/1.1" 201 0
2026-03-28 14:01:27 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item 7ca8ff92-ba13-58b4-8b9a-c74a2e2ed8c1
2026-03-28 14:01:27 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 7ca8ff92-ba13-58b4-8b9a-c74a2e2ed8c1, skipping ID generation
2026-03-28 14:01:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 7ca8ff92-ba13-58b4-8b9a-c74a2e2ed8c1
2026-03-28 14:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DSH14BOU-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-28 14:01:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=SH14BOU-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-28 14:01:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:01:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c51f390>
2026-03-28 14:01:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:01:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:01:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:01:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_24b3d1e2-9046-567a-ba39-2d683a6b4342/24b3d1e2-9046-567a-ba39-2d683a6b4342_expert_report_file_c1b99c57-cfc4-4404-9d71-2df37a247b5e.pdf HTTP/1.1" 201 0
2026-03-28 14:01:28 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item 24b3d1e2-9046-567a-ba39-2d683a6b4342
2026-03-28 14:01:28 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 24b3d1e2-9046-567a-ba39-2d683a6b4342, skipping ID generation
2026-03-28 14:01:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 24b3d1e2-9046-567a-ba39-2d683a6b4342
2026-03-28 14:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DGU10UYN-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-28 14:01:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=GU10UYN-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-28 14:01:28 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:01:28 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:01:28 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:01:28 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:01:28 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:01:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:01:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c4bb350>
2026-03-28 14:01:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:01:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:01:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:01:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cdcc838c-10d3-5f36-90c6-59ef07eececc/cdcc838c-10d3-5f36-90c6-59ef07eececc_image_9.jpg HTTP/1.1" 201 0
2026-03-28 14:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FGF57MWW%252F698928965%252F600') HTTP/1.1" 204 0
2026-03-28 14:01:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GF57MWW/698928965/600 saved to cache
2026-03-28 14:01:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item cdcc838c-10d3-5f36-90c6-59ef07eececc
2026-03-28 14:01:28 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/BL16UUB/42810250?sv=2020-08-04&st=2026-03-28T14%3A01%3A27Z&se=2026-03-28T14%3A26%3A27Z&sr=b&sp=r&sig=SYmTiNujaXYF2XAoxTdHUcpF%2BqchRSrGUQy4u1jrdO0%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=BL16%20UUB-GB>
2026-03-28 14:01:28 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VO17FMZ/698274406/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698274406>
2026-03-28 14:01:28 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YD66KFF/42810264?sv=2020-08-04&st=2026-03-28T14%3A01%3A27Z&se=2026-03-28T14%3A26%3A27Z&sr=b&sp=r&sig=BnH67lWrH1ehlh0fvDCmlxB%2FgGDsNGQtDgFTgEjpoSk%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=YD66%20KFF-GB>
2026-03-28 14:01:28 [bca.uk] INFO: Found listing with ID: RF08%20TZP
2026-03-28 14:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27RF08%2520TZP%27 HTTP/1.1" 200 None
2026-03-28 14:01:28 [bca.uk] INFO: Scrape type for RF08%20TZP: 1
2026-03-28 14:01:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0db89969-308f-54b4-910e-308fd1f55fa4 with identifier: RF08%20TZP
2026-03-28 14:01:28 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 0db89969-308f-54b4-910e-308fd1f55fa4
2026-03-28 14:01:28 [bca.uk] INFO: Found listing with ID: SG16%20HZK
2026-03-28 14:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SG16%2520HZK%27 HTTP/1.1" 200 None
2026-03-28 14:01:28 [bca.uk] INFO: Scrape type for SG16%20HZK: 2
2026-03-28 14:01:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6a954b03-04e8-528c-b300-da7be1103261 with identifier: SG16%20HZK
2026-03-28 14:01:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6a954b03-04e8-528c-b300-da7be1103261 with scrape type 2
2026-03-28 14:01:28 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6a954b03-04e8-528c-b300-da7be1103261 with scrape type 2
2026-03-28 14:01:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 6a954b03-04e8-528c-b300-da7be1103261, identifier: SG16%20HZK
2026-03-28 14:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698953147%27 HTTP/1.1" 200 None
2026-03-28 14:01:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698953147 not downloaded yet
2026-03-28 14:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D697544333%27 HTTP/1.1" 200 None
2026-03-28 14:01:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=697544333 not downloaded yet
2026-03-28 14:01:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YW64DGU/42810194?sv=2020-08-04&st=2026-03-28T14%3A01%3A23Z&se=2026-03-28T14%3A26%3A23Z&sr=b&sp=r&sig=bKUUxkl%2FQOTN6xP3oKLYX53uOLW1seBVRfhSdF3FtAg%3D> (referer: https://www.bca.co.uk/)
2026-03-28 14:01:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 6a954b03-04e8-528c-b300-da7be1103261 with identifier: SG16%20HZK
2026-03-28 14:01:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 6a954b03-04e8-528c-b300-da7be1103261 with identifier: SG16%20HZK
2026-03-28 14:01:28 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 6a954b03-04e8-528c-b300-da7be1103261 with identifier: SG16%20HZK to the API
2026-03-28 14:01:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:01:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:01:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=3&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 177,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=SG16%20HZK-GB',
'category': 'Car',
'color': 'silver',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.6L',
'expiration_date': '2026-03-29T10:00:00Z',
'fuel_type': 'Petrol',
'id': '6a954b03-04e8-528c-b300-da7be1103261',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'SG16 HZK',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=SG16%20HZK&vehicleType=*',
'listing': 'auction',
'location': 'Edinburgh',
'make': 'KIA',
'model': 'SPORTAGE',
'odometer': 77971,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-01-01',
'seller_name': None,
'title': 'KIA SPORTAGE 1.6 T GDI AWD GT-LINE StationWagon',
'transmission': 'manual',
'trim': 'T GDI AWD GT-LINE',
'vin': 'U5YPK816NGL042153',
'year': 2016}
2026-03-28 14:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SG16%2520HZK%27 HTTP/1.1" 200 None
2026-03-28 14:01:28 [bca.uk] INFO: Saving data for SG16%20HZK: {'auction_closing_time': 1774778400.0, 'created_time': 1774303482.017082, 'last_price_update_time': 1774706488.632561}
2026-03-28 14:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='SG16%2520HZK') HTTP/1.1" 204 0
2026-03-28 14:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698274453%27 HTTP/1.1" 200 None
2026-03-28 14:01:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698274453 not downloaded yet
2026-03-28 14:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698522048%27 HTTP/1.1" 200 None
2026-03-28 14:01:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698522048 not downloaded yet
2026-03-28 14:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698556122%27 HTTP/1.1" 200 None
2026-03-28 14:01:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698556122 not downloaded yet
2026-03-28 14:01:28 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/VK65XNW/42810265?sv=2020-08-04&st=2026-03-28T14%3A01%3A28Z&se=2026-03-28T14%3A26%3A28Z&sr=b&sp=r&sig=3QAAN%2BSB1OUMkxc4Xxtv%2BiBflOK5M03dTgEQ%2BLIgSi4%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=VK65%20XNW-GB>
2026-03-28 14:01:28 [bca.uk] INFO: Found listing with ID: YC72%20AVN
2026-03-28 14:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YC72%2520AVN%27 HTTP/1.1" 200 None
2026-03-28 14:01:28 [bca.uk] INFO: Scrape type for YC72%20AVN: 1
2026-03-28 14:01:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 98f6010a-0356-55b3-9d9f-fbc61b9e1410 with identifier: YC72%20AVN
2026-03-28 14:01:28 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 98f6010a-0356-55b3-9d9f-fbc61b9e1410
2026-03-28 14:01:28 [bca.uk] INFO: Found listing with ID: OY16%20VNK
2026-03-28 14:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27OY16%2520VNK%27 HTTP/1.1" 200 None
2026-03-28 14:01:28 [bca.uk] INFO: Scrape type for OY16%20VNK: 2
2026-03-28 14:01:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 473294e1-f04a-5695-b64b-fefa5b097db5 with identifier: OY16%20VNK
2026-03-28 14:01:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 473294e1-f04a-5695-b64b-fefa5b097db5 with scrape type 2
2026-03-28 14:01:28 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 473294e1-f04a-5695-b64b-fefa5b097db5 with scrape type 2
2026-03-28 14:01:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 473294e1-f04a-5695-b64b-fefa5b097db5, identifier: OY16%20VNK
2026-03-28 14:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698970528%27 HTTP/1.1" 200 None
2026-03-28 14:01:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698970528 not downloaded yet
2026-03-28 14:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D697544345%27 HTTP/1.1" 200 None
2026-03-28 14:01:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=697544345 not downloaded yet
2026-03-28 14:01:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:01:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c57c7d0>
2026-03-28 14:01:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:01:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:01:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:01:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_228041df-5797-5c8f-89c8-2a337a640ead/228041df-5797-5c8f-89c8-2a337a640ead_expert_report_file_64ee7556-60d7-43df-940e-622e13378213.pdf HTTP/1.1" 201 0
2026-03-28 14:01:28 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item 228041df-5797-5c8f-89c8-2a337a640ead
2026-03-28 14:01:28 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 228041df-5797-5c8f-89c8-2a337a640ead, skipping ID generation
2026-03-28 14:01:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 228041df-5797-5c8f-89c8-2a337a640ead
2026-03-28 14:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DSF65MRS-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-28 14:01:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=SF65MRS-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-28 14:01:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:01:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2deb18d0>
2026-03-28 14:01:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:01:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:01:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:01:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_012921cb-8763-5e72-9bbe-1684326c9a1d/012921cb-8763-5e72-9bbe-1684326c9a1d_expert_report_file_bb1aa5b4-3b08-4172-9b77-19636627d2d2.pdf HTTP/1.1" 201 0
2026-03-28 14:01:28 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item 012921cb-8763-5e72-9bbe-1684326c9a1d
2026-03-28 14:01:28 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 012921cb-8763-5e72-9bbe-1684326c9a1d, skipping ID generation
2026-03-28 14:01:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 012921cb-8763-5e72-9bbe-1684326c9a1d
2026-03-28 14:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DWA15XTF-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-28 14:01:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=WA15XTF-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-28 14:01:28 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:01:28 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:01:28 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:01:28 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:01:28 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:01:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:01:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c86e610>
2026-03-28 14:01:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:01:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:01:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:01:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e788d11e-974b-5084-adb6-d49a23c42616/e788d11e-974b-5084-adb6-d49a23c42616_image_6.jpg HTTP/1.1" 201 0
2026-03-28 14:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FX28AVE%252F698923783%252F600') HTTP/1.1" 204 0
2026-03-28 14:01:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/X28AVE/698923783/600 saved to cache
2026-03-28 14:01:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item e788d11e-974b-5084-adb6-d49a23c42616
2026-03-28 14:01:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/KO15JZW/42809875?sv=2020-08-04&st=2026-03-28T14%3A01%3A23Z&se=2026-03-28T14%3A26%3A23Z&sr=b&sp=r&sig=WtTYXpKYofDjFDmXev3jjoySms%2BztrBA4DkuQ5Y14aQ%3D> (referer: https://www.bca.co.uk/)
2026-03-28 14:01:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VO17FMZ/698274387/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/VO17FMZ/42810377?sv=2020-08-04&st=2026-03-28T14%3A01%3A10Z&se=2026-03-28T14%3A26%3A10Z&sr=b&sp=r&sig=PEm9gdKL%2BNRnVtrVK0%2F5sWr2YcEbrtVNzeob8CJbr3c%3D)
2026-03-28 14:01:29 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/FL59VTF/42810253?sv=2020-08-04&st=2026-03-28T14%3A01%3A28Z&se=2026-03-28T14%3A26%3A28Z&sr=b&sp=r&sig=GoiG7mqbYuLGhcwWnmQ5IpnLjHLSnXkwhQvXnkkGwWI%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=FL59%20VTF-GB>
2026-03-28 14:01:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 473294e1-f04a-5695-b64b-fefa5b097db5 with identifier: OY16%20VNK
2026-03-28 14:01:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 473294e1-f04a-5695-b64b-fefa5b097db5 with identifier: OY16%20VNK
2026-03-28 14:01:29 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 473294e1-f04a-5695-b64b-fefa5b097db5 with identifier: OY16%20VNK to the API
2026-03-28 14:01:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:01:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:01:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=3&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 237,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=OY16%20VNK-GB',
'category': 'Car',
'color': 'black',
'currency': 'GBP',
'doors_number': 2,
'engine': '5.5L',
'expiration_date': '2026-03-31T10:00:00Z',
'fuel_type': 'Petrol',
'id': '473294e1-f04a-5695-b64b-fefa5b097db5',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'OY16 VNK',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=OY16%20VNK&vehicleType=*',
'listing': 'auction',
'location': 'Edinburgh',
'make': 'MERCEDES-BENZ',
'model': 'S63 AMG',
'odometer': 51722,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-01-01',
'seller_name': None,
'title': 'MERCEDES-BENZ S63 AMG 5.5 (585) Coupe',
'transmission': 'manual',
'trim': '(585)',
'vin': 'WDD2173772A018405',
'year': 2016}
2026-03-28 14:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27OY16%2520VNK%27 HTTP/1.1" 200 None
2026-03-28 14:01:29 [bca.uk] INFO: Saving data for OY16%20VNK: {'auction_closing_time': 1774951200.0, 'created_time': 1774476149.783183, 'last_price_update_time': 1774706489.371334}
2026-03-28 14:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='OY16%2520VNK') HTTP/1.1" 204 0
2026-03-28 14:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698274476%27 HTTP/1.1" 200 None
2026-03-28 14:01:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698274476 not downloaded yet
2026-03-28 14:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698522057%27 HTTP/1.1" 200 None
2026-03-28 14:01:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698522057 not downloaded yet
2026-03-28 14:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698556136%27 HTTP/1.1" 200 None
2026-03-28 14:01:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698556136 not downloaded yet
2026-03-28 14:01:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/FH21UNX/42809938?sv=2020-08-04&st=2026-03-28T14%3A01%3A25Z&se=2026-03-28T14%3A26%3A25Z&sr=b&sp=r&sig=DX6Iqw0wYrgXXc1Kaaa%2FZcBpc9wYL%2BSdFRwB6BQgkeE%3D> (referer: https://www.bca.co.uk/)
2026-03-28 14:01:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/EJ19URS/42798170?sv=2020-08-04&st=2026-03-28T14%3A01%3A25Z&se=2026-03-28T14%3A26%3A25Z&sr=b&sp=r&sig=rAxmzY9RDaFtqRrL9CfX2gFSW4Q22XPI9rfpZk%2B4AL4%3D> (referer: https://www.bca.co.uk/)
2026-03-28 14:01:29 [bca.uk] INFO: Found listing with ID: FJ68%20ULM
2026-03-28 14:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FJ68%2520ULM%27 HTTP/1.1" 200 None
2026-03-28 14:01:29 [bca.uk] INFO: Scrape type for FJ68%20ULM: 0
2026-03-28 14:01:29 [bca.uk] INFO: Found listing with ID: FJ70%20HFF
2026-03-28 14:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FJ70%2520HFF%27 HTTP/1.1" 200 None
2026-03-28 14:01:29 [bca.uk] INFO: Scrape type for FJ70%20HFF: 1
2026-03-28 14:01:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 210bede2-fc35-5c06-850c-0f613a811123 with identifier: FJ70%20HFF
2026-03-28 14:01:29 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 210bede2-fc35-5c06-850c-0f613a811123
2026-03-28 14:01:29 [bca.uk] INFO: Found listing with ID: PE10%20DXZ
2026-03-28 14:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27PE10%2520DXZ%27 HTTP/1.1" 200 None
2026-03-28 14:01:29 [bca.uk] INFO: Scrape type for PE10%20DXZ: 1
2026-03-28 14:01:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4a813d3c-3e8d-5a38-9bde-5cc88840a6e8 with identifier: PE10%20DXZ
2026-03-28 14:01:29 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 4a813d3c-3e8d-5a38-9bde-5cc88840a6e8
2026-03-28 14:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698953163%27 HTTP/1.1" 200 None
2026-03-28 14:01:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698953163 not downloaded yet
2026-03-28 14:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D697544352%27 HTTP/1.1" 200 None
2026-03-28 14:01:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=697544352 not downloaded yet
2026-03-28 14:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698522052%27 HTTP/1.1" 200 None
2026-03-28 14:01:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698522052 not downloaded yet
2026-03-28 14:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D697938611%27 HTTP/1.1" 200 None
2026-03-28 14:01:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=697938611 not downloaded yet
2026-03-28 14:01:29 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VO17FMZ/698274413/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698274413>
2026-03-28 14:01:29 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VO17FMZ/698274418/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698274418>
2026-03-28 14:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698522068%27 HTTP/1.1" 200 None
2026-03-28 14:01:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698522068 not downloaded yet
2026-03-28 14:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698556155%27 HTTP/1.1" 200 None
2026-03-28 14:01:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698556155 not downloaded yet
2026-03-28 14:01:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:01:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c714990>
2026-03-28 14:01:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:01:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:01:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:01:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5b546abb-9cfb-537e-b2ac-6d60a5514e55/5b546abb-9cfb-537e-b2ac-6d60a5514e55_expert_report_file_ca43bd53-f8a5-46b9-abe3-e74b1fea6979.pdf HTTP/1.1" 201 0
2026-03-28 14:01:29 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item 5b546abb-9cfb-537e-b2ac-6d60a5514e55
2026-03-28 14:01:29 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 5b546abb-9cfb-537e-b2ac-6d60a5514e55, skipping ID generation
2026-03-28 14:01:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 5b546abb-9cfb-537e-b2ac-6d60a5514e55
2026-03-28 14:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DYW64DGU-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-28 14:01:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=YW64DGU-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-28 14:01:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VO17FMZ/698274399/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/VO17FMZ/42810377?sv=2020-08-04&st=2026-03-28T14%3A01%3A10Z&se=2026-03-28T14%3A26%3A10Z&sr=b&sp=r&sig=PEm9gdKL%2BNRnVtrVK0%2F5sWr2YcEbrtVNzeob8CJbr3c%3D)
2026-03-28 14:01:29 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VO17FMZ/698274432/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698274432>
2026-03-28 14:01:29 [bca.uk] INFO: Found listing with ID: ND19%20VHL
2026-03-28 14:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27ND19%2520VHL%27 HTTP/1.1" 200 None
2026-03-28 14:01:29 [bca.uk] INFO: Scrape type for ND19%20VHL: 1
2026-03-28 14:01:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3da52437-88a6-5c28-8143-adc9baabdca3 with identifier: ND19%20VHL
2026-03-28 14:01:29 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 3da52437-88a6-5c28-8143-adc9baabdca3
2026-03-28 14:01:29 [bca.uk] INFO: Found listing with ID: SW08%20OSX
2026-03-28 14:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SW08%2520OSX%27 HTTP/1.1" 200 None
2026-03-28 14:01:29 [bca.uk] INFO: Scrape type for SW08%20OSX: 0
2026-03-28 14:01:29 [bca.uk] INFO: Found listing with ID: SY11%20OZW
2026-03-28 14:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SY11%2520OZW%27 HTTP/1.1" 200 None
2026-03-28 14:01:29 [bca.uk] INFO: Scrape type for SY11%20OZW: 0
2026-03-28 14:01:29 [bca.uk] INFO: Found listing with ID: SY58%20YDP
2026-03-28 14:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SY58%2520YDP%27 HTTP/1.1" 200 None
2026-03-28 14:01:29 [bca.uk] INFO: Scrape type for SY58%20YDP: 0
2026-03-28 14:01:29 [bca.uk] INFO: Found listing with ID: SY61%20MXG
2026-03-28 14:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SY61%2520MXG%27 HTTP/1.1" 200 None
2026-03-28 14:01:29 [bca.uk] INFO: Scrape type for SY61%20MXG: 0
2026-03-28 14:01:29 [bca.uk] INFO: Found listing with ID: WN15%20XAB
2026-03-28 14:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WN15%2520XAB%27 HTTP/1.1" 200 None
2026-03-28 14:01:29 [bca.uk] INFO: Scrape type for WN15%20XAB: 0
2026-03-28 14:01:29 [bca.uk] INFO: Found listing with ID: YT12%20VGZ
2026-03-28 14:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YT12%2520VGZ%27 HTTP/1.1" 200 None
2026-03-28 14:01:29 [bca.uk] INFO: Scrape type for YT12%20VGZ: 0
2026-03-28 14:01:29 [bca.uk] INFO: Found listing with ID: AK58%20DZJ
2026-03-28 14:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27AK58%2520DZJ%27 HTTP/1.1" 200 None
2026-03-28 14:01:29 [bca.uk] INFO: Scrape type for AK58%20DZJ: 0
2026-03-28 14:01:29 [bca.uk] INFO: Found listing with ID: CK58%20JTV
2026-03-28 14:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27CK58%2520JTV%27 HTTP/1.1" 200 None
2026-03-28 14:01:29 [bca.uk] INFO: Scrape type for CK58%20JTV: 0
2026-03-28 14:01:29 [bca.uk] INFO: Found listing with ID: EJ10%20YOL
2026-03-28 14:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27EJ10%2520YOL%27 HTTP/1.1" 200 None
2026-03-28 14:01:29 [bca.uk] INFO: Scrape type for EJ10%20YOL: 0
2026-03-28 14:01:29 [bca.uk] INFO: Found listing with ID: EU63%20UNN
2026-03-28 14:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27EU63%2520UNN%27 HTTP/1.1" 200 None
2026-03-28 14:01:29 [bca.uk] INFO: Scrape type for EU63%20UNN: 0
2026-03-28 14:01:29 [bca.uk] INFO: Found listing with ID: KE15%20VGG
2026-03-28 14:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KE15%2520VGG%27 HTTP/1.1" 200 None
2026-03-28 14:01:29 [bca.uk] INFO: Scrape type for KE15%20VGG: 2
2026-03-28 14:01:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5e08ebb9-5776-5621-9c06-f20c01de4014 with identifier: KE15%20VGG
2026-03-28 14:01:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5e08ebb9-5776-5621-9c06-f20c01de4014 with scrape type 2
2026-03-28 14:01:29 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5e08ebb9-5776-5621-9c06-f20c01de4014 with scrape type 2
2026-03-28 14:01:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 5e08ebb9-5776-5621-9c06-f20c01de4014, identifier: KE15%20VGG
2026-03-28 14:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698970537%27 HTTP/1.1" 200 None
2026-03-28 14:01:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698970537 not downloaded yet
2026-03-28 14:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D697544362%27 HTTP/1.1" 200 None
2026-03-28 14:01:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=697544362 not downloaded yet
2026-03-28 14:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698522063%27 HTTP/1.1" 200 None
2026-03-28 14:01:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698522063 not downloaded yet
2026-03-28 14:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D697938624%27 HTTP/1.1" 200 None
2026-03-28 14:01:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=697938624 not downloaded yet
2026-03-28 14:01:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/WM19BFN/42804238?sv=2020-08-04&st=2026-03-28T14%3A01%3A26Z&se=2026-03-28T14%3A26%3A26Z&sr=b&sp=r&sig=EfjfS2OdrtC4SA3uZ5XRiTu1xsVnQ9sqSYyb4MkUK3s%3D> (referer: https://www.bca.co.uk/)
2026-03-28 14:01:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 5e08ebb9-5776-5621-9c06-f20c01de4014 with identifier: KE15%20VGG
2026-03-28 14:01:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 5e08ebb9-5776-5621-9c06-f20c01de4014 with identifier: KE15%20VGG
2026-03-28 14:01:30 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 5e08ebb9-5776-5621-9c06-f20c01de4014 with identifier: KE15%20VGG to the API
2026-03-28 14:01:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:01:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:01:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=3&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 119,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=KE15%20VGG-GB',
'category': 'Car',
'color': 'red',
'currency': 'GBP',
'doors_number': 5,
'engine': '2.0L',
'expiration_date': '2026-03-29T10:00:00Z',
'fuel_type': 'Petrol',
'id': '5e08ebb9-5776-5621-9c06-f20c01de4014',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'KE15 VGG',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=KE15%20VGG&vehicleType=*',
'listing': 'auction',
'location': 'Edinburgh',
'make': 'MAZDA',
'model': '3',
'odometer': 131237,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-01-01',
'seller_name': None,
'title': 'MAZDA 3 2.0 SPORT Hatchback',
'transmission': 'manual',
'trim': 'SPORT',
'vin': 'JMZBM646611302773',
'year': 2015}
2026-03-28 14:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KE15%2520VGG%27 HTTP/1.1" 200 None
2026-03-28 14:01:30 [bca.uk] INFO: Saving data for KE15%20VGG: {'auction_closing_time': 1774778400.0, 'created_time': 1774044491.637369, 'last_price_update_time': 1774706490.561601}
2026-03-28 14:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='KE15%2520VGG') HTTP/1.1" 204 0
2026-03-28 14:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698522076%27 HTTP/1.1" 200 None
2026-03-28 14:01:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698522076 not downloaded yet
2026-03-28 14:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698556165%27 HTTP/1.1" 200 None
2026-03-28 14:01:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698556165 not downloaded yet
2026-03-28 14:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698928782%27 HTTP/1.1" 200 None
2026-03-28 14:01:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698928782 not downloaded yet
2026-03-28 14:01:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VO17FMZ/698274406/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/VO17FMZ/42810377?sv=2020-08-04&st=2026-03-28T14%3A01%3A10Z&se=2026-03-28T14%3A26%3A10Z&sr=b&sp=r&sig=PEm9gdKL%2BNRnVtrVK0%2F5sWr2YcEbrtVNzeob8CJbr3c%3D)
2026-03-28 14:01:30 [bca.uk] INFO: Found listing with ID: AF71%20XUK
2026-03-28 14:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27AF71%2520XUK%27 HTTP/1.1" 200 None
2026-03-28 14:01:30 [bca.uk] INFO: Scrape type for AF71%20XUK: 1
2026-03-28 14:01:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ca8b23b7-2e66-554c-8e62-feb13d6c73d4 with identifier: AF71%20XUK
2026-03-28 14:01:30 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item ca8b23b7-2e66-554c-8e62-feb13d6c73d4
2026-03-28 14:01:30 [bca.uk] INFO: Found listing with ID: KG56%20YPR
2026-03-28 14:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KG56%2520YPR%27 HTTP/1.1" 200 None
2026-03-28 14:01:30 [bca.uk] INFO: Scrape type for KG56%20YPR: 0
2026-03-28 14:01:30 [bca.uk] INFO: Found listing with ID: NA59%20VLZ
2026-03-28 14:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27NA59%2520VLZ%27 HTTP/1.1" 200 None
2026-03-28 14:01:30 [bca.uk] INFO: Scrape type for NA59%20VLZ: 0
2026-03-28 14:01:30 [bca.uk] INFO: Found listing with ID: NK66%20YFN
2026-03-28 14:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27NK66%2520YFN%27 HTTP/1.1" 200 None
2026-03-28 14:01:30 [bca.uk] INFO: Scrape type for NK66%20YFN: 0
2026-03-28 14:01:30 [bca.uk] INFO: Found listing with ID: NL16%20XFV
2026-03-28 14:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27NL16%2520XFV%27 HTTP/1.1" 200 None
2026-03-28 14:01:30 [bca.uk] INFO: Scrape type for NL16%20XFV: 0
2026-03-28 14:01:30 [bca.uk] INFO: Found listing with ID: OY11%20XRC
2026-03-28 14:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27OY11%2520XRC%27 HTTP/1.1" 200 None
2026-03-28 14:01:30 [bca.uk] INFO: Scrape type for OY11%20XRC: 0
2026-03-28 14:01:30 [bca.uk] INFO: Found listing with ID: RX63%20SMO
2026-03-28 14:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27RX63%2520SMO%27 HTTP/1.1" 200 None
2026-03-28 14:01:30 [bca.uk] INFO: Scrape type for RX63%20SMO: 2
2026-03-28 14:01:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 208d0970-e666-5a1d-bb8d-26c8a38ccb22 with identifier: RX63%20SMO
2026-03-28 14:01:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 208d0970-e666-5a1d-bb8d-26c8a38ccb22 with scrape type 2
2026-03-28 14:01:30 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 208d0970-e666-5a1d-bb8d-26c8a38ccb22 with scrape type 2
2026-03-28 14:01:31 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 208d0970-e666-5a1d-bb8d-26c8a38ccb22, identifier: RX63%20SMO
2026-03-28 14:01:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698953175%27 HTTP/1.1" 200 None
2026-03-28 14:01:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698953175 not downloaded yet
2026-03-28 14:01:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D697544370%27 HTTP/1.1" 200 None
2026-03-28 14:01:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=697544370 not downloaded yet
2026-03-28 14:01:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698522077%27 HTTP/1.1" 200 None
2026-03-28 14:01:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698522077 not downloaded yet
2026-03-28 14:01:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D697938638%27 HTTP/1.1" 200 None
2026-03-28 14:01:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=697938638 not downloaded yet
2026-03-28 14:01:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:01:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2d9df590>
2026-03-28 14:01:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:01:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:01:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:01:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7cdb5790-795c-503b-b01e-2ccf288a1773/7cdb5790-795c-503b-b01e-2ccf288a1773_expert_report_file_9b9a7f8a-1a60-42a1-9fcd-1ae330d21703.pdf HTTP/1.1" 201 0
2026-03-28 14:01:31 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item 7cdb5790-795c-503b-b01e-2ccf288a1773
2026-03-28 14:01:31 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 7cdb5790-795c-503b-b01e-2ccf288a1773, skipping ID generation
2026-03-28 14:01:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 7cdb5790-795c-503b-b01e-2ccf288a1773
2026-03-28 14:01:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DKO15JZW-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-28 14:01:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=KO15JZW-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-28 14:01:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:01:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c618850>
2026-03-28 14:01:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:01:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:01:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:01:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7b233ce6-aa01-5f24-ac34-ccc770845b54/7b233ce6-aa01-5f24-ac34-ccc770845b54_image_0.jpg HTTP/1.1" 201 0
2026-03-28 14:01:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FVO17FMZ%252F698274387%252F600') HTTP/1.1" 204 0
2026-03-28 14:01:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VO17FMZ/698274387/600 saved to cache
2026-03-28 14:01:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 7b233ce6-aa01-5f24-ac34-ccc770845b54
2026-03-28 14:01:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:01:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c4403d0>
2026-03-28 14:01:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:01:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:01:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:01:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a610f6fb-a046-5c2e-8701-0fcb295f97f1/a610f6fb-a046-5c2e-8701-0fcb295f97f1_expert_report_file_a7a6cc68-ddc2-4719-9006-da72e7ecedb1.pdf HTTP/1.1" 201 0
2026-03-28 14:01:31 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item a610f6fb-a046-5c2e-8701-0fcb295f97f1
2026-03-28 14:01:31 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: a610f6fb-a046-5c2e-8701-0fcb295f97f1, skipping ID generation
2026-03-28 14:01:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item a610f6fb-a046-5c2e-8701-0fcb295f97f1
2026-03-28 14:01:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DFH21UNX-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-28 14:01:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=FH21UNX-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-28 14:01:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:01:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c644150>
2026-03-28 14:01:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:01:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:01:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:01:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_755baf27-b55d-5033-a837-c4d9f3659c0e/755baf27-b55d-5033-a837-c4d9f3659c0e_expert_report_file_0c806693-de04-4ce0-9d98-46286799b122.pdf HTTP/1.1" 201 0
2026-03-28 14:01:31 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item 755baf27-b55d-5033-a837-c4d9f3659c0e
2026-03-28 14:01:31 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 755baf27-b55d-5033-a837-c4d9f3659c0e, skipping ID generation
2026-03-28 14:01:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 755baf27-b55d-5033-a837-c4d9f3659c0e
2026-03-28 14:01:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DEJ19URS-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-28 14:01:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=EJ19URS-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-28 14:01:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/VO62RAU/42809976?sv=2020-08-04&st=2026-03-28T14%3A01%3A26Z&se=2026-03-28T14%3A26%3A26Z&sr=b&sp=r&sig=ajraupx01hOhBxj83xq2SeA0U6vZ89qgzfl3QZ0K0u0%3D> (referer: https://www.bca.co.uk/)
2026-03-28 14:01:31 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SB65CAX/697544333/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=697544333>
2026-03-28 14:01:31 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 208d0970-e666-5a1d-bb8d-26c8a38ccb22 with identifier: RX63%20SMO
2026-03-28 14:01:31 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 208d0970-e666-5a1d-bb8d-26c8a38ccb22 with identifier: RX63%20SMO
2026-03-28 14:01:32 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 208d0970-e666-5a1d-bb8d-26c8a38ccb22 with identifier: RX63%20SMO to the API
2026-03-28 14:01:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:01:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:01:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=3&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 100,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=RX63%20SMO-GB',
'category': 'Car',
'color': 'silver',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.6L',
'expiration_date': '2026-03-29T10:00:00Z',
'fuel_type': 'Diesel',
'id': '208d0970-e666-5a1d-bb8d-26c8a38ccb22',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'RX63 SMO',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=RX63%20SMO&vehicleType=*',
'listing': 'auction',
'location': 'Edinburgh',
'make': 'KIA',
'model': 'CEED',
'odometer': 106693,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2013-01-01',
'seller_name': None,
'title': 'KIA CEED 1.6 CRDI 126 E/D 2 Hatchback',
'transmission': 'manual',
'trim': 'CRDI 126 E/D 2',
'vin': 'U5YHN516LEL086444',
'year': 2013}
2026-03-28 14:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27RX63%2520SMO%27 HTTP/1.1" 200 None
2026-03-28 14:01:32 [bca.uk] INFO: Saving data for RX63%20SMO: {'auction_closing_time': 1774778400.0, 'created_time': 1774044457.61291, 'last_price_update_time': 1774706492.300124}
2026-03-28 14:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='RX63%2520SMO') HTTP/1.1" 204 0
2026-03-28 14:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698522088%27 HTTP/1.1" 200 None
2026-03-28 14:01:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698522088 not downloaded yet
2026-03-28 14:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698556176%27 HTTP/1.1" 200 None
2026-03-28 14:01:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698556176 not downloaded yet
2026-03-28 14:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698928804%27 HTTP/1.1" 200 None
2026-03-28 14:01:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698928804 not downloaded yet
2026-03-28 14:01:32 [bca.uk] INFO: Found listing with ID: BG72%20UUY
2026-03-28 14:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BG72%2520UUY%27 HTTP/1.1" 200 None
2026-03-28 14:01:32 [bca.uk] INFO: Scrape type for BG72%20UUY: 1
2026-03-28 14:01:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c2dfa08a-04ba-520a-b1ba-0b0dcf2d9ee2 with identifier: BG72%20UUY
2026-03-28 14:01:32 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item c2dfa08a-04ba-520a-b1ba-0b0dcf2d9ee2
2026-03-28 14:01:32 [bca.uk] INFO: Found listing with ID: SA62%20EKX
2026-03-28 14:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SA62%2520EKX%27 HTTP/1.1" 200 None
2026-03-28 14:01:32 [bca.uk] INFO: Scrape type for SA62%20EKX: 0
2026-03-28 14:01:32 [bca.uk] INFO: Found listing with ID: SB17%20CZR
2026-03-28 14:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SB17%2520CZR%27 HTTP/1.1" 200 None
2026-03-28 14:01:32 [bca.uk] INFO: Scrape type for SB17%20CZR: 0
2026-03-28 14:01:32 [bca.uk] INFO: Found listing with ID: SD61%20OKE
2026-03-28 14:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SD61%2520OKE%27 HTTP/1.1" 200 None
2026-03-28 14:01:32 [bca.uk] INFO: Scrape type for SD61%20OKE: 0
2026-03-28 14:01:32 [bca.uk] INFO: Found listing with ID: SH09%20HCE
2026-03-28 14:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SH09%2520HCE%27 HTTP/1.1" 200 None
2026-03-28 14:01:32 [bca.uk] INFO: Scrape type for SH09%20HCE: 0
2026-03-28 14:01:32 [bca.uk] INFO: Found listing with ID: AG59%20RKO
2026-03-28 14:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27AG59%2520RKO%27 HTTP/1.1" 200 None
2026-03-28 14:01:32 [bca.uk] INFO: Scrape type for AG59%20RKO: 0
2026-03-28 14:01:32 [bca.uk] INFO: Found listing with ID: YB19%20VUL
2026-03-28 14:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YB19%2520VUL%27 HTTP/1.1" 200 None
2026-03-28 14:01:32 [bca.uk] INFO: Scrape type for YB19%20VUL: 0
2026-03-28 14:01:32 [bca.uk] INFO: Found listing with ID: RA68%20WZE
2026-03-28 14:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27RA68%2520WZE%27 HTTP/1.1" 200 None
2026-03-28 14:01:32 [bca.uk] INFO: Scrape type for RA68%20WZE: 1
2026-03-28 14:01:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4de18175-834b-5b06-b8ed-75c0641e29ce with identifier: RA68%20WZE
2026-03-28 14:01:32 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 4de18175-834b-5b06-b8ed-75c0641e29ce
2026-03-28 14:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698970540%27 HTTP/1.1" 200 None
2026-03-28 14:01:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698970540 not downloaded yet
2026-03-28 14:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D697544382%27 HTTP/1.1" 200 None
2026-03-28 14:01:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=697544382 not downloaded yet
2026-03-28 14:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698522093%27 HTTP/1.1" 200 None
2026-03-28 14:01:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698522093 not downloaded yet
2026-03-28 14:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D697938651%27 HTTP/1.1" 200 None
2026-03-28 14:01:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=697938651 not downloaded yet
2026-03-28 14:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698928796%27 HTTP/1.1" 200 None
2026-03-28 14:01:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698928796 not downloaded yet
2026-03-28 14:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698923258%27 HTTP/1.1" 200 None
2026-03-28 14:01:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698923258 not downloaded yet
2026-03-28 14:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698294773%27 HTTP/1.1" 200 None
2026-03-28 14:01:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698294773 not downloaded yet
2026-03-28 14:01:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:01:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a1fd61f50>
2026-03-28 14:01:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:01:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:01:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:01:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7b233ce6-aa01-5f24-ac34-ccc770845b54/7b233ce6-aa01-5f24-ac34-ccc770845b54_image_2.jpg HTTP/1.1" 201 0
2026-03-28 14:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FVO17FMZ%252F698274399%252F600') HTTP/1.1" 204 0
2026-03-28 14:01:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VO17FMZ/698274399/600 saved to cache
2026-03-28 14:01:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 7b233ce6-aa01-5f24-ac34-ccc770845b54
2026-03-28 14:01:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:01:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a1feed110>
2026-03-28 14:01:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:01:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:01:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:01:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_94badcac-d91d-5664-a6fe-32adc35ee01a/94badcac-d91d-5664-a6fe-32adc35ee01a_expert_report_file_57fdc3e2-ee9b-4e08-ba5e-8f54121aacdc.pdf HTTP/1.1" 201 0
2026-03-28 14:01:32 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item 94badcac-d91d-5664-a6fe-32adc35ee01a
2026-03-28 14:01:32 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 94badcac-d91d-5664-a6fe-32adc35ee01a, skipping ID generation
2026-03-28 14:01:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 94badcac-d91d-5664-a6fe-32adc35ee01a
2026-03-28 14:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DWM19BFN-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-28 14:01:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=WM19BFN-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-28 14:01:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YD66KFF/42810264?sv=2020-08-04&st=2026-03-28T14%3A01%3A27Z&se=2026-03-28T14%3A26%3A27Z&sr=b&sp=r&sig=BnH67lWrH1ehlh0fvDCmlxB%2FgGDsNGQtDgFTgEjpoSk%3D> (referer: https://www.bca.co.uk/)
2026-03-28 14:01:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/BL16UUB/42810250?sv=2020-08-04&st=2026-03-28T14%3A01%3A27Z&se=2026-03-28T14%3A26%3A27Z&sr=b&sp=r&sig=SYmTiNujaXYF2XAoxTdHUcpF%2BqchRSrGUQy4u1jrdO0%3D> (referer: https://www.bca.co.uk/)
2026-03-28 14:01:32 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SH14BOU/698522048/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698522048>
2026-03-28 14:01:32 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GU10UYN/698556122/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698556122>
2026-03-28 14:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698522101%27 HTTP/1.1" 200 None
2026-03-28 14:01:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698522101 not downloaded yet
2026-03-28 14:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698556192%27 HTTP/1.1" 200 None
2026-03-28 14:01:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698556192 not downloaded yet
2026-03-28 14:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698928824%27 HTTP/1.1" 200 None
2026-03-28 14:01:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698928824 not downloaded yet
2026-03-28 14:01:32 [bca.uk] INFO: Found listing with ID: FG69%20CVL
2026-03-28 14:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FG69%2520CVL%27 HTTP/1.1" 200 None
2026-03-28 14:01:32 [bca.uk] INFO: Scrape type for FG69%20CVL: 1
2026-03-28 14:01:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a61064e7-41bf-5802-a31a-8f53de5bad6b with identifier: FG69%20CVL
2026-03-28 14:01:32 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item a61064e7-41bf-5802-a31a-8f53de5bad6b
2026-03-28 14:01:32 [bca.uk] INFO: Found listing with ID: FJ20%20XSP
2026-03-28 14:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FJ20%2520XSP%27 HTTP/1.1" 200 None
2026-03-28 14:01:33 [bca.uk] INFO: Scrape type for FJ20%20XSP: 0
2026-03-28 14:01:33 [bca.uk] INFO: Found listing with ID: LB22%20KUJ
2026-03-28 14:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LB22%2520KUJ%27 HTTP/1.1" 200 None
2026-03-28 14:01:33 [bca.uk] INFO: Scrape type for LB22%20KUJ: 2
2026-03-28 14:01:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b6af9ceb-fd5b-5386-b6aa-d50abde7ed68 with identifier: LB22%20KUJ
2026-03-28 14:01:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b6af9ceb-fd5b-5386-b6aa-d50abde7ed68 with scrape type 2
2026-03-28 14:01:33 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b6af9ceb-fd5b-5386-b6aa-d50abde7ed68 with scrape type 2
2026-03-28 14:01:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: b6af9ceb-fd5b-5386-b6aa-d50abde7ed68, identifier: LB22%20KUJ
2026-03-28 14:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698953189%27 HTTP/1.1" 200 None
2026-03-28 14:01:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698953189 not downloaded yet
2026-03-28 14:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D697544395%27 HTTP/1.1" 200 None
2026-03-28 14:01:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=697544395 not downloaded yet
2026-03-28 14:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698522099%27 HTTP/1.1" 200 None
2026-03-28 14:01:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698522099 not downloaded yet
2026-03-28 14:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D697938658%27 HTTP/1.1" 200 None
2026-03-28 14:01:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=697938658 not downloaded yet
2026-03-28 14:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698928815%27 HTTP/1.1" 200 None
2026-03-28 14:01:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698928815 not downloaded yet
2026-03-28 14:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698923269%27 HTTP/1.1" 200 None
2026-03-28 14:01:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698923269 not downloaded yet
2026-03-28 14:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698294784%27 HTTP/1.1" 200 None
2026-03-28 14:01:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698294784 not downloaded yet
2026-03-28 14:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698601797%27 HTTP/1.1" 200 None
2026-03-28 14:01:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698601797 not downloaded yet
2026-03-28 14:01:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/VK65XNW/42810265?sv=2020-08-04&st=2026-03-28T14%3A01%3A28Z&se=2026-03-28T14%3A26%3A28Z&sr=b&sp=r&sig=3QAAN%2BSB1OUMkxc4Xxtv%2BiBflOK5M03dTgEQ%2BLIgSi4%3D> (referer: https://www.bca.co.uk/)
2026-03-28 14:01:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/FL59VTF/42810253?sv=2020-08-04&st=2026-03-28T14%3A01%3A28Z&se=2026-03-28T14%3A26%3A28Z&sr=b&sp=r&sig=GoiG7mqbYuLGhcwWnmQ5IpnLjHLSnXkwhQvXnkkGwWI%3D> (referer: https://www.bca.co.uk/)
2026-03-28 14:01:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VO17FMZ/698274413/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/VO17FMZ/42810377?sv=2020-08-04&st=2026-03-28T14%3A01%3A10Z&se=2026-03-28T14%3A26%3A10Z&sr=b&sp=r&sig=PEm9gdKL%2BNRnVtrVK0%2F5sWr2YcEbrtVNzeob8CJbr3c%3D)
2026-03-28 14:01:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: b6af9ceb-fd5b-5386-b6aa-d50abde7ed68 with identifier: LB22%20KUJ
2026-03-28 14:01:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: b6af9ceb-fd5b-5386-b6aa-d50abde7ed68 with identifier: LB22%20KUJ
2026-03-28 14:01:33 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: b6af9ceb-fd5b-5386-b6aa-d50abde7ed68 with identifier: LB22%20KUJ to the API
2026-03-28 14:01:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:01:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:01:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=3&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 131,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=LB22%20KUJ-GB',
'category': 'Car',
'color': 'white',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.0L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol',
'id': 'b6af9ceb-fd5b-5386-b6aa-d50abde7ed68',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'LB22 KUJ',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=LB22%20KUJ&vehicleType=*',
'listing': 'auction',
'location': 'Bristol',
'make': 'DACIA',
'model': 'JOGGER',
'odometer': 50331,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-01-01',
'seller_name': None,
'title': 'DACIA JOGGER 1.0 TCE ESSENTIAL Estate',
'transmission': 'manual',
'trim': 'TCE ESSENTIAL',
'vin': 'UU1DJF00069677053',
'year': 2022}
2026-03-28 14:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LB22%2520KUJ%27 HTTP/1.1" 200 None
2026-03-28 14:01:33 [bca.uk] INFO: Saving data for LB22%20KUJ: {'auction_closing_time': 1774864800.0, 'created_time': 1774562704.452882, 'last_price_update_time': 1774706493.705694}
2026-03-28 14:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='LB22%2520KUJ') HTTP/1.1" 204 0
2026-03-28 14:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698522113%27 HTTP/1.1" 200 None
2026-03-28 14:01:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698522113 not downloaded yet
2026-03-28 14:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698556209%27 HTTP/1.1" 200 None
2026-03-28 14:01:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698556209 not downloaded yet
2026-03-28 14:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698928849%27 HTTP/1.1" 200 None
2026-03-28 14:01:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698928849 not downloaded yet
2026-03-28 14:01:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:01:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c748c50>
2026-03-28 14:01:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:01:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:01:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:01:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7b233ce6-aa01-5f24-ac34-ccc770845b54/7b233ce6-aa01-5f24-ac34-ccc770845b54_image_3.jpg HTTP/1.1" 201 0
2026-03-28 14:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FVO17FMZ%252F698274406%252F600') HTTP/1.1" 204 0
2026-03-28 14:01:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VO17FMZ/698274406/600 saved to cache
2026-03-28 14:01:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 7b233ce6-aa01-5f24-ac34-ccc770845b54
2026-03-28 14:01:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:01:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a30123e50>
2026-03-28 14:01:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:01:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:01:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:01:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_60bcb64c-26b9-5747-8fc6-986efaa78996/60bcb64c-26b9-5747-8fc6-986efaa78996_expert_report_file_b11751e7-eebb-4353-a8b4-176fb6a99869.pdf HTTP/1.1" 201 0
2026-03-28 14:01:34 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item 60bcb64c-26b9-5747-8fc6-986efaa78996
2026-03-28 14:01:34 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 60bcb64c-26b9-5747-8fc6-986efaa78996, skipping ID generation
2026-03-28 14:01:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 60bcb64c-26b9-5747-8fc6-986efaa78996
2026-03-28 14:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DVO62RAU-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-28 14:01:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=VO62RAU-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-28 14:01:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VO17FMZ/698274418/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/VO17FMZ/42810377?sv=2020-08-04&st=2026-03-28T14%3A01%3A10Z&se=2026-03-28T14%3A26%3A10Z&sr=b&sp=r&sig=PEm9gdKL%2BNRnVtrVK0%2F5sWr2YcEbrtVNzeob8CJbr3c%3D)
2026-03-28 14:01:34 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WA15XTF/697938611/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=697938611>
2026-03-28 14:01:34 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GU10UYN/698556136/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698556136>
2026-03-28 14:01:34 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SH14BOU/698522057/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698522057>
2026-03-28 14:01:34 [bca.uk] INFO: Found listing with ID: KM69%20NXO
2026-03-28 14:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KM69%2520NXO%27 HTTP/1.1" 200 None
2026-03-28 14:01:34 [bca.uk] INFO: Scrape type for KM69%20NXO: 1
2026-03-28 14:01:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 494cffc1-9b07-5d98-9c75-414638ff32d2 with identifier: KM69%20NXO
2026-03-28 14:01:34 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 494cffc1-9b07-5d98-9c75-414638ff32d2
2026-03-28 14:01:34 [bca.uk] INFO: Found listing with ID: LM20%20BCX
2026-03-28 14:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LM20%2520BCX%27 HTTP/1.1" 200 None
2026-03-28 14:01:34 [bca.uk] INFO: Scrape type for LM20%20BCX: 1
2026-03-28 14:01:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 62f297d6-6b1d-5054-88b1-7c86565bdaf1 with identifier: LM20%20BCX
2026-03-28 14:01:34 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 62f297d6-6b1d-5054-88b1-7c86565bdaf1
2026-03-28 14:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698970545%27 HTTP/1.1" 200 None
2026-03-28 14:01:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698970545 not downloaded yet
2026-03-28 14:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D697544407%27 HTTP/1.1" 200 None
2026-03-28 14:01:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=697544407 not downloaded yet
2026-03-28 14:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698522114%27 HTTP/1.1" 200 None
2026-03-28 14:01:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698522114 not downloaded yet
2026-03-28 14:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D697938675%27 HTTP/1.1" 200 None
2026-03-28 14:01:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=697938675 not downloaded yet
2026-03-28 14:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698928836%27 HTTP/1.1" 200 None
2026-03-28 14:01:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698928836 not downloaded yet
2026-03-28 14:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698923287%27 HTTP/1.1" 200 None
2026-03-28 14:01:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698923287 not downloaded yet
2026-03-28 14:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698294798%27 HTTP/1.1" 200 None
2026-03-28 14:01:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698294798 not downloaded yet
2026-03-28 14:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698601813%27 HTTP/1.1" 200 None
2026-03-28 14:01:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698601813 not downloaded yet
2026-03-28 14:01:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VO17FMZ/698274432/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/VO17FMZ/42810377?sv=2020-08-04&st=2026-03-28T14%3A01%3A10Z&se=2026-03-28T14%3A26%3A10Z&sr=b&sp=r&sig=PEm9gdKL%2BNRnVtrVK0%2F5sWr2YcEbrtVNzeob8CJbr3c%3D)
2026-03-28 14:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698522122%27 HTTP/1.1" 200 None
2026-03-28 14:01:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698522122 not downloaded yet
2026-03-28 14:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698556226%27 HTTP/1.1" 200 None
2026-03-28 14:01:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698556226 not downloaded yet
2026-03-28 14:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698928863%27 HTTP/1.1" 200 None
2026-03-28 14:01:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698928863 not downloaded yet
2026-03-28 14:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698928822%27 HTTP/1.1" 200 None
2026-03-28 14:01:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698928822 not downloaded yet
2026-03-28 14:01:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SB65CAX/697544333/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/SB65CAX/42810123?sv=2020-08-04&st=2026-03-28T14%3A01%3A23Z&se=2026-03-28T14%3A26%3A23Z&sr=b&sp=r&sig=vTzzhGIuSP84%2BuZVufy4vR0mq7%2F9VRE2bdnD30Ub%2FBU%3D)
2026-03-28 14:01:34 [bca.uk] INFO: Found listing with ID: KY19%20EBR
2026-03-28 14:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KY19%2520EBR%27 HTTP/1.1" 200 None
2026-03-28 14:01:34 [bca.uk] INFO: Scrape type for KY19%20EBR: 1
2026-03-28 14:01:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3937afb9-0d72-5b2f-b51e-2f8c60821b71 with identifier: KY19%20EBR
2026-03-28 14:01:34 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 3937afb9-0d72-5b2f-b51e-2f8c60821b71
2026-03-28 14:01:34 [bca.uk] INFO: Found listing with ID: ML19%20YHM
2026-03-28 14:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27ML19%2520YHM%27 HTTP/1.1" 200 None
2026-03-28 14:01:34 [bca.uk] INFO: Scrape type for ML19%20YHM: 2
2026-03-28 14:01:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3c8deba4-edee-5023-a28a-a9a2f4ed53e6 with identifier: ML19%20YHM
2026-03-28 14:01:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3c8deba4-edee-5023-a28a-a9a2f4ed53e6 with scrape type 2
2026-03-28 14:01:34 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3c8deba4-edee-5023-a28a-a9a2f4ed53e6 with scrape type 2
2026-03-28 14:01:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 3c8deba4-edee-5023-a28a-a9a2f4ed53e6, identifier: ML19%20YHM
2026-03-28 14:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698522124%27 HTTP/1.1" 200 None
2026-03-28 14:01:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698522124 not downloaded yet
2026-03-28 14:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D697938692%27 HTTP/1.1" 200 None
2026-03-28 14:01:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=697938692 not downloaded yet
2026-03-28 14:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698928858%27 HTTP/1.1" 200 None
2026-03-28 14:01:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698928858 not downloaded yet
2026-03-28 14:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698923307%27 HTTP/1.1" 200 None
2026-03-28 14:01:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698923307 not downloaded yet
2026-03-28 14:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698294807%27 HTTP/1.1" 200 None
2026-03-28 14:01:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698294807 not downloaded yet
2026-03-28 14:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698601833%27 HTTP/1.1" 200 None
2026-03-28 14:01:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698601833 not downloaded yet
2026-03-28 14:01:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:01:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2de22750>
2026-03-28 14:01:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:01:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:01:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:01:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c163b1cf-cc62-5193-9026-6cea3a049e80/c163b1cf-cc62-5193-9026-6cea3a049e80_expert_report_file_2cc0ef32-f39d-4efb-9795-79332d0ec6e9.pdf HTTP/1.1" 201 0
2026-03-28 14:01:34 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item c163b1cf-cc62-5193-9026-6cea3a049e80
2026-03-28 14:01:34 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: c163b1cf-cc62-5193-9026-6cea3a049e80, skipping ID generation
2026-03-28 14:01:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item c163b1cf-cc62-5193-9026-6cea3a049e80
2026-03-28 14:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DYD66KFF-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-28 14:01:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=YD66KFF-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-28 14:01:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:01:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c52d890>
2026-03-28 14:01:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:01:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:01:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:01:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fc54a12c-7c43-5241-baa9-136ed93039c1/fc54a12c-7c43-5241-baa9-136ed93039c1_expert_report_file_74b1d75c-d10c-4ebd-9a04-31857dbce3db.pdf HTTP/1.1" 201 0
2026-03-28 14:01:34 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item fc54a12c-7c43-5241-baa9-136ed93039c1
2026-03-28 14:01:34 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: fc54a12c-7c43-5241-baa9-136ed93039c1, skipping ID generation
2026-03-28 14:01:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item fc54a12c-7c43-5241-baa9-136ed93039c1
2026-03-28 14:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DBL16UUB-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-28 14:01:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=BL16UUB-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-28 14:01:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:01:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2d7c02d0>
2026-03-28 14:01:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:01:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:01:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:01:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_defab1ac-857d-50f7-901c-50783b029725/defab1ac-857d-50f7-901c-50783b029725_expert_report_file_cd80ac44-b49f-4617-a9f1-b17b5f21c81d.pdf HTTP/1.1" 201 0
2026-03-28 14:01:34 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item defab1ac-857d-50f7-901c-50783b029725
2026-03-28 14:01:34 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: defab1ac-857d-50f7-901c-50783b029725, skipping ID generation
2026-03-28 14:01:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item defab1ac-857d-50f7-901c-50783b029725
2026-03-28 14:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DVK65XNW-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-28 14:01:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=VK65XNW-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-28 14:01:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:01:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2d7b6890>
2026-03-28 14:01:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:01:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:01:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:01:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3007384c-6a41-5ced-bc4c-10b628334249/3007384c-6a41-5ced-bc4c-10b628334249_expert_report_file_448ac4b8-86d8-401c-b75e-a61d0c753ef8.pdf HTTP/1.1" 201 0
2026-03-28 14:01:34 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item 3007384c-6a41-5ced-bc4c-10b628334249
2026-03-28 14:01:34 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 3007384c-6a41-5ced-bc4c-10b628334249, skipping ID generation
2026-03-28 14:01:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 3007384c-6a41-5ced-bc4c-10b628334249
2026-03-28 14:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DFL59VTF-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-28 14:01:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=FL59VTF-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-28 14:01:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:01:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2d7db690>
2026-03-28 14:01:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:01:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:01:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:01:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7b233ce6-aa01-5f24-ac34-ccc770845b54/7b233ce6-aa01-5f24-ac34-ccc770845b54_image_4.jpg HTTP/1.1" 201 0
2026-03-28 14:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FVO17FMZ%252F698274413%252F600') HTTP/1.1" 204 0
2026-03-28 14:01:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VO17FMZ/698274413/600 saved to cache
2026-03-28 14:01:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 7b233ce6-aa01-5f24-ac34-ccc770845b54
2026-03-28 14:01:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GU10UYN/698556122/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/GU10UYN/42810320?sv=2020-08-04&st=2026-03-28T14%3A01%3A23Z&se=2026-03-28T14%3A26%3A23Z&sr=b&sp=r&sig=mGNhX9MAfZVu5g6PpXH03XgVnNc%2FnLjEd8Y2gqIppCM%3D)
2026-03-28 14:01:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SH14BOU/698522048/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/SH14BOU/42810142?sv=2020-08-04&st=2026-03-28T14%3A01%3A23Z&se=2026-03-28T14%3A26%3A23Z&sr=b&sp=r&sig=qF%2Fj8vLm9uL8z4mTnCxa7QRX8NL1HO0if01okEQdE50%3D)
2026-03-28 14:01:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 3c8deba4-edee-5023-a28a-a9a2f4ed53e6 with identifier: ML19%20YHM
2026-03-28 14:01:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 3c8deba4-edee-5023-a28a-a9a2f4ed53e6 with identifier: ML19%20YHM
2026-03-28 14:01:35 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 3c8deba4-edee-5023-a28a-a9a2f4ed53e6 with identifier: ML19%20YHM to the API
2026-03-28 14:01:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:01:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:01:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=3&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 110,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=ML19%20YHM-GB',
'category': 'Car',
'color': 'red',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.0L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol',
'id': '3c8deba4-edee-5023-a28a-a9a2f4ed53e6',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'ML19 YHM',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=ML19%20YHM&vehicleType=*',
'listing': 'auction',
'location': 'Bristol',
'make': 'VOLKSWAGEN',
'model': 'POLO',
'odometer': 27847,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-01-01',
'seller_name': None,
'title': 'VOLKSWAGEN POLO 1.0 EVO 80 SE Hatchback',
'transmission': 'manual',
'trim': 'EVO 80 SE',
'vin': 'WVWZZZAWZKU048357',
'year': 2019}
2026-03-28 14:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27ML19%2520YHM%27 HTTP/1.1" 200 None
2026-03-28 14:01:35 [bca.uk] INFO: Saving data for ML19%20YHM: {'auction_closing_time': 1774864800.0, 'created_time': 1774305608.289614, 'last_price_update_time': 1774706495.501459}
2026-03-28 14:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='ML19%2520YHM') HTTP/1.1" 204 0
2026-03-28 14:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698522134%27 HTTP/1.1" 200 None
2026-03-28 14:01:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698522134 not downloaded yet
2026-03-28 14:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698556242%27 HTTP/1.1" 200 None
2026-03-28 14:01:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698556242 not downloaded yet
2026-03-28 14:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698928896%27 HTTP/1.1" 200 None
2026-03-28 14:01:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698928896 not downloaded yet
2026-03-28 14:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698928851%27 HTTP/1.1" 200 None
2026-03-28 14:01:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698928851 not downloaded yet
2026-03-28 14:01:35 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WA15XTF/697938624/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=697938624>
2026-03-28 14:01:35 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SF65MRS/698522063/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698522063>
2026-03-28 14:01:35 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YW64DGU/698928804/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698928804>
2026-03-28 14:01:35 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EJ19URS/698294761/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=EJ19URS-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-28 14:01:35 [bca.uk] INFO: Found listing with ID: SK20%20URM
2026-03-28 14:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SK20%2520URM%27 HTTP/1.1" 200 None
2026-03-28 14:01:35 [bca.uk] INFO: Scrape type for SK20%20URM: 0
2026-03-28 14:01:35 [bca.uk] INFO: Found listing with ID: KX09%20XPF
2026-03-28 14:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KX09%2520XPF%27 HTTP/1.1" 200 None
2026-03-28 14:01:35 [bca.uk] INFO: Scrape type for KX09%20XPF: 1
2026-03-28 14:01:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 80521ed8-2cf2-526c-aee2-2d1012f8f649 with identifier: KX09%20XPF
2026-03-28 14:01:35 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 80521ed8-2cf2-526c-aee2-2d1012f8f649
2026-03-28 14:01:35 [bca.uk] INFO: Found listing with ID: MX22%20PPO
2026-03-28 14:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MX22%2520PPO%27 HTTP/1.1" 200 None
2026-03-28 14:01:35 [bca.uk] INFO: Scrape type for MX22%20PPO: 1
2026-03-28 14:01:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bbaf1f9b-e6a2-5ab9-9d30-d087740491cb with identifier: MX22%20PPO
2026-03-28 14:01:35 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item bbaf1f9b-e6a2-5ab9-9d30-d087740491cb
2026-03-28 14:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698522140%27 HTTP/1.1" 200 None
2026-03-28 14:01:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698522140 not downloaded yet
2026-03-28 14:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D697938708%27 HTTP/1.1" 200 None
2026-03-28 14:01:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=697938708 not downloaded yet
2026-03-28 14:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698928877%27 HTTP/1.1" 200 None
2026-03-28 14:01:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698928877 not downloaded yet
2026-03-28 14:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698923325%27 HTTP/1.1" 200 None
2026-03-28 14:01:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698923325 not downloaded yet
2026-03-28 14:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698294822%27 HTTP/1.1" 200 None
2026-03-28 14:01:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698294822 not downloaded yet
2026-03-28 14:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698601845%27 HTTP/1.1" 200 None
2026-03-28 14:01:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698601845 not downloaded yet
2026-03-28 14:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698260485%27 HTTP/1.1" 200 None
2026-03-28 14:01:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698260485 not downloaded yet
2026-03-28 14:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D697704387%27 HTTP/1.1" 200 None
2026-03-28 14:01:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=697704387 not downloaded yet
2026-03-28 14:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D697722945%27 HTTP/1.1" 200 None
2026-03-28 14:01:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=697722945 not downloaded yet
2026-03-28 14:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698069835%27 HTTP/1.1" 200 None
2026-03-28 14:01:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698069835 not downloaded yet
2026-03-28 14:01:35 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GU10UYN/698556176/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698556176>
2026-03-28 14:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698928923%27 HTTP/1.1" 200 None
2026-03-28 14:01:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698928923 not downloaded yet
2026-03-28 14:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698928871%27 HTTP/1.1" 200 None
2026-03-28 14:01:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698928871 not downloaded yet
2026-03-28 14:01:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:01:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2d945290>
2026-03-28 14:01:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:01:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:01:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:01:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7b233ce6-aa01-5f24-ac34-ccc770845b54/7b233ce6-aa01-5f24-ac34-ccc770845b54_image_5.jpg HTTP/1.1" 201 0
2026-03-28 14:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FVO17FMZ%252F698274418%252F600') HTTP/1.1" 204 0
2026-03-28 14:01:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VO17FMZ/698274418/600 saved to cache
2026-03-28 14:01:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 7b233ce6-aa01-5f24-ac34-ccc770845b54
2026-03-28 14:01:35 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:01:35 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:01:35 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:01:35 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:01:35 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:01:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:01:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2d755010>
2026-03-28 14:01:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:01:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:01:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:01:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7b233ce6-aa01-5f24-ac34-ccc770845b54/7b233ce6-aa01-5f24-ac34-ccc770845b54_image_6.jpg HTTP/1.1" 201 0
2026-03-28 14:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FVO17FMZ%252F698274432%252F600') HTTP/1.1" 204 0
2026-03-28 14:01:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VO17FMZ/698274432/600 saved to cache
2026-03-28 14:01:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 7b233ce6-aa01-5f24-ac34-ccc770845b54
2026-03-28 14:01:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:01:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a30121a50>
2026-03-28 14:01:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:01:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:01:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:01:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_05412951-b5cb-5847-b7df-8f166615ed23/05412951-b5cb-5847-b7df-8f166615ed23_image_2.jpg HTTP/1.1" 201 0
2026-03-28 14:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FSB65CAX%252F697544333%252F600') HTTP/1.1" 204 0
2026-03-28 14:01:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SB65CAX/697544333/600 saved to cache
2026-03-28 14:01:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 05412951-b5cb-5847-b7df-8f166615ed23
2026-03-28 14:01:36 [bca.uk] INFO: Found listing with ID: LD14%20UGX
2026-03-28 14:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LD14%2520UGX%27 HTTP/1.1" 200 None
2026-03-28 14:01:36 [bca.uk] INFO: Scrape type for LD14%20UGX: 1
2026-03-28 14:01:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c886d5a8-7924-5e92-b88e-1f87c5b1511a with identifier: LD14%20UGX
2026-03-28 14:01:36 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item c886d5a8-7924-5e92-b88e-1f87c5b1511a
2026-03-28 14:01:36 [bca.uk] INFO: Found listing with ID: SH19%20ZZL
2026-03-28 14:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SH19%2520ZZL%27 HTTP/1.1" 200 None
2026-03-28 14:01:36 [bca.uk] INFO: Scrape type for SH19%20ZZL: 0
2026-03-28 14:01:36 [bca.uk] INFO: Found listing with ID: VN21%20GCK
2026-03-28 14:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27VN21%2520GCK%27 HTTP/1.1" 200 None
2026-03-28 14:01:36 [bca.uk] INFO: Scrape type for VN21%20GCK: 1
2026-03-28 14:01:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 042f9bcc-1260-53d1-9b7d-30c11d39be73 with identifier: VN21%20GCK
2026-03-28 14:01:36 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 042f9bcc-1260-53d1-9b7d-30c11d39be73
2026-03-28 14:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698522154%27 HTTP/1.1" 200 None
2026-03-28 14:01:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698522154 not downloaded yet
2026-03-28 14:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D697938732%27 HTTP/1.1" 200 None
2026-03-28 14:01:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=697938732 not downloaded yet
2026-03-28 14:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698928899%27 HTTP/1.1" 200 None
2026-03-28 14:01:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698928899 not downloaded yet
2026-03-28 14:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698923356%27 HTTP/1.1" 200 None
2026-03-28 14:01:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698923356 not downloaded yet
2026-03-28 14:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698294830%27 HTTP/1.1" 200 None
2026-03-28 14:01:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698294830 not downloaded yet
2026-03-28 14:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698601858%27 HTTP/1.1" 200 None
2026-03-28 14:01:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698601858 not downloaded yet
2026-03-28 14:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698260488%27 HTTP/1.1" 200 None
2026-03-28 14:01:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698260488 not downloaded yet
2026-03-28 14:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D697704392%27 HTTP/1.1" 200 None
2026-03-28 14:01:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=697704392 not downloaded yet
2026-03-28 14:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D697722953%27 HTTP/1.1" 200 None
2026-03-28 14:01:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=697722953 not downloaded yet
2026-03-28 14:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698069840%27 HTTP/1.1" 200 None
2026-03-28 14:01:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698069840 not downloaded yet
2026-03-28 14:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698928956%27 HTTP/1.1" 200 None
2026-03-28 14:01:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698928956 not downloaded yet
2026-03-28 14:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698928885%27 HTTP/1.1" 200 None
2026-03-28 14:01:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698928885 not downloaded yet
2026-03-28 14:01:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:01:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c6aa350>
2026-03-28 14:01:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:01:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:01:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:01:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_24b3d1e2-9046-567a-ba39-2d683a6b4342/24b3d1e2-9046-567a-ba39-2d683a6b4342_image_1.jpg HTTP/1.1" 201 0
2026-03-28 14:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FGU10UYN%252F698556122%252F600') HTTP/1.1" 204 0
2026-03-28 14:01:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GU10UYN/698556122/600 saved to cache
2026-03-28 14:01:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 24b3d1e2-9046-567a-ba39-2d683a6b4342
2026-03-28 14:01:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:01:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2d9a7fd0>
2026-03-28 14:01:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:01:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:01:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:01:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7ca8ff92-ba13-58b4-8b9a-c74a2e2ed8c1/7ca8ff92-ba13-58b4-8b9a-c74a2e2ed8c1_image_1.jpg HTTP/1.1" 201 0
2026-03-28 14:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FSH14BOU%252F698522048%252F600') HTTP/1.1" 204 0
2026-03-28 14:01:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SH14BOU/698522048/600 saved to cache
2026-03-28 14:01:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 7ca8ff92-ba13-58b4-8b9a-c74a2e2ed8c1
2026-03-28 14:01:36 [bca.uk] INFO: Found listing with ID: SE16%20KBX
2026-03-28 14:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SE16%2520KBX%27 HTTP/1.1" 200 None
2026-03-28 14:01:36 [bca.uk] INFO: Scrape type for SE16%20KBX: 1
2026-03-28 14:01:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2e77e548-6211-5739-af41-39c112c5041c with identifier: SE16%20KBX
2026-03-28 14:01:36 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 2e77e548-6211-5739-af41-39c112c5041c
2026-03-28 14:01:36 [bca.uk] INFO: Found listing with ID: WX18%20RMZ
2026-03-28 14:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WX18%2520RMZ%27 HTTP/1.1" 200 None
2026-03-28 14:01:36 [bca.uk] INFO: Scrape type for WX18%20RMZ: 1
2026-03-28 14:01:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e4a41ade-3285-55a6-95db-86a4f368e5a7 with identifier: WX18%20RMZ
2026-03-28 14:01:36 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item e4a41ade-3285-55a6-95db-86a4f368e5a7
2026-03-28 14:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698928924%27 HTTP/1.1" 200 None
2026-03-28 14:01:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698928924 not downloaded yet
2026-03-28 14:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698923386%27 HTTP/1.1" 200 None
2026-03-28 14:01:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698923386 not downloaded yet
2026-03-28 14:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698294848%27 HTTP/1.1" 200 None
2026-03-28 14:01:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698294848 not downloaded yet
2026-03-28 14:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698601888%27 HTTP/1.1" 200 None
2026-03-28 14:01:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698601888 not downloaded yet
2026-03-28 14:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698260492%27 HTTP/1.1" 200 None
2026-03-28 14:01:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698260492 not downloaded yet
2026-03-28 14:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D697704395%27 HTTP/1.1" 200 None
2026-03-28 14:01:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=697704395 not downloaded yet
2026-03-28 14:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D697722963%27 HTTP/1.1" 200 None
2026-03-28 14:01:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=697722963 not downloaded yet
2026-03-28 14:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698069847%27 HTTP/1.1" 200 None
2026-03-28 14:01:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698069847 not downloaded yet
2026-03-28 14:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698928973%27 HTTP/1.1" 200 None
2026-03-28 14:01:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698928973 not downloaded yet
2026-03-28 14:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698928900%27 HTTP/1.1" 200 None
2026-03-28 14:01:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698928900 not downloaded yet
2026-03-28 14:01:36 [bca.uk] INFO: Found listing with ID: PN64%20UHS
2026-03-28 14:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27PN64%2520UHS%27 HTTP/1.1" 200 None
2026-03-28 14:01:36 [bca.uk] INFO: Scrape type for PN64%20UHS: 1
2026-03-28 14:01:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0314c884-43b5-5d2e-81ae-0d6223087ff6 with identifier: PN64%20UHS
2026-03-28 14:01:36 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 0314c884-43b5-5d2e-81ae-0d6223087ff6
2026-03-28 14:01:36 [bca.uk] INFO: Found listing with ID: WX70%20JZJ
2026-03-28 14:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WX70%2520JZJ%27 HTTP/1.1" 200 None
2026-03-28 14:01:36 [bca.uk] INFO: Scrape type for WX70%20JZJ: 1
2026-03-28 14:01:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 78b2ead9-6d58-5edb-a028-9b77396fb5da with identifier: WX70%20JZJ
2026-03-28 14:01:36 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 78b2ead9-6d58-5edb-a028-9b77396fb5da
2026-03-28 14:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698928945%27 HTTP/1.1" 200 None
2026-03-28 14:01:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698928945 not downloaded yet
2026-03-28 14:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698923419%27 HTTP/1.1" 200 None
2026-03-28 14:01:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698923419 not downloaded yet
2026-03-28 14:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698294858%27 HTTP/1.1" 200 None
2026-03-28 14:01:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698294858 not downloaded yet
2026-03-28 14:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698601908%27 HTTP/1.1" 200 None
2026-03-28 14:01:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698601908 not downloaded yet
2026-03-28 14:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698260498%27 HTTP/1.1" 200 None
2026-03-28 14:01:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698260498 not downloaded yet
2026-03-28 14:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D697704398%27 HTTP/1.1" 200 None
2026-03-28 14:01:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=697704398 not downloaded yet
2026-03-28 14:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D697722974%27 HTTP/1.1" 200 None
2026-03-28 14:01:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=697722974 not downloaded yet
2026-03-28 14:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698069856%27 HTTP/1.1" 200 None
2026-03-28 14:01:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698069856 not downloaded yet
2026-03-28 14:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698928925%27 HTTP/1.1" 200 None
2026-03-28 14:01:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698928925 not downloaded yet
2026-03-28 14:01:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GU10UYN/698556176/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/GU10UYN/42810320?sv=2020-08-04&st=2026-03-28T14%3A01%3A23Z&se=2026-03-28T14%3A26%3A23Z&sr=b&sp=r&sig=mGNhX9MAfZVu5g6PpXH03XgVnNc%2FnLjEd8Y2gqIppCM%3D)
2026-03-28 14:01:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WA15XTF/697938624/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/WA15XTF/42809463?sv=2020-08-04&st=2026-03-28T14%3A01%3A23Z&se=2026-03-28T14%3A26%3A23Z&sr=b&sp=r&sig=OVT1XXFunRJjcV5jy5Zgfxxi5O1xAq2cfTX%2F%2FcIif88%3D)
2026-03-28 14:01:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GU10UYN/698556136/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/GU10UYN/42810320?sv=2020-08-04&st=2026-03-28T14%3A01%3A23Z&se=2026-03-28T14%3A26%3A23Z&sr=b&sp=r&sig=mGNhX9MAfZVu5g6PpXH03XgVnNc%2FnLjEd8Y2gqIppCM%3D)
2026-03-28 14:01:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SF65MRS/698522063/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/SF65MRS/42810141?sv=2020-08-04&st=2026-03-28T14%3A01%3A23Z&se=2026-03-28T14%3A26%3A23Z&sr=b&sp=r&sig=pKcKPXIMRDrpvR7qgfCAU8Cghh7jF%2FL25jpHeT9Gs0U%3D)
2026-03-28 14:01:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EJ19URS/698294761/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/EJ19URS/42798170?sv=2020-08-04&st=2026-03-28T14%3A01%3A25Z&se=2026-03-28T14%3A26%3A25Z&sr=b&sp=r&sig=rAxmzY9RDaFtqRrL9CfX2gFSW4Q22XPI9rfpZk%2B4AL4%3D)
2026-03-28 14:01:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YW64DGU/698928804/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YW64DGU/42810194?sv=2020-08-04&st=2026-03-28T14%3A01%3A23Z&se=2026-03-28T14%3A26%3A23Z&sr=b&sp=r&sig=bKUUxkl%2FQOTN6xP3oKLYX53uOLW1seBVRfhSdF3FtAg%3D)
2026-03-28 14:01:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WA15XTF/697938611/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/WA15XTF/42809463?sv=2020-08-04&st=2026-03-28T14%3A01%3A23Z&se=2026-03-28T14%3A26%3A23Z&sr=b&sp=r&sig=OVT1XXFunRJjcV5jy5Zgfxxi5O1xAq2cfTX%2F%2FcIif88%3D)
2026-03-28 14:01:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SH14BOU/698522057/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/SH14BOU/42810142?sv=2020-08-04&st=2026-03-28T14%3A01%3A23Z&se=2026-03-28T14%3A26%3A23Z&sr=b&sp=r&sig=qF%2Fj8vLm9uL8z4mTnCxa7QRX8NL1HO0if01okEQdE50%3D)
2026-03-28 14:01:36 [bca.uk] INFO: Found listing with ID: RO63%20WRK
2026-03-28 14:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27RO63%2520WRK%27 HTTP/1.1" 200 None
2026-03-28 14:01:36 [bca.uk] INFO: Scrape type for RO63%20WRK: 1
2026-03-28 14:01:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 10beb970-842b-5836-9952-ce1ec016ade8 with identifier: RO63%20WRK
2026-03-28 14:01:36 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 10beb970-842b-5836-9952-ce1ec016ade8
2026-03-28 14:01:36 [bca.uk] INFO: Found listing with ID: CA18%20JPY
2026-03-28 14:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27CA18%2520JPY%27 HTTP/1.1" 200 None
2026-03-28 14:01:37 [bca.uk] INFO: Scrape type for CA18%20JPY: 0
2026-03-28 14:01:37 [bca.uk] INFO: Found listing with ID: CP19%20XKX
2026-03-28 14:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27CP19%2520XKX%27 HTTP/1.1" 200 None
2026-03-28 14:01:37 [bca.uk] INFO: Scrape type for CP19%20XKX: 1
2026-03-28 14:01:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b697841c-f8f8-5c3e-a0f7-75585967ab4c with identifier: CP19%20XKX
2026-03-28 14:01:37 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item b697841c-f8f8-5c3e-a0f7-75585967ab4c
2026-03-28 14:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698928974%27 HTTP/1.1" 200 None
2026-03-28 14:01:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698928974 not downloaded yet
2026-03-28 14:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698923445%27 HTTP/1.1" 200 None
2026-03-28 14:01:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698923445 not downloaded yet
2026-03-28 14:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698294872%27 HTTP/1.1" 200 None
2026-03-28 14:01:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698294872 not downloaded yet
2026-03-28 14:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698601922%27 HTTP/1.1" 200 None
2026-03-28 14:01:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698601922 not downloaded yet
2026-03-28 14:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698260508%27 HTTP/1.1" 200 None
2026-03-28 14:01:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698260508 not downloaded yet
2026-03-28 14:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D697704402%27 HTTP/1.1" 200 None
2026-03-28 14:01:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=697704402 not downloaded yet
2026-03-28 14:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D697722988%27 HTTP/1.1" 200 None
2026-03-28 14:01:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=697722988 not downloaded yet
2026-03-28 14:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698069861%27 HTTP/1.1" 200 None
2026-03-28 14:01:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698069861 not downloaded yet
2026-03-28 14:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698928946%27 HTTP/1.1" 200 None
2026-03-28 14:01:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698928946 not downloaded yet
2026-03-28 14:01:37 [bca.uk] INFO: Found listing with ID: JS51%20JOK
2026-03-28 14:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27JS51%2520JOK%27 HTTP/1.1" 200 None
2026-03-28 14:01:37 [bca.uk] INFO: Scrape type for JS51%20JOK: 2
2026-03-28 14:01:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e6cb1169-5006-5b6d-997d-79acddd4e723 with identifier: JS51%20JOK
2026-03-28 14:01:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e6cb1169-5006-5b6d-997d-79acddd4e723 with scrape type 2
2026-03-28 14:01:37 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e6cb1169-5006-5b6d-997d-79acddd4e723 with scrape type 2
2026-03-28 14:01:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: e6cb1169-5006-5b6d-997d-79acddd4e723, identifier: JS51%20JOK
2026-03-28 14:01:37 [bca.uk] INFO: Found listing with ID: WP22%20GWL
2026-03-28 14:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WP22%2520GWL%27 HTTP/1.1" 200 None
2026-03-28 14:01:37 [bca.uk] INFO: Scrape type for WP22%20GWL: 2
2026-03-28 14:01:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 15b21a0f-88dd-58d2-981c-b10423b58a1d with identifier: WP22%20GWL
2026-03-28 14:01:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 15b21a0f-88dd-58d2-981c-b10423b58a1d with scrape type 2
2026-03-28 14:01:37 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 15b21a0f-88dd-58d2-981c-b10423b58a1d with scrape type 2
2026-03-28 14:01:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 15b21a0f-88dd-58d2-981c-b10423b58a1d, identifier: WP22%20GWL
2026-03-28 14:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698601937%27 HTTP/1.1" 200 None
2026-03-28 14:01:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698601937 not downloaded yet
2026-03-28 14:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698260519%27 HTTP/1.1" 200 None
2026-03-28 14:01:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698260519 not downloaded yet
2026-03-28 14:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D697704406%27 HTTP/1.1" 200 None
2026-03-28 14:01:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=697704406 not downloaded yet
2026-03-28 14:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D697723008%27 HTTP/1.1" 200 None
2026-03-28 14:01:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=697723008 not downloaded yet
2026-03-28 14:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698069876%27 HTTP/1.1" 200 None
2026-03-28 14:01:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698069876 not downloaded yet
2026-03-28 14:01:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: e6cb1169-5006-5b6d-997d-79acddd4e723 with identifier: JS51%20JOK
2026-03-28 14:01:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: e6cb1169-5006-5b6d-997d-79acddd4e723 with identifier: JS51%20JOK
2026-03-28 14:01:37 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: e6cb1169-5006-5b6d-997d-79acddd4e723 with identifier: JS51%20JOK to the API
2026-03-28 14:01:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:01:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:01:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=2&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 194,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=JS51%20JOK-GB',
'category': 'Car',
'color': 'red',
'currency': 'GBP',
'doors_number': 5,
'engine': '2.2L',
'expiration_date': '2026-03-29T10:00:00Z',
'fuel_type': 'Diesel',
'id': 'e6cb1169-5006-5b6d-997d-79acddd4e723',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'JS51 JOK',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=JS51%20JOK&vehicleType=*',
'listing': 'auction',
'location': 'Livingston',
'make': 'MITSUBISHI',
'model': 'OUTLANDER II',
'odometer': 53271,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2008-01-01',
'seller_name': None,
'title': 'MITSUBISHI OUTLANDER II 2.2 DI-DC DIAMOND StationWagon',
'transmission': 'manual',
'trim': 'DI-DC DIAMOND',
'vin': 'JMAXJCW7W8Z000567',
'year': 2008}
2026-03-28 14:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27JS51%2520JOK%27 HTTP/1.1" 200 None
2026-03-28 14:01:38 [bca.uk] INFO: Saving data for JS51%20JOK: {'auction_closing_time': 1774778400.0, 'created_time': 1774505591.428425, 'last_price_update_time': 1774706498.344701}
2026-03-28 14:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='JS51%2520JOK') HTTP/1.1" 204 0
2026-03-28 14:01:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 15b21a0f-88dd-58d2-981c-b10423b58a1d with identifier: WP22%20GWL
2026-03-28 14:01:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 15b21a0f-88dd-58d2-981c-b10423b58a1d with identifier: WP22%20GWL
2026-03-28 14:01:38 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 15b21a0f-88dd-58d2-981c-b10423b58a1d with identifier: WP22%20GWL to the API
2026-03-28 14:01:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:01:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:01:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=3&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 166,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=WP22%20GWL-GB',
'category': 'Car',
'color': 'white',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.5L',
'expiration_date': '2026-03-31T10:00:00Z',
'fuel_type': 'Petrol',
'id': '15b21a0f-88dd-58d2-981c-b10423b58a1d',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'WP22 GWL',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=WP22%20GWL&vehicleType=*',
'listing': 'auction',
'location': 'Bristol',
'make': 'VOLKSWAGEN',
'model': 'TIGUAN',
'odometer': 34345,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-01-01',
'seller_name': None,
'title': 'VOLKSWAGEN TIGUAN 1.5 TSI 150 R LINE DSG StationWagon',
'transmission': 'automatic',
'trim': 'TSI 150 R LINE DSG',
'vin': 'WVGZZZ5NZNW061442',
'year': 2022}
2026-03-28 14:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WP22%2520GWL%27 HTTP/1.1" 200 None
2026-03-28 14:01:38 [bca.uk] INFO: Saving data for WP22%20GWL: {'auction_closing_time': 1774951200.0, 'created_time': 1774562682.245281, 'last_price_update_time': 1774706498.838248}
2026-03-28 14:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='WP22%2520GWL') HTTP/1.1" 204 0
2026-03-28 14:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698928975%27 HTTP/1.1" 200 None
2026-03-28 14:01:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698928975 not downloaded yet
2026-03-28 14:01:38 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YD66KFF/698260488/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698260488>
2026-03-28 14:01:38 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BL16UUB/697704392/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=697704392>
2026-03-28 14:01:38 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WM19BFN/698601858/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698601858>
2026-03-28 14:01:38 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FL59VTF/698069840/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698069840>
2026-03-28 14:01:38 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VK65XNW/697722953/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=697722953>
2026-03-28 14:01:38 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FH21UNX/698923356/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698923356>
2026-03-28 14:01:38 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EJ19URS/698294830/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698294830>
2026-03-28 14:01:38 [bca.uk] INFO: Found listing with ID: FV20%20CSZ
2026-03-28 14:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FV20%2520CSZ%27 HTTP/1.1" 200 None
2026-03-28 14:01:38 [bca.uk] INFO: Scrape type for FV20%20CSZ: 0
2026-03-28 14:01:38 [bca.uk] INFO: Found listing with ID: CU72%20ZHM
2026-03-28 14:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27CU72%2520ZHM%27 HTTP/1.1" 200 None
2026-03-28 14:01:38 [bca.uk] INFO: Scrape type for CU72%20ZHM: 2
2026-03-28 14:01:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4c608761-e726-59cf-ae78-06b30c913589 with identifier: CU72%20ZHM
2026-03-28 14:01:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4c608761-e726-59cf-ae78-06b30c913589 with scrape type 2
2026-03-28 14:01:38 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4c608761-e726-59cf-ae78-06b30c913589 with scrape type 2
2026-03-28 14:01:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 4c608761-e726-59cf-ae78-06b30c913589, identifier: CU72%20ZHM
2026-03-28 14:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698260528%27 HTTP/1.1" 200 None
2026-03-28 14:01:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698260528 not downloaded yet
2026-03-28 14:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D697704410%27 HTTP/1.1" 200 None
2026-03-28 14:01:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=697704410 not downloaded yet
2026-03-28 14:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D697723030%27 HTTP/1.1" 200 None
2026-03-28 14:01:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=697723030 not downloaded yet
2026-03-28 14:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698069889%27 HTTP/1.1" 200 None
2026-03-28 14:01:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698069889 not downloaded yet
2026-03-28 14:01:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:01:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2d993850>
2026-03-28 14:01:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:01:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:01:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:01:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_24b3d1e2-9046-567a-ba39-2d683a6b4342/24b3d1e2-9046-567a-ba39-2d683a6b4342_image_5.jpg HTTP/1.1" 201 0
2026-03-28 14:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FGU10UYN%252F698556176%252F600') HTTP/1.1" 204 0
2026-03-28 14:01:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GU10UYN/698556176/600 saved to cache
2026-03-28 14:01:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 24b3d1e2-9046-567a-ba39-2d683a6b4342
2026-03-28 14:01:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:01:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2d727f10>
2026-03-28 14:01:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:01:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:01:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:01:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_012921cb-8763-5e72-9bbe-1684326c9a1d/012921cb-8763-5e72-9bbe-1684326c9a1d_image_2.jpg HTTP/1.1" 201 0
2026-03-28 14:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FWA15XTF%252F697938624%252F600') HTTP/1.1" 204 0
2026-03-28 14:01:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WA15XTF/697938624/600 saved to cache
2026-03-28 14:01:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 012921cb-8763-5e72-9bbe-1684326c9a1d
2026-03-28 14:01:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:01:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2d6b7f10>
2026-03-28 14:01:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:01:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:01:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:01:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_24b3d1e2-9046-567a-ba39-2d683a6b4342/24b3d1e2-9046-567a-ba39-2d683a6b4342_image_2.jpg HTTP/1.1" 201 0
2026-03-28 14:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FGU10UYN%252F698556136%252F600') HTTP/1.1" 204 0
2026-03-28 14:01:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GU10UYN/698556136/600 saved to cache
2026-03-28 14:01:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 24b3d1e2-9046-567a-ba39-2d683a6b4342
2026-03-28 14:01:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:01:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2d6af550>
2026-03-28 14:01:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:01:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:01:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:01:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_228041df-5797-5c8f-89c8-2a337a640ead/228041df-5797-5c8f-89c8-2a337a640ead_image_2.jpg HTTP/1.1" 201 0
2026-03-28 14:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FSF65MRS%252F698522063%252F600') HTTP/1.1" 204 0
2026-03-28 14:01:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SF65MRS/698522063/600 saved to cache
2026-03-28 14:01:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 228041df-5797-5c8f-89c8-2a337a640ead
2026-03-28 14:01:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:01:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2d73d610>
2026-03-28 14:01:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:01:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:01:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:01:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_755baf27-b55d-5033-a837-c4d9f3659c0e/755baf27-b55d-5033-a837-c4d9f3659c0e_image_0.jpg HTTP/1.1" 201 0
2026-03-28 14:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FEJ19URS%252F698294761%252F600') HTTP/1.1" 204 0
2026-03-28 14:01:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EJ19URS/698294761/600 saved to cache
2026-03-28 14:01:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 755baf27-b55d-5033-a837-c4d9f3659c0e
2026-03-28 14:01:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:01:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2d724e50>
2026-03-28 14:01:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:01:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:01:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:01:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5b546abb-9cfb-537e-b2ac-6d60a5514e55/5b546abb-9cfb-537e-b2ac-6d60a5514e55_image_2.jpg HTTP/1.1" 201 0
2026-03-28 14:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FYW64DGU%252F698928804%252F600') HTTP/1.1" 204 0
2026-03-28 14:01:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YW64DGU/698928804/600 saved to cache
2026-03-28 14:01:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 5b546abb-9cfb-537e-b2ac-6d60a5514e55
2026-03-28 14:01:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:01:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2d6ac110>
2026-03-28 14:01:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:01:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:01:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:01:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_012921cb-8763-5e72-9bbe-1684326c9a1d/012921cb-8763-5e72-9bbe-1684326c9a1d_image_1.jpg HTTP/1.1" 201 0
2026-03-28 14:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FWA15XTF%252F697938611%252F600') HTTP/1.1" 204 0
2026-03-28 14:01:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WA15XTF/697938611/600 saved to cache
2026-03-28 14:01:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 012921cb-8763-5e72-9bbe-1684326c9a1d
2026-03-28 14:01:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:01:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2d726f10>
2026-03-28 14:01:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:01:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:01:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:01:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7ca8ff92-ba13-58b4-8b9a-c74a2e2ed8c1/7ca8ff92-ba13-58b4-8b9a-c74a2e2ed8c1_image_2.jpg HTTP/1.1" 201 0
2026-03-28 14:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FSH14BOU%252F698522057%252F600') HTTP/1.1" 204 0
2026-03-28 14:01:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SH14BOU/698522057/600 saved to cache
2026-03-28 14:01:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 7ca8ff92-ba13-58b4-8b9a-c74a2e2ed8c1
2026-03-28 14:01:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 4c608761-e726-59cf-ae78-06b30c913589 with identifier: CU72%20ZHM
2026-03-28 14:01:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-28 14:01:39 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=Petrol%2FElectric HTTP/1.1" 200 None
2026-03-28 14:01:39 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-28 14:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-28 14:01:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 4c608761-e726-59cf-ae78-06b30c913589 with identifier: CU72%20ZHM
2026-03-28 14:01:39 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 4c608761-e726-59cf-ae78-06b30c913589 with identifier: CU72%20ZHM to the API
2026-03-28 14:01:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:01:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:01:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=3&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 98,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=CU72%20ZHM-GB',
'category': 'Car',
'color': 'grey',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.5L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol/Electric',
'id': '4c608761-e726-59cf-ae78-06b30c913589',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'CU72 ZHM',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=CU72%20ZHM&vehicleType=*',
'listing': 'auction',
'location': 'Bristol',
'make': 'TOYOTA',
'model': 'YARIS',
'odometer': 14951,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-01-01',
'seller_name': None,
'title': 'TOYOTA YARIS 1.5 HYBRID EXCEL Hatchback',
'transmission': 'automatic',
'trim': 'HYBRID EXCEL',
'vin': 'VNKKBAC360A242291',
'year': 2022}
2026-03-28 14:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27CU72%2520ZHM%27 HTTP/1.1" 200 None
2026-03-28 14:01:39 [bca.uk] INFO: Saving data for CU72%20ZHM: {'auction_closing_time': 1774864800.0, 'created_time': 1774477597.049549, 'last_price_update_time': 1774706499.880708}
2026-03-28 14:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='CU72%2520ZHM') HTTP/1.1" 204 0
2026-03-28 14:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698929002%27 HTTP/1.1" 200 None
2026-03-28 14:01:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698929002 not downloaded yet
2026-03-28 14:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698260535%27 HTTP/1.1" 200 None
2026-03-28 14:01:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698260535 not downloaded yet
2026-03-28 14:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D697704417%27 HTTP/1.1" 200 None
2026-03-28 14:01:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=697704417 not downloaded yet
2026-03-28 14:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D697723054%27 HTTP/1.1" 200 None
2026-03-28 14:01:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=697723054 not downloaded yet
2026-03-28 14:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698069908%27 HTTP/1.1" 200 None
2026-03-28 14:01:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698069908 not downloaded yet
2026-03-28 14:01:40 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FL59VTF/698069856/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698069856>
2026-03-28 14:01:40 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YD66KFF/698260498/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698260498>
2026-03-28 14:01:40 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BL16UUB/697704398/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=697704398>
2026-03-28 14:01:40 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VO62RAU/698928925/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698928925>
2026-03-28 14:01:40 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EJ19URS/698294858/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698294858>
2026-03-28 14:01:40 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VK65XNW/697722974/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=697722974>
2026-03-28 14:01:40 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WM19BFN/698601908/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698601908>
2026-03-28 14:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698260541%27 HTTP/1.1" 200 None
2026-03-28 14:01:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698260541 not downloaded yet
2026-03-28 14:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D697704426%27 HTTP/1.1" 200 None
2026-03-28 14:01:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=697704426 not downloaded yet
2026-03-28 14:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D697723071%27 HTTP/1.1" 200 None
2026-03-28 14:01:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=697723071 not downloaded yet
2026-03-28 14:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698069914%27 HTTP/1.1" 200 None
2026-03-28 14:01:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698069914 not downloaded yet
2026-03-28 14:01:40 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FH21UNX/698923419/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698923419>
2026-03-28 14:01:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VK65XNW/697722953/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/VK65XNW/42810265?sv=2020-08-04&st=2026-03-28T14%3A01%3A28Z&se=2026-03-28T14%3A26%3A28Z&sr=b&sp=r&sig=3QAAN%2BSB1OUMkxc4Xxtv%2BiBflOK5M03dTgEQ%2BLIgSi4%3D)
2026-03-28 14:01:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BL16UUB/697704392/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/BL16UUB/42810250?sv=2020-08-04&st=2026-03-28T14%3A01%3A27Z&se=2026-03-28T14%3A26%3A27Z&sr=b&sp=r&sig=SYmTiNujaXYF2XAoxTdHUcpF%2BqchRSrGUQy4u1jrdO0%3D)
2026-03-28 14:01:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FH21UNX/698923356/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/FH21UNX/42809938?sv=2020-08-04&st=2026-03-28T14%3A01%3A25Z&se=2026-03-28T14%3A26%3A25Z&sr=b&sp=r&sig=DX6Iqw0wYrgXXc1Kaaa%2FZcBpc9wYL%2BSdFRwB6BQgkeE%3D)
2026-03-28 14:01:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WM19BFN/698601858/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/WM19BFN/42804238?sv=2020-08-04&st=2026-03-28T14%3A01%3A26Z&se=2026-03-28T14%3A26%3A26Z&sr=b&sp=r&sig=EfjfS2OdrtC4SA3uZ5XRiTu1xsVnQ9sqSYyb4MkUK3s%3D)
2026-03-28 14:01:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EJ19URS/698294830/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/EJ19URS/42798170?sv=2020-08-04&st=2026-03-28T14%3A01%3A25Z&se=2026-03-28T14%3A26%3A25Z&sr=b&sp=r&sig=rAxmzY9RDaFtqRrL9CfX2gFSW4Q22XPI9rfpZk%2B4AL4%3D)
2026-03-28 14:01:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FL59VTF/698069840/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/FL59VTF/42810253?sv=2020-08-04&st=2026-03-28T14%3A01%3A28Z&se=2026-03-28T14%3A26%3A28Z&sr=b&sp=r&sig=GoiG7mqbYuLGhcwWnmQ5IpnLjHLSnXkwhQvXnkkGwWI%3D)
2026-03-28 14:01:40 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KO15JZW/698928899/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698928899>
2026-03-28 14:01:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VO62RAU/698928925/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/VO62RAU/42809976?sv=2020-08-04&st=2026-03-28T14%3A01%3A26Z&se=2026-03-28T14%3A26%3A26Z&sr=b&sp=r&sig=ajraupx01hOhBxj83xq2SeA0U6vZ89qgzfl3QZ0K0u0%3D)
2026-03-28 14:01:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BL16UUB/697704398/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/BL16UUB/42810250?sv=2020-08-04&st=2026-03-28T14%3A01%3A27Z&se=2026-03-28T14%3A26%3A27Z&sr=b&sp=r&sig=SYmTiNujaXYF2XAoxTdHUcpF%2BqchRSrGUQy4u1jrdO0%3D)
2026-03-28 14:01:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EJ19URS/698294858/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/EJ19URS/42798170?sv=2020-08-04&st=2026-03-28T14%3A01%3A25Z&se=2026-03-28T14%3A26%3A25Z&sr=b&sp=r&sig=rAxmzY9RDaFtqRrL9CfX2gFSW4Q22XPI9rfpZk%2B4AL4%3D)
2026-03-28 14:01:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YD66KFF/698260488/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YD66KFF/42810264?sv=2020-08-04&st=2026-03-28T14%3A01%3A27Z&se=2026-03-28T14%3A26%3A27Z&sr=b&sp=r&sig=BnH67lWrH1ehlh0fvDCmlxB%2FgGDsNGQtDgFTgEjpoSk%3D)
2026-03-28 14:01:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WM19BFN/698601908/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/WM19BFN/42804238?sv=2020-08-04&st=2026-03-28T14%3A01%3A26Z&se=2026-03-28T14%3A26%3A26Z&sr=b&sp=r&sig=EfjfS2OdrtC4SA3uZ5XRiTu1xsVnQ9sqSYyb4MkUK3s%3D)
2026-03-28 14:01:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YD66KFF/698260498/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YD66KFF/42810264?sv=2020-08-04&st=2026-03-28T14%3A01%3A27Z&se=2026-03-28T14%3A26%3A27Z&sr=b&sp=r&sig=BnH67lWrH1ehlh0fvDCmlxB%2FgGDsNGQtDgFTgEjpoSk%3D)
2026-03-28 14:01:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:01:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a1fdb41d0>
2026-03-28 14:01:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:01:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:01:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:01:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_defab1ac-857d-50f7-901c-50783b029725/defab1ac-857d-50f7-901c-50783b029725_image_2.jpg HTTP/1.1" 201 0
2026-03-28 14:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FVK65XNW%252F697722953%252F600') HTTP/1.1" 204 0
2026-03-28 14:01:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VK65XNW/697722953/600 saved to cache
2026-03-28 14:01:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item defab1ac-857d-50f7-901c-50783b029725
2026-03-28 14:01:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FL59VTF/698069856/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/FL59VTF/42810253?sv=2020-08-04&st=2026-03-28T14%3A01%3A28Z&se=2026-03-28T14%3A26%3A28Z&sr=b&sp=r&sig=GoiG7mqbYuLGhcwWnmQ5IpnLjHLSnXkwhQvXnkkGwWI%3D)
2026-03-28 14:01:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VK65XNW/697722974/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/VK65XNW/42810265?sv=2020-08-04&st=2026-03-28T14%3A01%3A28Z&se=2026-03-28T14%3A26%3A28Z&sr=b&sp=r&sig=3QAAN%2BSB1OUMkxc4Xxtv%2BiBflOK5M03dTgEQ%2BLIgSi4%3D)
2026-03-28 14:01:40 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FL59VTF/698069914/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698069914>
2026-03-28 14:01:40 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VK65XNW/697723071/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=697723071>
2026-03-28 14:01:40 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BL16UUB/697704426/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=697704426>
2026-03-28 14:01:40 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FL59VTF/698069908/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698069908>
2026-03-28 14:01:40 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YD66KFF/698260541/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698260541>
2026-03-28 14:01:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FH21UNX/698923419/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/FH21UNX/42809938?sv=2020-08-04&st=2026-03-28T14%3A01%3A25Z&se=2026-03-28T14%3A26%3A25Z&sr=b&sp=r&sig=DX6Iqw0wYrgXXc1Kaaa%2FZcBpc9wYL%2BSdFRwB6BQgkeE%3D)
2026-03-28 14:01:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:01:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a1fdb4490>
2026-03-28 14:01:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:01:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:01:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:01:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fc54a12c-7c43-5241-baa9-136ed93039c1/fc54a12c-7c43-5241-baa9-136ed93039c1_image_2.jpg HTTP/1.1" 201 0
2026-03-28 14:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FBL16UUB%252F697704392%252F600') HTTP/1.1" 204 0
2026-03-28 14:01:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BL16UUB/697704392/600 saved to cache
2026-03-28 14:01:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item fc54a12c-7c43-5241-baa9-136ed93039c1
2026-03-28 14:01:40 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:01:40 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:01:40 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:01:40 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:01:40 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:01:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:01:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c78b150>
2026-03-28 14:01:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:01:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:01:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:01:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a610f6fb-a046-5c2e-8701-0fcb295f97f1/a610f6fb-a046-5c2e-8701-0fcb295f97f1_image_6.jpg HTTP/1.1" 201 0
2026-03-28 14:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FFH21UNX%252F698923356%252F600') HTTP/1.1" 204 0
2026-03-28 14:01:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FH21UNX/698923356/600 saved to cache
2026-03-28 14:01:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item a610f6fb-a046-5c2e-8701-0fcb295f97f1
2026-03-28 14:01:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:01:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a1fd58490>
2026-03-28 14:01:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:01:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:01:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:01:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_94badcac-d91d-5664-a6fe-32adc35ee01a/94badcac-d91d-5664-a6fe-32adc35ee01a_image_5.jpg HTTP/1.1" 201 0
2026-03-28 14:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FWM19BFN%252F698601858%252F600') HTTP/1.1" 204 0
2026-03-28 14:01:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WM19BFN/698601858/600 saved to cache
2026-03-28 14:01:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 94badcac-d91d-5664-a6fe-32adc35ee01a
2026-03-28 14:01:40 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:01:40 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:01:40 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:01:40 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:01:40 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:01:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:01:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c42e310>
2026-03-28 14:01:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:01:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:01:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:01:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_755baf27-b55d-5033-a837-c4d9f3659c0e/755baf27-b55d-5033-a837-c4d9f3659c0e_image_6.jpg HTTP/1.1" 201 0
2026-03-28 14:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FEJ19URS%252F698294830%252F600') HTTP/1.1" 204 0
2026-03-28 14:01:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EJ19URS/698294830/600 saved to cache
2026-03-28 14:01:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 755baf27-b55d-5033-a837-c4d9f3659c0e
2026-03-28 14:01:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:01:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c85af90>
2026-03-28 14:01:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:01:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:01:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:01:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3007384c-6a41-5ced-bc4c-10b628334249/3007384c-6a41-5ced-bc4c-10b628334249_image_2.jpg HTTP/1.1" 201 0
2026-03-28 14:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FFL59VTF%252F698069840%252F600') HTTP/1.1" 204 0
2026-03-28 14:01:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FL59VTF/698069840/600 saved to cache
2026-03-28 14:01:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 3007384c-6a41-5ced-bc4c-10b628334249
2026-03-28 14:01:40 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:01:40 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:01:40 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:01:40 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:01:40 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:01:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:01:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2eb12d10>
2026-03-28 14:01:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:01:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:01:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:01:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_60bcb64c-26b9-5747-8fc6-986efaa78996/60bcb64c-26b9-5747-8fc6-986efaa78996_image_6.jpg HTTP/1.1" 201 0
2026-03-28 14:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FVO62RAU%252F698928925%252F600') HTTP/1.1" 204 0
2026-03-28 14:01:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VO62RAU/698928925/600 saved to cache
2026-03-28 14:01:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 60bcb64c-26b9-5747-8fc6-986efaa78996
2026-03-28 14:01:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:01:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2d6af0d0>
2026-03-28 14:01:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:01:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:01:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:01:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fc54a12c-7c43-5241-baa9-136ed93039c1/fc54a12c-7c43-5241-baa9-136ed93039c1_image_4.jpg HTTP/1.1" 201 0
2026-03-28 14:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FBL16UUB%252F697704398%252F600') HTTP/1.1" 204 0
2026-03-28 14:01:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BL16UUB/697704398/600 saved to cache
2026-03-28 14:01:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item fc54a12c-7c43-5241-baa9-136ed93039c1
2026-03-28 14:01:40 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:01:40 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:01:40 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:01:40 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:01:40 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:01:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:01:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c0db090>
2026-03-28 14:01:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:01:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:01:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:01:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_755baf27-b55d-5033-a837-c4d9f3659c0e/755baf27-b55d-5033-a837-c4d9f3659c0e_image_8.jpg HTTP/1.1" 201 0
2026-03-28 14:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FEJ19URS%252F698294858%252F600') HTTP/1.1" 204 0
2026-03-28 14:01:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EJ19URS/698294858/600 saved to cache
2026-03-28 14:01:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 755baf27-b55d-5033-a837-c4d9f3659c0e
2026-03-28 14:01:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:01:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a1fd61c50>
2026-03-28 14:01:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:01:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:01:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:01:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c163b1cf-cc62-5193-9026-6cea3a049e80/c163b1cf-cc62-5193-9026-6cea3a049e80_image_2.jpg HTTP/1.1" 201 0
2026-03-28 14:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FYD66KFF%252F698260488%252F600') HTTP/1.1" 204 0
2026-03-28 14:01:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YD66KFF/698260488/600 saved to cache
2026-03-28 14:01:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item c163b1cf-cc62-5193-9026-6cea3a049e80
2026-03-28 14:01:40 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:01:40 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:01:40 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:01:40 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:01:40 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:01:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:01:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c5046d0>
2026-03-28 14:01:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:01:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:01:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:01:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_94badcac-d91d-5664-a6fe-32adc35ee01a/94badcac-d91d-5664-a6fe-32adc35ee01a_image_7.jpg HTTP/1.1" 201 0
2026-03-28 14:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FWM19BFN%252F698601908%252F600') HTTP/1.1" 204 0
2026-03-28 14:01:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WM19BFN/698601908/600 saved to cache
2026-03-28 14:01:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 94badcac-d91d-5664-a6fe-32adc35ee01a
2026-03-28 14:01:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:01:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c501010>
2026-03-28 14:01:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:01:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:01:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:01:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c163b1cf-cc62-5193-9026-6cea3a049e80/c163b1cf-cc62-5193-9026-6cea3a049e80_image_4.jpg HTTP/1.1" 201 0
2026-03-28 14:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FYD66KFF%252F698260498%252F600') HTTP/1.1" 204 0
2026-03-28 14:01:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YD66KFF/698260498/600 saved to cache
2026-03-28 14:01:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item c163b1cf-cc62-5193-9026-6cea3a049e80
2026-03-28 14:01:40 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YD66KFF/698260535/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698260535>
2026-03-28 14:01:40 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VK65XNW/697723030/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=697723030>
2026-03-28 14:01:40 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BL16UUB/697704417/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=697704417>
2026-03-28 14:01:40 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VO62RAU/698929002/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698929002>
2026-03-28 14:01:40 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VK65XNW/697723054/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=697723054>
2026-03-28 14:01:40 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FL59VTF/698069889/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698069889>
2026-03-28 14:01:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KO15JZW/698928899/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/KO15JZW/42809875?sv=2020-08-04&st=2026-03-28T14%3A01%3A23Z&se=2026-03-28T14%3A26%3A23Z&sr=b&sp=r&sig=WtTYXpKYofDjFDmXev3jjoySms%2BztrBA4DkuQ5Y14aQ%3D)
2026-03-28 14:01:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:01:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a1ff353d0>
2026-03-28 14:01:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:01:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:01:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:01:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3007384c-6a41-5ced-bc4c-10b628334249/3007384c-6a41-5ced-bc4c-10b628334249_image_4.jpg HTTP/1.1" 201 0
2026-03-28 14:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FFL59VTF%252F698069856%252F600') HTTP/1.1" 204 0
2026-03-28 14:01:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FL59VTF/698069856/600 saved to cache
2026-03-28 14:01:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 3007384c-6a41-5ced-bc4c-10b628334249
2026-03-28 14:01:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:01:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a1ff34cd0>
2026-03-28 14:01:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:01:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:01:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:01:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_defab1ac-857d-50f7-901c-50783b029725/defab1ac-857d-50f7-901c-50783b029725_image_4.jpg HTTP/1.1" 201 0
2026-03-28 14:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FVK65XNW%252F697722974%252F600') HTTP/1.1" 204 0
2026-03-28 14:01:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VK65XNW/697722974/600 saved to cache
2026-03-28 14:01:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item defab1ac-857d-50f7-901c-50783b029725
2026-03-28 14:01:41 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:01:41 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:01:41 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:01:41 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:01:41 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:01:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:01:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a1ff2cbd0>
2026-03-28 14:01:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:01:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:01:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:01:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a610f6fb-a046-5c2e-8701-0fcb295f97f1/a610f6fb-a046-5c2e-8701-0fcb295f97f1_image_8.jpg HTTP/1.1" 201 0
2026-03-28 14:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FFH21UNX%252F698923419%252F600') HTTP/1.1" 204 0
2026-03-28 14:01:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FH21UNX/698923419/600 saved to cache
2026-03-28 14:01:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item a610f6fb-a046-5c2e-8701-0fcb295f97f1
2026-03-28 14:01:41 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BL16UUB/697704410/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=697704410>
2026-03-28 14:01:41 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VO62RAU/698928975/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698928975>
2026-03-28 14:01:41 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YD66KFF/698260528/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698260528>
2026-03-28 14:01:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BL16UUB/697704426/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/BL16UUB/42810250?sv=2020-08-04&st=2026-03-28T14%3A01%3A27Z&se=2026-03-28T14%3A26%3A27Z&sr=b&sp=r&sig=SYmTiNujaXYF2XAoxTdHUcpF%2BqchRSrGUQy4u1jrdO0%3D)
2026-03-28 14:01:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FL59VTF/698069908/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/FL59VTF/42810253?sv=2020-08-04&st=2026-03-28T14%3A01%3A28Z&se=2026-03-28T14%3A26%3A28Z&sr=b&sp=r&sig=GoiG7mqbYuLGhcwWnmQ5IpnLjHLSnXkwhQvXnkkGwWI%3D)
2026-03-28 14:01:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FL59VTF/698069914/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/FL59VTF/42810253?sv=2020-08-04&st=2026-03-28T14%3A01%3A28Z&se=2026-03-28T14%3A26%3A28Z&sr=b&sp=r&sig=GoiG7mqbYuLGhcwWnmQ5IpnLjHLSnXkwhQvXnkkGwWI%3D)
2026-03-28 14:01:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YD66KFF/698260541/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YD66KFF/42810264?sv=2020-08-04&st=2026-03-28T14%3A01%3A27Z&se=2026-03-28T14%3A26%3A27Z&sr=b&sp=r&sig=BnH67lWrH1ehlh0fvDCmlxB%2FgGDsNGQtDgFTgEjpoSk%3D)
2026-03-28 14:01:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VK65XNW/697723071/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/VK65XNW/42810265?sv=2020-08-04&st=2026-03-28T14%3A01%3A28Z&se=2026-03-28T14%3A26%3A28Z&sr=b&sp=r&sig=3QAAN%2BSB1OUMkxc4Xxtv%2BiBflOK5M03dTgEQ%2BLIgSi4%3D)
2026-03-28 14:01:41 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:01:41 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:01:41 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:01:41 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:01:41 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:01:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:01:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a1ff37c50>
2026-03-28 14:01:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:01:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:01:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:01:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7cdb5790-795c-503b-b01e-2ccf288a1773/7cdb5790-795c-503b-b01e-2ccf288a1773_image_6.jpg HTTP/1.1" 201 0
2026-03-28 14:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FKO15JZW%252F698928899%252F600') HTTP/1.1" 204 0
2026-03-28 14:01:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KO15JZW/698928899/600 saved to cache
2026-03-28 14:01:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 7cdb5790-795c-503b-b01e-2ccf288a1773
2026-03-28 14:01:41 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:01:41 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:01:41 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:01:41 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:01:41 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:01:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:01:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2ca34810>
2026-03-28 14:01:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:01:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:01:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:01:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fc54a12c-7c43-5241-baa9-136ed93039c1/fc54a12c-7c43-5241-baa9-136ed93039c1_image_9.jpg HTTP/1.1" 201 0
2026-03-28 14:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FBL16UUB%252F697704426%252F600') HTTP/1.1" 204 0
2026-03-28 14:01:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BL16UUB/697704426/600 saved to cache
2026-03-28 14:01:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item fc54a12c-7c43-5241-baa9-136ed93039c1
2026-03-28 14:01:41 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:01:41 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:01:41 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:01:41 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:01:41 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:01:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:01:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c9f5390>
2026-03-28 14:01:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:01:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:01:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:01:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3007384c-6a41-5ced-bc4c-10b628334249/3007384c-6a41-5ced-bc4c-10b628334249_image_8.jpg HTTP/1.1" 201 0
2026-03-28 14:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FFL59VTF%252F698069908%252F600') HTTP/1.1" 204 0
2026-03-28 14:01:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FL59VTF/698069908/600 saved to cache
2026-03-28 14:01:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 3007384c-6a41-5ced-bc4c-10b628334249
2026-03-28 14:01:41 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VK65XNW/697723008/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=697723008>
2026-03-28 14:01:41 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FL59VTF/698069876/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698069876>
2026-03-28 14:01:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VK65XNW/697723054/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/VK65XNW/42810265?sv=2020-08-04&st=2026-03-28T14%3A01%3A28Z&se=2026-03-28T14%3A26%3A28Z&sr=b&sp=r&sig=3QAAN%2BSB1OUMkxc4Xxtv%2BiBflOK5M03dTgEQ%2BLIgSi4%3D)
2026-03-28 14:01:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BL16UUB/697704417/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/BL16UUB/42810250?sv=2020-08-04&st=2026-03-28T14%3A01%3A27Z&se=2026-03-28T14%3A26%3A27Z&sr=b&sp=r&sig=SYmTiNujaXYF2XAoxTdHUcpF%2BqchRSrGUQy4u1jrdO0%3D)
2026-03-28 14:01:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VO62RAU/698929002/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/VO62RAU/42809976?sv=2020-08-04&st=2026-03-28T14%3A01%3A26Z&se=2026-03-28T14%3A26%3A26Z&sr=b&sp=r&sig=ajraupx01hOhBxj83xq2SeA0U6vZ89qgzfl3QZ0K0u0%3D)
2026-03-28 14:01:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VK65XNW/697723030/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/VK65XNW/42810265?sv=2020-08-04&st=2026-03-28T14%3A01%3A28Z&se=2026-03-28T14%3A26%3A28Z&sr=b&sp=r&sig=3QAAN%2BSB1OUMkxc4Xxtv%2BiBflOK5M03dTgEQ%2BLIgSi4%3D)
2026-03-28 14:01:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FL59VTF/698069889/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/FL59VTF/42810253?sv=2020-08-04&st=2026-03-28T14%3A01%3A28Z&se=2026-03-28T14%3A26%3A28Z&sr=b&sp=r&sig=GoiG7mqbYuLGhcwWnmQ5IpnLjHLSnXkwhQvXnkkGwWI%3D)
2026-03-28 14:01:41 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:01:41 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:01:41 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:01:41 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:01:41 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:01:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:01:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c9d7150>
2026-03-28 14:01:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:01:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:01:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:01:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3007384c-6a41-5ced-bc4c-10b628334249/3007384c-6a41-5ced-bc4c-10b628334249_image_9.jpg HTTP/1.1" 201 0
2026-03-28 14:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FFL59VTF%252F698069914%252F600') HTTP/1.1" 204 0
2026-03-28 14:01:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FL59VTF/698069914/600 saved to cache
2026-03-28 14:01:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 3007384c-6a41-5ced-bc4c-10b628334249
2026-03-28 14:01:41 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:01:41 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:01:41 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:01:41 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:01:41 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:01:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:01:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2ca0e110>
2026-03-28 14:01:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:01:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:01:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:01:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c163b1cf-cc62-5193-9026-6cea3a049e80/c163b1cf-cc62-5193-9026-6cea3a049e80_image_9.jpg HTTP/1.1" 201 0
2026-03-28 14:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FYD66KFF%252F698260541%252F600') HTTP/1.1" 204 0
2026-03-28 14:01:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YD66KFF/698260541/600 saved to cache
2026-03-28 14:01:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item c163b1cf-cc62-5193-9026-6cea3a049e80
2026-03-28 14:01:41 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:01:41 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:01:41 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:01:41 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:01:41 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:01:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:01:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a1fd77910>
2026-03-28 14:01:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:01:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:01:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:01:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_defab1ac-857d-50f7-901c-50783b029725/defab1ac-857d-50f7-901c-50783b029725_image_9.jpg HTTP/1.1" 201 0
2026-03-28 14:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FVK65XNW%252F697723071%252F600') HTTP/1.1" 204 0
2026-03-28 14:01:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VK65XNW/697723071/600 saved to cache
2026-03-28 14:01:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item defab1ac-857d-50f7-901c-50783b029725
2026-03-28 14:01:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YD66KFF/698260535/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YD66KFF/42810264?sv=2020-08-04&st=2026-03-28T14%3A01%3A27Z&se=2026-03-28T14%3A26%3A27Z&sr=b&sp=r&sig=BnH67lWrH1ehlh0fvDCmlxB%2FgGDsNGQtDgFTgEjpoSk%3D)
2026-03-28 14:01:41 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:01:41 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:01:41 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:01:41 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:01:41 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:01:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:01:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c4e8590>
2026-03-28 14:01:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:01:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:01:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:01:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_defab1ac-857d-50f7-901c-50783b029725/defab1ac-857d-50f7-901c-50783b029725_image_8.jpg HTTP/1.1" 201 0
2026-03-28 14:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FVK65XNW%252F697723054%252F600') HTTP/1.1" 204 0
2026-03-28 14:01:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VK65XNW/697723054/600 saved to cache
2026-03-28 14:01:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item defab1ac-857d-50f7-901c-50783b029725
2026-03-28 14:01:41 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:01:41 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:01:41 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:01:41 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:01:41 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:01:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:01:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2d726490>
2026-03-28 14:01:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:01:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:01:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:01:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fc54a12c-7c43-5241-baa9-136ed93039c1/fc54a12c-7c43-5241-baa9-136ed93039c1_image_8.jpg HTTP/1.1" 201 0
2026-03-28 14:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FBL16UUB%252F697704417%252F600') HTTP/1.1" 204 0
2026-03-28 14:01:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BL16UUB/697704417/600 saved to cache
2026-03-28 14:01:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item fc54a12c-7c43-5241-baa9-136ed93039c1
2026-03-28 14:01:41 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:01:41 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:01:41 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:01:41 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:01:41 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:01:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:01:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2d6b4090>
2026-03-28 14:01:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:01:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:01:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:01:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_60bcb64c-26b9-5747-8fc6-986efaa78996/60bcb64c-26b9-5747-8fc6-986efaa78996_image_9.jpg HTTP/1.1" 201 0
2026-03-28 14:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FVO62RAU%252F698929002%252F600') HTTP/1.1" 204 0
2026-03-28 14:01:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VO62RAU/698929002/600 saved to cache
2026-03-28 14:01:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 60bcb64c-26b9-5747-8fc6-986efaa78996
2026-03-28 14:01:41 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:01:41 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:01:41 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:01:41 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:01:41 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:01:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:01:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2deabf10>
2026-03-28 14:01:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:01:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:01:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:01:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_defab1ac-857d-50f7-901c-50783b029725/defab1ac-857d-50f7-901c-50783b029725_image_7.jpg HTTP/1.1" 201 0
2026-03-28 14:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FVK65XNW%252F697723030%252F600') HTTP/1.1" 204 0
2026-03-28 14:01:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VK65XNW/697723030/600 saved to cache
2026-03-28 14:01:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item defab1ac-857d-50f7-901c-50783b029725
2026-03-28 14:01:41 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:01:41 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:01:41 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:01:41 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:01:41 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:01:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:01:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a30128e90>
2026-03-28 14:01:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:01:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:01:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:01:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3007384c-6a41-5ced-bc4c-10b628334249/3007384c-6a41-5ced-bc4c-10b628334249_image_7.jpg HTTP/1.1" 201 0
2026-03-28 14:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FFL59VTF%252F698069889%252F600') HTTP/1.1" 204 0
2026-03-28 14:01:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FL59VTF/698069889/600 saved to cache
2026-03-28 14:01:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 3007384c-6a41-5ced-bc4c-10b628334249
2026-03-28 14:01:41 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BL16UUB/697704406/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=697704406>
2026-03-28 14:01:41 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VO62RAU/698928946/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698928946>
2026-03-28 14:01:41 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WM19BFN/698601937/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698601937>
2026-03-28 14:01:41 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YD66KFF/698260519/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698260519>
2026-03-28 14:01:41 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FL59VTF/698069861/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698069861>
2026-03-28 14:01:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VO62RAU/698928975/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/VO62RAU/42809976?sv=2020-08-04&st=2026-03-28T14%3A01%3A26Z&se=2026-03-28T14%3A26%3A26Z&sr=b&sp=r&sig=ajraupx01hOhBxj83xq2SeA0U6vZ89qgzfl3QZ0K0u0%3D)
2026-03-28 14:01:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BL16UUB/697704410/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/BL16UUB/42810250?sv=2020-08-04&st=2026-03-28T14%3A01%3A27Z&se=2026-03-28T14%3A26%3A27Z&sr=b&sp=r&sig=SYmTiNujaXYF2XAoxTdHUcpF%2BqchRSrGUQy4u1jrdO0%3D)
2026-03-28 14:01:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YD66KFF/698260528/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YD66KFF/42810264?sv=2020-08-04&st=2026-03-28T14%3A01%3A27Z&se=2026-03-28T14%3A26%3A27Z&sr=b&sp=r&sig=BnH67lWrH1ehlh0fvDCmlxB%2FgGDsNGQtDgFTgEjpoSk%3D)
2026-03-28 14:01:41 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:01:41 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:01:41 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:01:41 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:01:41 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:01:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:01:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2ec92f50>
2026-03-28 14:01:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:01:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:01:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:01:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c163b1cf-cc62-5193-9026-6cea3a049e80/c163b1cf-cc62-5193-9026-6cea3a049e80_image_8.jpg HTTP/1.1" 201 0
2026-03-28 14:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FYD66KFF%252F698260535%252F600') HTTP/1.1" 204 0
2026-03-28 14:01:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YD66KFF/698260535/600 saved to cache
2026-03-28 14:01:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item c163b1cf-cc62-5193-9026-6cea3a049e80
2026-03-28 14:01:41 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BL16UUB/697704402/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=697704402>
2026-03-28 14:01:41 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VK65XNW/697722988/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=697722988>
2026-03-28 14:01:41 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YD66KFF/698260508/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698260508>
2026-03-28 14:01:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FL59VTF/698069876/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/FL59VTF/42810253?sv=2020-08-04&st=2026-03-28T14%3A01%3A28Z&se=2026-03-28T14%3A26%3A28Z&sr=b&sp=r&sig=GoiG7mqbYuLGhcwWnmQ5IpnLjHLSnXkwhQvXnkkGwWI%3D)
2026-03-28 14:01:41 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:01:41 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:01:41 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:01:41 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:01:41 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:01:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:01:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c135110>
2026-03-28 14:01:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:01:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:01:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:01:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_60bcb64c-26b9-5747-8fc6-986efaa78996/60bcb64c-26b9-5747-8fc6-986efaa78996_image_8.jpg HTTP/1.1" 201 0
2026-03-28 14:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FVO62RAU%252F698928975%252F600') HTTP/1.1" 204 0
2026-03-28 14:01:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VO62RAU/698928975/600 saved to cache
2026-03-28 14:01:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 60bcb64c-26b9-5747-8fc6-986efaa78996
2026-03-28 14:01:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VK65XNW/697723008/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/VK65XNW/42810265?sv=2020-08-04&st=2026-03-28T14%3A01%3A28Z&se=2026-03-28T14%3A26%3A28Z&sr=b&sp=r&sig=3QAAN%2BSB1OUMkxc4Xxtv%2BiBflOK5M03dTgEQ%2BLIgSi4%3D)
2026-03-28 14:01:41 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EJ19URS/698294872/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698294872>
2026-03-28 14:01:41 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WM19BFN/698601922/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698601922>
2026-03-28 14:01:41 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FH21UNX/698923445/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698923445>
2026-03-28 14:01:41 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:01:41 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:01:41 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:01:41 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:01:41 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:01:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:01:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c18f050>
2026-03-28 14:01:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:01:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:01:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:01:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fc54a12c-7c43-5241-baa9-136ed93039c1/fc54a12c-7c43-5241-baa9-136ed93039c1_image_7.jpg HTTP/1.1" 201 0
2026-03-28 14:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FBL16UUB%252F697704410%252F600') HTTP/1.1" 204 0
2026-03-28 14:01:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BL16UUB/697704410/600 saved to cache
2026-03-28 14:01:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item fc54a12c-7c43-5241-baa9-136ed93039c1
2026-03-28 14:01:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FL59VTF/698069861/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/FL59VTF/42810253?sv=2020-08-04&st=2026-03-28T14%3A01%3A28Z&se=2026-03-28T14%3A26%3A28Z&sr=b&sp=r&sig=GoiG7mqbYuLGhcwWnmQ5IpnLjHLSnXkwhQvXnkkGwWI%3D)
2026-03-28 14:01:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VO62RAU/698928946/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/VO62RAU/42809976?sv=2020-08-04&st=2026-03-28T14%3A01%3A26Z&se=2026-03-28T14%3A26%3A26Z&sr=b&sp=r&sig=ajraupx01hOhBxj83xq2SeA0U6vZ89qgzfl3QZ0K0u0%3D)
2026-03-28 14:01:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YD66KFF/698260519/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YD66KFF/42810264?sv=2020-08-04&st=2026-03-28T14%3A01%3A27Z&se=2026-03-28T14%3A26%3A27Z&sr=b&sp=r&sig=BnH67lWrH1ehlh0fvDCmlxB%2FgGDsNGQtDgFTgEjpoSk%3D)
2026-03-28 14:01:42 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:01:42 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:01:42 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:01:42 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:01:42 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:01:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:01:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c99e890>
2026-03-28 14:01:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:01:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:01:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:01:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c163b1cf-cc62-5193-9026-6cea3a049e80/c163b1cf-cc62-5193-9026-6cea3a049e80_image_7.jpg HTTP/1.1" 201 0
2026-03-28 14:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FYD66KFF%252F698260528%252F600') HTTP/1.1" 204 0
2026-03-28 14:01:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YD66KFF/698260528/600 saved to cache
2026-03-28 14:01:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item c163b1cf-cc62-5193-9026-6cea3a049e80
2026-03-28 14:01:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WM19BFN/698601937/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/WM19BFN/42804238?sv=2020-08-04&st=2026-03-28T14%3A01%3A26Z&se=2026-03-28T14%3A26%3A26Z&sr=b&sp=r&sig=EfjfS2OdrtC4SA3uZ5XRiTu1xsVnQ9sqSYyb4MkUK3s%3D)
2026-03-28 14:01:42 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:01:42 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:01:42 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:01:42 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:01:42 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:01:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:01:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a30110110>
2026-03-28 14:01:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:01:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:01:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:01:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3007384c-6a41-5ced-bc4c-10b628334249/3007384c-6a41-5ced-bc4c-10b628334249_image_6.jpg HTTP/1.1" 201 0
2026-03-28 14:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FFL59VTF%252F698069876%252F600') HTTP/1.1" 204 0
2026-03-28 14:01:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FL59VTF/698069876/600 saved to cache
2026-03-28 14:01:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 3007384c-6a41-5ced-bc4c-10b628334249
2026-03-28 14:01:42 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:01:42 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:01:42 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:01:42 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:01:42 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:01:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:01:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c6a9550>
2026-03-28 14:01:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:01:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:01:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:01:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_defab1ac-857d-50f7-901c-50783b029725/defab1ac-857d-50f7-901c-50783b029725_image_6.jpg HTTP/1.1" 201 0
2026-03-28 14:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FVK65XNW%252F697723008%252F600') HTTP/1.1" 204 0
2026-03-28 14:01:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VK65XNW/697723008/600 saved to cache
2026-03-28 14:01:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item defab1ac-857d-50f7-901c-50783b029725
2026-03-28 14:01:42 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KO15JZW/698928974/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698928974>
2026-03-28 14:01:42 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/CP19XKX/42810052?sv=2020-08-04&st=2026-03-28T14%3A01%3A42Z&se=2026-03-28T14%3A26%3A42Z&sr=b&sp=r&sig=bjyHHkX2Tk%2Fg1NdAswlyjtEAt76c1wRB5i7u%2BULrS5U%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=CP19%20XKX-GB>
2026-03-28 14:01:42 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/RO63WRK/42810240?sv=2020-08-04&st=2026-03-28T14%3A01%3A42Z&se=2026-03-28T14%3A26%3A42Z&sr=b&sp=r&sig=MOREAH8gnhiPYq9fnYSM0K23PHRvNBVeUgjnUtNHuk8%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=RO63%20WRK-GB>
2026-03-28 14:01:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BL16UUB/697704402/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/BL16UUB/42810250?sv=2020-08-04&st=2026-03-28T14%3A01%3A27Z&se=2026-03-28T14%3A26%3A27Z&sr=b&sp=r&sig=SYmTiNujaXYF2XAoxTdHUcpF%2BqchRSrGUQy4u1jrdO0%3D)
2026-03-28 14:01:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YD66KFF/698260508/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YD66KFF/42810264?sv=2020-08-04&st=2026-03-28T14%3A01%3A27Z&se=2026-03-28T14%3A26%3A27Z&sr=b&sp=r&sig=BnH67lWrH1ehlh0fvDCmlxB%2FgGDsNGQtDgFTgEjpoSk%3D)
2026-03-28 14:01:42 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KO15JZW/698928945/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698928945>
2026-03-28 14:01:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VK65XNW/697722988/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/VK65XNW/42810265?sv=2020-08-04&st=2026-03-28T14%3A01%3A28Z&se=2026-03-28T14%3A26%3A28Z&sr=b&sp=r&sig=3QAAN%2BSB1OUMkxc4Xxtv%2BiBflOK5M03dTgEQ%2BLIgSi4%3D)
2026-03-28 14:01:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BL16UUB/697704406/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/BL16UUB/42810250?sv=2020-08-04&st=2026-03-28T14%3A01%3A27Z&se=2026-03-28T14%3A26%3A27Z&sr=b&sp=r&sig=SYmTiNujaXYF2XAoxTdHUcpF%2BqchRSrGUQy4u1jrdO0%3D)
2026-03-28 14:01:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:01:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c9d7050>
2026-03-28 14:01:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:01:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:01:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:01:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3007384c-6a41-5ced-bc4c-10b628334249/3007384c-6a41-5ced-bc4c-10b628334249_image_5.jpg HTTP/1.1" 201 0
2026-03-28 14:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FFL59VTF%252F698069861%252F600') HTTP/1.1" 204 0
2026-03-28 14:01:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FL59VTF/698069861/600 saved to cache
2026-03-28 14:01:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 3007384c-6a41-5ced-bc4c-10b628334249
2026-03-28 14:01:42 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:01:42 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:01:42 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:01:42 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:01:42 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:01:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:01:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a1ff4c090>
2026-03-28 14:01:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:01:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:01:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:01:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_60bcb64c-26b9-5747-8fc6-986efaa78996/60bcb64c-26b9-5747-8fc6-986efaa78996_image_7.jpg HTTP/1.1" 201 0
2026-03-28 14:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FVO62RAU%252F698928946%252F600') HTTP/1.1" 204 0
2026-03-28 14:01:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VO62RAU/698928946/600 saved to cache
2026-03-28 14:01:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 60bcb64c-26b9-5747-8fc6-986efaa78996
2026-03-28 14:01:42 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:01:42 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:01:42 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:01:42 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:01:42 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:01:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:01:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c76f550>
2026-03-28 14:01:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:01:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:01:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:01:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c163b1cf-cc62-5193-9026-6cea3a049e80/c163b1cf-cc62-5193-9026-6cea3a049e80_image_6.jpg HTTP/1.1" 201 0
2026-03-28 14:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FYD66KFF%252F698260519%252F600') HTTP/1.1" 204 0
2026-03-28 14:01:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YD66KFF/698260519/600 saved to cache
2026-03-28 14:01:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item c163b1cf-cc62-5193-9026-6cea3a049e80
2026-03-28 14:01:42 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:01:42 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:01:42 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:01:42 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:01:42 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:01:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:01:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c0ec6d0>
2026-03-28 14:01:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:01:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:01:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:01:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_94badcac-d91d-5664-a6fe-32adc35ee01a/94badcac-d91d-5664-a6fe-32adc35ee01a_image_9.jpg HTTP/1.1" 201 0
2026-03-28 14:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FWM19BFN%252F698601937%252F600') HTTP/1.1" 204 0
2026-03-28 14:01:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WM19BFN/698601937/600 saved to cache
2026-03-28 14:01:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 94badcac-d91d-5664-a6fe-32adc35ee01a
2026-03-28 14:01:42 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VO62RAU/698928900/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698928900>
2026-03-28 14:01:42 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YW64DGU/698928973/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698928973>
2026-03-28 14:01:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:01:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c0ee790>
2026-03-28 14:01:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:01:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:01:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:01:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fc54a12c-7c43-5241-baa9-136ed93039c1/fc54a12c-7c43-5241-baa9-136ed93039c1_image_5.jpg HTTP/1.1" 201 0
2026-03-28 14:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FBL16UUB%252F697704402%252F600') HTTP/1.1" 204 0
2026-03-28 14:01:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BL16UUB/697704402/600 saved to cache
2026-03-28 14:01:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item fc54a12c-7c43-5241-baa9-136ed93039c1
2026-03-28 14:01:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:01:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c6ab910>
2026-03-28 14:01:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:01:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:01:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:01:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c163b1cf-cc62-5193-9026-6cea3a049e80/c163b1cf-cc62-5193-9026-6cea3a049e80_image_5.jpg HTTP/1.1" 201 0
2026-03-28 14:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FYD66KFF%252F698260508%252F600') HTTP/1.1" 204 0
2026-03-28 14:01:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YD66KFF/698260508/600 saved to cache
2026-03-28 14:01:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item c163b1cf-cc62-5193-9026-6cea3a049e80
2026-03-28 14:01:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:01:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2d684550>
2026-03-28 14:01:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:01:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:01:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:01:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_defab1ac-857d-50f7-901c-50783b029725/defab1ac-857d-50f7-901c-50783b029725_image_5.jpg HTTP/1.1" 201 0
2026-03-28 14:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FVK65XNW%252F697722988%252F600') HTTP/1.1" 204 0
2026-03-28 14:01:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VK65XNW/697722988/600 saved to cache
2026-03-28 14:01:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item defab1ac-857d-50f7-901c-50783b029725
2026-03-28 14:01:42 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:01:42 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:01:42 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:01:42 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:01:42 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:01:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:01:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2ca36a50>
2026-03-28 14:01:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:01:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:01:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:01:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fc54a12c-7c43-5241-baa9-136ed93039c1/fc54a12c-7c43-5241-baa9-136ed93039c1_image_6.jpg HTTP/1.1" 201 0
2026-03-28 14:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FBL16UUB%252F697704406%252F600') HTTP/1.1" 204 0
2026-03-28 14:01:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BL16UUB/697704406/600 saved to cache
2026-03-28 14:01:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item fc54a12c-7c43-5241-baa9-136ed93039c1
2026-03-28 14:01:42 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FL59VTF/698069847/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698069847>
2026-03-28 14:01:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WM19BFN/698601922/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/WM19BFN/42804238?sv=2020-08-04&st=2026-03-28T14%3A01%3A26Z&se=2026-03-28T14%3A26%3A26Z&sr=b&sp=r&sig=EfjfS2OdrtC4SA3uZ5XRiTu1xsVnQ9sqSYyb4MkUK3s%3D)
2026-03-28 14:01:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FH21UNX/698923445/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/FH21UNX/42809938?sv=2020-08-04&st=2026-03-28T14%3A01%3A25Z&se=2026-03-28T14%3A26%3A25Z&sr=b&sp=r&sig=DX6Iqw0wYrgXXc1Kaaa%2FZcBpc9wYL%2BSdFRwB6BQgkeE%3D)
2026-03-28 14:01:42 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/PN64UHS/42810229?sv=2020-08-04&st=2026-03-28T14%3A01%3A42Z&se=2026-03-28T14%3A26%3A42Z&sr=b&sp=r&sig=poKtxPpxXbqP0NGLExiJbxVwCiEJHxglY1MdvVHQzVg%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=PN64%20UHS-GB>
2026-03-28 14:01:42 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/WX70JZJ/42810045?sv=2020-08-04&st=2026-03-28T14%3A01%3A42Z&se=2026-03-28T14%3A26%3A42Z&sr=b&sp=r&sig=zpaKYMdJB0PiQSX%2BpoOKZdTxRmLBiapRNqdSFDIfp%2Bc%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=WX70%20JZJ-GB>
2026-03-28 14:01:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EJ19URS/698294872/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/EJ19URS/42798170?sv=2020-08-04&st=2026-03-28T14%3A01%3A25Z&se=2026-03-28T14%3A26%3A25Z&sr=b&sp=r&sig=rAxmzY9RDaFtqRrL9CfX2gFSW4Q22XPI9rfpZk%2B4AL4%3D)
2026-03-28 14:01:42 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VK65XNW/697722963/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=697722963>
2026-03-28 14:01:42 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BL16UUB/697704395/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=697704395>
2026-03-28 14:01:42 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YD66KFF/698260492/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698260492>
2026-03-28 14:01:42 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WM19BFN/698601888/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698601888>
2026-03-28 14:01:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KO15JZW/698928945/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/KO15JZW/42809875?sv=2020-08-04&st=2026-03-28T14%3A01%3A23Z&se=2026-03-28T14%3A26%3A23Z&sr=b&sp=r&sig=WtTYXpKYofDjFDmXev3jjoySms%2BztrBA4DkuQ5Y14aQ%3D)
2026-03-28 14:01:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/RO63WRK/42810240?sv=2020-08-04&st=2026-03-28T14%3A01%3A42Z&se=2026-03-28T14%3A26%3A42Z&sr=b&sp=r&sig=MOREAH8gnhiPYq9fnYSM0K23PHRvNBVeUgjnUtNHuk8%3D> (referer: https://www.bca.co.uk/)
2026-03-28 14:01:42 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:01:42 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:01:42 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:01:42 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:01:42 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:01:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:01:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c165bd0>
2026-03-28 14:01:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:01:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:01:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:01:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_94badcac-d91d-5664-a6fe-32adc35ee01a/94badcac-d91d-5664-a6fe-32adc35ee01a_image_8.jpg HTTP/1.1" 201 0
2026-03-28 14:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FWM19BFN%252F698601922%252F600') HTTP/1.1" 204 0
2026-03-28 14:01:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WM19BFN/698601922/600 saved to cache
2026-03-28 14:01:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 94badcac-d91d-5664-a6fe-32adc35ee01a
2026-03-28 14:01:42 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:01:42 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:01:42 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:01:42 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:01:42 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:01:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:01:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c9dfd50>
2026-03-28 14:01:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:01:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:01:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:01:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a610f6fb-a046-5c2e-8701-0fcb295f97f1/a610f6fb-a046-5c2e-8701-0fcb295f97f1_image_9.jpg HTTP/1.1" 201 0
2026-03-28 14:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FFH21UNX%252F698923445%252F600') HTTP/1.1" 204 0
2026-03-28 14:01:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FH21UNX/698923445/600 saved to cache
2026-03-28 14:01:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item a610f6fb-a046-5c2e-8701-0fcb295f97f1
2026-03-28 14:01:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KO15JZW/698928974/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/KO15JZW/42809875?sv=2020-08-04&st=2026-03-28T14%3A01%3A23Z&se=2026-03-28T14%3A26%3A23Z&sr=b&sp=r&sig=WtTYXpKYofDjFDmXev3jjoySms%2BztrBA4DkuQ5Y14aQ%3D)
2026-03-28 14:01:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VO62RAU/698928900/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/VO62RAU/42809976?sv=2020-08-04&st=2026-03-28T14%3A01%3A26Z&se=2026-03-28T14%3A26%3A26Z&sr=b&sp=r&sig=ajraupx01hOhBxj83xq2SeA0U6vZ89qgzfl3QZ0K0u0%3D)
2026-03-28 14:01:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/CP19XKX/42810052?sv=2020-08-04&st=2026-03-28T14%3A01%3A42Z&se=2026-03-28T14%3A26%3A42Z&sr=b&sp=r&sig=bjyHHkX2Tk%2Fg1NdAswlyjtEAt76c1wRB5i7u%2BULrS5U%3D> (referer: https://www.bca.co.uk/)
2026-03-28 14:01:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/WX70JZJ/42810045?sv=2020-08-04&st=2026-03-28T14%3A01%3A42Z&se=2026-03-28T14%3A26%3A42Z&sr=b&sp=r&sig=zpaKYMdJB0PiQSX%2BpoOKZdTxRmLBiapRNqdSFDIfp%2Bc%3D> (referer: https://www.bca.co.uk/)
2026-03-28 14:01:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YW64DGU/698928973/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YW64DGU/42810194?sv=2020-08-04&st=2026-03-28T14%3A01%3A23Z&se=2026-03-28T14%3A26%3A23Z&sr=b&sp=r&sig=bKUUxkl%2FQOTN6xP3oKLYX53uOLW1seBVRfhSdF3FtAg%3D)
2026-03-28 14:01:42 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:01:42 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:01:42 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:01:42 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:01:42 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:01:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:01:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2d6b6e50>
2026-03-28 14:01:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:01:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:01:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:01:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_755baf27-b55d-5033-a837-c4d9f3659c0e/755baf27-b55d-5033-a837-c4d9f3659c0e_image_9.jpg HTTP/1.1" 201 0
2026-03-28 14:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FEJ19URS%252F698294872%252F600') HTTP/1.1" 204 0
2026-03-28 14:01:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EJ19URS/698294872/600 saved to cache
2026-03-28 14:01:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 755baf27-b55d-5033-a837-c4d9f3659c0e
2026-03-28 14:01:42 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:01:42 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:01:42 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:01:42 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:01:42 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:01:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:01:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c9de310>
2026-03-28 14:01:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:01:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:01:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:01:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7cdb5790-795c-503b-b01e-2ccf288a1773/7cdb5790-795c-503b-b01e-2ccf288a1773_image_8.jpg HTTP/1.1" 201 0
2026-03-28 14:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FKO15JZW%252F698928945%252F600') HTTP/1.1" 204 0
2026-03-28 14:01:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KO15JZW/698928945/600 saved to cache
2026-03-28 14:01:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 7cdb5790-795c-503b-b01e-2ccf288a1773
2026-03-28 14:01:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:01:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c6ab5d0>
2026-03-28 14:01:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:01:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:01:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:01:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_10beb970-842b-5836-9952-ce1ec016ade8/10beb970-842b-5836-9952-ce1ec016ade8_expert_report_file_8b053052-ad1a-4f33-adc5-8785769fe3f7.pdf HTTP/1.1" 201 0
2026-03-28 14:01:42 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item 10beb970-842b-5836-9952-ce1ec016ade8
2026-03-28 14:01:42 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 10beb970-842b-5836-9952-ce1ec016ade8, skipping ID generation
2026-03-28 14:01:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 10beb970-842b-5836-9952-ce1ec016ade8
2026-03-28 14:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DRO63WRK-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-28 14:01:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=RO63WRK-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-28 14:01:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/PN64UHS/42810229?sv=2020-08-04&st=2026-03-28T14%3A01%3A42Z&se=2026-03-28T14%3A26%3A42Z&sr=b&sp=r&sig=poKtxPpxXbqP0NGLExiJbxVwCiEJHxglY1MdvVHQzVg%3D> (referer: https://www.bca.co.uk/)
2026-03-28 14:01:42 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EJ19URS/698294848/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698294848>
2026-03-28 14:01:42 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FH21UNX/698923386/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698923386>
2026-03-28 14:01:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FL59VTF/698069847/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/FL59VTF/42810253?sv=2020-08-04&st=2026-03-28T14%3A01%3A28Z&se=2026-03-28T14%3A26%3A28Z&sr=b&sp=r&sig=GoiG7mqbYuLGhcwWnmQ5IpnLjHLSnXkwhQvXnkkGwWI%3D)
2026-03-28 14:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698460256%27 HTTP/1.1" 200 None
2026-03-28 14:01:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698460256 not downloaded yet
2026-03-28 14:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698460260%27 HTTP/1.1" 200 None
2026-03-28 14:01:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698460260 not downloaded yet
2026-03-28 14:01:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BL16UUB/697704395/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/BL16UUB/42810250?sv=2020-08-04&st=2026-03-28T14%3A01%3A27Z&se=2026-03-28T14%3A26%3A27Z&sr=b&sp=r&sig=SYmTiNujaXYF2XAoxTdHUcpF%2BqchRSrGUQy4u1jrdO0%3D)
2026-03-28 14:01:43 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:01:43 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:01:43 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:01:43 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:01:43 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:01:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:01:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2ca2e390>
2026-03-28 14:01:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:01:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:01:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:01:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7cdb5790-795c-503b-b01e-2ccf288a1773/7cdb5790-795c-503b-b01e-2ccf288a1773_image_9.jpg HTTP/1.1" 201 0
2026-03-28 14:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FKO15JZW%252F698928974%252F600') HTTP/1.1" 204 0
2026-03-28 14:01:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KO15JZW/698928974/600 saved to cache
2026-03-28 14:01:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 7cdb5790-795c-503b-b01e-2ccf288a1773
2026-03-28 14:01:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:01:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c67d5d0>
2026-03-28 14:01:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:01:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:01:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:01:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_60bcb64c-26b9-5747-8fc6-986efaa78996/60bcb64c-26b9-5747-8fc6-986efaa78996_image_5.jpg HTTP/1.1" 201 0
2026-03-28 14:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FVO62RAU%252F698928900%252F600') HTTP/1.1" 204 0
2026-03-28 14:01:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VO62RAU/698928900/600 saved to cache
2026-03-28 14:01:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 60bcb64c-26b9-5747-8fc6-986efaa78996
2026-03-28 14:01:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:01:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c9c0ed0>
2026-03-28 14:01:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:01:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:01:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:01:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b697841c-f8f8-5c3e-a0f7-75585967ab4c/b697841c-f8f8-5c3e-a0f7-75585967ab4c_expert_report_file_020d010b-afca-4ea1-9987-5e0f840724e4.pdf HTTP/1.1" 201 0
2026-03-28 14:01:43 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item b697841c-f8f8-5c3e-a0f7-75585967ab4c
2026-03-28 14:01:43 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: b697841c-f8f8-5c3e-a0f7-75585967ab4c, skipping ID generation
2026-03-28 14:01:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item b697841c-f8f8-5c3e-a0f7-75585967ab4c
2026-03-28 14:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DCP19XKX-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-28 14:01:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=CP19XKX-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-28 14:01:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:01:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c5e0990>
2026-03-28 14:01:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:01:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:01:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:01:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_78b2ead9-6d58-5edb-a028-9b77396fb5da/78b2ead9-6d58-5edb-a028-9b77396fb5da_expert_report_file_d7079ec3-0ced-4354-bd31-8c2af5ebb5cb.pdf HTTP/1.1" 201 0
2026-03-28 14:01:43 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item 78b2ead9-6d58-5edb-a028-9b77396fb5da
2026-03-28 14:01:43 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 78b2ead9-6d58-5edb-a028-9b77396fb5da, skipping ID generation
2026-03-28 14:01:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 78b2ead9-6d58-5edb-a028-9b77396fb5da
2026-03-28 14:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DWX70JZJ-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-28 14:01:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=WX70JZJ-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-28 14:01:43 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:01:43 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:01:43 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:01:43 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:01:43 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:01:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:01:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a30123e10>
2026-03-28 14:01:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:01:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:01:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:01:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5b546abb-9cfb-537e-b2ac-6d60a5514e55/5b546abb-9cfb-537e-b2ac-6d60a5514e55_image_9.jpg HTTP/1.1" 201 0
2026-03-28 14:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FYW64DGU%252F698928973%252F600') HTTP/1.1" 204 0
2026-03-28 14:01:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YW64DGU/698928973/600 saved to cache
2026-03-28 14:01:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 5b546abb-9cfb-537e-b2ac-6d60a5514e55
2026-03-28 14:01:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YD66KFF/698260492/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YD66KFF/42810264?sv=2020-08-04&st=2026-03-28T14%3A01%3A27Z&se=2026-03-28T14%3A26%3A27Z&sr=b&sp=r&sig=BnH67lWrH1ehlh0fvDCmlxB%2FgGDsNGQtDgFTgEjpoSk%3D)
2026-03-28 14:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698460263%27 HTTP/1.1" 200 None
2026-03-28 14:01:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698460263 not downloaded yet
2026-03-28 14:01:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VK65XNW/697722963/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/VK65XNW/42810265?sv=2020-08-04&st=2026-03-28T14%3A01%3A28Z&se=2026-03-28T14%3A26%3A28Z&sr=b&sp=r&sig=3QAAN%2BSB1OUMkxc4Xxtv%2BiBflOK5M03dTgEQ%2BLIgSi4%3D)
2026-03-28 14:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698252597%27 HTTP/1.1" 200 None
2026-03-28 14:01:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698252597 not downloaded yet
2026-03-28 14:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698017405%27 HTTP/1.1" 200 None
2026-03-28 14:01:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698017405 not downloaded yet
2026-03-28 14:01:43 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KO15JZW/698928924/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698928924>
2026-03-28 14:01:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WM19BFN/698601888/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/WM19BFN/42804238?sv=2020-08-04&st=2026-03-28T14%3A01%3A26Z&se=2026-03-28T14%3A26%3A26Z&sr=b&sp=r&sig=EfjfS2OdrtC4SA3uZ5XRiTu1xsVnQ9sqSYyb4MkUK3s%3D)
2026-03-28 14:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698460265%27 HTTP/1.1" 200 None
2026-03-28 14:01:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698460265 not downloaded yet
2026-03-28 14:01:43 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VO62RAU/698928885/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698928885>
2026-03-28 14:01:43 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/SE16KBX/42810481?sv=2020-08-04&st=2026-03-28T14%3A01%3A43Z&se=2026-03-28T14%3A26%3A43Z&sr=b&sp=r&sig=rYZ6%2FLmXFuF3wm%2Fw4qElxJjSolkBjHdf49Pe6BwnMBo%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=SE16%20KBX-GB>
2026-03-28 14:01:43 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/WX18RMZ/42802183?sv=2020-08-04&st=2026-03-28T14%3A01%3A43Z&se=2026-03-28T14%3A26%3A43Z&sr=b&sp=r&sig=KSkY%2BSv6OSFm2lLfKktFLHwDGf8wN319lzyYallQs%2FQ%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=WX18%20RMZ-GB>
2026-03-28 14:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698252603%27 HTTP/1.1" 200 None
2026-03-28 14:01:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698252603 not downloaded yet
2026-03-28 14:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698017408%27 HTTP/1.1" 200 None
2026-03-28 14:01:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698017408 not downloaded yet
2026-03-28 14:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698460267%27 HTTP/1.1" 200 None
2026-03-28 14:01:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698460267 not downloaded yet
2026-03-28 14:01:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:01:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c5e1790>
2026-03-28 14:01:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:01:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:01:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:01:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0314c884-43b5-5d2e-81ae-0d6223087ff6/0314c884-43b5-5d2e-81ae-0d6223087ff6_expert_report_file_b6ad4617-66ac-49ff-bcfe-35e0ca6296fa.pdf HTTP/1.1" 201 0
2026-03-28 14:01:43 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item 0314c884-43b5-5d2e-81ae-0d6223087ff6
2026-03-28 14:01:43 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 0314c884-43b5-5d2e-81ae-0d6223087ff6, skipping ID generation
2026-03-28 14:01:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 0314c884-43b5-5d2e-81ae-0d6223087ff6
2026-03-28 14:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DPN64UHS-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-28 14:01:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=PN64UHS-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-28 14:01:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:01:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c8212d0>
2026-03-28 14:01:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:01:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:01:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:01:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3007384c-6a41-5ced-bc4c-10b628334249/3007384c-6a41-5ced-bc4c-10b628334249_image_3.jpg HTTP/1.1" 201 0
2026-03-28 14:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FFL59VTF%252F698069847%252F600') HTTP/1.1" 204 0
2026-03-28 14:01:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FL59VTF/698069847/600 saved to cache
2026-03-28 14:01:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 3007384c-6a41-5ced-bc4c-10b628334249
2026-03-28 14:01:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:01:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2ddf9b90>
2026-03-28 14:01:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:01:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:01:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:01:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fc54a12c-7c43-5241-baa9-136ed93039c1/fc54a12c-7c43-5241-baa9-136ed93039c1_image_3.jpg HTTP/1.1" 201 0
2026-03-28 14:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FBL16UUB%252F697704395%252F600') HTTP/1.1" 204 0
2026-03-28 14:01:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BL16UUB/697704395/600 saved to cache
2026-03-28 14:01:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item fc54a12c-7c43-5241-baa9-136ed93039c1
2026-03-28 14:01:43 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YW64DGU/698928956/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698928956>
2026-03-28 14:01:43 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WA15XTF/697938732/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=697938732>
2026-03-28 14:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698252610%27 HTTP/1.1" 200 None
2026-03-28 14:01:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698252610 not downloaded yet
2026-03-28 14:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698017415%27 HTTP/1.1" 200 None
2026-03-28 14:01:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698017415 not downloaded yet
2026-03-28 14:01:43 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SF65MRS/698522154/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698522154>
2026-03-28 14:01:43 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/VN21GCK/42810042?sv=2020-08-04&st=2026-03-28T14%3A01%3A43Z&se=2026-03-28T14%3A26%3A43Z&sr=b&sp=r&sig=K536yllWddRWkBSE9QiLSB7gYH5xYBnaNI8d3nMUcBg%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=VN21%20GCK-GB>
2026-03-28 14:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698460270%27 HTTP/1.1" 200 None
2026-03-28 14:01:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698460270 not downloaded yet
2026-03-28 14:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698149252%27 HTTP/1.1" 200 None
2026-03-28 14:01:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698149252 not downloaded yet
2026-03-28 14:01:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FH21UNX/698923386/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/FH21UNX/42809938?sv=2020-08-04&st=2026-03-28T14%3A01%3A25Z&se=2026-03-28T14%3A26%3A25Z&sr=b&sp=r&sig=DX6Iqw0wYrgXXc1Kaaa%2FZcBpc9wYL%2BSdFRwB6BQgkeE%3D)
2026-03-28 14:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698252618%27 HTTP/1.1" 200 None
2026-03-28 14:01:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698252618 not downloaded yet
2026-03-28 14:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698017425%27 HTTP/1.1" 200 None
2026-03-28 14:01:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698017425 not downloaded yet
2026-03-28 14:01:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:01:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c116c10>
2026-03-28 14:01:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:01:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:01:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:01:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c163b1cf-cc62-5193-9026-6cea3a049e80/c163b1cf-cc62-5193-9026-6cea3a049e80_image_3.jpg HTTP/1.1" 201 0
2026-03-28 14:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FYD66KFF%252F698260492%252F600') HTTP/1.1" 204 0
2026-03-28 14:01:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YD66KFF/698260492/600 saved to cache
2026-03-28 14:01:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item c163b1cf-cc62-5193-9026-6cea3a049e80
2026-03-28 14:01:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:01:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a1fd2e590>
2026-03-28 14:01:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:01:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:01:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:01:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_defab1ac-857d-50f7-901c-50783b029725/defab1ac-857d-50f7-901c-50783b029725_image_3.jpg HTTP/1.1" 201 0
2026-03-28 14:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FVK65XNW%252F697722963%252F600') HTTP/1.1" 204 0
2026-03-28 14:01:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VK65XNW/697722963/600 saved to cache
2026-03-28 14:01:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item defab1ac-857d-50f7-901c-50783b029725
2026-03-28 14:01:43 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:01:43 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:01:43 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:01:43 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:01:43 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:01:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:01:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2d6aea90>
2026-03-28 14:01:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:01:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:01:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:01:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_94badcac-d91d-5664-a6fe-32adc35ee01a/94badcac-d91d-5664-a6fe-32adc35ee01a_image_6.jpg HTTP/1.1" 201 0
2026-03-28 14:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FWM19BFN%252F698601888%252F600') HTTP/1.1" 204 0
2026-03-28 14:01:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WM19BFN/698601888/600 saved to cache
2026-03-28 14:01:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 94badcac-d91d-5664-a6fe-32adc35ee01a
2026-03-28 14:01:43 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RO63WRK/698460252/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=RO63WRK-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-28 14:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698460274%27 HTTP/1.1" 200 None
2026-03-28 14:01:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698460274 not downloaded yet
2026-03-28 14:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698149259%27 HTTP/1.1" 200 None
2026-03-28 14:01:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698149259 not downloaded yet
2026-03-28 14:01:43 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RO63WRK/698460256/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698460256>
2026-03-28 14:01:43 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WX70JZJ/698017397/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=WX70JZJ-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-28 14:01:43 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LD14UGX/42809825?sv=2020-08-04&st=2026-03-28T14%3A01%3A43Z&se=2026-03-28T14%3A26%3A43Z&sr=b&sp=r&sig=%2BaRmCEwHPNy3otLvYKNHicfNibWcwPy6Mz8eAP9fbh8%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=LD14%20UGX-GB>
2026-03-28 14:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698252625%27 HTTP/1.1" 200 None
2026-03-28 14:01:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698252625 not downloaded yet
2026-03-28 14:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698017433%27 HTTP/1.1" 200 None
2026-03-28 14:01:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698017433 not downloaded yet
2026-03-28 14:01:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EJ19URS/698294848/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/EJ19URS/42798170?sv=2020-08-04&st=2026-03-28T14%3A01%3A25Z&se=2026-03-28T14%3A26%3A25Z&sr=b&sp=r&sig=rAxmzY9RDaFtqRrL9CfX2gFSW4Q22XPI9rfpZk%2B4AL4%3D)
2026-03-28 14:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698460277%27 HTTP/1.1" 200 None
2026-03-28 14:01:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698460277 not downloaded yet
2026-03-28 14:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698149265%27 HTTP/1.1" 200 None
2026-03-28 14:01:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698149265 not downloaded yet
2026-03-28 14:01:44 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:01:44 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:01:44 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:01:44 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:01:44 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:01:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:01:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c4625d0>
2026-03-28 14:01:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:01:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:01:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:01:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a610f6fb-a046-5c2e-8701-0fcb295f97f1/a610f6fb-a046-5c2e-8701-0fcb295f97f1_image_7.jpg HTTP/1.1" 201 0
2026-03-28 14:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FFH21UNX%252F698923386%252F600') HTTP/1.1" 204 0
2026-03-28 14:01:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FH21UNX/698923386/600 saved to cache
2026-03-28 14:01:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item a610f6fb-a046-5c2e-8701-0fcb295f97f1
2026-03-28 14:01:44 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RO63WRK/698460263/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698460263>
2026-03-28 14:01:44 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CP19XKX/698252589/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=CP19XKX-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-28 14:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698252632%27 HTTP/1.1" 200 None
2026-03-28 14:01:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698252632 not downloaded yet
2026-03-28 14:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698017439%27 HTTP/1.1" 200 None
2026-03-28 14:01:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698017439 not downloaded yet
2026-03-28 14:01:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KO15JZW/698928924/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/KO15JZW/42809875?sv=2020-08-04&st=2026-03-28T14%3A01%3A23Z&se=2026-03-28T14%3A26%3A23Z&sr=b&sp=r&sig=WtTYXpKYofDjFDmXev3jjoySms%2BztrBA4DkuQ5Y14aQ%3D)
2026-03-28 14:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698460279%27 HTTP/1.1" 200 None
2026-03-28 14:01:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698460279 not downloaded yet
2026-03-28 14:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698149331%27 HTTP/1.1" 200 None
2026-03-28 14:01:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698149331 not downloaded yet
2026-03-28 14:01:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/WX18RMZ/42802183?sv=2020-08-04&st=2026-03-28T14%3A01%3A43Z&se=2026-03-28T14%3A26%3A43Z&sr=b&sp=r&sig=KSkY%2BSv6OSFm2lLfKktFLHwDGf8wN319lzyYallQs%2FQ%3D> (referer: https://www.bca.co.uk/)
2026-03-28 14:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698252641%27 HTTP/1.1" 200 None
2026-03-28 14:01:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698252641 not downloaded yet
2026-03-28 14:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698017456%27 HTTP/1.1" 200 None
2026-03-28 14:01:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698017456 not downloaded yet
2026-03-28 14:01:44 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:01:44 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:01:44 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:01:44 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:01:44 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:01:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:01:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c135fd0>
2026-03-28 14:01:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:01:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:01:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:01:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_755baf27-b55d-5033-a837-c4d9f3659c0e/755baf27-b55d-5033-a837-c4d9f3659c0e_image_7.jpg HTTP/1.1" 201 0
2026-03-28 14:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FEJ19URS%252F698294848%252F600') HTTP/1.1" 204 0
2026-03-28 14:01:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EJ19URS/698294848/600 saved to cache
2026-03-28 14:01:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 755baf27-b55d-5033-a837-c4d9f3659c0e
2026-03-28 14:01:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VO62RAU/698928885/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/VO62RAU/42809976?sv=2020-08-04&st=2026-03-28T14%3A01%3A26Z&se=2026-03-28T14%3A26%3A26Z&sr=b&sp=r&sig=ajraupx01hOhBxj83xq2SeA0U6vZ89qgzfl3QZ0K0u0%3D)
2026-03-28 14:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698149349%27 HTTP/1.1" 200 None
2026-03-28 14:01:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698149349 not downloaded yet
2026-03-28 14:01:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YW64DGU/698928956/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YW64DGU/42810194?sv=2020-08-04&st=2026-03-28T14%3A01%3A23Z&se=2026-03-28T14%3A26%3A23Z&sr=b&sp=r&sig=bKUUxkl%2FQOTN6xP3oKLYX53uOLW1seBVRfhSdF3FtAg%3D)
2026-03-28 14:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698252652%27 HTTP/1.1" 200 None
2026-03-28 14:01:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698252652 not downloaded yet
2026-03-28 14:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698017470%27 HTTP/1.1" 200 None
2026-03-28 14:01:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698017470 not downloaded yet
2026-03-28 14:01:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/SE16KBX/42810481?sv=2020-08-04&st=2026-03-28T14%3A01%3A43Z&se=2026-03-28T14%3A26%3A43Z&sr=b&sp=r&sig=rYZ6%2FLmXFuF3wm%2Fw4qElxJjSolkBjHdf49Pe6BwnMBo%3D> (referer: https://www.bca.co.uk/)
2026-03-28 14:01:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WA15XTF/697938732/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/WA15XTF/42809463?sv=2020-08-04&st=2026-03-28T14%3A01%3A23Z&se=2026-03-28T14%3A26%3A23Z&sr=b&sp=r&sig=OVT1XXFunRJjcV5jy5Zgfxxi5O1xAq2cfTX%2F%2FcIif88%3D)
2026-03-28 14:01:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SF65MRS/698522154/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/SF65MRS/42810141?sv=2020-08-04&st=2026-03-28T14%3A01%3A23Z&se=2026-03-28T14%3A26%3A23Z&sr=b&sp=r&sig=pKcKPXIMRDrpvR7qgfCAU8Cghh7jF%2FL25jpHeT9Gs0U%3D)
2026-03-28 14:01:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/VN21GCK/42810042?sv=2020-08-04&st=2026-03-28T14%3A01%3A43Z&se=2026-03-28T14%3A26%3A43Z&sr=b&sp=r&sig=K536yllWddRWkBSE9QiLSB7gYH5xYBnaNI8d3nMUcBg%3D> (referer: https://www.bca.co.uk/)
2026-03-28 14:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698149360%27 HTTP/1.1" 200 None
2026-03-28 14:01:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698149360 not downloaded yet
2026-03-28 14:01:44 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:01:44 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:01:44 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:01:44 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:01:44 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:01:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:01:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2d684750>
2026-03-28 14:01:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:01:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:01:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:01:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7cdb5790-795c-503b-b01e-2ccf288a1773/7cdb5790-795c-503b-b01e-2ccf288a1773_image_7.jpg HTTP/1.1" 201 0
2026-03-28 14:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FKO15JZW%252F698928924%252F600') HTTP/1.1" 204 0
2026-03-28 14:01:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KO15JZW/698928924/600 saved to cache
2026-03-28 14:01:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 7cdb5790-795c-503b-b01e-2ccf288a1773
2026-03-28 14:01:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RO63WRK/698460252/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/RO63WRK/42810240?sv=2020-08-04&st=2026-03-28T14%3A01%3A42Z&se=2026-03-28T14%3A26%3A42Z&sr=b&sp=r&sig=MOREAH8gnhiPYq9fnYSM0K23PHRvNBVeUgjnUtNHuk8%3D)
2026-03-28 14:01:44 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WX70JZJ/698017415/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698017415>
2026-03-28 14:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698252660%27 HTTP/1.1" 200 None
2026-03-28 14:01:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698252660 not downloaded yet
2026-03-28 14:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698017475%27 HTTP/1.1" 200 None
2026-03-28 14:01:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698017475 not downloaded yet
2026-03-28 14:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698149372%27 HTTP/1.1" 200 None
2026-03-28 14:01:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698149372 not downloaded yet
2026-03-28 14:01:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:01:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c135890>
2026-03-28 14:01:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:01:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:01:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:01:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e4a41ade-3285-55a6-95db-86a4f368e5a7/e4a41ade-3285-55a6-95db-86a4f368e5a7_expert_report_file_2f0d593f-f0b8-435d-94ba-725be7843509.pdf HTTP/1.1" 201 0
2026-03-28 14:01:44 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item e4a41ade-3285-55a6-95db-86a4f368e5a7
2026-03-28 14:01:44 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: e4a41ade-3285-55a6-95db-86a4f368e5a7, skipping ID generation
2026-03-28 14:01:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item e4a41ade-3285-55a6-95db-86a4f368e5a7
2026-03-28 14:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DWX18RMZ-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-28 14:01:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=WX18RMZ-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-28 14:01:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:01:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2ddfad50>
2026-03-28 14:01:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:01:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:01:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:01:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_60bcb64c-26b9-5747-8fc6-986efaa78996/60bcb64c-26b9-5747-8fc6-986efaa78996_image_4.jpg HTTP/1.1" 201 0
2026-03-28 14:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FVO62RAU%252F698928885%252F600') HTTP/1.1" 204 0
2026-03-28 14:01:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VO62RAU/698928885/600 saved to cache
2026-03-28 14:01:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 60bcb64c-26b9-5747-8fc6-986efaa78996
2026-03-28 14:01:44 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:01:44 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:01:44 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:01:44 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:01:44 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:01:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:01:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c43e7d0>
2026-03-28 14:01:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:01:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:01:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:01:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5b546abb-9cfb-537e-b2ac-6d60a5514e55/5b546abb-9cfb-537e-b2ac-6d60a5514e55_image_8.jpg HTTP/1.1" 201 0
2026-03-28 14:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FYW64DGU%252F698928956%252F600') HTTP/1.1" 204 0
2026-03-28 14:01:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YW64DGU/698928956/600 saved to cache
2026-03-28 14:01:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 5b546abb-9cfb-537e-b2ac-6d60a5514e55
2026-03-28 14:01:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LD14UGX/42809825?sv=2020-08-04&st=2026-03-28T14%3A01%3A43Z&se=2026-03-28T14%3A26%3A43Z&sr=b&sp=r&sig=%2BaRmCEwHPNy3otLvYKNHicfNibWcwPy6Mz8eAP9fbh8%3D> (referer: https://www.bca.co.uk/)
2026-03-28 14:01:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WX70JZJ/698017397/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/WX70JZJ/42810045?sv=2020-08-04&st=2026-03-28T14%3A01%3A42Z&se=2026-03-28T14%3A26%3A42Z&sr=b&sp=r&sig=zpaKYMdJB0PiQSX%2BpoOKZdTxRmLBiapRNqdSFDIfp%2Bc%3D)
2026-03-28 14:01:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CP19XKX/698252589/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/CP19XKX/42810052?sv=2020-08-04&st=2026-03-28T14%3A01%3A42Z&se=2026-03-28T14%3A26%3A42Z&sr=b&sp=r&sig=bjyHHkX2Tk%2Fg1NdAswlyjtEAt76c1wRB5i7u%2BULrS5U%3D)
2026-03-28 14:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698149388%27 HTTP/1.1" 200 None
2026-03-28 14:01:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698149388 not downloaded yet
2026-03-28 14:01:44 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PN64UHS/698149259/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698149259>
2026-03-28 14:01:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RO63WRK/698460256/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/RO63WRK/42810240?sv=2020-08-04&st=2026-03-28T14%3A01%3A42Z&se=2026-03-28T14%3A26%3A42Z&sr=b&sp=r&sig=MOREAH8gnhiPYq9fnYSM0K23PHRvNBVeUgjnUtNHuk8%3D)
2026-03-28 14:01:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RO63WRK/698460263/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/RO63WRK/42810240?sv=2020-08-04&st=2026-03-28T14%3A01%3A42Z&se=2026-03-28T14%3A26%3A42Z&sr=b&sp=r&sig=MOREAH8gnhiPYq9fnYSM0K23PHRvNBVeUgjnUtNHuk8%3D)
2026-03-28 14:01:44 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WX70JZJ/698017439/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698017439>
2026-03-28 14:01:44 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CP19XKX/698252632/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698252632>
2026-03-28 14:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698558951%27 HTTP/1.1" 200 None
2026-03-28 14:01:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698558951 not downloaded yet
2026-03-28 14:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698149402%27 HTTP/1.1" 200 None
2026-03-28 14:01:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698149402 not downloaded yet
2026-03-28 14:01:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:01:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c99f510>
2026-03-28 14:01:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:01:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:01:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:01:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2e77e548-6211-5739-af41-39c112c5041c/2e77e548-6211-5739-af41-39c112c5041c_expert_report_file_97aeadad-dd24-4522-9ed5-53fe7666e37a.pdf HTTP/1.1" 201 0
2026-03-28 14:01:44 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item 2e77e548-6211-5739-af41-39c112c5041c
2026-03-28 14:01:44 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 2e77e548-6211-5739-af41-39c112c5041c, skipping ID generation
2026-03-28 14:01:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 2e77e548-6211-5739-af41-39c112c5041c
2026-03-28 14:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DSE16KBX-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-28 14:01:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=SE16KBX-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-28 14:01:44 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:01:44 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:01:44 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:01:44 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:01:44 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:01:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:01:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c6e7b90>
2026-03-28 14:01:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:01:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:01:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:01:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_012921cb-8763-5e72-9bbe-1684326c9a1d/012921cb-8763-5e72-9bbe-1684326c9a1d_image_9.jpg HTTP/1.1" 201 0
2026-03-28 14:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FWA15XTF%252F697938732%252F600') HTTP/1.1" 204 0
2026-03-28 14:01:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WA15XTF/697938732/600 saved to cache
2026-03-28 14:01:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 012921cb-8763-5e72-9bbe-1684326c9a1d
2026-03-28 14:01:44 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:01:44 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:01:44 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:01:44 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:01:44 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:01:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:01:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a1fd74c90>
2026-03-28 14:01:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:01:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:01:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:01:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_228041df-5797-5c8f-89c8-2a337a640ead/228041df-5797-5c8f-89c8-2a337a640ead_image_9.jpg HTTP/1.1" 201 0
2026-03-28 14:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FSF65MRS%252F698522154%252F600') HTTP/1.1" 204 0
2026-03-28 14:01:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SF65MRS/698522154/600 saved to cache
2026-03-28 14:01:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 228041df-5797-5c8f-89c8-2a337a640ead
2026-03-28 14:01:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:01:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c779910>
2026-03-28 14:01:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:01:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:01:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:01:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_042f9bcc-1260-53d1-9b7d-30c11d39be73/042f9bcc-1260-53d1-9b7d-30c11d39be73_expert_report_file_83f60ee0-f7db-4d85-9074-05f14de5fbec.pdf HTTP/1.1" 201 0
2026-03-28 14:01:44 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item 042f9bcc-1260-53d1-9b7d-30c11d39be73
2026-03-28 14:01:44 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 042f9bcc-1260-53d1-9b7d-30c11d39be73, skipping ID generation
2026-03-28 14:01:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 042f9bcc-1260-53d1-9b7d-30c11d39be73
2026-03-28 14:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DVN21GCK-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-28 14:01:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=VN21GCK-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-28 14:01:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:01:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c67f1d0>
2026-03-28 14:01:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:01:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:01:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:01:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_10beb970-842b-5836-9952-ce1ec016ade8/10beb970-842b-5836-9952-ce1ec016ade8_image_0.jpg HTTP/1.1" 201 0
2026-03-28 14:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FRO63WRK%252F698460252%252F600') HTTP/1.1" 204 0
2026-03-28 14:01:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RO63WRK/698460252/600 saved to cache
2026-03-28 14:01:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 10beb970-842b-5836-9952-ce1ec016ade8
2026-03-28 14:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698558980%27 HTTP/1.1" 200 None
2026-03-28 14:01:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698558980 not downloaded yet
2026-03-28 14:01:44 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PN64UHS/698149349/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698149349>
2026-03-28 14:01:44 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WX70JZJ/698017456/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698017456>
2026-03-28 14:01:44 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PN64UHS/698149331/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698149331>
2026-03-28 14:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698938669%27 HTTP/1.1" 200 None
2026-03-28 14:01:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698938669 not downloaded yet
2026-03-28 14:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D697998947%27 HTTP/1.1" 200 None
2026-03-28 14:01:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=697998947 not downloaded yet
2026-03-28 14:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698559064%27 HTTP/1.1" 200 None
2026-03-28 14:01:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698559064 not downloaded yet
2026-03-28 14:01:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:01:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c6e7f10>
2026-03-28 14:01:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:01:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:01:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:01:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c886d5a8-7924-5e92-b88e-1f87c5b1511a/c886d5a8-7924-5e92-b88e-1f87c5b1511a_expert_report_file_fdc4a348-2352-4e65-a34e-35356a93ff23.pdf HTTP/1.1" 201 0
2026-03-28 14:01:44 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item c886d5a8-7924-5e92-b88e-1f87c5b1511a
2026-03-28 14:01:44 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: c886d5a8-7924-5e92-b88e-1f87c5b1511a, skipping ID generation
2026-03-28 14:01:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item c886d5a8-7924-5e92-b88e-1f87c5b1511a
2026-03-28 14:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DLD14UGX-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-28 14:01:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=LD14UGX-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-28 14:01:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:01:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c6bf610>
2026-03-28 14:01:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:01:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:01:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:01:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_78b2ead9-6d58-5edb-a028-9b77396fb5da/78b2ead9-6d58-5edb-a028-9b77396fb5da_image_0.jpg HTTP/1.1" 201 0
2026-03-28 14:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FWX70JZJ%252F698017397%252F600') HTTP/1.1" 204 0
2026-03-28 14:01:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WX70JZJ/698017397/600 saved to cache
2026-03-28 14:01:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 78b2ead9-6d58-5edb-a028-9b77396fb5da
2026-03-28 14:01:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:01:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a1fed3910>
2026-03-28 14:01:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:01:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:01:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:01:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b697841c-f8f8-5c3e-a0f7-75585967ab4c/b697841c-f8f8-5c3e-a0f7-75585967ab4c_image_0.jpg HTTP/1.1" 201 0
2026-03-28 14:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FCP19XKX%252F698252589%252F600') HTTP/1.1" 204 0
2026-03-28 14:01:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CP19XKX/698252589/600 saved to cache
2026-03-28 14:01:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item b697841c-f8f8-5c3e-a0f7-75585967ab4c
2026-03-28 14:01:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:01:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2ca1bd10>
2026-03-28 14:01:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:01:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:01:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:01:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_10beb970-842b-5836-9952-ce1ec016ade8/10beb970-842b-5836-9952-ce1ec016ade8_image_1.jpg HTTP/1.1" 201 0
2026-03-28 14:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FRO63WRK%252F698460256%252F600') HTTP/1.1" 204 0
2026-03-28 14:01:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RO63WRK/698460256/600 saved to cache
2026-03-28 14:01:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 10beb970-842b-5836-9952-ce1ec016ade8
2026-03-28 14:01:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:01:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c11ec90>
2026-03-28 14:01:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:01:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:01:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:01:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_10beb970-842b-5836-9952-ce1ec016ade8/10beb970-842b-5836-9952-ce1ec016ade8_image_3.jpg HTTP/1.1" 201 0
2026-03-28 14:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FRO63WRK%252F698460263%252F600') HTTP/1.1" 204 0
2026-03-28 14:01:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RO63WRK/698460263/600 saved to cache
2026-03-28 14:01:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 10beb970-842b-5836-9952-ce1ec016ade8
2026-03-28 14:01:45 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PN64UHS/698149265/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698149265>
2026-03-28 14:01:45 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WX70JZJ/698017470/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698017470>
2026-03-28 14:01:45 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RO63WRK/698460279/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698460279>
2026-03-28 14:01:45 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CP19XKX/698252641/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698252641>
2026-03-28 14:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698938680%27 HTTP/1.1" 200 None
2026-03-28 14:01:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698938680 not downloaded yet
2026-03-28 14:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D697998953%27 HTTP/1.1" 200 None
2026-03-28 14:01:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=697998953 not downloaded yet
2026-03-28 14:01:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WX70JZJ/698017415/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/WX70JZJ/42810045?sv=2020-08-04&st=2026-03-28T14%3A01%3A42Z&se=2026-03-28T14%3A26%3A42Z&sr=b&sp=r&sig=zpaKYMdJB0PiQSX%2BpoOKZdTxRmLBiapRNqdSFDIfp%2Bc%3D)
2026-03-28 14:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698559073%27 HTTP/1.1" 200 None
2026-03-28 14:01:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698559073 not downloaded yet
2026-03-28 14:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D697217746%27 HTTP/1.1" 200 None
2026-03-28 14:01:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=697217746 not downloaded yet
2026-03-28 14:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698938689%27 HTTP/1.1" 200 None
2026-03-28 14:01:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698938689 not downloaded yet
2026-03-28 14:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D697998957%27 HTTP/1.1" 200 None
2026-03-28 14:01:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=697998957 not downloaded yet
2026-03-28 14:01:45 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PN64UHS/698149372/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698149372>
2026-03-28 14:01:45 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WX70JZJ/698017475/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698017475>
2026-03-28 14:01:45 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CP19XKX/698252660/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698252660>
2026-03-28 14:01:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PN64UHS/698149259/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/PN64UHS/42810229?sv=2020-08-04&st=2026-03-28T14%3A01%3A42Z&se=2026-03-28T14%3A26%3A42Z&sr=b&sp=r&sig=poKtxPpxXbqP0NGLExiJbxVwCiEJHxglY1MdvVHQzVg%3D)
2026-03-28 14:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698559084%27 HTTP/1.1" 200 None
2026-03-28 14:01:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698559084 not downloaded yet
2026-03-28 14:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D697217752%27 HTTP/1.1" 200 None
2026-03-28 14:01:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=697217752 not downloaded yet
2026-03-28 14:01:45 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PN64UHS/698149388/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698149388>
2026-03-28 14:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698938698%27 HTTP/1.1" 200 None
2026-03-28 14:01:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698938698 not downloaded yet
2026-03-28 14:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D697998961%27 HTTP/1.1" 200 None
2026-03-28 14:01:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=697998961 not downloaded yet
2026-03-28 14:01:46 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WX18RMZ/698558942/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=WX18RMZ-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-28 14:01:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CP19XKX/698252632/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/CP19XKX/42810052?sv=2020-08-04&st=2026-03-28T14%3A01%3A42Z&se=2026-03-28T14%3A26%3A42Z&sr=b&sp=r&sig=bjyHHkX2Tk%2Fg1NdAswlyjtEAt76c1wRB5i7u%2BULrS5U%3D)
2026-03-28 14:01:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WX70JZJ/698017439/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/WX70JZJ/42810045?sv=2020-08-04&st=2026-03-28T14%3A01%3A42Z&se=2026-03-28T14%3A26%3A42Z&sr=b&sp=r&sig=zpaKYMdJB0PiQSX%2BpoOKZdTxRmLBiapRNqdSFDIfp%2Bc%3D)
2026-03-28 14:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698559106%27 HTTP/1.1" 200 None
2026-03-28 14:01:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698559106 not downloaded yet
2026-03-28 14:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D697217759%27 HTTP/1.1" 200 None
2026-03-28 14:01:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=697217759 not downloaded yet
2026-03-28 14:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698938705%27 HTTP/1.1" 200 None
2026-03-28 14:01:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698938705 not downloaded yet
2026-03-28 14:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D697998965%27 HTTP/1.1" 200 None
2026-03-28 14:01:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=697998965 not downloaded yet
2026-03-28 14:01:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:01:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a1fdb4490>
2026-03-28 14:01:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:01:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:01:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:01:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_78b2ead9-6d58-5edb-a028-9b77396fb5da/78b2ead9-6d58-5edb-a028-9b77396fb5da_image_3.jpg HTTP/1.1" 201 0
2026-03-28 14:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FWX70JZJ%252F698017415%252F600') HTTP/1.1" 204 0
2026-03-28 14:01:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WX70JZJ/698017415/600 saved to cache
2026-03-28 14:01:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 78b2ead9-6d58-5edb-a028-9b77396fb5da
2026-03-28 14:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698559129%27 HTTP/1.1" 200 None
2026-03-28 14:01:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698559129 not downloaded yet
2026-03-28 14:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D697217764%27 HTTP/1.1" 200 None
2026-03-28 14:01:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=697217764 not downloaded yet
2026-03-28 14:01:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PN64UHS/698149331/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/PN64UHS/42810229?sv=2020-08-04&st=2026-03-28T14%3A01%3A42Z&se=2026-03-28T14%3A26%3A42Z&sr=b&sp=r&sig=poKtxPpxXbqP0NGLExiJbxVwCiEJHxglY1MdvVHQzVg%3D)
2026-03-28 14:01:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PN64UHS/698149349/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/PN64UHS/42810229?sv=2020-08-04&st=2026-03-28T14%3A01%3A42Z&se=2026-03-28T14%3A26%3A42Z&sr=b&sp=r&sig=poKtxPpxXbqP0NGLExiJbxVwCiEJHxglY1MdvVHQzVg%3D)
2026-03-28 14:01:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CP19XKX/698252641/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/CP19XKX/42810052?sv=2020-08-04&st=2026-03-28T14%3A01%3A42Z&se=2026-03-28T14%3A26%3A42Z&sr=b&sp=r&sig=bjyHHkX2Tk%2Fg1NdAswlyjtEAt76c1wRB5i7u%2BULrS5U%3D)
2026-03-28 14:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698938720%27 HTTP/1.1" 200 None
2026-03-28 14:01:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698938720 not downloaded yet
2026-03-28 14:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D697998970%27 HTTP/1.1" 200 None
2026-03-28 14:01:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=697998970 not downloaded yet
2026-03-28 14:01:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RO63WRK/698460279/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/RO63WRK/42810240?sv=2020-08-04&st=2026-03-28T14%3A01%3A42Z&se=2026-03-28T14%3A26%3A42Z&sr=b&sp=r&sig=MOREAH8gnhiPYq9fnYSM0K23PHRvNBVeUgjnUtNHuk8%3D)
2026-03-28 14:01:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WX70JZJ/698017456/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/WX70JZJ/42810045?sv=2020-08-04&st=2026-03-28T14%3A01%3A42Z&se=2026-03-28T14%3A26%3A42Z&sr=b&sp=r&sig=zpaKYMdJB0PiQSX%2BpoOKZdTxRmLBiapRNqdSFDIfp%2Bc%3D)
2026-03-28 14:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698559156%27 HTTP/1.1" 200 None
2026-03-28 14:01:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698559156 not downloaded yet
2026-03-28 14:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D697217771%27 HTTP/1.1" 200 None
2026-03-28 14:01:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=697217771 not downloaded yet
2026-03-28 14:01:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:01:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c0f7a50>
2026-03-28 14:01:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:01:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:01:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:01:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0314c884-43b5-5d2e-81ae-0d6223087ff6/0314c884-43b5-5d2e-81ae-0d6223087ff6_image_2.jpg HTTP/1.1" 201 0
2026-03-28 14:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FPN64UHS%252F698149259%252F600') HTTP/1.1" 204 0
2026-03-28 14:01:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PN64UHS/698149259/600 saved to cache
2026-03-28 14:01:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 0314c884-43b5-5d2e-81ae-0d6223087ff6
2026-03-28 14:01:46 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:01:46 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:01:46 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:01:46 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:01:46 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:01:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:01:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c8a03d0>
2026-03-28 14:01:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:01:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:01:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:01:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b697841c-f8f8-5c3e-a0f7-75585967ab4c/b697841c-f8f8-5c3e-a0f7-75585967ab4c_image_6.jpg HTTP/1.1" 201 0
2026-03-28 14:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FCP19XKX%252F698252632%252F600') HTTP/1.1" 204 0
2026-03-28 14:01:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CP19XKX/698252632/600 saved to cache
2026-03-28 14:01:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item b697841c-f8f8-5c3e-a0f7-75585967ab4c
2026-03-28 14:01:46 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:01:46 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:01:46 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:01:46 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:01:46 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:01:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:01:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a1fd6d990>
2026-03-28 14:01:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:01:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:01:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:01:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_78b2ead9-6d58-5edb-a028-9b77396fb5da/78b2ead9-6d58-5edb-a028-9b77396fb5da_image_6.jpg HTTP/1.1" 201 0
2026-03-28 14:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FWX70JZJ%252F698017439%252F600') HTTP/1.1" 204 0
2026-03-28 14:01:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WX70JZJ/698017439/600 saved to cache
2026-03-28 14:01:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 78b2ead9-6d58-5edb-a028-9b77396fb5da
2026-03-28 14:01:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PN64UHS/698149265/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/PN64UHS/42810229?sv=2020-08-04&st=2026-03-28T14%3A01%3A42Z&se=2026-03-28T14%3A26%3A42Z&sr=b&sp=r&sig=poKtxPpxXbqP0NGLExiJbxVwCiEJHxglY1MdvVHQzVg%3D)
2026-03-28 14:01:46 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LD14UGX/697217739/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=LD14UGX-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-28 14:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698938734%27 HTTP/1.1" 200 None
2026-03-28 14:01:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698938734 not downloaded yet
2026-03-28 14:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D697998984%27 HTTP/1.1" 200 None
2026-03-28 14:01:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=697998984 not downloaded yet
2026-03-28 14:01:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WX70JZJ/698017470/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/WX70JZJ/42810045?sv=2020-08-04&st=2026-03-28T14%3A01%3A42Z&se=2026-03-28T14%3A26%3A42Z&sr=b&sp=r&sig=zpaKYMdJB0PiQSX%2BpoOKZdTxRmLBiapRNqdSFDIfp%2Bc%3D)
2026-03-28 14:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698559174%27 HTTP/1.1" 200 None
2026-03-28 14:01:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698559174 not downloaded yet
2026-03-28 14:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D697217777%27 HTTP/1.1" 200 None
2026-03-28 14:01:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=697217777 not downloaded yet
2026-03-28 14:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698938749%27 HTTP/1.1" 200 None
2026-03-28 14:01:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698938749 not downloaded yet
2026-03-28 14:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D697998990%27 HTTP/1.1" 200 None
2026-03-28 14:01:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=697998990 not downloaded yet
2026-03-28 14:01:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:01:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c5a9590>
2026-03-28 14:01:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:01:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:01:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:01:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0314c884-43b5-5d2e-81ae-0d6223087ff6/0314c884-43b5-5d2e-81ae-0d6223087ff6_image_4.jpg HTTP/1.1" 201 0
2026-03-28 14:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FPN64UHS%252F698149331%252F600') HTTP/1.1" 204 0
2026-03-28 14:01:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PN64UHS/698149331/600 saved to cache
2026-03-28 14:01:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 0314c884-43b5-5d2e-81ae-0d6223087ff6
2026-03-28 14:01:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:01:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c1676d0>
2026-03-28 14:01:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:01:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:01:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:01:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0314c884-43b5-5d2e-81ae-0d6223087ff6/0314c884-43b5-5d2e-81ae-0d6223087ff6_image_5.jpg HTTP/1.1" 201 0
2026-03-28 14:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FPN64UHS%252F698149349%252F600') HTTP/1.1" 204 0
2026-03-28 14:01:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PN64UHS/698149349/600 saved to cache
2026-03-28 14:01:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 0314c884-43b5-5d2e-81ae-0d6223087ff6
2026-03-28 14:01:46 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:01:46 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:01:46 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:01:46 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:01:46 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:01:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:01:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2d991ad0>
2026-03-28 14:01:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:01:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:01:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:01:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b697841c-f8f8-5c3e-a0f7-75585967ab4c/b697841c-f8f8-5c3e-a0f7-75585967ab4c_image_7.jpg HTTP/1.1" 201 0
2026-03-28 14:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FCP19XKX%252F698252641%252F600') HTTP/1.1" 204 0
2026-03-28 14:01:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CP19XKX/698252641/600 saved to cache
2026-03-28 14:01:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item b697841c-f8f8-5c3e-a0f7-75585967ab4c
2026-03-28 14:01:46 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:01:46 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:01:46 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:01:46 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:01:46 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:01:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:01:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2ca7e510>
2026-03-28 14:01:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:01:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:01:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:01:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_10beb970-842b-5836-9952-ce1ec016ade8/10beb970-842b-5836-9952-ce1ec016ade8_image_9.jpg HTTP/1.1" 201 0
2026-03-28 14:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FRO63WRK%252F698460279%252F600') HTTP/1.1" 204 0
2026-03-28 14:01:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RO63WRK/698460279/600 saved to cache
2026-03-28 14:01:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 10beb970-842b-5836-9952-ce1ec016ade8
2026-03-28 14:01:46 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:01:46 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:01:46 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:01:46 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:01:46 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:01:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:01:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c855590>
2026-03-28 14:01:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:01:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:01:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:01:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_78b2ead9-6d58-5edb-a028-9b77396fb5da/78b2ead9-6d58-5edb-a028-9b77396fb5da_image_7.jpg HTTP/1.1" 201 0
2026-03-28 14:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FWX70JZJ%252F698017456%252F600') HTTP/1.1" 204 0
2026-03-28 14:01:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WX70JZJ/698017456/600 saved to cache
2026-03-28 14:01:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 78b2ead9-6d58-5edb-a028-9b77396fb5da
2026-03-28 14:01:46 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VN21GCK/697998957/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=697998957>
2026-03-28 14:01:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PN64UHS/698149372/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/PN64UHS/42810229?sv=2020-08-04&st=2026-03-28T14%3A01%3A42Z&se=2026-03-28T14%3A26%3A42Z&sr=b&sp=r&sig=poKtxPpxXbqP0NGLExiJbxVwCiEJHxglY1MdvVHQzVg%3D)
2026-03-28 14:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D697217782%27 HTTP/1.1" 200 None
2026-03-28 14:01:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=697217782 not downloaded yet
2026-03-28 14:01:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WX18RMZ/698558942/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/WX18RMZ/42802183?sv=2020-08-04&st=2026-03-28T14%3A01%3A43Z&se=2026-03-28T14%3A26%3A43Z&sr=b&sp=r&sig=KSkY%2BSv6OSFm2lLfKktFLHwDGf8wN319lzyYallQs%2FQ%3D)
2026-03-28 14:01:47 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VN21GCK/697998961/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=697998961>
2026-03-28 14:01:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PN64UHS/698149388/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/PN64UHS/42810229?sv=2020-08-04&st=2026-03-28T14%3A01%3A42Z&se=2026-03-28T14%3A26%3A42Z&sr=b&sp=r&sig=poKtxPpxXbqP0NGLExiJbxVwCiEJHxglY1MdvVHQzVg%3D)
2026-03-28 14:01:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WX70JZJ/698017475/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/WX70JZJ/42810045?sv=2020-08-04&st=2026-03-28T14%3A01%3A42Z&se=2026-03-28T14%3A26%3A42Z&sr=b&sp=r&sig=zpaKYMdJB0PiQSX%2BpoOKZdTxRmLBiapRNqdSFDIfp%2Bc%3D)
2026-03-28 14:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698938761%27 HTTP/1.1" 200 None
2026-03-28 14:01:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698938761 not downloaded yet
2026-03-28 14:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D697999000%27 HTTP/1.1" 200 None
2026-03-28 14:01:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=697999000 not downloaded yet
2026-03-28 14:01:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CP19XKX/698252660/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/CP19XKX/42810052?sv=2020-08-04&st=2026-03-28T14%3A01%3A42Z&se=2026-03-28T14%3A26%3A42Z&sr=b&sp=r&sig=bjyHHkX2Tk%2Fg1NdAswlyjtEAt76c1wRB5i7u%2BULrS5U%3D)
2026-03-28 14:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D697217784%27 HTTP/1.1" 200 None
2026-03-28 14:01:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=697217784 not downloaded yet
2026-03-28 14:01:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:01:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2d757010>
2026-03-28 14:01:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:01:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:01:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:01:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0314c884-43b5-5d2e-81ae-0d6223087ff6/0314c884-43b5-5d2e-81ae-0d6223087ff6_image_3.jpg HTTP/1.1" 201 0
2026-03-28 14:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FPN64UHS%252F698149265%252F600') HTTP/1.1" 204 0
2026-03-28 14:01:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PN64UHS/698149265/600 saved to cache
2026-03-28 14:01:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 0314c884-43b5-5d2e-81ae-0d6223087ff6
2026-03-28 14:01:47 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:01:47 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:01:47 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:01:47 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:01:47 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:01:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:01:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c114fd0>
2026-03-28 14:01:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:01:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:01:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:01:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_78b2ead9-6d58-5edb-a028-9b77396fb5da/78b2ead9-6d58-5edb-a028-9b77396fb5da_image_8.jpg HTTP/1.1" 201 0
2026-03-28 14:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FWX70JZJ%252F698017470%252F600') HTTP/1.1" 204 0
2026-03-28 14:01:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WX70JZJ/698017470/600 saved to cache
2026-03-28 14:01:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 78b2ead9-6d58-5edb-a028-9b77396fb5da
2026-03-28 14:01:47 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SE16KBX/698938698/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698938698>
2026-03-28 14:01:47 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LD14UGX/697217764/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=697217764>
2026-03-28 14:01:47 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WX18RMZ/698559129/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698559129>
2026-03-28 14:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D697217791%27 HTTP/1.1" 200 None
2026-03-28 14:01:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=697217791 not downloaded yet
2026-03-28 14:01:47 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:01:47 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:01:47 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:01:47 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:01:47 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:01:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:01:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c4d0a10>
2026-03-28 14:01:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:01:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:01:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:01:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0314c884-43b5-5d2e-81ae-0d6223087ff6/0314c884-43b5-5d2e-81ae-0d6223087ff6_image_7.jpg HTTP/1.1" 201 0
2026-03-28 14:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FPN64UHS%252F698149372%252F600') HTTP/1.1" 204 0
2026-03-28 14:01:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PN64UHS/698149372/600 saved to cache
2026-03-28 14:01:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 0314c884-43b5-5d2e-81ae-0d6223087ff6
2026-03-28 14:01:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:01:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c990710>
2026-03-28 14:01:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:01:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:01:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:01:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e4a41ade-3285-55a6-95db-86a4f368e5a7/e4a41ade-3285-55a6-95db-86a4f368e5a7_image_0.jpg HTTP/1.1" 201 0
2026-03-28 14:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FWX18RMZ%252F698558942%252F600') HTTP/1.1" 204 0
2026-03-28 14:01:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WX18RMZ/698558942/600 saved to cache
2026-03-28 14:01:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item e4a41ade-3285-55a6-95db-86a4f368e5a7
2026-03-28 14:01:47 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:01:47 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:01:47 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:01:47 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:01:47 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:01:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:01:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c532610>
2026-03-28 14:01:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:01:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:01:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:01:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0314c884-43b5-5d2e-81ae-0d6223087ff6/0314c884-43b5-5d2e-81ae-0d6223087ff6_image_8.jpg HTTP/1.1" 201 0
2026-03-28 14:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FPN64UHS%252F698149388%252F600') HTTP/1.1" 204 0
2026-03-28 14:01:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PN64UHS/698149388/600 saved to cache
2026-03-28 14:01:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 0314c884-43b5-5d2e-81ae-0d6223087ff6
2026-03-28 14:01:47 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:01:47 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:01:47 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:01:47 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:01:47 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:01:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:01:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c503350>
2026-03-28 14:01:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:01:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:01:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:01:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_78b2ead9-6d58-5edb-a028-9b77396fb5da/78b2ead9-6d58-5edb-a028-9b77396fb5da_image_9.jpg HTTP/1.1" 201 0
2026-03-28 14:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FWX70JZJ%252F698017475%252F600') HTTP/1.1" 204 0
2026-03-28 14:01:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WX70JZJ/698017475/600 saved to cache
2026-03-28 14:01:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 78b2ead9-6d58-5edb-a028-9b77396fb5da
2026-03-28 14:01:47 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:01:47 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:01:47 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:01:47 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:01:47 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:01:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:01:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2d7373d0>
2026-03-28 14:01:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:01:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:01:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:01:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b697841c-f8f8-5c3e-a0f7-75585967ab4c/b697841c-f8f8-5c3e-a0f7-75585967ab4c_image_9.jpg HTTP/1.1" 201 0
2026-03-28 14:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FCP19XKX%252F698252660%252F600') HTTP/1.1" 204 0
2026-03-28 14:01:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CP19XKX/698252660/600 saved to cache
2026-03-28 14:01:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item b697841c-f8f8-5c3e-a0f7-75585967ab4c
2026-03-28 14:01:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LD14UGX/697217739/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LD14UGX/42809825?sv=2020-08-04&st=2026-03-28T14%3A01%3A43Z&se=2026-03-28T14%3A26%3A43Z&sr=b&sp=r&sig=%2BaRmCEwHPNy3otLvYKNHicfNibWcwPy6Mz8eAP9fbh8%3D)
2026-03-28 14:01:47 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VN21GCK/697998965/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=697998965>
2026-03-28 14:01:47 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LD14UGX/697217759/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=697217759>
2026-03-28 14:01:47 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SE16KBX/698938705/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698938705>
2026-03-28 14:01:47 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VN21GCK/697998984/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=697998984>
2026-03-28 14:01:47 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VN21GCK/697998970/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=697998970>
2026-03-28 14:01:47 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LD14UGX/697217777/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=697217777>
2026-03-28 14:01:47 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LD14UGX/697217782/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=697217782>
2026-03-28 14:01:47 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WX18RMZ/698559174/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698559174>
2026-03-28 14:01:47 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SE16KBX/698938749/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698938749>
2026-03-28 14:01:47 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VN21GCK/697998990/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=697998990>
2026-03-28 14:01:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VN21GCK/697998957/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/VN21GCK/42810042?sv=2020-08-04&st=2026-03-28T14%3A01%3A43Z&se=2026-03-28T14%3A26%3A43Z&sr=b&sp=r&sig=K536yllWddRWkBSE9QiLSB7gYH5xYBnaNI8d3nMUcBg%3D)
2026-03-28 14:01:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VN21GCK/697998961/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/VN21GCK/42810042?sv=2020-08-04&st=2026-03-28T14%3A01%3A43Z&se=2026-03-28T14%3A26%3A43Z&sr=b&sp=r&sig=K536yllWddRWkBSE9QiLSB7gYH5xYBnaNI8d3nMUcBg%3D)
2026-03-28 14:01:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:01:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c598190>
2026-03-28 14:01:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:01:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:01:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:01:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c886d5a8-7924-5e92-b88e-1f87c5b1511a/c886d5a8-7924-5e92-b88e-1f87c5b1511a_image_0.jpg HTTP/1.1" 201 0
2026-03-28 14:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLD14UGX%252F697217739%252F600') HTTP/1.1" 204 0
2026-03-28 14:01:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LD14UGX/697217739/600 saved to cache
2026-03-28 14:01:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item c886d5a8-7924-5e92-b88e-1f87c5b1511a
2026-03-28 14:01:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SE16KBX/698938698/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/SE16KBX/42810481?sv=2020-08-04&st=2026-03-28T14%3A01%3A43Z&se=2026-03-28T14%3A26%3A43Z&sr=b&sp=r&sig=rYZ6%2FLmXFuF3wm%2Fw4qElxJjSolkBjHdf49Pe6BwnMBo%3D)
2026-03-28 14:01:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WX18RMZ/698559129/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/WX18RMZ/42802183?sv=2020-08-04&st=2026-03-28T14%3A01%3A43Z&se=2026-03-28T14%3A26%3A43Z&sr=b&sp=r&sig=KSkY%2BSv6OSFm2lLfKktFLHwDGf8wN319lzyYallQs%2FQ%3D)
2026-03-28 14:01:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VN21GCK/697998965/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/VN21GCK/42810042?sv=2020-08-04&st=2026-03-28T14%3A01%3A43Z&se=2026-03-28T14%3A26%3A43Z&sr=b&sp=r&sig=K536yllWddRWkBSE9QiLSB7gYH5xYBnaNI8d3nMUcBg%3D)
2026-03-28 14:01:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LD14UGX/697217759/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LD14UGX/42809825?sv=2020-08-04&st=2026-03-28T14%3A01%3A43Z&se=2026-03-28T14%3A26%3A43Z&sr=b&sp=r&sig=%2BaRmCEwHPNy3otLvYKNHicfNibWcwPy6Mz8eAP9fbh8%3D)
2026-03-28 14:01:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VN21GCK/697998970/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/VN21GCK/42810042?sv=2020-08-04&st=2026-03-28T14%3A01%3A43Z&se=2026-03-28T14%3A26%3A43Z&sr=b&sp=r&sig=K536yllWddRWkBSE9QiLSB7gYH5xYBnaNI8d3nMUcBg%3D)
2026-03-28 14:01:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VN21GCK/697998984/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/VN21GCK/42810042?sv=2020-08-04&st=2026-03-28T14%3A01%3A43Z&se=2026-03-28T14%3A26%3A43Z&sr=b&sp=r&sig=K536yllWddRWkBSE9QiLSB7gYH5xYBnaNI8d3nMUcBg%3D)
2026-03-28 14:01:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SE16KBX/698938705/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/SE16KBX/42810481?sv=2020-08-04&st=2026-03-28T14%3A01%3A43Z&se=2026-03-28T14%3A26%3A43Z&sr=b&sp=r&sig=rYZ6%2FLmXFuF3wm%2Fw4qElxJjSolkBjHdf49Pe6BwnMBo%3D)
2026-03-28 14:01:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LD14UGX/697217764/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LD14UGX/42809825?sv=2020-08-04&st=2026-03-28T14%3A01%3A43Z&se=2026-03-28T14%3A26%3A43Z&sr=b&sp=r&sig=%2BaRmCEwHPNy3otLvYKNHicfNibWcwPy6Mz8eAP9fbh8%3D)
2026-03-28 14:01:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:01:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c679950>
2026-03-28 14:01:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:01:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:01:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:01:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_042f9bcc-1260-53d1-9b7d-30c11d39be73/042f9bcc-1260-53d1-9b7d-30c11d39be73_image_3.jpg HTTP/1.1" 201 0
2026-03-28 14:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FVN21GCK%252F697998957%252F600') HTTP/1.1" 204 0
2026-03-28 14:01:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VN21GCK/697998957/600 saved to cache
2026-03-28 14:01:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 042f9bcc-1260-53d1-9b7d-30c11d39be73
2026-03-28 14:01:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:01:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c107a50>
2026-03-28 14:01:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:01:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:01:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:01:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_042f9bcc-1260-53d1-9b7d-30c11d39be73/042f9bcc-1260-53d1-9b7d-30c11d39be73_image_4.jpg HTTP/1.1" 201 0
2026-03-28 14:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FVN21GCK%252F697998961%252F600') HTTP/1.1" 204 0
2026-03-28 14:01:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VN21GCK/697998961/600 saved to cache
2026-03-28 14:01:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 042f9bcc-1260-53d1-9b7d-30c11d39be73
2026-03-28 14:01:47 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LD14UGX/697217791/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=697217791>
2026-03-28 14:01:47 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LD14UGX/697217784/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=697217784>
2026-03-28 14:01:47 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VN21GCK/697999000/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=697999000>
2026-03-28 14:01:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VN21GCK/697998990/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/VN21GCK/42810042?sv=2020-08-04&st=2026-03-28T14%3A01%3A43Z&se=2026-03-28T14%3A26%3A43Z&sr=b&sp=r&sig=K536yllWddRWkBSE9QiLSB7gYH5xYBnaNI8d3nMUcBg%3D)
2026-03-28 14:01:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SE16KBX/698938749/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/SE16KBX/42810481?sv=2020-08-04&st=2026-03-28T14%3A01%3A43Z&se=2026-03-28T14%3A26%3A43Z&sr=b&sp=r&sig=rYZ6%2FLmXFuF3wm%2Fw4qElxJjSolkBjHdf49Pe6BwnMBo%3D)
2026-03-28 14:01:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LD14UGX/697217777/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LD14UGX/42809825?sv=2020-08-04&st=2026-03-28T14%3A01%3A43Z&se=2026-03-28T14%3A26%3A43Z&sr=b&sp=r&sig=%2BaRmCEwHPNy3otLvYKNHicfNibWcwPy6Mz8eAP9fbh8%3D)
2026-03-28 14:01:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LD14UGX/697217782/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LD14UGX/42809825?sv=2020-08-04&st=2026-03-28T14%3A01%3A43Z&se=2026-03-28T14%3A26%3A43Z&sr=b&sp=r&sig=%2BaRmCEwHPNy3otLvYKNHicfNibWcwPy6Mz8eAP9fbh8%3D)
2026-03-28 14:01:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:01:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c702010>
2026-03-28 14:01:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:01:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:01:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:01:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2e77e548-6211-5739-af41-39c112c5041c/2e77e548-6211-5739-af41-39c112c5041c_image_4.jpg HTTP/1.1" 201 0
2026-03-28 14:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FSE16KBX%252F698938698%252F600') HTTP/1.1" 204 0
2026-03-28 14:01:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SE16KBX/698938698/600 saved to cache
2026-03-28 14:01:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 2e77e548-6211-5739-af41-39c112c5041c
2026-03-28 14:01:47 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:01:47 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:01:47 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:01:47 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:01:47 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:01:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:01:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c84dd50>
2026-03-28 14:01:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:01:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:01:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:01:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e4a41ade-3285-55a6-95db-86a4f368e5a7/e4a41ade-3285-55a6-95db-86a4f368e5a7_image_7.jpg HTTP/1.1" 201 0
2026-03-28 14:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FWX18RMZ%252F698559129%252F600') HTTP/1.1" 204 0
2026-03-28 14:01:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WX18RMZ/698559129/600 saved to cache
2026-03-28 14:01:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item e4a41ade-3285-55a6-95db-86a4f368e5a7
2026-03-28 14:01:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:01:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c6795d0>
2026-03-28 14:01:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:01:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:01:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:01:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_042f9bcc-1260-53d1-9b7d-30c11d39be73/042f9bcc-1260-53d1-9b7d-30c11d39be73_image_5.jpg HTTP/1.1" 201 0
2026-03-28 14:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FVN21GCK%252F697998965%252F600') HTTP/1.1" 204 0
2026-03-28 14:01:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VN21GCK/697998965/600 saved to cache
2026-03-28 14:01:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 042f9bcc-1260-53d1-9b7d-30c11d39be73
2026-03-28 14:01:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:01:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c0ff190>
2026-03-28 14:01:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:01:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:01:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:01:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c886d5a8-7924-5e92-b88e-1f87c5b1511a/c886d5a8-7924-5e92-b88e-1f87c5b1511a_image_3.jpg HTTP/1.1" 201 0
2026-03-28 14:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLD14UGX%252F697217759%252F600') HTTP/1.1" 204 0
2026-03-28 14:01:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LD14UGX/697217759/600 saved to cache
2026-03-28 14:01:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item c886d5a8-7924-5e92-b88e-1f87c5b1511a
2026-03-28 14:01:47 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:01:47 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:01:47 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:01:47 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:01:47 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:01:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:01:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a1fd710d0>
2026-03-28 14:01:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:01:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:01:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:01:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_042f9bcc-1260-53d1-9b7d-30c11d39be73/042f9bcc-1260-53d1-9b7d-30c11d39be73_image_6.jpg HTTP/1.1" 201 0
2026-03-28 14:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FVN21GCK%252F697998970%252F600') HTTP/1.1" 204 0
2026-03-28 14:01:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VN21GCK/697998970/600 saved to cache
2026-03-28 14:01:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 042f9bcc-1260-53d1-9b7d-30c11d39be73
2026-03-28 14:01:48 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:01:48 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:01:48 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:01:48 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:01:48 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:01:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:01:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c892e50>
2026-03-28 14:01:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:01:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:01:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:01:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_042f9bcc-1260-53d1-9b7d-30c11d39be73/042f9bcc-1260-53d1-9b7d-30c11d39be73_image_7.jpg HTTP/1.1" 201 0
2026-03-28 14:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FVN21GCK%252F697998984%252F600') HTTP/1.1" 204 0
2026-03-28 14:01:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VN21GCK/697998984/600 saved to cache
2026-03-28 14:01:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 042f9bcc-1260-53d1-9b7d-30c11d39be73
2026-03-28 14:01:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:01:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2d9a7b90>
2026-03-28 14:01:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:01:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:01:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:01:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2e77e548-6211-5739-af41-39c112c5041c/2e77e548-6211-5739-af41-39c112c5041c_image_5.jpg HTTP/1.1" 201 0
2026-03-28 14:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FSE16KBX%252F698938705%252F600') HTTP/1.1" 204 0
2026-03-28 14:01:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SE16KBX/698938705/600 saved to cache
2026-03-28 14:01:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 2e77e548-6211-5739-af41-39c112c5041c
2026-03-28 14:01:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WX18RMZ/698559174/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/WX18RMZ/42802183?sv=2020-08-04&st=2026-03-28T14%3A01%3A43Z&se=2026-03-28T14%3A26%3A43Z&sr=b&sp=r&sig=KSkY%2BSv6OSFm2lLfKktFLHwDGf8wN319lzyYallQs%2FQ%3D)
2026-03-28 14:01:48 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SE16KBX/698938734/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698938734>
2026-03-28 14:01:48 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SE16KBX/698938761/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698938761>
2026-03-28 14:01:48 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LD14UGX/697217771/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=697217771>
2026-03-28 14:01:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:01:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c622410>
2026-03-28 14:01:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:01:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:01:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:01:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c886d5a8-7924-5e92-b88e-1f87c5b1511a/c886d5a8-7924-5e92-b88e-1f87c5b1511a_image_4.jpg HTTP/1.1" 201 0
2026-03-28 14:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLD14UGX%252F697217764%252F600') HTTP/1.1" 204 0
2026-03-28 14:01:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LD14UGX/697217764/600 saved to cache
2026-03-28 14:01:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item c886d5a8-7924-5e92-b88e-1f87c5b1511a
2026-03-28 14:01:48 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:01:48 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:01:48 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:01:48 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:01:48 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:01:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:01:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c57dbd0>
2026-03-28 14:01:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:01:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:01:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:01:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_042f9bcc-1260-53d1-9b7d-30c11d39be73/042f9bcc-1260-53d1-9b7d-30c11d39be73_image_8.jpg HTTP/1.1" 201 0
2026-03-28 14:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FVN21GCK%252F697998990%252F600') HTTP/1.1" 204 0
2026-03-28 14:01:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VN21GCK/697998990/600 saved to cache
2026-03-28 14:01:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 042f9bcc-1260-53d1-9b7d-30c11d39be73
2026-03-28 14:01:48 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:01:48 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:01:48 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:01:48 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:01:48 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:01:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:01:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a30121950>
2026-03-28 14:01:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:01:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:01:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:01:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2e77e548-6211-5739-af41-39c112c5041c/2e77e548-6211-5739-af41-39c112c5041c_image_8.jpg HTTP/1.1" 201 0
2026-03-28 14:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FSE16KBX%252F698938749%252F600') HTTP/1.1" 204 0
2026-03-28 14:01:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SE16KBX/698938749/600 saved to cache
2026-03-28 14:01:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 2e77e548-6211-5739-af41-39c112c5041c
2026-03-28 14:01:48 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:01:48 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:01:48 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:01:48 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:01:48 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:01:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:01:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a1ff52c10>
2026-03-28 14:01:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:01:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:01:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:01:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c886d5a8-7924-5e92-b88e-1f87c5b1511a/c886d5a8-7924-5e92-b88e-1f87c5b1511a_image_6.jpg HTTP/1.1" 201 0
2026-03-28 14:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLD14UGX%252F697217777%252F600') HTTP/1.1" 204 0
2026-03-28 14:01:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LD14UGX/697217777/600 saved to cache
2026-03-28 14:01:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item c886d5a8-7924-5e92-b88e-1f87c5b1511a
2026-03-28 14:01:48 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:01:48 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:01:48 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:01:48 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:01:48 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:01:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:01:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a1ff3d810>
2026-03-28 14:01:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:01:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:01:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:01:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c886d5a8-7924-5e92-b88e-1f87c5b1511a/c886d5a8-7924-5e92-b88e-1f87c5b1511a_image_7.jpg HTTP/1.1" 201 0
2026-03-28 14:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLD14UGX%252F697217782%252F600') HTTP/1.1" 204 0
2026-03-28 14:01:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LD14UGX/697217782/600 saved to cache
2026-03-28 14:01:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item c886d5a8-7924-5e92-b88e-1f87c5b1511a
2026-03-28 14:01:48 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WX18RMZ/698559106/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698559106>
2026-03-28 14:01:48 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WX18RMZ/698559156/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698559156>
2026-03-28 14:01:48 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SE16KBX/698938720/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698938720>
2026-03-28 14:01:48 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LD14UGX/697217752/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=697217752>
2026-03-28 14:01:48 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WX18RMZ/698559084/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698559084>
2026-03-28 14:01:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VN21GCK/697999000/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/VN21GCK/42810042?sv=2020-08-04&st=2026-03-28T14%3A01%3A43Z&se=2026-03-28T14%3A26%3A43Z&sr=b&sp=r&sig=K536yllWddRWkBSE9QiLSB7gYH5xYBnaNI8d3nMUcBg%3D)
2026-03-28 14:01:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LD14UGX/697217784/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LD14UGX/42809825?sv=2020-08-04&st=2026-03-28T14%3A01%3A43Z&se=2026-03-28T14%3A26%3A43Z&sr=b&sp=r&sig=%2BaRmCEwHPNy3otLvYKNHicfNibWcwPy6Mz8eAP9fbh8%3D)
2026-03-28 14:01:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LD14UGX/697217791/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LD14UGX/42809825?sv=2020-08-04&st=2026-03-28T14%3A01%3A43Z&se=2026-03-28T14%3A26%3A43Z&sr=b&sp=r&sig=%2BaRmCEwHPNy3otLvYKNHicfNibWcwPy6Mz8eAP9fbh8%3D)
2026-03-28 14:01:48 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:01:48 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:01:48 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:01:48 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:01:48 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:01:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:01:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2ca5dd90>
2026-03-28 14:01:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:01:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:01:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:01:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e4a41ade-3285-55a6-95db-86a4f368e5a7/e4a41ade-3285-55a6-95db-86a4f368e5a7_image_9.jpg HTTP/1.1" 201 0
2026-03-28 14:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FWX18RMZ%252F698559174%252F600') HTTP/1.1" 204 0
2026-03-28 14:01:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WX18RMZ/698559174/600 saved to cache
2026-03-28 14:01:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item e4a41ade-3285-55a6-95db-86a4f368e5a7
2026-03-28 14:01:48 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:01:48 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:01:48 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:01:48 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:01:48 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:01:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:01:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c592e50>
2026-03-28 14:01:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:01:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:01:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:01:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_042f9bcc-1260-53d1-9b7d-30c11d39be73/042f9bcc-1260-53d1-9b7d-30c11d39be73_image_9.jpg HTTP/1.1" 201 0
2026-03-28 14:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FVN21GCK%252F697999000%252F600') HTTP/1.1" 204 0
2026-03-28 14:01:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VN21GCK/697999000/600 saved to cache
2026-03-28 14:01:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 042f9bcc-1260-53d1-9b7d-30c11d39be73
2026-03-28 14:01:48 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SE16KBX/698938689/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698938689>
2026-03-28 14:01:48 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VN21GCK/697998953/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=697998953>
2026-03-28 14:01:48 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SE16KBX/698938680/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698938680>
2026-03-28 14:01:48 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LD14UGX/697217746/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=697217746>
2026-03-28 14:01:48 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WX18RMZ/698559073/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698559073>
2026-03-28 14:01:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LD14UGX/697217771/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LD14UGX/42809825?sv=2020-08-04&st=2026-03-28T14%3A01%3A43Z&se=2026-03-28T14%3A26%3A43Z&sr=b&sp=r&sig=%2BaRmCEwHPNy3otLvYKNHicfNibWcwPy6Mz8eAP9fbh8%3D)
2026-03-28 14:01:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SE16KBX/698938734/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/SE16KBX/42810481?sv=2020-08-04&st=2026-03-28T14%3A01%3A43Z&se=2026-03-28T14%3A26%3A43Z&sr=b&sp=r&sig=rYZ6%2FLmXFuF3wm%2Fw4qElxJjSolkBjHdf49Pe6BwnMBo%3D)
2026-03-28 14:01:48 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:01:48 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:01:48 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:01:48 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:01:48 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:01:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:01:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c71ab90>
2026-03-28 14:01:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:01:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:01:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:01:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c886d5a8-7924-5e92-b88e-1f87c5b1511a/c886d5a8-7924-5e92-b88e-1f87c5b1511a_image_8.jpg HTTP/1.1" 201 0
2026-03-28 14:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLD14UGX%252F697217784%252F600') HTTP/1.1" 204 0
2026-03-28 14:01:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LD14UGX/697217784/600 saved to cache
2026-03-28 14:01:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item c886d5a8-7924-5e92-b88e-1f87c5b1511a
2026-03-28 14:01:48 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:01:48 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:01:48 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:01:48 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:01:48 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:01:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:01:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c590e50>
2026-03-28 14:01:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:01:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:01:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:01:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c886d5a8-7924-5e92-b88e-1f87c5b1511a/c886d5a8-7924-5e92-b88e-1f87c5b1511a_image_9.jpg HTTP/1.1" 201 0
2026-03-28 14:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLD14UGX%252F697217791%252F600') HTTP/1.1" 204 0
2026-03-28 14:01:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LD14UGX/697217791/600 saved to cache
2026-03-28 14:01:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item c886d5a8-7924-5e92-b88e-1f87c5b1511a
2026-03-28 14:01:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SE16KBX/698938761/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/SE16KBX/42810481?sv=2020-08-04&st=2026-03-28T14%3A01%3A43Z&se=2026-03-28T14%3A26%3A43Z&sr=b&sp=r&sig=rYZ6%2FLmXFuF3wm%2Fw4qElxJjSolkBjHdf49Pe6BwnMBo%3D)
2026-03-28 14:01:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:01:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2ca34450>
2026-03-28 14:01:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:01:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:01:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:01:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c886d5a8-7924-5e92-b88e-1f87c5b1511a/c886d5a8-7924-5e92-b88e-1f87c5b1511a_image_5.jpg HTTP/1.1" 201 0
2026-03-28 14:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLD14UGX%252F697217771%252F600') HTTP/1.1" 204 0
2026-03-28 14:01:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LD14UGX/697217771/600 saved to cache
2026-03-28 14:01:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item c886d5a8-7924-5e92-b88e-1f87c5b1511a
2026-03-28 14:01:48 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:01:48 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:01:48 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:01:48 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:01:48 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:01:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:01:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a1ff2fb50>
2026-03-28 14:01:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:01:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:01:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:01:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2e77e548-6211-5739-af41-39c112c5041c/2e77e548-6211-5739-af41-39c112c5041c_image_7.jpg HTTP/1.1" 201 0
2026-03-28 14:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FSE16KBX%252F698938734%252F600') HTTP/1.1" 204 0
2026-03-28 14:01:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SE16KBX/698938734/600 saved to cache
2026-03-28 14:01:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 2e77e548-6211-5739-af41-39c112c5041c
2026-03-28 14:01:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LD14UGX/697217752/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LD14UGX/42809825?sv=2020-08-04&st=2026-03-28T14%3A01%3A43Z&se=2026-03-28T14%3A26%3A43Z&sr=b&sp=r&sig=%2BaRmCEwHPNy3otLvYKNHicfNibWcwPy6Mz8eAP9fbh8%3D)
2026-03-28 14:01:48 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VN21GCK/697998947/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=697998947>
2026-03-28 14:01:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WX18RMZ/698559156/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/WX18RMZ/42802183?sv=2020-08-04&st=2026-03-28T14%3A01%3A43Z&se=2026-03-28T14%3A26%3A43Z&sr=b&sp=r&sig=KSkY%2BSv6OSFm2lLfKktFLHwDGf8wN319lzyYallQs%2FQ%3D)
2026-03-28 14:01:48 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WX18RMZ/698559064/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698559064>
2026-03-28 14:01:48 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SE16KBX/698938669/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698938669>
2026-03-28 14:01:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WX18RMZ/698559106/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/WX18RMZ/42802183?sv=2020-08-04&st=2026-03-28T14%3A01%3A43Z&se=2026-03-28T14%3A26%3A43Z&sr=b&sp=r&sig=KSkY%2BSv6OSFm2lLfKktFLHwDGf8wN319lzyYallQs%2FQ%3D)
2026-03-28 14:01:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SE16KBX/698938720/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/SE16KBX/42810481?sv=2020-08-04&st=2026-03-28T14%3A01%3A43Z&se=2026-03-28T14%3A26%3A43Z&sr=b&sp=r&sig=rYZ6%2FLmXFuF3wm%2Fw4qElxJjSolkBjHdf49Pe6BwnMBo%3D)
2026-03-28 14:01:48 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:01:48 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:01:48 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:01:48 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:01:48 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:01:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:01:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c89a850>
2026-03-28 14:01:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:01:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:01:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:01:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2e77e548-6211-5739-af41-39c112c5041c/2e77e548-6211-5739-af41-39c112c5041c_image_9.jpg HTTP/1.1" 201 0
2026-03-28 14:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FSE16KBX%252F698938761%252F600') HTTP/1.1" 204 0
2026-03-28 14:01:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SE16KBX/698938761/600 saved to cache
2026-03-28 14:01:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 2e77e548-6211-5739-af41-39c112c5041c
2026-03-28 14:01:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WX18RMZ/698559084/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/WX18RMZ/42802183?sv=2020-08-04&st=2026-03-28T14%3A01%3A43Z&se=2026-03-28T14%3A26%3A43Z&sr=b&sp=r&sig=KSkY%2BSv6OSFm2lLfKktFLHwDGf8wN319lzyYallQs%2FQ%3D)
2026-03-28 14:01:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SE16KBX/698938680/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/SE16KBX/42810481?sv=2020-08-04&st=2026-03-28T14%3A01%3A43Z&se=2026-03-28T14%3A26%3A43Z&sr=b&sp=r&sig=rYZ6%2FLmXFuF3wm%2Fw4qElxJjSolkBjHdf49Pe6BwnMBo%3D)
2026-03-28 14:01:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VN21GCK/697998953/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/VN21GCK/42810042?sv=2020-08-04&st=2026-03-28T14%3A01%3A43Z&se=2026-03-28T14%3A26%3A43Z&sr=b&sp=r&sig=K536yllWddRWkBSE9QiLSB7gYH5xYBnaNI8d3nMUcBg%3D)
2026-03-28 14:01:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SE16KBX/698938689/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/SE16KBX/42810481?sv=2020-08-04&st=2026-03-28T14%3A01%3A43Z&se=2026-03-28T14%3A26%3A43Z&sr=b&sp=r&sig=rYZ6%2FLmXFuF3wm%2Fw4qElxJjSolkBjHdf49Pe6BwnMBo%3D)
2026-03-28 14:01:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WX18RMZ/698559073/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/WX18RMZ/42802183?sv=2020-08-04&st=2026-03-28T14%3A01%3A43Z&se=2026-03-28T14%3A26%3A43Z&sr=b&sp=r&sig=KSkY%2BSv6OSFm2lLfKktFLHwDGf8wN319lzyYallQs%2FQ%3D)
2026-03-28 14:01:48 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WX18RMZ/698558980/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698558980>
2026-03-28 14:01:48 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VN21GCK/697998944/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=VN21GCK-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-28 14:01:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LD14UGX/697217746/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LD14UGX/42809825?sv=2020-08-04&st=2026-03-28T14%3A01%3A43Z&se=2026-03-28T14%3A26%3A43Z&sr=b&sp=r&sig=%2BaRmCEwHPNy3otLvYKNHicfNibWcwPy6Mz8eAP9fbh8%3D)
2026-03-28 14:01:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:01:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2ca34550>
2026-03-28 14:01:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:01:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:01:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:01:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c886d5a8-7924-5e92-b88e-1f87c5b1511a/c886d5a8-7924-5e92-b88e-1f87c5b1511a_image_2.jpg HTTP/1.1" 201 0
2026-03-28 14:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLD14UGX%252F697217752%252F600') HTTP/1.1" 204 0
2026-03-28 14:01:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LD14UGX/697217752/600 saved to cache
2026-03-28 14:01:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item c886d5a8-7924-5e92-b88e-1f87c5b1511a
2026-03-28 14:01:48 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SE16KBX/698938662/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=SE16KBX-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-28 14:01:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WX18RMZ/698559064/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/WX18RMZ/42802183?sv=2020-08-04&st=2026-03-28T14%3A01%3A43Z&se=2026-03-28T14%3A26%3A43Z&sr=b&sp=r&sig=KSkY%2BSv6OSFm2lLfKktFLHwDGf8wN319lzyYallQs%2FQ%3D)
2026-03-28 14:01:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VN21GCK/697998947/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/VN21GCK/42810042?sv=2020-08-04&st=2026-03-28T14%3A01%3A43Z&se=2026-03-28T14%3A26%3A43Z&sr=b&sp=r&sig=K536yllWddRWkBSE9QiLSB7gYH5xYBnaNI8d3nMUcBg%3D)
2026-03-28 14:01:48 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PN64UHS/698149360/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698149360>
2026-03-28 14:01:48 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PN64UHS/698149402/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698149402>
2026-03-28 14:01:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SE16KBX/698938669/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/SE16KBX/42810481?sv=2020-08-04&st=2026-03-28T14%3A01%3A43Z&se=2026-03-28T14%3A26%3A43Z&sr=b&sp=r&sig=rYZ6%2FLmXFuF3wm%2Fw4qElxJjSolkBjHdf49Pe6BwnMBo%3D)
2026-03-28 14:01:48 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WX18RMZ/698558951/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698558951>
2026-03-28 14:01:48 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:01:48 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:01:48 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:01:48 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:01:48 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:01:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:01:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c165990>
2026-03-28 14:01:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:01:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:01:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:01:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e4a41ade-3285-55a6-95db-86a4f368e5a7/e4a41ade-3285-55a6-95db-86a4f368e5a7_image_8.jpg HTTP/1.1" 201 0
2026-03-28 14:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FWX18RMZ%252F698559156%252F600') HTTP/1.1" 204 0
2026-03-28 14:01:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WX18RMZ/698559156/600 saved to cache
2026-03-28 14:01:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item e4a41ade-3285-55a6-95db-86a4f368e5a7
2026-03-28 14:01:48 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:01:48 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:01:48 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:01:48 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:01:48 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:01:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:01:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c0ef850>
2026-03-28 14:01:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:01:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:01:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:01:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e4a41ade-3285-55a6-95db-86a4f368e5a7/e4a41ade-3285-55a6-95db-86a4f368e5a7_image_6.jpg HTTP/1.1" 201 0
2026-03-28 14:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FWX18RMZ%252F698559106%252F600') HTTP/1.1" 204 0
2026-03-28 14:01:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WX18RMZ/698559106/600 saved to cache
2026-03-28 14:01:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item e4a41ade-3285-55a6-95db-86a4f368e5a7
2026-03-28 14:01:48 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:01:48 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:01:48 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:01:48 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:01:48 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:01:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:01:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c990410>
2026-03-28 14:01:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:01:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:01:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:01:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2e77e548-6211-5739-af41-39c112c5041c/2e77e548-6211-5739-af41-39c112c5041c_image_6.jpg HTTP/1.1" 201 0
2026-03-28 14:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FSE16KBX%252F698938720%252F600') HTTP/1.1" 204 0
2026-03-28 14:01:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SE16KBX/698938720/600 saved to cache
2026-03-28 14:01:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 2e77e548-6211-5739-af41-39c112c5041c
2026-03-28 14:01:49 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CP19XKX/698252652/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698252652>
2026-03-28 14:01:49 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RO63WRK/698460277/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698460277>
2026-03-28 14:01:49 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WX70JZJ/698017433/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698017433>
2026-03-28 14:01:49 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CP19XKX/698252625/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698252625>
2026-03-28 14:01:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:01:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a1fd6de10>
2026-03-28 14:01:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:01:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:01:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:01:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e4a41ade-3285-55a6-95db-86a4f368e5a7/e4a41ade-3285-55a6-95db-86a4f368e5a7_image_5.jpg HTTP/1.1" 201 0
2026-03-28 14:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FWX18RMZ%252F698559084%252F600') HTTP/1.1" 204 0
2026-03-28 14:01:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WX18RMZ/698559084/600 saved to cache
2026-03-28 14:01:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item e4a41ade-3285-55a6-95db-86a4f368e5a7
2026-03-28 14:01:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:01:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a1fd6ffd0>
2026-03-28 14:01:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:01:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:01:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:01:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2e77e548-6211-5739-af41-39c112c5041c/2e77e548-6211-5739-af41-39c112c5041c_image_2.jpg HTTP/1.1" 201 0
2026-03-28 14:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FSE16KBX%252F698938680%252F600') HTTP/1.1" 204 0
2026-03-28 14:01:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SE16KBX/698938680/600 saved to cache
2026-03-28 14:01:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 2e77e548-6211-5739-af41-39c112c5041c
2026-03-28 14:01:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:01:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2d684390>
2026-03-28 14:01:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:01:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:01:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:01:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_042f9bcc-1260-53d1-9b7d-30c11d39be73/042f9bcc-1260-53d1-9b7d-30c11d39be73_image_2.jpg HTTP/1.1" 201 0
2026-03-28 14:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FVN21GCK%252F697998953%252F600') HTTP/1.1" 204 0
2026-03-28 14:01:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VN21GCK/697998953/600 saved to cache
2026-03-28 14:01:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 042f9bcc-1260-53d1-9b7d-30c11d39be73
2026-03-28 14:01:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:01:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a1ff4fc90>
2026-03-28 14:01:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:01:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:01:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:01:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2e77e548-6211-5739-af41-39c112c5041c/2e77e548-6211-5739-af41-39c112c5041c_image_3.jpg HTTP/1.1" 201 0
2026-03-28 14:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FSE16KBX%252F698938689%252F600') HTTP/1.1" 204 0
2026-03-28 14:01:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SE16KBX/698938689/600 saved to cache
2026-03-28 14:01:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 2e77e548-6211-5739-af41-39c112c5041c
2026-03-28 14:01:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:01:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c67f7d0>
2026-03-28 14:01:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:01:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:01:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:01:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e4a41ade-3285-55a6-95db-86a4f368e5a7/e4a41ade-3285-55a6-95db-86a4f368e5a7_image_4.jpg HTTP/1.1" 201 0
2026-03-28 14:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FWX18RMZ%252F698559073%252F600') HTTP/1.1" 204 0
2026-03-28 14:01:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WX18RMZ/698559073/600 saved to cache
2026-03-28 14:01:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item e4a41ade-3285-55a6-95db-86a4f368e5a7
2026-03-28 14:01:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:01:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c680b50>
2026-03-28 14:01:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:01:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:01:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:01:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c886d5a8-7924-5e92-b88e-1f87c5b1511a/c886d5a8-7924-5e92-b88e-1f87c5b1511a_image_1.jpg HTTP/1.1" 201 0
2026-03-28 14:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLD14UGX%252F697217746%252F600') HTTP/1.1" 204 0
2026-03-28 14:01:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LD14UGX/697217746/600 saved to cache
2026-03-28 14:01:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item c886d5a8-7924-5e92-b88e-1f87c5b1511a
2026-03-28 14:01:49 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: c886d5a8-7924-5e92-b88e-1f87c5b1511a, skipping ID generation
2026-03-28 14:01:49 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item c886d5a8-7924-5e92-b88e-1f87c5b1511a sending to next pipeline
2026-03-28 14:01:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: c886d5a8-7924-5e92-b88e-1f87c5b1511a, identifier: LD14%20UGX
2026-03-28 14:01:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:01:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2ffaaf10>
2026-03-28 14:01:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:01:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:01:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:01:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e4a41ade-3285-55a6-95db-86a4f368e5a7/e4a41ade-3285-55a6-95db-86a4f368e5a7_image_3.jpg HTTP/1.1" 201 0
2026-03-28 14:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FWX18RMZ%252F698559064%252F600') HTTP/1.1" 204 0
2026-03-28 14:01:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WX18RMZ/698559064/600 saved to cache
2026-03-28 14:01:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item e4a41ade-3285-55a6-95db-86a4f368e5a7
2026-03-28 14:01:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:01:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c85bed0>
2026-03-28 14:01:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:01:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:01:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:01:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_042f9bcc-1260-53d1-9b7d-30c11d39be73/042f9bcc-1260-53d1-9b7d-30c11d39be73_image_1.jpg HTTP/1.1" 201 0
2026-03-28 14:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FVN21GCK%252F697998947%252F600') HTTP/1.1" 204 0
2026-03-28 14:01:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VN21GCK/697998947/600 saved to cache
2026-03-28 14:01:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 042f9bcc-1260-53d1-9b7d-30c11d39be73
2026-03-28 14:01:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:01:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a1fec68d0>
2026-03-28 14:01:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:01:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:01:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:01:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2e77e548-6211-5739-af41-39c112c5041c/2e77e548-6211-5739-af41-39c112c5041c_image_1.jpg HTTP/1.1" 201 0
2026-03-28 14:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FSE16KBX%252F698938669%252F600') HTTP/1.1" 204 0
2026-03-28 14:01:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SE16KBX/698938669/600 saved to cache
2026-03-28 14:01:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 2e77e548-6211-5739-af41-39c112c5041c
2026-03-28 14:01:50 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RO63WRK/698460274/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698460274>
2026-03-28 14:01:50 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WX70JZJ/698017425/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698017425>
2026-03-28 14:01:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: c886d5a8-7924-5e92-b88e-1f87c5b1511a with identifier: LD14%20UGX
2026-03-28 14:01:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: c886d5a8-7924-5e92-b88e-1f87c5b1511a with identifier: LD14%20UGX
2026-03-28 14:01:50 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: c886d5a8-7924-5e92-b88e-1f87c5b1511a with identifier: LD14%20UGX to the API
2026-03-28 14:01:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:01:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:01:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LD14UGX/697217746/600>
{'auction_title': '',
'c_o_2_emission_value': 94,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c886d5a8-7924-5e92-b88e-1f87c5b1511a/c886d5a8-7924-5e92-b88e-1f87c5b1511a_expert_report_file_fdc4a348-2352-4e65-a34e-35356a93ff23.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=LD14%20UGX-GB',
'category': 'Car',
'color': 'red',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.8L',
'expiration_date': '2026-03-29T10:00:00Z',
'fuel_type': 'Petrol/Electric',
'id': 'c886d5a8-7924-5e92-b88e-1f87c5b1511a',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'LD14 UGX',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=LD14%20UGX&vehicleType=*',
'listing': 'auction',
'location': 'Measham',
'make': 'LEXUS',
'model': 'CT 200H',
'odometer': 55599,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 11,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c886d5a8-7924-5e92-b88e-1f87c5b1511a/c886d5a8-7924-5e92-b88e-1f87c5b1511a_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 46508,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LD14UGX/697217739/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c886d5a8-7924-5e92-b88e-1f87c5b1511a/c886d5a8-7924-5e92-b88e-1f87c5b1511a_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 43891,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LD14UGX/697217746/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c886d5a8-7924-5e92-b88e-1f87c5b1511a/c886d5a8-7924-5e92-b88e-1f87c5b1511a_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 47537,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LD14UGX/697217752/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c886d5a8-7924-5e92-b88e-1f87c5b1511a/c886d5a8-7924-5e92-b88e-1f87c5b1511a_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 46016,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LD14UGX/697217759/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c886d5a8-7924-5e92-b88e-1f87c5b1511a/c886d5a8-7924-5e92-b88e-1f87c5b1511a_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 45042,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LD14UGX/697217764/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c886d5a8-7924-5e92-b88e-1f87c5b1511a/c886d5a8-7924-5e92-b88e-1f87c5b1511a_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 44122,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LD14UGX/697217771/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c886d5a8-7924-5e92-b88e-1f87c5b1511a/c886d5a8-7924-5e92-b88e-1f87c5b1511a_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 93942,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LD14UGX/697217777/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c886d5a8-7924-5e92-b88e-1f87c5b1511a/c886d5a8-7924-5e92-b88e-1f87c5b1511a_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 84294,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LD14UGX/697217782/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c886d5a8-7924-5e92-b88e-1f87c5b1511a/c886d5a8-7924-5e92-b88e-1f87c5b1511a_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 91405,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LD14UGX/697217784/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c886d5a8-7924-5e92-b88e-1f87c5b1511a/c886d5a8-7924-5e92-b88e-1f87c5b1511a_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 89552,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LD14UGX/697217791/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2014-01-01',
'seller_name': None,
'title': 'LEXUS CT 200H 1.8 ADVANCE Hatchback',
'transmission': 'automatic',
'trim': 'ADVANCE',
'vin': 'JTHKD5BHX02186128',
'year': 2014}
2026-03-28 14:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LD14%2520UGX%27 HTTP/1.1" 200 None
2026-03-28 14:01:50 [bca.uk] INFO: Saving data for LD14%20UGX: {'created_time': 1774706510.494003, 'last_price_update_time': 1774706510.49402, 'auction_closing_time': 1774778400.0}
2026-03-28 14:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='LD14%2520UGX') HTTP/1.1" 204 0
2026-03-28 14:01:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VN21GCK/697998944/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/VN21GCK/42810042?sv=2020-08-04&st=2026-03-28T14%3A01%3A43Z&se=2026-03-28T14%3A26%3A43Z&sr=b&sp=r&sig=K536yllWddRWkBSE9QiLSB7gYH5xYBnaNI8d3nMUcBg%3D)
2026-03-28 14:01:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WX18RMZ/698558980/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/WX18RMZ/42802183?sv=2020-08-04&st=2026-03-28T14%3A01%3A43Z&se=2026-03-28T14%3A26%3A43Z&sr=b&sp=r&sig=KSkY%2BSv6OSFm2lLfKktFLHwDGf8wN319lzyYallQs%2FQ%3D)
2026-03-28 14:01:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SE16KBX/698938662/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/SE16KBX/42810481?sv=2020-08-04&st=2026-03-28T14%3A01%3A43Z&se=2026-03-28T14%3A26%3A43Z&sr=b&sp=r&sig=rYZ6%2FLmXFuF3wm%2Fw4qElxJjSolkBjHdf49Pe6BwnMBo%3D)
2026-03-28 14:01:50 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PN64UHS/698149252/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698149252>
2026-03-28 14:01:50 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CP19XKX/698252618/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698252618>
2026-03-28 14:01:50 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RO63WRK/698460270/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698460270>
2026-03-28 14:01:50 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CP19XKX/698252610/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698252610>
2026-03-28 14:01:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WX18RMZ/698558951/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/WX18RMZ/42802183?sv=2020-08-04&st=2026-03-28T14%3A01%3A43Z&se=2026-03-28T14%3A26%3A43Z&sr=b&sp=r&sig=KSkY%2BSv6OSFm2lLfKktFLHwDGf8wN319lzyYallQs%2FQ%3D)
2026-03-28 14:01:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RO63WRK/698460277/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/RO63WRK/42810240?sv=2020-08-04&st=2026-03-28T14%3A01%3A42Z&se=2026-03-28T14%3A26%3A42Z&sr=b&sp=r&sig=MOREAH8gnhiPYq9fnYSM0K23PHRvNBVeUgjnUtNHuk8%3D)
2026-03-28 14:01:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CP19XKX/698252652/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/CP19XKX/42810052?sv=2020-08-04&st=2026-03-28T14%3A01%3A42Z&se=2026-03-28T14%3A26%3A42Z&sr=b&sp=r&sig=bjyHHkX2Tk%2Fg1NdAswlyjtEAt76c1wRB5i7u%2BULrS5U%3D)
2026-03-28 14:01:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WX70JZJ/698017433/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/WX70JZJ/42810045?sv=2020-08-04&st=2026-03-28T14%3A01%3A42Z&se=2026-03-28T14%3A26%3A42Z&sr=b&sp=r&sig=zpaKYMdJB0PiQSX%2BpoOKZdTxRmLBiapRNqdSFDIfp%2Bc%3D)
2026-03-28 14:01:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PN64UHS/698149360/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/PN64UHS/42810229?sv=2020-08-04&st=2026-03-28T14%3A01%3A42Z&se=2026-03-28T14%3A26%3A42Z&sr=b&sp=r&sig=poKtxPpxXbqP0NGLExiJbxVwCiEJHxglY1MdvVHQzVg%3D)
2026-03-28 14:01:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:01:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c116610>
2026-03-28 14:01:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:01:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:01:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:01:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_042f9bcc-1260-53d1-9b7d-30c11d39be73/042f9bcc-1260-53d1-9b7d-30c11d39be73_image_0.jpg HTTP/1.1" 201 0
2026-03-28 14:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FVN21GCK%252F697998944%252F600') HTTP/1.1" 204 0
2026-03-28 14:01:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VN21GCK/697998944/600 saved to cache
2026-03-28 14:01:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 042f9bcc-1260-53d1-9b7d-30c11d39be73
2026-03-28 14:01:50 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 042f9bcc-1260-53d1-9b7d-30c11d39be73, skipping ID generation
2026-03-28 14:01:50 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 042f9bcc-1260-53d1-9b7d-30c11d39be73 sending to next pipeline
2026-03-28 14:01:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 042f9bcc-1260-53d1-9b7d-30c11d39be73, identifier: VN21%20GCK
2026-03-28 14:01:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:01:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c9f5810>
2026-03-28 14:01:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:01:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:01:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:01:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e4a41ade-3285-55a6-95db-86a4f368e5a7/e4a41ade-3285-55a6-95db-86a4f368e5a7_image_2.jpg HTTP/1.1" 201 0
2026-03-28 14:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FWX18RMZ%252F698558980%252F600') HTTP/1.1" 204 0
2026-03-28 14:01:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WX18RMZ/698558980/600 saved to cache
2026-03-28 14:01:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item e4a41ade-3285-55a6-95db-86a4f368e5a7
2026-03-28 14:01:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:01:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2d73d150>
2026-03-28 14:01:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:01:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:01:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:01:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2e77e548-6211-5739-af41-39c112c5041c/2e77e548-6211-5739-af41-39c112c5041c_image_0.jpg HTTP/1.1" 201 0
2026-03-28 14:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FSE16KBX%252F698938662%252F600') HTTP/1.1" 204 0
2026-03-28 14:01:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SE16KBX/698938662/600 saved to cache
2026-03-28 14:01:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 2e77e548-6211-5739-af41-39c112c5041c
2026-03-28 14:01:50 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 2e77e548-6211-5739-af41-39c112c5041c, skipping ID generation
2026-03-28 14:01:50 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 2e77e548-6211-5739-af41-39c112c5041c sending to next pipeline
2026-03-28 14:01:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 2e77e548-6211-5739-af41-39c112c5041c, identifier: SE16%20KBX
2026-03-28 14:01:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 042f9bcc-1260-53d1-9b7d-30c11d39be73 with identifier: VN21%20GCK
2026-03-28 14:01:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 042f9bcc-1260-53d1-9b7d-30c11d39be73 with identifier: VN21%20GCK
2026-03-28 14:01:51 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 042f9bcc-1260-53d1-9b7d-30c11d39be73 with identifier: VN21%20GCK to the API
2026-03-28 14:01:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:01:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:01:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VN21GCK/697998944/600>
{'auction_title': '',
'c_o_2_emission_value': None,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_042f9bcc-1260-53d1-9b7d-30c11d39be73/042f9bcc-1260-53d1-9b7d-30c11d39be73_expert_report_file_83f60ee0-f7db-4d85-9074-05f14de5fbec.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=VN21%20GCK-GB',
'category': 'Car',
'color': 'black',
'currency': 'GBP',
'doors_number': 5,
'engine': '0.0L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Electric',
'id': '042f9bcc-1260-53d1-9b7d-30c11d39be73',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'VN21 GCK',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=VN21%20GCK&vehicleType=*',
'listing': 'auction',
'location': 'Bristol',
'make': 'VAUXHALL',
'model': 'CORSA-E',
'odometer': 37779,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 11,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_042f9bcc-1260-53d1-9b7d-30c11d39be73/042f9bcc-1260-53d1-9b7d-30c11d39be73_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 45288,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VN21GCK/697998944/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_042f9bcc-1260-53d1-9b7d-30c11d39be73/042f9bcc-1260-53d1-9b7d-30c11d39be73_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 45286,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VN21GCK/697998947/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_042f9bcc-1260-53d1-9b7d-30c11d39be73/042f9bcc-1260-53d1-9b7d-30c11d39be73_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 42406,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VN21GCK/697998953/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_042f9bcc-1260-53d1-9b7d-30c11d39be73/042f9bcc-1260-53d1-9b7d-30c11d39be73_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 43634,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VN21GCK/697998957/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_042f9bcc-1260-53d1-9b7d-30c11d39be73/042f9bcc-1260-53d1-9b7d-30c11d39be73_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 42044,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VN21GCK/697998961/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_042f9bcc-1260-53d1-9b7d-30c11d39be73/042f9bcc-1260-53d1-9b7d-30c11d39be73_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 41343,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VN21GCK/697998965/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_042f9bcc-1260-53d1-9b7d-30c11d39be73/042f9bcc-1260-53d1-9b7d-30c11d39be73_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 87656,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VN21GCK/697998970/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_042f9bcc-1260-53d1-9b7d-30c11d39be73/042f9bcc-1260-53d1-9b7d-30c11d39be73_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 64207,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VN21GCK/697998984/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_042f9bcc-1260-53d1-9b7d-30c11d39be73/042f9bcc-1260-53d1-9b7d-30c11d39be73_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 86205,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VN21GCK/697998990/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_042f9bcc-1260-53d1-9b7d-30c11d39be73/042f9bcc-1260-53d1-9b7d-30c11d39be73_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 68545,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VN21GCK/697999000/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-01-01',
'seller_name': None,
'title': 'VAUXHALL CORSA-E 100KW 50KWH SE PREMIUM (7.4) Hatchback',
'transmission': 'automatic',
'trim': '100KW 50KWH SE PREMIUM (7.4)',
'vin': 'VXKUHZKXZM4110876',
'year': 2021}
2026-03-28 14:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27VN21%2520GCK%27 HTTP/1.1" 200 None
2026-03-28 14:01:51 [bca.uk] INFO: Saving data for VN21%20GCK: {'created_time': 1774706511.557914, 'last_price_update_time': 1774706511.557928, 'auction_closing_time': 1774864800.0}
2026-03-28 14:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='VN21%2520GCK') HTTP/1.1" 204 0
2026-03-28 14:01:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 2e77e548-6211-5739-af41-39c112c5041c with identifier: SE16%20KBX
2026-03-28 14:01:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 2e77e548-6211-5739-af41-39c112c5041c with identifier: SE16%20KBX
2026-03-28 14:01:51 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 2e77e548-6211-5739-af41-39c112c5041c with identifier: SE16%20KBX to the API
2026-03-28 14:01:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:01:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:01:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SE16KBX/698938662/600>
{'auction_title': '',
'c_o_2_emission_value': 109,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2e77e548-6211-5739-af41-39c112c5041c/2e77e548-6211-5739-af41-39c112c5041c_expert_report_file_97aeadad-dd24-4522-9ed5-53fe7666e37a.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=SE16%20KBX-GB',
'category': 'Car',
'color': 'black',
'currency': 'GBP',
'doors_number': 4,
'engine': '2.0L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Diesel',
'id': '2e77e548-6211-5739-af41-39c112c5041c',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'SE16 KBX',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=SE16%20KBX&vehicleType=*',
'listing': 'auction',
'location': 'Measham',
'make': 'BMW',
'model': '520D',
'odometer': 97817,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 11,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2e77e548-6211-5739-af41-39c112c5041c/2e77e548-6211-5739-af41-39c112c5041c_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 46322,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SE16KBX/698938662/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2e77e548-6211-5739-af41-39c112c5041c/2e77e548-6211-5739-af41-39c112c5041c_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 42439,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SE16KBX/698938669/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2e77e548-6211-5739-af41-39c112c5041c/2e77e548-6211-5739-af41-39c112c5041c_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 44166,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SE16KBX/698938680/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2e77e548-6211-5739-af41-39c112c5041c/2e77e548-6211-5739-af41-39c112c5041c_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 42141,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SE16KBX/698938689/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2e77e548-6211-5739-af41-39c112c5041c/2e77e548-6211-5739-af41-39c112c5041c_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 41153,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SE16KBX/698938698/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2e77e548-6211-5739-af41-39c112c5041c/2e77e548-6211-5739-af41-39c112c5041c_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 40415,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SE16KBX/698938705/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2e77e548-6211-5739-af41-39c112c5041c/2e77e548-6211-5739-af41-39c112c5041c_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 80467,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SE16KBX/698938720/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2e77e548-6211-5739-af41-39c112c5041c/2e77e548-6211-5739-af41-39c112c5041c_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 89129,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SE16KBX/698938734/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2e77e548-6211-5739-af41-39c112c5041c/2e77e548-6211-5739-af41-39c112c5041c_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 93305,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SE16KBX/698938749/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2e77e548-6211-5739-af41-39c112c5041c/2e77e548-6211-5739-af41-39c112c5041c_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 78073,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SE16KBX/698938761/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-01-01',
'seller_name': None,
'title': 'BMW 520D 2.0 190 SE STEP Saloon',
'transmission': 'automatic',
'trim': '190 SE STEP',
'vin': 'WBA5E52050G719041',
'year': 2016}
2026-03-28 14:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SE16%2520KBX%27 HTTP/1.1" 200 None
2026-03-28 14:01:51 [bca.uk] INFO: Saving data for SE16%20KBX: {'created_time': 1774706511.990574, 'last_price_update_time': 1774706511.990587, 'auction_closing_time': 1774864800.0}
2026-03-28 14:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='SE16%2520KBX') HTTP/1.1" 204 0
2026-03-28 14:01:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PN64UHS/698149402/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/PN64UHS/42810229?sv=2020-08-04&st=2026-03-28T14%3A01%3A42Z&se=2026-03-28T14%3A26%3A42Z&sr=b&sp=r&sig=poKtxPpxXbqP0NGLExiJbxVwCiEJHxglY1MdvVHQzVg%3D)
2026-03-28 14:01:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CP19XKX/698252625/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/CP19XKX/42810052?sv=2020-08-04&st=2026-03-28T14%3A01%3A42Z&se=2026-03-28T14%3A26%3A42Z&sr=b&sp=r&sig=bjyHHkX2Tk%2Fg1NdAswlyjtEAt76c1wRB5i7u%2BULrS5U%3D)
2026-03-28 14:01:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WX70JZJ/698017425/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/WX70JZJ/42810045?sv=2020-08-04&st=2026-03-28T14%3A01%3A42Z&se=2026-03-28T14%3A26%3A42Z&sr=b&sp=r&sig=zpaKYMdJB0PiQSX%2BpoOKZdTxRmLBiapRNqdSFDIfp%2Bc%3D)
2026-03-28 14:01:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PN64UHS/698149252/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/PN64UHS/42810229?sv=2020-08-04&st=2026-03-28T14%3A01%3A42Z&se=2026-03-28T14%3A26%3A42Z&sr=b&sp=r&sig=poKtxPpxXbqP0NGLExiJbxVwCiEJHxglY1MdvVHQzVg%3D)
2026-03-28 14:01:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CP19XKX/698252618/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/CP19XKX/42810052?sv=2020-08-04&st=2026-03-28T14%3A01%3A42Z&se=2026-03-28T14%3A26%3A42Z&sr=b&sp=r&sig=bjyHHkX2Tk%2Fg1NdAswlyjtEAt76c1wRB5i7u%2BULrS5U%3D)
2026-03-28 14:01:52 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PN64UHS/698149248/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=PN64UHS-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-28 14:01:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RO63WRK/698460274/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/RO63WRK/42810240?sv=2020-08-04&st=2026-03-28T14%3A01%3A42Z&se=2026-03-28T14%3A26%3A42Z&sr=b&sp=r&sig=MOREAH8gnhiPYq9fnYSM0K23PHRvNBVeUgjnUtNHuk8%3D)
2026-03-28 14:01:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RO63WRK/698460270/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/RO63WRK/42810240?sv=2020-08-04&st=2026-03-28T14%3A01%3A42Z&se=2026-03-28T14%3A26%3A42Z&sr=b&sp=r&sig=MOREAH8gnhiPYq9fnYSM0K23PHRvNBVeUgjnUtNHuk8%3D)
2026-03-28 14:01:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:01:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c504dd0>
2026-03-28 14:01:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:01:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:01:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:01:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e4a41ade-3285-55a6-95db-86a4f368e5a7/e4a41ade-3285-55a6-95db-86a4f368e5a7_image_1.jpg HTTP/1.1" 201 0
2026-03-28 14:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FWX18RMZ%252F698558951%252F600') HTTP/1.1" 204 0
2026-03-28 14:01:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WX18RMZ/698558951/600 saved to cache
2026-03-28 14:01:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item e4a41ade-3285-55a6-95db-86a4f368e5a7
2026-03-28 14:01:52 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: e4a41ade-3285-55a6-95db-86a4f368e5a7, skipping ID generation
2026-03-28 14:01:52 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item e4a41ade-3285-55a6-95db-86a4f368e5a7 sending to next pipeline
2026-03-28 14:01:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: e4a41ade-3285-55a6-95db-86a4f368e5a7, identifier: WX18%20RMZ
2026-03-28 14:01:52 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:01:52 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:01:52 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:01:52 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:01:52 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:01:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:01:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2d950790>
2026-03-28 14:01:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:01:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:01:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:01:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_10beb970-842b-5836-9952-ce1ec016ade8/10beb970-842b-5836-9952-ce1ec016ade8_image_8.jpg HTTP/1.1" 201 0
2026-03-28 14:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FRO63WRK%252F698460277%252F600') HTTP/1.1" 204 0
2026-03-28 14:01:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RO63WRK/698460277/600 saved to cache
2026-03-28 14:01:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 10beb970-842b-5836-9952-ce1ec016ade8
2026-03-28 14:01:52 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:01:52 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:01:52 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:01:52 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:01:52 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:01:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:01:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c991b50>
2026-03-28 14:01:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:01:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:01:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:01:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b697841c-f8f8-5c3e-a0f7-75585967ab4c/b697841c-f8f8-5c3e-a0f7-75585967ab4c_image_8.jpg HTTP/1.1" 201 0
2026-03-28 14:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FCP19XKX%252F698252652%252F600') HTTP/1.1" 204 0
2026-03-28 14:01:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CP19XKX/698252652/600 saved to cache
2026-03-28 14:01:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item b697841c-f8f8-5c3e-a0f7-75585967ab4c
2026-03-28 14:01:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:01:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2ca7f610>
2026-03-28 14:01:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:01:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:01:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:01:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_78b2ead9-6d58-5edb-a028-9b77396fb5da/78b2ead9-6d58-5edb-a028-9b77396fb5da_image_5.jpg HTTP/1.1" 201 0
2026-03-28 14:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FWX70JZJ%252F698017433%252F600') HTTP/1.1" 204 0
2026-03-28 14:01:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WX70JZJ/698017433/600 saved to cache
2026-03-28 14:01:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 78b2ead9-6d58-5edb-a028-9b77396fb5da
2026-03-28 14:01:52 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:01:52 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:01:52 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:01:52 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:01:52 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:01:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:01:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2d991750>
2026-03-28 14:01:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:01:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:01:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:01:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0314c884-43b5-5d2e-81ae-0d6223087ff6/0314c884-43b5-5d2e-81ae-0d6223087ff6_image_6.jpg HTTP/1.1" 201 0
2026-03-28 14:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FPN64UHS%252F698149360%252F600') HTTP/1.1" 204 0
2026-03-28 14:01:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PN64UHS/698149360/600 saved to cache
2026-03-28 14:01:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 0314c884-43b5-5d2e-81ae-0d6223087ff6
2026-03-28 14:01:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: e4a41ade-3285-55a6-95db-86a4f368e5a7 with identifier: WX18%20RMZ
2026-03-28 14:01:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: e4a41ade-3285-55a6-95db-86a4f368e5a7 with identifier: WX18%20RMZ
2026-03-28 14:01:52 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: e4a41ade-3285-55a6-95db-86a4f368e5a7 with identifier: WX18%20RMZ to the API
2026-03-28 14:01:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:01:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:01:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WX18RMZ/698558951/600>
{'auction_title': '',
'c_o_2_emission_value': 111,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e4a41ade-3285-55a6-95db-86a4f368e5a7/e4a41ade-3285-55a6-95db-86a4f368e5a7_expert_report_file_2f0d593f-f0b8-435d-94ba-725be7843509.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=WX18%20RMZ-GB',
'category': 'Car',
'color': 'white',
'currency': 'GBP',
'doors_number': 4,
'engine': '1.6L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Diesel',
'id': 'e4a41ade-3285-55a6-95db-86a4f368e5a7',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'WX18 RMZ',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=WX18%20RMZ&vehicleType=*',
'listing': 'auction',
'location': 'Bristol',
'make': 'MERCEDES-BENZ',
'model': 'C200 D',
'odometer': 62999,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 11,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e4a41ade-3285-55a6-95db-86a4f368e5a7/e4a41ade-3285-55a6-95db-86a4f368e5a7_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 48723,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WX18RMZ/698558942/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e4a41ade-3285-55a6-95db-86a4f368e5a7/e4a41ade-3285-55a6-95db-86a4f368e5a7_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 48204,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WX18RMZ/698558951/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e4a41ade-3285-55a6-95db-86a4f368e5a7/e4a41ade-3285-55a6-95db-86a4f368e5a7_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 44505,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WX18RMZ/698558980/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e4a41ade-3285-55a6-95db-86a4f368e5a7/e4a41ade-3285-55a6-95db-86a4f368e5a7_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 46496,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WX18RMZ/698559064/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e4a41ade-3285-55a6-95db-86a4f368e5a7/e4a41ade-3285-55a6-95db-86a4f368e5a7_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 45925,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WX18RMZ/698559073/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e4a41ade-3285-55a6-95db-86a4f368e5a7/e4a41ade-3285-55a6-95db-86a4f368e5a7_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 44794,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WX18RMZ/698559084/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e4a41ade-3285-55a6-95db-86a4f368e5a7/e4a41ade-3285-55a6-95db-86a4f368e5a7_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 73817,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WX18RMZ/698559106/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e4a41ade-3285-55a6-95db-86a4f368e5a7/e4a41ade-3285-55a6-95db-86a4f368e5a7_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 58270,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WX18RMZ/698559129/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e4a41ade-3285-55a6-95db-86a4f368e5a7/e4a41ade-3285-55a6-95db-86a4f368e5a7_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 73792,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WX18RMZ/698559156/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e4a41ade-3285-55a6-95db-86a4f368e5a7/e4a41ade-3285-55a6-95db-86a4f368e5a7_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 76274,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WX18RMZ/698559174/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-01-01',
'seller_name': None,
'title': 'MERCEDES-BENZ C200 D 1.6 SPORT Saloon',
'transmission': 'manual',
'trim': 'SPORT',
'vin': 'WDD2050372R342440',
'year': 2018}
2026-03-28 14:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WX18%2520RMZ%27 HTTP/1.1" 200 None
2026-03-28 14:01:52 [bca.uk] INFO: Saving data for WX18%20RMZ: {'created_time': 1774706512.901608, 'last_price_update_time': 1774706512.901621, 'auction_closing_time': 1774864800.0}
2026-03-28 14:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='WX18%2520RMZ') HTTP/1.1" 204 0
2026-03-28 14:01:52 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RO63WRK/698460265/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698460265>
2026-03-28 14:01:52 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RO63WRK/698460267/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698460267>
2026-03-28 14:01:52 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WX70JZJ/698017408/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698017408>
2026-03-28 14:01:52 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CP19XKX/698252603/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698252603>
2026-03-28 14:01:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CP19XKX/698252610/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/CP19XKX/42810052?sv=2020-08-04&st=2026-03-28T14%3A01%3A42Z&se=2026-03-28T14%3A26%3A42Z&sr=b&sp=r&sig=bjyHHkX2Tk%2Fg1NdAswlyjtEAt76c1wRB5i7u%2BULrS5U%3D)
2026-03-28 14:01:52 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RO63WRK/698460260/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698460260>
2026-03-28 14:01:52 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CP19XKX/698252597/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698252597>
2026-03-28 14:01:52 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WX70JZJ/698017405/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698017405>
2026-03-28 14:01:53 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:01:53 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:01:53 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:01:53 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:01:53 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:01:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:01:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2d950250>
2026-03-28 14:01:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:01:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:01:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:01:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0314c884-43b5-5d2e-81ae-0d6223087ff6/0314c884-43b5-5d2e-81ae-0d6223087ff6_image_9.jpg HTTP/1.1" 201 0
2026-03-28 14:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FPN64UHS%252F698149402%252F600') HTTP/1.1" 204 0
2026-03-28 14:01:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PN64UHS/698149402/600 saved to cache
2026-03-28 14:01:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 0314c884-43b5-5d2e-81ae-0d6223087ff6
2026-03-28 14:01:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:01:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c99cbd0>
2026-03-28 14:01:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:01:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:01:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:01:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b697841c-f8f8-5c3e-a0f7-75585967ab4c/b697841c-f8f8-5c3e-a0f7-75585967ab4c_image_5.jpg HTTP/1.1" 201 0
2026-03-28 14:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FCP19XKX%252F698252625%252F600') HTTP/1.1" 204 0
2026-03-28 14:01:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CP19XKX/698252625/600 saved to cache
2026-03-28 14:01:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item b697841c-f8f8-5c3e-a0f7-75585967ab4c
2026-03-28 14:01:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:01:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a1ff51450>
2026-03-28 14:01:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:01:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:01:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:01:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_78b2ead9-6d58-5edb-a028-9b77396fb5da/78b2ead9-6d58-5edb-a028-9b77396fb5da_image_4.jpg HTTP/1.1" 201 0
2026-03-28 14:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FWX70JZJ%252F698017425%252F600') HTTP/1.1" 204 0
2026-03-28 14:01:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WX70JZJ/698017425/600 saved to cache
2026-03-28 14:01:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 78b2ead9-6d58-5edb-a028-9b77396fb5da
2026-03-28 14:01:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:01:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c821010>
2026-03-28 14:01:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:01:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:01:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:01:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0314c884-43b5-5d2e-81ae-0d6223087ff6/0314c884-43b5-5d2e-81ae-0d6223087ff6_image_1.jpg HTTP/1.1" 201 0
2026-03-28 14:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FPN64UHS%252F698149252%252F600') HTTP/1.1" 204 0
2026-03-28 14:01:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PN64UHS/698149252/600 saved to cache
2026-03-28 14:01:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 0314c884-43b5-5d2e-81ae-0d6223087ff6
2026-03-28 14:01:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:01:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2d725210>
2026-03-28 14:01:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:01:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:01:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:01:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b697841c-f8f8-5c3e-a0f7-75585967ab4c/b697841c-f8f8-5c3e-a0f7-75585967ab4c_image_4.jpg HTTP/1.1" 201 0
2026-03-28 14:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FCP19XKX%252F698252618%252F600') HTTP/1.1" 204 0
2026-03-28 14:01:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CP19XKX/698252618/600 saved to cache
2026-03-28 14:01:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item b697841c-f8f8-5c3e-a0f7-75585967ab4c
2026-03-28 14:01:53 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:01:53 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:01:53 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:01:53 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:01:53 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:01:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:01:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c681590>
2026-03-28 14:01:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:01:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:01:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:01:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_10beb970-842b-5836-9952-ce1ec016ade8/10beb970-842b-5836-9952-ce1ec016ade8_image_7.jpg HTTP/1.1" 201 0
2026-03-28 14:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FRO63WRK%252F698460274%252F600') HTTP/1.1" 204 0
2026-03-28 14:01:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RO63WRK/698460274/600 saved to cache
2026-03-28 14:01:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 10beb970-842b-5836-9952-ce1ec016ade8
2026-03-28 14:01:53 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:01:53 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:01:53 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:01:53 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:01:53 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:01:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:01:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c0f7310>
2026-03-28 14:01:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:01:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:01:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:01:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_10beb970-842b-5836-9952-ce1ec016ade8/10beb970-842b-5836-9952-ce1ec016ade8_image_6.jpg HTTP/1.1" 201 0
2026-03-28 14:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FRO63WRK%252F698460270%252F600') HTTP/1.1" 204 0
2026-03-28 14:01:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RO63WRK/698460270/600 saved to cache
2026-03-28 14:01:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 10beb970-842b-5836-9952-ce1ec016ade8
2026-03-28 14:01:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:01:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c591390>
2026-03-28 14:01:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:01:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:01:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:01:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b697841c-f8f8-5c3e-a0f7-75585967ab4c/b697841c-f8f8-5c3e-a0f7-75585967ab4c_image_3.jpg HTTP/1.1" 201 0
2026-03-28 14:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FCP19XKX%252F698252610%252F600') HTTP/1.1" 204 0
2026-03-28 14:01:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CP19XKX/698252610/600 saved to cache
2026-03-28 14:01:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item b697841c-f8f8-5c3e-a0f7-75585967ab4c
2026-03-28 14:01:53 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YD66KFF/698260485/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698260485>
2026-03-28 14:01:53 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VO62RAU/698928871/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698928871>
2026-03-28 14:01:53 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BL16UUB/697704387/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=697704387>
2026-03-28 14:01:53 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VK65XNW/697722945/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=697722945>
2026-03-28 14:01:53 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WM19BFN/698601845/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698601845>
2026-03-28 14:01:53 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YW64DGU/698928923/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698928923>
2026-03-28 14:01:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PN64UHS/698149248/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/PN64UHS/42810229?sv=2020-08-04&st=2026-03-28T14%3A01%3A42Z&se=2026-03-28T14%3A26%3A42Z&sr=b&sp=r&sig=poKtxPpxXbqP0NGLExiJbxVwCiEJHxglY1MdvVHQzVg%3D)
2026-03-28 14:01:53 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FL59VTF/698069835/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698069835>
2026-03-28 14:01:53 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EJ19URS/698294822/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698294822>
2026-03-28 14:01:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RO63WRK/698460260/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/RO63WRK/42810240?sv=2020-08-04&st=2026-03-28T14%3A01%3A42Z&se=2026-03-28T14%3A26%3A42Z&sr=b&sp=r&sig=MOREAH8gnhiPYq9fnYSM0K23PHRvNBVeUgjnUtNHuk8%3D)
2026-03-28 14:01:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WX70JZJ/698017408/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/WX70JZJ/42810045?sv=2020-08-04&st=2026-03-28T14%3A01%3A42Z&se=2026-03-28T14%3A26%3A42Z&sr=b&sp=r&sig=zpaKYMdJB0PiQSX%2BpoOKZdTxRmLBiapRNqdSFDIfp%2Bc%3D)
2026-03-28 14:01:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WX70JZJ/698017405/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/WX70JZJ/42810045?sv=2020-08-04&st=2026-03-28T14%3A01%3A42Z&se=2026-03-28T14%3A26%3A42Z&sr=b&sp=r&sig=zpaKYMdJB0PiQSX%2BpoOKZdTxRmLBiapRNqdSFDIfp%2Bc%3D)
2026-03-28 14:01:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CP19XKX/698252603/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/CP19XKX/42810052?sv=2020-08-04&st=2026-03-28T14%3A01%3A42Z&se=2026-03-28T14%3A26%3A42Z&sr=b&sp=r&sig=bjyHHkX2Tk%2Fg1NdAswlyjtEAt76c1wRB5i7u%2BULrS5U%3D)
2026-03-28 14:01:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CP19XKX/698252597/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/CP19XKX/42810052?sv=2020-08-04&st=2026-03-28T14%3A01%3A42Z&se=2026-03-28T14%3A26%3A42Z&sr=b&sp=r&sig=bjyHHkX2Tk%2Fg1NdAswlyjtEAt76c1wRB5i7u%2BULrS5U%3D)
2026-03-28 14:01:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RO63WRK/698460265/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/RO63WRK/42810240?sv=2020-08-04&st=2026-03-28T14%3A01%3A42Z&se=2026-03-28T14%3A26%3A42Z&sr=b&sp=r&sig=MOREAH8gnhiPYq9fnYSM0K23PHRvNBVeUgjnUtNHuk8%3D)
2026-03-28 14:01:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:01:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c8a3290>
2026-03-28 14:01:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:01:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:01:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:01:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0314c884-43b5-5d2e-81ae-0d6223087ff6/0314c884-43b5-5d2e-81ae-0d6223087ff6_image_0.jpg HTTP/1.1" 201 0
2026-03-28 14:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FPN64UHS%252F698149248%252F600') HTTP/1.1" 204 0
2026-03-28 14:01:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PN64UHS/698149248/600 saved to cache
2026-03-28 14:01:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 0314c884-43b5-5d2e-81ae-0d6223087ff6
2026-03-28 14:01:53 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 0314c884-43b5-5d2e-81ae-0d6223087ff6, skipping ID generation
2026-03-28 14:01:53 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 0314c884-43b5-5d2e-81ae-0d6223087ff6 sending to next pipeline
2026-03-28 14:01:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 0314c884-43b5-5d2e-81ae-0d6223087ff6, identifier: PN64%20UHS
2026-03-28 14:01:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RO63WRK/698460267/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/RO63WRK/42810240?sv=2020-08-04&st=2026-03-28T14%3A01%3A42Z&se=2026-03-28T14%3A26%3A42Z&sr=b&sp=r&sig=MOREAH8gnhiPYq9fnYSM0K23PHRvNBVeUgjnUtNHuk8%3D)
2026-03-28 14:01:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 0314c884-43b5-5d2e-81ae-0d6223087ff6 with identifier: PN64%20UHS
2026-03-28 14:01:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 0314c884-43b5-5d2e-81ae-0d6223087ff6 with identifier: PN64%20UHS
2026-03-28 14:01:53 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 0314c884-43b5-5d2e-81ae-0d6223087ff6 with identifier: PN64%20UHS to the API
2026-03-28 14:01:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:01:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:01:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PN64UHS/698149248/600>
{'auction_title': '',
'c_o_2_emission_value': 150,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0314c884-43b5-5d2e-81ae-0d6223087ff6/0314c884-43b5-5d2e-81ae-0d6223087ff6_expert_report_file_b6ad4617-66ac-49ff-bcfe-35e0ca6296fa.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=PN64%20UHS-GB',
'category': 'Car',
'color': 'grey',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.6L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol',
'id': '0314c884-43b5-5d2e-81ae-0d6223087ff6',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'PN64 UHS',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=PN64%20UHS&vehicleType=*',
'listing': 'auction',
'location': 'Measham',
'make': 'PEUGEOT',
'model': '2008',
'odometer': 71317,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 11,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0314c884-43b5-5d2e-81ae-0d6223087ff6/0314c884-43b5-5d2e-81ae-0d6223087ff6_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 41403,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PN64UHS/698149248/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0314c884-43b5-5d2e-81ae-0d6223087ff6/0314c884-43b5-5d2e-81ae-0d6223087ff6_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 42137,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PN64UHS/698149252/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0314c884-43b5-5d2e-81ae-0d6223087ff6/0314c884-43b5-5d2e-81ae-0d6223087ff6_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 43789,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PN64UHS/698149259/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0314c884-43b5-5d2e-81ae-0d6223087ff6/0314c884-43b5-5d2e-81ae-0d6223087ff6_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 41497,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PN64UHS/698149265/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0314c884-43b5-5d2e-81ae-0d6223087ff6/0314c884-43b5-5d2e-81ae-0d6223087ff6_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 42769,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PN64UHS/698149331/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0314c884-43b5-5d2e-81ae-0d6223087ff6/0314c884-43b5-5d2e-81ae-0d6223087ff6_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 42792,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PN64UHS/698149349/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0314c884-43b5-5d2e-81ae-0d6223087ff6/0314c884-43b5-5d2e-81ae-0d6223087ff6_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 60585,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PN64UHS/698149360/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0314c884-43b5-5d2e-81ae-0d6223087ff6/0314c884-43b5-5d2e-81ae-0d6223087ff6_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 55477,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PN64UHS/698149372/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0314c884-43b5-5d2e-81ae-0d6223087ff6/0314c884-43b5-5d2e-81ae-0d6223087ff6_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 66241,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PN64UHS/698149388/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0314c884-43b5-5d2e-81ae-0d6223087ff6/0314c884-43b5-5d2e-81ae-0d6223087ff6_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 71447,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PN64UHS/698149402/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2014-01-01',
'seller_name': None,
'title': 'PEUGEOT 2008 1.6 VTI ALLURE MPV',
'transmission': 'automatic',
'trim': 'VTI ALLURE',
'vin': 'VF3CU5FS9EY099066',
'year': 2014}
2026-03-28 14:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27PN64%2520UHS%27 HTTP/1.1" 200 None
2026-03-28 14:01:54 [bca.uk] INFO: Saving data for PN64%20UHS: {'created_time': 1774706514.210263, 'last_price_update_time': 1774706514.210276, 'auction_closing_time': 1774864800.0}
2026-03-28 14:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='PN64%2520UHS') HTTP/1.1" 204 0
2026-03-28 14:01:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BL16UUB/697704387/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/BL16UUB/42810250?sv=2020-08-04&st=2026-03-28T14%3A01%3A27Z&se=2026-03-28T14%3A26%3A27Z&sr=b&sp=r&sig=SYmTiNujaXYF2XAoxTdHUcpF%2BqchRSrGUQy4u1jrdO0%3D)
2026-03-28 14:01:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VK65XNW/697722945/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/VK65XNW/42810265?sv=2020-08-04&st=2026-03-28T14%3A01%3A28Z&se=2026-03-28T14%3A26%3A28Z&sr=b&sp=r&sig=3QAAN%2BSB1OUMkxc4Xxtv%2BiBflOK5M03dTgEQ%2BLIgSi4%3D)
2026-03-28 14:01:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YD66KFF/698260485/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YD66KFF/42810264?sv=2020-08-04&st=2026-03-28T14%3A01%3A27Z&se=2026-03-28T14%3A26%3A27Z&sr=b&sp=r&sig=BnH67lWrH1ehlh0fvDCmlxB%2FgGDsNGQtDgFTgEjpoSk%3D)
2026-03-28 14:01:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YW64DGU/698928923/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YW64DGU/42810194?sv=2020-08-04&st=2026-03-28T14%3A01%3A23Z&se=2026-03-28T14%3A26%3A23Z&sr=b&sp=r&sig=bKUUxkl%2FQOTN6xP3oKLYX53uOLW1seBVRfhSdF3FtAg%3D)
2026-03-28 14:01:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FL59VTF/698069835/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/FL59VTF/42810253?sv=2020-08-04&st=2026-03-28T14%3A01%3A28Z&se=2026-03-28T14%3A26%3A28Z&sr=b&sp=r&sig=GoiG7mqbYuLGhcwWnmQ5IpnLjHLSnXkwhQvXnkkGwWI%3D)
2026-03-28 14:01:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VO62RAU/698928871/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/VO62RAU/42809976?sv=2020-08-04&st=2026-03-28T14%3A01%3A26Z&se=2026-03-28T14%3A26%3A26Z&sr=b&sp=r&sig=ajraupx01hOhBxj83xq2SeA0U6vZ89qgzfl3QZ0K0u0%3D)
2026-03-28 14:01:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WM19BFN/698601845/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/WM19BFN/42804238?sv=2020-08-04&st=2026-03-28T14%3A01%3A26Z&se=2026-03-28T14%3A26%3A26Z&sr=b&sp=r&sig=EfjfS2OdrtC4SA3uZ5XRiTu1xsVnQ9sqSYyb4MkUK3s%3D)
2026-03-28 14:01:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:01:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a1fd17dd0>
2026-03-28 14:01:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:01:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:01:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:01:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_10beb970-842b-5836-9952-ce1ec016ade8/10beb970-842b-5836-9952-ce1ec016ade8_image_2.jpg HTTP/1.1" 201 0
2026-03-28 14:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FRO63WRK%252F698460260%252F600') HTTP/1.1" 204 0
2026-03-28 14:01:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RO63WRK/698460260/600 saved to cache
2026-03-28 14:01:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 10beb970-842b-5836-9952-ce1ec016ade8
2026-03-28 14:01:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:01:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c760890>
2026-03-28 14:01:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:01:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:01:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:01:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_78b2ead9-6d58-5edb-a028-9b77396fb5da/78b2ead9-6d58-5edb-a028-9b77396fb5da_image_2.jpg HTTP/1.1" 201 0
2026-03-28 14:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FWX70JZJ%252F698017408%252F600') HTTP/1.1" 204 0
2026-03-28 14:01:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WX70JZJ/698017408/600 saved to cache
2026-03-28 14:01:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 78b2ead9-6d58-5edb-a028-9b77396fb5da
2026-03-28 14:01:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:01:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2eb1d810>
2026-03-28 14:01:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:01:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:01:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:01:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_78b2ead9-6d58-5edb-a028-9b77396fb5da/78b2ead9-6d58-5edb-a028-9b77396fb5da_image_1.jpg HTTP/1.1" 201 0
2026-03-28 14:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FWX70JZJ%252F698017405%252F600') HTTP/1.1" 204 0
2026-03-28 14:01:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WX70JZJ/698017405/600 saved to cache
2026-03-28 14:01:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 78b2ead9-6d58-5edb-a028-9b77396fb5da
2026-03-28 14:01:54 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 78b2ead9-6d58-5edb-a028-9b77396fb5da, skipping ID generation
2026-03-28 14:01:54 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 78b2ead9-6d58-5edb-a028-9b77396fb5da sending to next pipeline
2026-03-28 14:01:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 78b2ead9-6d58-5edb-a028-9b77396fb5da, identifier: WX70%20JZJ
2026-03-28 14:01:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:01:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c899650>
2026-03-28 14:01:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:01:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:01:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:01:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b697841c-f8f8-5c3e-a0f7-75585967ab4c/b697841c-f8f8-5c3e-a0f7-75585967ab4c_image_2.jpg HTTP/1.1" 201 0
2026-03-28 14:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FCP19XKX%252F698252603%252F600') HTTP/1.1" 204 0
2026-03-28 14:01:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CP19XKX/698252603/600 saved to cache
2026-03-28 14:01:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item b697841c-f8f8-5c3e-a0f7-75585967ab4c
2026-03-28 14:01:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:01:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c5038d0>
2026-03-28 14:01:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:01:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:01:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:01:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b697841c-f8f8-5c3e-a0f7-75585967ab4c/b697841c-f8f8-5c3e-a0f7-75585967ab4c_image_1.jpg HTTP/1.1" 201 0
2026-03-28 14:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FCP19XKX%252F698252597%252F600') HTTP/1.1" 204 0
2026-03-28 14:01:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CP19XKX/698252597/600 saved to cache
2026-03-28 14:01:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item b697841c-f8f8-5c3e-a0f7-75585967ab4c
2026-03-28 14:01:54 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: b697841c-f8f8-5c3e-a0f7-75585967ab4c, skipping ID generation
2026-03-28 14:01:54 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item b697841c-f8f8-5c3e-a0f7-75585967ab4c sending to next pipeline
2026-03-28 14:01:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: b697841c-f8f8-5c3e-a0f7-75585967ab4c, identifier: CP19%20XKX
2026-03-28 14:01:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:01:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2d73d7d0>
2026-03-28 14:01:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:01:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:01:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:01:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_10beb970-842b-5836-9952-ce1ec016ade8/10beb970-842b-5836-9952-ce1ec016ade8_image_4.jpg HTTP/1.1" 201 0
2026-03-28 14:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FRO63WRK%252F698460265%252F600') HTTP/1.1" 204 0
2026-03-28 14:01:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RO63WRK/698460265/600 saved to cache
2026-03-28 14:01:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 10beb970-842b-5836-9952-ce1ec016ade8
2026-03-28 14:01:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:01:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a1fea0d90>
2026-03-28 14:01:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:01:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:01:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:01:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_10beb970-842b-5836-9952-ce1ec016ade8/10beb970-842b-5836-9952-ce1ec016ade8_image_5.jpg HTTP/1.1" 201 0
2026-03-28 14:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FRO63WRK%252F698460267%252F600') HTTP/1.1" 204 0
2026-03-28 14:01:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RO63WRK/698460267/600 saved to cache
2026-03-28 14:01:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 10beb970-842b-5836-9952-ce1ec016ade8
2026-03-28 14:01:54 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 10beb970-842b-5836-9952-ce1ec016ade8, skipping ID generation
2026-03-28 14:01:54 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 10beb970-842b-5836-9952-ce1ec016ade8 sending to next pipeline
2026-03-28 14:01:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 10beb970-842b-5836-9952-ce1ec016ade8, identifier: RO63%20WRK
2026-03-28 14:01:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 78b2ead9-6d58-5edb-a028-9b77396fb5da with identifier: WX70%20JZJ
2026-03-28 14:01:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 78b2ead9-6d58-5edb-a028-9b77396fb5da with identifier: WX70%20JZJ
2026-03-28 14:01:54 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 78b2ead9-6d58-5edb-a028-9b77396fb5da with identifier: WX70%20JZJ to the API
2026-03-28 14:01:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:01:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:01:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WX70JZJ/698017405/600>
{'auction_title': '',
'c_o_2_emission_value': 143,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_78b2ead9-6d58-5edb-a028-9b77396fb5da/78b2ead9-6d58-5edb-a028-9b77396fb5da_expert_report_file_d7079ec3-0ced-4354-bd31-8c2af5ebb5cb.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=WX70%20JZJ-GB',
'category': 'Car',
'color': 'black',
'currency': 'GBP',
'doors_number': 4,
'engine': '2.2L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Diesel',
'id': '78b2ead9-6d58-5edb-a028-9b77396fb5da',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'WX70 JZJ',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=WX70%20JZJ&vehicleType=*',
'listing': 'auction',
'location': 'Bristol',
'make': 'ALFA ROMEO',
'model': 'GIULIA',
'odometer': 41514,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 11,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_78b2ead9-6d58-5edb-a028-9b77396fb5da/78b2ead9-6d58-5edb-a028-9b77396fb5da_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 45968,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WX70JZJ/698017397/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_78b2ead9-6d58-5edb-a028-9b77396fb5da/78b2ead9-6d58-5edb-a028-9b77396fb5da_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 47059,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WX70JZJ/698017405/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_78b2ead9-6d58-5edb-a028-9b77396fb5da/78b2ead9-6d58-5edb-a028-9b77396fb5da_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 42874,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WX70JZJ/698017408/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_78b2ead9-6d58-5edb-a028-9b77396fb5da/78b2ead9-6d58-5edb-a028-9b77396fb5da_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 43627,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WX70JZJ/698017415/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_78b2ead9-6d58-5edb-a028-9b77396fb5da/78b2ead9-6d58-5edb-a028-9b77396fb5da_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 42967,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WX70JZJ/698017425/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_78b2ead9-6d58-5edb-a028-9b77396fb5da/78b2ead9-6d58-5edb-a028-9b77396fb5da_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 42485,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WX70JZJ/698017433/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_78b2ead9-6d58-5edb-a028-9b77396fb5da/78b2ead9-6d58-5edb-a028-9b77396fb5da_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 82217,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WX70JZJ/698017439/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_78b2ead9-6d58-5edb-a028-9b77396fb5da/78b2ead9-6d58-5edb-a028-9b77396fb5da_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 80564,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WX70JZJ/698017456/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_78b2ead9-6d58-5edb-a028-9b77396fb5da/78b2ead9-6d58-5edb-a028-9b77396fb5da_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 91100,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WX70JZJ/698017470/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_78b2ead9-6d58-5edb-a028-9b77396fb5da/78b2ead9-6d58-5edb-a028-9b77396fb5da_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 72592,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WX70JZJ/698017475/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-01-01',
'seller_name': None,
'title': 'ALFA ROMEO GIULIA 2.2 JTDM-2 190 LUSSO TI Saloon',
'transmission': 'automatic',
'trim': 'JTDM-2 190 LUSSO TI',
'vin': 'ZAREAEKX3L7632535',
'year': 2020}
2026-03-28 14:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WX70%2520JZJ%27 HTTP/1.1" 200 None
2026-03-28 14:01:55 [bca.uk] INFO: Saving data for WX70%20JZJ: {'created_time': 1774706515.248894, 'last_price_update_time': 1774706515.248905, 'auction_closing_time': 1774864800.0}
2026-03-28 14:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='WX70%2520JZJ') HTTP/1.1" 204 0
2026-03-28 14:01:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: b697841c-f8f8-5c3e-a0f7-75585967ab4c with identifier: CP19%20XKX
2026-03-28 14:01:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: b697841c-f8f8-5c3e-a0f7-75585967ab4c with identifier: CP19%20XKX
2026-03-28 14:01:55 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: b697841c-f8f8-5c3e-a0f7-75585967ab4c with identifier: CP19%20XKX to the API
2026-03-28 14:01:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:01:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:01:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CP19XKX/698252597/600>
{'auction_title': '',
'c_o_2_emission_value': 119,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b697841c-f8f8-5c3e-a0f7-75585967ab4c/b697841c-f8f8-5c3e-a0f7-75585967ab4c_expert_report_file_020d010b-afca-4ea1-9987-5e0f840724e4.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=CP19%20XKX-GB',
'category': 'Car',
'color': 'silver',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.2L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol',
'id': 'b697841c-f8f8-5c3e-a0f7-75585967ab4c',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'CP19 XKX',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=CP19%20XKX&vehicleType=*',
'listing': 'auction',
'location': 'Bristol',
'make': 'CITROEN',
'model': 'C3 AIRCROSS',
'odometer': 76367,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 11,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b697841c-f8f8-5c3e-a0f7-75585967ab4c/b697841c-f8f8-5c3e-a0f7-75585967ab4c_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 47366,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CP19XKX/698252589/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b697841c-f8f8-5c3e-a0f7-75585967ab4c/b697841c-f8f8-5c3e-a0f7-75585967ab4c_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 47815,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CP19XKX/698252597/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b697841c-f8f8-5c3e-a0f7-75585967ab4c/b697841c-f8f8-5c3e-a0f7-75585967ab4c_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 44294,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CP19XKX/698252603/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b697841c-f8f8-5c3e-a0f7-75585967ab4c/b697841c-f8f8-5c3e-a0f7-75585967ab4c_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 44839,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CP19XKX/698252610/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b697841c-f8f8-5c3e-a0f7-75585967ab4c/b697841c-f8f8-5c3e-a0f7-75585967ab4c_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 44679,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CP19XKX/698252618/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b697841c-f8f8-5c3e-a0f7-75585967ab4c/b697841c-f8f8-5c3e-a0f7-75585967ab4c_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 43428,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CP19XKX/698252625/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b697841c-f8f8-5c3e-a0f7-75585967ab4c/b697841c-f8f8-5c3e-a0f7-75585967ab4c_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 84033,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CP19XKX/698252632/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b697841c-f8f8-5c3e-a0f7-75585967ab4c/b697841c-f8f8-5c3e-a0f7-75585967ab4c_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 56644,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CP19XKX/698252641/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b697841c-f8f8-5c3e-a0f7-75585967ab4c/b697841c-f8f8-5c3e-a0f7-75585967ab4c_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 73079,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CP19XKX/698252652/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b697841c-f8f8-5c3e-a0f7-75585967ab4c/b697841c-f8f8-5c3e-a0f7-75585967ab4c_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 70152,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CP19XKX/698252660/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-01-01',
'seller_name': None,
'title': 'CITROEN C3 AIRCROSS 1.2 P/T 130 FEEL Hatchback',
'transmission': 'manual',
'trim': 'P/T 130 FEEL',
'vin': 'VF72RHNSJJ4389313',
'year': 2019}
2026-03-28 14:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27CP19%2520XKX%27 HTTP/1.1" 200 None
2026-03-28 14:01:55 [bca.uk] INFO: Saving data for CP19%20XKX: {'created_time': 1774706515.702667, 'last_price_update_time': 1774706515.702681, 'auction_closing_time': 1774864800.0}
2026-03-28 14:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='CP19%2520XKX') HTTP/1.1" 204 0
2026-03-28 14:01:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 10beb970-842b-5836-9952-ce1ec016ade8 with identifier: RO63%20WRK
2026-03-28 14:01:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 10beb970-842b-5836-9952-ce1ec016ade8 with identifier: RO63%20WRK
2026-03-28 14:01:55 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 10beb970-842b-5836-9952-ce1ec016ade8 with identifier: RO63%20WRK to the API
2026-03-28 14:01:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:01:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:01:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RO63WRK/698460267/600>
{'auction_title': '',
'c_o_2_emission_value': 128,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_10beb970-842b-5836-9952-ce1ec016ade8/10beb970-842b-5836-9952-ce1ec016ade8_expert_report_file_8b053052-ad1a-4f33-adc5-8785769fe3f7.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=RO63%20WRK-GB',
'category': 'Car',
'color': 'white',
'currency': 'GBP',
'doors_number': 2,
'engine': '2.1L',
'expiration_date': '2026-03-29T10:00:00Z',
'fuel_type': 'Diesel',
'id': '10beb970-842b-5836-9952-ce1ec016ade8',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'RO63 WRK',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=RO63%20WRK&vehicleType=*',
'listing': 'auction',
'location': 'Measham',
'make': 'MERCEDES-BENZ',
'model': 'E250',
'odometer': 140410,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 12,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_10beb970-842b-5836-9952-ce1ec016ade8/10beb970-842b-5836-9952-ce1ec016ade8_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 41177,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RO63WRK/698460252/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_10beb970-842b-5836-9952-ce1ec016ade8/10beb970-842b-5836-9952-ce1ec016ade8_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 41689,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RO63WRK/698460256/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_10beb970-842b-5836-9952-ce1ec016ade8/10beb970-842b-5836-9952-ce1ec016ade8_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 43556,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RO63WRK/698460260/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_10beb970-842b-5836-9952-ce1ec016ade8/10beb970-842b-5836-9952-ce1ec016ade8_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 41706,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RO63WRK/698460263/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_10beb970-842b-5836-9952-ce1ec016ade8/10beb970-842b-5836-9952-ce1ec016ade8_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 39616,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RO63WRK/698460265/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_10beb970-842b-5836-9952-ce1ec016ade8/10beb970-842b-5836-9952-ce1ec016ade8_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 40865,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RO63WRK/698460267/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_10beb970-842b-5836-9952-ce1ec016ade8/10beb970-842b-5836-9952-ce1ec016ade8_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 66927,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RO63WRK/698460270/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_10beb970-842b-5836-9952-ce1ec016ade8/10beb970-842b-5836-9952-ce1ec016ade8_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 65253,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RO63WRK/698460274/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_10beb970-842b-5836-9952-ce1ec016ade8/10beb970-842b-5836-9952-ce1ec016ade8_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 77070,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RO63WRK/698460277/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_10beb970-842b-5836-9952-ce1ec016ade8/10beb970-842b-5836-9952-ce1ec016ade8_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 75898,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RO63WRK/698460279/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2013-01-01',
'seller_name': None,
'title': 'MERCEDES-BENZ E250 2.1 CDI AMG SPORT TIP Convertible',
'transmission': 'manual',
'trim': 'CDI AMG SPORT TIP',
'vin': 'WDD2074032F252448',
'year': 2013}
2026-03-28 14:01:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27RO63%2520WRK%27 HTTP/1.1" 200 None
2026-03-28 14:01:56 [bca.uk] INFO: Saving data for RO63%20WRK: {'created_time': 1774706516.211063, 'last_price_update_time': 1774706516.211076, 'auction_closing_time': 1774778400.0}
2026-03-28 14:01:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='RO63%2520WRK') HTTP/1.1" 204 0
2026-03-28 14:01:56 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KO15JZW/698928877/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698928877>
2026-03-28 14:01:56 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WA15XTF/697938708/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=697938708>
2026-03-28 14:01:56 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SF65MRS/698522140/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698522140>
2026-03-28 14:01:56 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/MX22PPO/42810044?sv=2020-08-04&st=2026-03-28T14%3A01%3A54Z&se=2026-03-28T14%3A26%3A54Z&sr=b&sp=r&sig=cOivuK7Ij9PCIphPJcld%2BoxGcM6JagsRhi5zUF61PdA%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=MX22%20PPO-GB>
2026-03-28 14:01:56 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FH21UNX/698923325/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698923325>
2026-03-28 14:01:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EJ19URS/698294822/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/EJ19URS/42798170?sv=2020-08-04&st=2026-03-28T14%3A01%3A25Z&se=2026-03-28T14%3A26%3A25Z&sr=b&sp=r&sig=rAxmzY9RDaFtqRrL9CfX2gFSW4Q22XPI9rfpZk%2B4AL4%3D)
2026-03-28 14:01:56 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/KX09XPF/42809692?sv=2020-08-04&st=2026-03-28T14%3A01%3A54Z&se=2026-03-28T14%3A26%3A54Z&sr=b&sp=r&sig=UaaeKrI75EkebeSUIi7%2FvDct7K9AnHCAXaF4PIxxAA8%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=KX09%20XPF-GB>
2026-03-28 14:01:56 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VO62RAU/698928851/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698928851>
2026-03-28 14:01:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:01:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c18f390>
2026-03-28 14:01:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:01:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:01:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:01:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fc54a12c-7c43-5241-baa9-136ed93039c1/fc54a12c-7c43-5241-baa9-136ed93039c1_image_1.jpg HTTP/1.1" 201 0
2026-03-28 14:01:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FBL16UUB%252F697704387%252F600') HTTP/1.1" 204 0
2026-03-28 14:01:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BL16UUB/697704387/600 saved to cache
2026-03-28 14:01:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item fc54a12c-7c43-5241-baa9-136ed93039c1
2026-03-28 14:01:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:01:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c822810>
2026-03-28 14:01:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:01:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:01:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:01:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_defab1ac-857d-50f7-901c-50783b029725/defab1ac-857d-50f7-901c-50783b029725_image_1.jpg HTTP/1.1" 201 0
2026-03-28 14:01:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FVK65XNW%252F697722945%252F600') HTTP/1.1" 204 0
2026-03-28 14:01:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VK65XNW/697722945/600 saved to cache
2026-03-28 14:01:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item defab1ac-857d-50f7-901c-50783b029725
2026-03-28 14:01:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:01:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2d685ed0>
2026-03-28 14:01:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:01:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:01:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:01:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c163b1cf-cc62-5193-9026-6cea3a049e80/c163b1cf-cc62-5193-9026-6cea3a049e80_image_1.jpg HTTP/1.1" 201 0
2026-03-28 14:01:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FYD66KFF%252F698260485%252F600') HTTP/1.1" 204 0
2026-03-28 14:01:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YD66KFF/698260485/600 saved to cache
2026-03-28 14:01:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item c163b1cf-cc62-5193-9026-6cea3a049e80
2026-03-28 14:01:56 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:01:56 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:01:56 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:01:56 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:01:56 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:01:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:01:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c0ec890>
2026-03-28 14:01:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:01:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:01:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:01:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5b546abb-9cfb-537e-b2ac-6d60a5514e55/5b546abb-9cfb-537e-b2ac-6d60a5514e55_image_7.jpg HTTP/1.1" 201 0
2026-03-28 14:01:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FYW64DGU%252F698928923%252F600') HTTP/1.1" 204 0
2026-03-28 14:01:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YW64DGU/698928923/600 saved to cache
2026-03-28 14:01:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 5b546abb-9cfb-537e-b2ac-6d60a5514e55
2026-03-28 14:01:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:01:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c0ec210>
2026-03-28 14:01:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:01:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:01:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:01:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3007384c-6a41-5ced-bc4c-10b628334249/3007384c-6a41-5ced-bc4c-10b628334249_image_1.jpg HTTP/1.1" 201 0
2026-03-28 14:01:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FFL59VTF%252F698069835%252F600') HTTP/1.1" 204 0
2026-03-28 14:01:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FL59VTF/698069835/600 saved to cache
2026-03-28 14:01:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 3007384c-6a41-5ced-bc4c-10b628334249
2026-03-28 14:01:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:01:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a1fea2450>
2026-03-28 14:01:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:01:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:01:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:01:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_60bcb64c-26b9-5747-8fc6-986efaa78996/60bcb64c-26b9-5747-8fc6-986efaa78996_image_3.jpg HTTP/1.1" 201 0
2026-03-28 14:01:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FVO62RAU%252F698928871%252F600') HTTP/1.1" 204 0
2026-03-28 14:01:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VO62RAU/698928871/600 saved to cache
2026-03-28 14:01:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 60bcb64c-26b9-5747-8fc6-986efaa78996
2026-03-28 14:01:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:01:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c67aa10>
2026-03-28 14:01:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:01:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:01:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:01:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_94badcac-d91d-5664-a6fe-32adc35ee01a/94badcac-d91d-5664-a6fe-32adc35ee01a_image_4.jpg HTTP/1.1" 201 0
2026-03-28 14:01:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FWM19BFN%252F698601845%252F600') HTTP/1.1" 204 0
2026-03-28 14:01:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WM19BFN/698601845/600 saved to cache
2026-03-28 14:01:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 94badcac-d91d-5664-a6fe-32adc35ee01a
2026-03-28 14:01:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:01:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a1fd63c10>
2026-03-28 14:01:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:01:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:01:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:01:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_755baf27-b55d-5033-a837-c4d9f3659c0e/755baf27-b55d-5033-a837-c4d9f3659c0e_image_5.jpg HTTP/1.1" 201 0
2026-03-28 14:01:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FEJ19URS%252F698294822%252F600') HTTP/1.1" 204 0
2026-03-28 14:01:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EJ19URS/698294822/600 saved to cache
2026-03-28 14:01:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 755baf27-b55d-5033-a837-c4d9f3659c0e
2026-03-28 14:01:56 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GU10UYN/698556242/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698556242>
2026-03-28 14:01:56 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WM19BFN/698601833/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698601833>
2026-03-28 14:01:56 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YD66KFF/698260482/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=YD66KFF-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-28 14:01:56 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SH14BOU/698522134/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698522134>
2026-03-28 14:01:56 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VK65XNW/697722930/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=VK65XNW-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-28 14:01:56 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YW64DGU/698928896/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698928896>
2026-03-28 14:01:56 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FL59VTF/698069826/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=FL59VTF-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-28 14:01:56 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BL16UUB/697704385/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=BL16UUB-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-28 14:01:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VO62RAU/698928851/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/VO62RAU/42809976?sv=2020-08-04&st=2026-03-28T14%3A01%3A26Z&se=2026-03-28T14%3A26%3A26Z&sr=b&sp=r&sig=ajraupx01hOhBxj83xq2SeA0U6vZ89qgzfl3QZ0K0u0%3D)
2026-03-28 14:01:56 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EJ19URS/698294807/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698294807>
2026-03-28 14:01:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SF65MRS/698522140/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/SF65MRS/42810141?sv=2020-08-04&st=2026-03-28T14%3A01%3A23Z&se=2026-03-28T14%3A26%3A23Z&sr=b&sp=r&sig=pKcKPXIMRDrpvR7qgfCAU8Cghh7jF%2FL25jpHeT9Gs0U%3D)
2026-03-28 14:01:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WA15XTF/697938708/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/WA15XTF/42809463?sv=2020-08-04&st=2026-03-28T14%3A01%3A23Z&se=2026-03-28T14%3A26%3A23Z&sr=b&sp=r&sig=OVT1XXFunRJjcV5jy5Zgfxxi5O1xAq2cfTX%2F%2FcIif88%3D)
2026-03-28 14:01:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FH21UNX/698923325/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/FH21UNX/42809938?sv=2020-08-04&st=2026-03-28T14%3A01%3A25Z&se=2026-03-28T14%3A26%3A25Z&sr=b&sp=r&sig=DX6Iqw0wYrgXXc1Kaaa%2FZcBpc9wYL%2BSdFRwB6BQgkeE%3D)
2026-03-28 14:01:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KO15JZW/698928877/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/KO15JZW/42809875?sv=2020-08-04&st=2026-03-28T14%3A01%3A23Z&se=2026-03-28T14%3A26%3A23Z&sr=b&sp=r&sig=WtTYXpKYofDjFDmXev3jjoySms%2BztrBA4DkuQ5Y14aQ%3D)
2026-03-28 14:01:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/KX09XPF/42809692?sv=2020-08-04&st=2026-03-28T14%3A01%3A54Z&se=2026-03-28T14%3A26%3A54Z&sr=b&sp=r&sig=UaaeKrI75EkebeSUIi7%2FvDct7K9AnHCAXaF4PIxxAA8%3D> (referer: https://www.bca.co.uk/)
2026-03-28 14:01:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VK65XNW/697722930/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/VK65XNW/42810265?sv=2020-08-04&st=2026-03-28T14%3A01%3A28Z&se=2026-03-28T14%3A26%3A28Z&sr=b&sp=r&sig=3QAAN%2BSB1OUMkxc4Xxtv%2BiBflOK5M03dTgEQ%2BLIgSi4%3D)
2026-03-28 14:01:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/MX22PPO/42810044?sv=2020-08-04&st=2026-03-28T14%3A01%3A54Z&se=2026-03-28T14%3A26%3A54Z&sr=b&sp=r&sig=cOivuK7Ij9PCIphPJcld%2BoxGcM6JagsRhi5zUF61PdA%3D> (referer: https://www.bca.co.uk/)
2026-03-28 14:01:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GU10UYN/698556242/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/GU10UYN/42810320?sv=2020-08-04&st=2026-03-28T14%3A01%3A23Z&se=2026-03-28T14%3A26%3A23Z&sr=b&sp=r&sig=mGNhX9MAfZVu5g6PpXH03XgVnNc%2FnLjEd8Y2gqIppCM%3D)
2026-03-28 14:01:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YD66KFF/698260482/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YD66KFF/42810264?sv=2020-08-04&st=2026-03-28T14%3A01%3A27Z&se=2026-03-28T14%3A26%3A27Z&sr=b&sp=r&sig=BnH67lWrH1ehlh0fvDCmlxB%2FgGDsNGQtDgFTgEjpoSk%3D)
2026-03-28 14:01:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WM19BFN/698601833/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/WM19BFN/42804238?sv=2020-08-04&st=2026-03-28T14%3A01%3A26Z&se=2026-03-28T14%3A26%3A26Z&sr=b&sp=r&sig=EfjfS2OdrtC4SA3uZ5XRiTu1xsVnQ9sqSYyb4MkUK3s%3D)
2026-03-28 14:01:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:01:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2d6adb90>
2026-03-28 14:01:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:01:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:01:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:01:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_60bcb64c-26b9-5747-8fc6-986efaa78996/60bcb64c-26b9-5747-8fc6-986efaa78996_image_2.jpg HTTP/1.1" 201 0
2026-03-28 14:01:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FVO62RAU%252F698928851%252F600') HTTP/1.1" 204 0
2026-03-28 14:01:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VO62RAU/698928851/600 saved to cache
2026-03-28 14:01:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 60bcb64c-26b9-5747-8fc6-986efaa78996
2026-03-28 14:01:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SH14BOU/698522134/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/SH14BOU/42810142?sv=2020-08-04&st=2026-03-28T14%3A01%3A23Z&se=2026-03-28T14%3A26%3A23Z&sr=b&sp=r&sig=qF%2Fj8vLm9uL8z4mTnCxa7QRX8NL1HO0if01okEQdE50%3D)
2026-03-28 14:01:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BL16UUB/697704385/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/BL16UUB/42810250?sv=2020-08-04&st=2026-03-28T14%3A01%3A27Z&se=2026-03-28T14%3A26%3A27Z&sr=b&sp=r&sig=SYmTiNujaXYF2XAoxTdHUcpF%2BqchRSrGUQy4u1jrdO0%3D)
2026-03-28 14:01:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FL59VTF/698069826/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/FL59VTF/42810253?sv=2020-08-04&st=2026-03-28T14%3A01%3A28Z&se=2026-03-28T14%3A26%3A28Z&sr=b&sp=r&sig=GoiG7mqbYuLGhcwWnmQ5IpnLjHLSnXkwhQvXnkkGwWI%3D)
2026-03-28 14:01:56 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KO15JZW/698928858/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698928858>
2026-03-28 14:01:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EJ19URS/698294807/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/EJ19URS/42798170?sv=2020-08-04&st=2026-03-28T14%3A01%3A25Z&se=2026-03-28T14%3A26%3A25Z&sr=b&sp=r&sig=rAxmzY9RDaFtqRrL9CfX2gFSW4Q22XPI9rfpZk%2B4AL4%3D)
2026-03-28 14:01:56 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FH21UNX/698923307/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698923307>
2026-03-28 14:01:56 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WA15XTF/697938692/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=697938692>
2026-03-28 14:01:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YW64DGU/698928896/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YW64DGU/42810194?sv=2020-08-04&st=2026-03-28T14%3A01%3A23Z&se=2026-03-28T14%3A26%3A23Z&sr=b&sp=r&sig=bKUUxkl%2FQOTN6xP3oKLYX53uOLW1seBVRfhSdF3FtAg%3D)
2026-03-28 14:01:56 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:01:56 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:01:56 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:01:56 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:01:56 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:01:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:01:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a1fe87c10>
2026-03-28 14:01:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:01:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:01:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:01:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_228041df-5797-5c8f-89c8-2a337a640ead/228041df-5797-5c8f-89c8-2a337a640ead_image_8.jpg HTTP/1.1" 201 0
2026-03-28 14:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FSF65MRS%252F698522140%252F600') HTTP/1.1" 204 0
2026-03-28 14:01:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SF65MRS/698522140/600 saved to cache
2026-03-28 14:01:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 228041df-5797-5c8f-89c8-2a337a640ead
2026-03-28 14:01:57 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:01:57 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:01:57 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:01:57 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:01:57 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:01:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:01:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2ca5c690>
2026-03-28 14:01:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:01:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:01:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:01:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_012921cb-8763-5e72-9bbe-1684326c9a1d/012921cb-8763-5e72-9bbe-1684326c9a1d_image_8.jpg HTTP/1.1" 201 0
2026-03-28 14:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FWA15XTF%252F697938708%252F600') HTTP/1.1" 204 0
2026-03-28 14:01:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WA15XTF/697938708/600 saved to cache
2026-03-28 14:01:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 012921cb-8763-5e72-9bbe-1684326c9a1d
2026-03-28 14:01:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:01:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2ca80c50>
2026-03-28 14:01:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:01:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:01:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:01:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a610f6fb-a046-5c2e-8701-0fcb295f97f1/a610f6fb-a046-5c2e-8701-0fcb295f97f1_image_5.jpg HTTP/1.1" 201 0
2026-03-28 14:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FFH21UNX%252F698923325%252F600') HTTP/1.1" 204 0
2026-03-28 14:01:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FH21UNX/698923325/600 saved to cache
2026-03-28 14:01:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item a610f6fb-a046-5c2e-8701-0fcb295f97f1
2026-03-28 14:01:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:01:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a1fd2c490>
2026-03-28 14:01:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:01:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:01:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:01:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7cdb5790-795c-503b-b01e-2ccf288a1773/7cdb5790-795c-503b-b01e-2ccf288a1773_image_5.jpg HTTP/1.1" 201 0
2026-03-28 14:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FKO15JZW%252F698928877%252F600') HTTP/1.1" 204 0
2026-03-28 14:01:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KO15JZW/698928877/600 saved to cache
2026-03-28 14:01:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 7cdb5790-795c-503b-b01e-2ccf288a1773
2026-03-28 14:01:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:01:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2ca82bd0>
2026-03-28 14:01:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:01:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:01:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:01:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_80521ed8-2cf2-526c-aee2-2d1012f8f649/80521ed8-2cf2-526c-aee2-2d1012f8f649_expert_report_file_7a21ce13-1f9e-4570-8896-015edddaa8fa.pdf HTTP/1.1" 201 0
2026-03-28 14:01:57 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item 80521ed8-2cf2-526c-aee2-2d1012f8f649
2026-03-28 14:01:57 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 80521ed8-2cf2-526c-aee2-2d1012f8f649, skipping ID generation
2026-03-28 14:01:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 80521ed8-2cf2-526c-aee2-2d1012f8f649
2026-03-28 14:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DKX09XPF-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-28 14:01:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=KX09XPF-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-28 14:01:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:01:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c115d90>
2026-03-28 14:01:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:01:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:01:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:01:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_defab1ac-857d-50f7-901c-50783b029725/defab1ac-857d-50f7-901c-50783b029725_image_0.jpg HTTP/1.1" 201 0
2026-03-28 14:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FVK65XNW%252F697722930%252F600') HTTP/1.1" 204 0
2026-03-28 14:01:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VK65XNW/697722930/600 saved to cache
2026-03-28 14:01:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item defab1ac-857d-50f7-901c-50783b029725
2026-03-28 14:01:57 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: defab1ac-857d-50f7-901c-50783b029725, skipping ID generation
2026-03-28 14:01:57 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item defab1ac-857d-50f7-901c-50783b029725 sending to next pipeline
2026-03-28 14:01:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: defab1ac-857d-50f7-901c-50783b029725, identifier: VK65%20XNW
2026-03-28 14:01:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:01:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a3186e110>
2026-03-28 14:01:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:01:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:01:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:01:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bbaf1f9b-e6a2-5ab9-9d30-d087740491cb/bbaf1f9b-e6a2-5ab9-9d30-d087740491cb_expert_report_file_f9df7ee1-184f-4f4a-8e35-90d2dae2e700.pdf HTTP/1.1" 201 0
2026-03-28 14:01:57 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item bbaf1f9b-e6a2-5ab9-9d30-d087740491cb
2026-03-28 14:01:57 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: bbaf1f9b-e6a2-5ab9-9d30-d087740491cb, skipping ID generation
2026-03-28 14:01:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item bbaf1f9b-e6a2-5ab9-9d30-d087740491cb
2026-03-28 14:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DMX22PPO-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-28 14:01:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=MX22PPO-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-28 14:01:57 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:01:57 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:01:57 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:01:57 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:01:57 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:01:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:01:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2d6863d0>
2026-03-28 14:01:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:01:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:01:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:01:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_24b3d1e2-9046-567a-ba39-2d683a6b4342/24b3d1e2-9046-567a-ba39-2d683a6b4342_image_9.jpg HTTP/1.1" 201 0
2026-03-28 14:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FGU10UYN%252F698556242%252F600') HTTP/1.1" 204 0
2026-03-28 14:01:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GU10UYN/698556242/600 saved to cache
2026-03-28 14:01:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 24b3d1e2-9046-567a-ba39-2d683a6b4342
2026-03-28 14:01:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:01:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a1fea1e90>
2026-03-28 14:01:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:01:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:01:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:01:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c163b1cf-cc62-5193-9026-6cea3a049e80/c163b1cf-cc62-5193-9026-6cea3a049e80_image_0.jpg HTTP/1.1" 201 0
2026-03-28 14:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FYD66KFF%252F698260482%252F600') HTTP/1.1" 204 0
2026-03-28 14:01:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YD66KFF/698260482/600 saved to cache
2026-03-28 14:01:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item c163b1cf-cc62-5193-9026-6cea3a049e80
2026-03-28 14:01:57 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: c163b1cf-cc62-5193-9026-6cea3a049e80, skipping ID generation
2026-03-28 14:01:57 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item c163b1cf-cc62-5193-9026-6cea3a049e80 sending to next pipeline
2026-03-28 14:01:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: c163b1cf-cc62-5193-9026-6cea3a049e80, identifier: YD66%20KFF
2026-03-28 14:01:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:01:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2d687f10>
2026-03-28 14:01:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:01:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:01:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:01:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_94badcac-d91d-5664-a6fe-32adc35ee01a/94badcac-d91d-5664-a6fe-32adc35ee01a_image_3.jpg HTTP/1.1" 201 0
2026-03-28 14:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FWM19BFN%252F698601833%252F600') HTTP/1.1" 204 0
2026-03-28 14:01:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WM19BFN/698601833/600 saved to cache
2026-03-28 14:01:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 94badcac-d91d-5664-a6fe-32adc35ee01a
2026-03-28 14:01:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: defab1ac-857d-50f7-901c-50783b029725 with identifier: VK65%20XNW
2026-03-28 14:01:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: defab1ac-857d-50f7-901c-50783b029725 with identifier: VK65%20XNW
2026-03-28 14:01:57 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: defab1ac-857d-50f7-901c-50783b029725 with identifier: VK65%20XNW to the API
2026-03-28 14:01:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:01:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:01:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VK65XNW/697722930/600>
{'auction_title': '',
'c_o_2_emission_value': 103,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_defab1ac-857d-50f7-901c-50783b029725/defab1ac-857d-50f7-901c-50783b029725_expert_report_file_cd80ac44-b49f-4617-a9f1-b17b5f21c81d.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=VK65%20XNW-GB',
'category': 'Car',
'color': 'black',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.5L',
'expiration_date': '2026-03-29T10:00:00Z',
'fuel_type': 'Diesel',
'id': 'defab1ac-857d-50f7-901c-50783b029725',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'VK65 XNW',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=VK65%20XNW&vehicleType=*',
'listing': 'auction',
'location': 'Newcastle-u-Tyne',
'make': 'NISSAN',
'model': 'QASHQAI',
'odometer': 89945,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 11,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_defab1ac-857d-50f7-901c-50783b029725/defab1ac-857d-50f7-901c-50783b029725_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 50914,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VK65XNW/697722930/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_defab1ac-857d-50f7-901c-50783b029725/defab1ac-857d-50f7-901c-50783b029725_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 46184,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VK65XNW/697722945/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_defab1ac-857d-50f7-901c-50783b029725/defab1ac-857d-50f7-901c-50783b029725_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 43779,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VK65XNW/697722953/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_defab1ac-857d-50f7-901c-50783b029725/defab1ac-857d-50f7-901c-50783b029725_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 45362,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VK65XNW/697722963/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_defab1ac-857d-50f7-901c-50783b029725/defab1ac-857d-50f7-901c-50783b029725_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 44474,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VK65XNW/697722974/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_defab1ac-857d-50f7-901c-50783b029725/defab1ac-857d-50f7-901c-50783b029725_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 42618,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VK65XNW/697722988/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_defab1ac-857d-50f7-901c-50783b029725/defab1ac-857d-50f7-901c-50783b029725_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 92708,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VK65XNW/697723008/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_defab1ac-857d-50f7-901c-50783b029725/defab1ac-857d-50f7-901c-50783b029725_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 84655,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VK65XNW/697723030/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_defab1ac-857d-50f7-901c-50783b029725/defab1ac-857d-50f7-901c-50783b029725_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 97651,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VK65XNW/697723054/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_defab1ac-857d-50f7-901c-50783b029725/defab1ac-857d-50f7-901c-50783b029725_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 90847,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VK65XNW/697723071/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-01-01',
'seller_name': None,
'title': 'NISSAN QASHQAI 1.5 DCI 110 TEKNA Hatchback',
'transmission': 'manual',
'trim': 'DCI 110 TEKNA',
'vin': 'SJNFAAJ11U1475045',
'year': 2015}
2026-03-28 14:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27VK65%2520XNW%27 HTTP/1.1" 200 None
2026-03-28 14:01:58 [bca.uk] INFO: Saving data for VK65%20XNW: {'created_time': 1774706518.187415, 'last_price_update_time': 1774706518.187426, 'auction_closing_time': 1774778400.0}
2026-03-28 14:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='VK65%2520XNW') HTTP/1.1" 204 0
2026-03-28 14:01:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: c163b1cf-cc62-5193-9026-6cea3a049e80 with identifier: YD66%20KFF
2026-03-28 14:01:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: c163b1cf-cc62-5193-9026-6cea3a049e80 with identifier: YD66%20KFF
2026-03-28 14:01:58 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: c163b1cf-cc62-5193-9026-6cea3a049e80 with identifier: YD66%20KFF to the API
2026-03-28 14:01:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:01:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:01:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YD66KFF/698260482/600>
{'auction_title': '',
'c_o_2_emission_value': 139,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c163b1cf-cc62-5193-9026-6cea3a049e80/c163b1cf-cc62-5193-9026-6cea3a049e80_expert_report_file_2cc0ef32-f39d-4efb-9795-79332d0ec6e9.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=YD66%20KFF-GB',
'category': 'Car',
'color': 'black',
'currency': 'GBP',
'doors_number': 5,
'engine': '2.0L',
'expiration_date': '2026-03-29T10:00:00Z',
'fuel_type': 'Diesel',
'id': 'c163b1cf-cc62-5193-9026-6cea3a049e80',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'YD66 KFF',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=YD66%20KFF&vehicleType=*',
'listing': 'auction',
'location': 'Newcastle-u-Tyne',
'make': 'LAND ROVER',
'model': 'DISCOVERY SPORT',
'odometer': 75361,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 11,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c163b1cf-cc62-5193-9026-6cea3a049e80/c163b1cf-cc62-5193-9026-6cea3a049e80_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 52036,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YD66KFF/698260482/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c163b1cf-cc62-5193-9026-6cea3a049e80/c163b1cf-cc62-5193-9026-6cea3a049e80_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 47619,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YD66KFF/698260485/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c163b1cf-cc62-5193-9026-6cea3a049e80/c163b1cf-cc62-5193-9026-6cea3a049e80_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 43438,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YD66KFF/698260488/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c163b1cf-cc62-5193-9026-6cea3a049e80/c163b1cf-cc62-5193-9026-6cea3a049e80_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 44068,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YD66KFF/698260492/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c163b1cf-cc62-5193-9026-6cea3a049e80/c163b1cf-cc62-5193-9026-6cea3a049e80_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 43692,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YD66KFF/698260498/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c163b1cf-cc62-5193-9026-6cea3a049e80/c163b1cf-cc62-5193-9026-6cea3a049e80_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 42691,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YD66KFF/698260508/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c163b1cf-cc62-5193-9026-6cea3a049e80/c163b1cf-cc62-5193-9026-6cea3a049e80_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 84504,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YD66KFF/698260519/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c163b1cf-cc62-5193-9026-6cea3a049e80/c163b1cf-cc62-5193-9026-6cea3a049e80_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 88855,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YD66KFF/698260528/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c163b1cf-cc62-5193-9026-6cea3a049e80/c163b1cf-cc62-5193-9026-6cea3a049e80_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 96183,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YD66KFF/698260535/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c163b1cf-cc62-5193-9026-6cea3a049e80/c163b1cf-cc62-5193-9026-6cea3a049e80_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 72938,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YD66KFF/698260541/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-01-01',
'seller_name': None,
'title': 'LAND ROVER DISCOVERY SPORT 2.0 TD4 180 HSE StationWagon',
'transmission': 'manual',
'trim': 'TD4 180 HSE',
'vin': 'SALCA2CN1HH642438',
'year': 2016}
2026-03-28 14:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YD66%2520KFF%27 HTTP/1.1" 200 None
2026-03-28 14:01:58 [bca.uk] INFO: Saving data for YD66%20KFF: {'created_time': 1774706518.595276, 'last_price_update_time': 1774706518.595288, 'auction_closing_time': 1774778400.0}
2026-03-28 14:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='YD66%2520KFF') HTTP/1.1" 204 0
2026-03-28 14:01:58 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VO62RAU/698928822/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698928822>
2026-03-28 14:01:58 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SH14BOU/698522122/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698522122>
2026-03-28 14:01:58 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SF65MRS/698522124/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698522124>
2026-03-28 14:01:58 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GU10UYN/698556226/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698556226>
2026-03-28 14:01:58 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WM19BFN/698601813/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698601813>
2026-03-28 14:01:58 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YW64DGU/698928863/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698928863>
2026-03-28 14:01:58 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/KY19EBR/42810442?sv=2020-08-04&st=2026-03-28T14%3A01%3A57Z&se=2026-03-28T14%3A26%3A57Z&sr=b&sp=r&sig=V0CcrjxWQQpRwhNxJ6%2BBHvhoFpY%2BzGdLjfaoEpq0%2BKM%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=KY19%20EBR-GB>
2026-03-28 14:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698920507%27 HTTP/1.1" 200 None
2026-03-28 14:01:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698920507 not downloaded yet
2026-03-28 14:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698132246%27 HTTP/1.1" 200 None
2026-03-28 14:01:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698132246 not downloaded yet
2026-03-28 14:01:58 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EJ19URS/698294798/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698294798>
2026-03-28 14:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698920513%27 HTTP/1.1" 200 None
2026-03-28 14:01:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698920513 not downloaded yet
2026-03-28 14:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698132253%27 HTTP/1.1" 200 None
2026-03-28 14:01:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698132253 not downloaded yet
2026-03-28 14:01:58 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:01:58 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:01:58 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:01:58 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:01:58 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:01:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:01:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2d6b5710>
2026-03-28 14:01:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:01:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:01:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:01:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7ca8ff92-ba13-58b4-8b9a-c74a2e2ed8c1/7ca8ff92-ba13-58b4-8b9a-c74a2e2ed8c1_image_9.jpg HTTP/1.1" 201 0
2026-03-28 14:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FSH14BOU%252F698522134%252F600') HTTP/1.1" 204 0
2026-03-28 14:01:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SH14BOU/698522134/600 saved to cache
2026-03-28 14:01:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 7ca8ff92-ba13-58b4-8b9a-c74a2e2ed8c1
2026-03-28 14:01:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:01:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c5dfad0>
2026-03-28 14:01:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:01:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:01:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:01:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fc54a12c-7c43-5241-baa9-136ed93039c1/fc54a12c-7c43-5241-baa9-136ed93039c1_image_0.jpg HTTP/1.1" 201 0
2026-03-28 14:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FBL16UUB%252F697704385%252F600') HTTP/1.1" 204 0
2026-03-28 14:01:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BL16UUB/697704385/600 saved to cache
2026-03-28 14:01:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item fc54a12c-7c43-5241-baa9-136ed93039c1
2026-03-28 14:01:58 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: fc54a12c-7c43-5241-baa9-136ed93039c1, skipping ID generation
2026-03-28 14:01:58 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item fc54a12c-7c43-5241-baa9-136ed93039c1 sending to next pipeline
2026-03-28 14:01:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: fc54a12c-7c43-5241-baa9-136ed93039c1, identifier: BL16%20UUB
2026-03-28 14:01:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:01:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2d687790>
2026-03-28 14:01:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:01:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:01:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:01:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3007384c-6a41-5ced-bc4c-10b628334249/3007384c-6a41-5ced-bc4c-10b628334249_image_0.jpg HTTP/1.1" 201 0
2026-03-28 14:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FFL59VTF%252F698069826%252F600') HTTP/1.1" 204 0
2026-03-28 14:01:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FL59VTF/698069826/600 saved to cache
2026-03-28 14:01:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 3007384c-6a41-5ced-bc4c-10b628334249
2026-03-28 14:01:58 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 3007384c-6a41-5ced-bc4c-10b628334249, skipping ID generation
2026-03-28 14:01:58 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 3007384c-6a41-5ced-bc4c-10b628334249 sending to next pipeline
2026-03-28 14:01:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 3007384c-6a41-5ced-bc4c-10b628334249, identifier: FL59%20VTF
2026-03-28 14:01:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:01:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2d95a5d0>
2026-03-28 14:01:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:01:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:01:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:01:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_755baf27-b55d-5033-a837-c4d9f3659c0e/755baf27-b55d-5033-a837-c4d9f3659c0e_image_4.jpg HTTP/1.1" 201 0
2026-03-28 14:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FEJ19URS%252F698294807%252F600') HTTP/1.1" 204 0
2026-03-28 14:01:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EJ19URS/698294807/600 saved to cache
2026-03-28 14:01:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 755baf27-b55d-5033-a837-c4d9f3659c0e
2026-03-28 14:01:59 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:01:59 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:01:59 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:01:59 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:01:59 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:01:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:01:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c9cb9d0>
2026-03-28 14:01:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:01:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:01:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:01:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5b546abb-9cfb-537e-b2ac-6d60a5514e55/5b546abb-9cfb-537e-b2ac-6d60a5514e55_image_6.jpg HTTP/1.1" 201 0
2026-03-28 14:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FYW64DGU%252F698928896%252F600') HTTP/1.1" 204 0
2026-03-28 14:01:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YW64DGU/698928896/600 saved to cache
2026-03-28 14:01:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 5b546abb-9cfb-537e-b2ac-6d60a5514e55
2026-03-28 14:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698920520%27 HTTP/1.1" 200 None
2026-03-28 14:01:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698920520 not downloaded yet
2026-03-28 14:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698132257%27 HTTP/1.1" 200 None
2026-03-28 14:01:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698132257 not downloaded yet
2026-03-28 14:01:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: fc54a12c-7c43-5241-baa9-136ed93039c1 with identifier: BL16%20UUB
2026-03-28 14:01:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: fc54a12c-7c43-5241-baa9-136ed93039c1 with identifier: BL16%20UUB
2026-03-28 14:01:59 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: fc54a12c-7c43-5241-baa9-136ed93039c1 with identifier: BL16%20UUB to the API
2026-03-28 14:01:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:01:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:01:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BL16UUB/697704385/600>
{'auction_title': '',
'c_o_2_emission_value': 158,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fc54a12c-7c43-5241-baa9-136ed93039c1/fc54a12c-7c43-5241-baa9-136ed93039c1_expert_report_file_74b1d75c-d10c-4ebd-9a04-31857dbce3db.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=BL16%20UUB-GB',
'category': 'Car',
'color': 'white',
'currency': 'GBP',
'doors_number': 5,
'engine': '3.0L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Diesel',
'id': 'fc54a12c-7c43-5241-baa9-136ed93039c1',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'BL16 UUB',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=BL16%20UUB&vehicleType=*',
'listing': 'auction',
'location': 'Newcastle-u-Tyne',
'make': 'BMW',
'model': 'X5',
'odometer': 110091,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 11,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fc54a12c-7c43-5241-baa9-136ed93039c1/fc54a12c-7c43-5241-baa9-136ed93039c1_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 44161,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BL16UUB/697704385/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fc54a12c-7c43-5241-baa9-136ed93039c1/fc54a12c-7c43-5241-baa9-136ed93039c1_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 43536,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BL16UUB/697704387/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fc54a12c-7c43-5241-baa9-136ed93039c1/fc54a12c-7c43-5241-baa9-136ed93039c1_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 44197,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BL16UUB/697704392/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fc54a12c-7c43-5241-baa9-136ed93039c1/fc54a12c-7c43-5241-baa9-136ed93039c1_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 44919,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BL16UUB/697704395/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fc54a12c-7c43-5241-baa9-136ed93039c1/fc54a12c-7c43-5241-baa9-136ed93039c1_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 42009,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BL16UUB/697704398/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fc54a12c-7c43-5241-baa9-136ed93039c1/fc54a12c-7c43-5241-baa9-136ed93039c1_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 40550,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BL16UUB/697704402/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fc54a12c-7c43-5241-baa9-136ed93039c1/fc54a12c-7c43-5241-baa9-136ed93039c1_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 72885,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BL16UUB/697704406/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fc54a12c-7c43-5241-baa9-136ed93039c1/fc54a12c-7c43-5241-baa9-136ed93039c1_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 73304,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BL16UUB/697704410/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fc54a12c-7c43-5241-baa9-136ed93039c1/fc54a12c-7c43-5241-baa9-136ed93039c1_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 86246,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BL16UUB/697704417/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fc54a12c-7c43-5241-baa9-136ed93039c1/fc54a12c-7c43-5241-baa9-136ed93039c1_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 82416,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BL16UUB/697704426/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-01-01',
'seller_name': None,
'title': 'BMW X5 3.0 XDRIVE 30D M SPORT StationWagon',
'transmission': 'manual',
'trim': 'XDRIVE 30D M SPORT',
'vin': 'WBAKS420700J58940',
'year': 2016}
2026-03-28 14:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BL16%2520UUB%27 HTTP/1.1" 200 None
2026-03-28 14:01:59 [bca.uk] INFO: Saving data for BL16%20UUB: {'created_time': 1774706519.549883, 'last_price_update_time': 1774706519.549893, 'auction_closing_time': 1774864800.0}
2026-03-28 14:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='BL16%2520UUB') HTTP/1.1" 204 0
2026-03-28 14:01:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 3007384c-6a41-5ced-bc4c-10b628334249 with identifier: FL59%20VTF
2026-03-28 14:01:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 3007384c-6a41-5ced-bc4c-10b628334249 with identifier: FL59%20VTF
2026-03-28 14:01:59 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 3007384c-6a41-5ced-bc4c-10b628334249 with identifier: FL59%20VTF to the API
2026-03-28 14:01:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:01:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:01:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FL59VTF/698069826/600>
{'auction_title': '',
'c_o_2_emission_value': 224,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3007384c-6a41-5ced-bc4c-10b628334249/3007384c-6a41-5ced-bc4c-10b628334249_expert_report_file_448ac4b8-86d8-401c-b75e-a61d0c753ef8.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=FL59%20VTF-GB',
'category': 'Car',
'color': 'white',
'currency': 'GBP',
'doors_number': 5,
'engine': '3.0L',
'expiration_date': '2026-03-31T10:00:00Z',
'fuel_type': 'Petrol',
'id': '3007384c-6a41-5ced-bc4c-10b628334249',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'FL59 VTF',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=FL59%20VTF&vehicleType=*',
'listing': 'auction',
'location': 'Newcastle-u-Tyne',
'make': 'AUDI',
'model': 'S4 AVANT',
'odometer': 64451,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 11,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3007384c-6a41-5ced-bc4c-10b628334249/3007384c-6a41-5ced-bc4c-10b628334249_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 46116,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FL59VTF/698069826/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3007384c-6a41-5ced-bc4c-10b628334249/3007384c-6a41-5ced-bc4c-10b628334249_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 45009,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FL59VTF/698069835/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3007384c-6a41-5ced-bc4c-10b628334249/3007384c-6a41-5ced-bc4c-10b628334249_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 43911,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FL59VTF/698069840/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3007384c-6a41-5ced-bc4c-10b628334249/3007384c-6a41-5ced-bc4c-10b628334249_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 44661,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FL59VTF/698069847/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3007384c-6a41-5ced-bc4c-10b628334249/3007384c-6a41-5ced-bc4c-10b628334249_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 42458,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FL59VTF/698069856/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3007384c-6a41-5ced-bc4c-10b628334249/3007384c-6a41-5ced-bc4c-10b628334249_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 42061,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FL59VTF/698069861/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3007384c-6a41-5ced-bc4c-10b628334249/3007384c-6a41-5ced-bc4c-10b628334249_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 85021,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FL59VTF/698069876/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3007384c-6a41-5ced-bc4c-10b628334249/3007384c-6a41-5ced-bc4c-10b628334249_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 67145,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FL59VTF/698069889/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3007384c-6a41-5ced-bc4c-10b628334249/3007384c-6a41-5ced-bc4c-10b628334249_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 75922,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FL59VTF/698069908/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3007384c-6a41-5ced-bc4c-10b628334249/3007384c-6a41-5ced-bc4c-10b628334249_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 71240,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FL59VTF/698069914/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2009-01-01',
'seller_name': None,
'title': 'AUDI S4 AVANT 3.0 TFSI 333 QUATTRO S-T Estate',
'transmission': 'automatic',
'trim': 'TFSI 333 QUATTRO S-T',
'vin': 'WAUZZZ8K8AA046644',
'year': 2009}
2026-03-28 14:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FL59%2520VTF%27 HTTP/1.1" 200 None
2026-03-28 14:01:59 [bca.uk] INFO: Saving data for FL59%20VTF: {'created_time': 1774706519.99517, 'last_price_update_time': 1774706519.995181, 'auction_closing_time': 1774951200.0}
2026-03-28 14:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='FL59%2520VTF') HTTP/1.1" 204 0
2026-03-28 14:02:00 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WA15XTF/697938675/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=697938675>
2026-03-28 14:02:00 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SF65MRS/698522114/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698522114>
2026-03-28 14:02:00 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FH21UNX/698923287/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698923287>
2026-03-28 14:02:00 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KO15JZW/698928836/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698928836>
2026-03-28 14:02:00 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SB65CAX/697544407/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=697544407>
2026-03-28 14:02:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FH21UNX/698923307/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/FH21UNX/42809938?sv=2020-08-04&st=2026-03-28T14%3A01%3A25Z&se=2026-03-28T14%3A26%3A25Z&sr=b&sp=r&sig=DX6Iqw0wYrgXXc1Kaaa%2FZcBpc9wYL%2BSdFRwB6BQgkeE%3D)
2026-03-28 14:02:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KO15JZW/698928858/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/KO15JZW/42809875?sv=2020-08-04&st=2026-03-28T14%3A01%3A23Z&se=2026-03-28T14%3A26%3A23Z&sr=b&sp=r&sig=WtTYXpKYofDjFDmXev3jjoySms%2BztrBA4DkuQ5Y14aQ%3D)
2026-03-28 14:02:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WA15XTF/697938692/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/WA15XTF/42809463?sv=2020-08-04&st=2026-03-28T14%3A01%3A23Z&se=2026-03-28T14%3A26%3A23Z&sr=b&sp=r&sig=OVT1XXFunRJjcV5jy5Zgfxxi5O1xAq2cfTX%2F%2FcIif88%3D)
2026-03-28 14:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698920526%27 HTTP/1.1" 200 None
2026-03-28 14:02:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698920526 not downloaded yet
2026-03-28 14:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698132261%27 HTTP/1.1" 200 None
2026-03-28 14:02:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698132261 not downloaded yet
2026-03-28 14:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698920534%27 HTTP/1.1" 200 None
2026-03-28 14:02:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698920534 not downloaded yet
2026-03-28 14:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698132265%27 HTTP/1.1" 200 None
2026-03-28 14:02:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698132265 not downloaded yet
2026-03-28 14:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698920542%27 HTTP/1.1" 200 None
2026-03-28 14:02:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698920542 not downloaded yet
2026-03-28 14:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698132275%27 HTTP/1.1" 200 None
2026-03-28 14:02:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698132275 not downloaded yet
2026-03-28 14:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698920552%27 HTTP/1.1" 200 None
2026-03-28 14:02:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698920552 not downloaded yet
2026-03-28 14:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698132285%27 HTTP/1.1" 200 None
2026-03-28 14:02:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698132285 not downloaded yet
2026-03-28 14:02:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:02:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c6918d0>
2026-03-28 14:02:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:02:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:02:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:02:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a610f6fb-a046-5c2e-8701-0fcb295f97f1/a610f6fb-a046-5c2e-8701-0fcb295f97f1_image_4.jpg HTTP/1.1" 201 0
2026-03-28 14:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FFH21UNX%252F698923307%252F600') HTTP/1.1" 204 0
2026-03-28 14:02:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FH21UNX/698923307/600 saved to cache
2026-03-28 14:02:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item a610f6fb-a046-5c2e-8701-0fcb295f97f1
2026-03-28 14:02:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:02:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a1ff176d0>
2026-03-28 14:02:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:02:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:02:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:02:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7cdb5790-795c-503b-b01e-2ccf288a1773/7cdb5790-795c-503b-b01e-2ccf288a1773_image_4.jpg HTTP/1.1" 201 0
2026-03-28 14:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FKO15JZW%252F698928858%252F600') HTTP/1.1" 204 0
2026-03-28 14:02:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KO15JZW/698928858/600 saved to cache
2026-03-28 14:02:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 7cdb5790-795c-503b-b01e-2ccf288a1773
2026-03-28 14:02:00 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:02:00 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:02:00 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:02:00 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:02:00 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:02:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:02:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c99d9d0>
2026-03-28 14:02:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:02:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:02:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:02:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_012921cb-8763-5e72-9bbe-1684326c9a1d/012921cb-8763-5e72-9bbe-1684326c9a1d_image_7.jpg HTTP/1.1" 201 0
2026-03-28 14:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FWA15XTF%252F697938692%252F600') HTTP/1.1" 204 0
2026-03-28 14:02:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WA15XTF/697938692/600 saved to cache
2026-03-28 14:02:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 012921cb-8763-5e72-9bbe-1684326c9a1d
2026-03-28 14:02:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WM19BFN/698601813/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/WM19BFN/42804238?sv=2020-08-04&st=2026-03-28T14%3A01%3A26Z&se=2026-03-28T14%3A26%3A26Z&sr=b&sp=r&sig=EfjfS2OdrtC4SA3uZ5XRiTu1xsVnQ9sqSYyb4MkUK3s%3D)
2026-03-28 14:02:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GU10UYN/698556226/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/GU10UYN/42810320?sv=2020-08-04&st=2026-03-28T14%3A01%3A23Z&se=2026-03-28T14%3A26%3A23Z&sr=b&sp=r&sig=mGNhX9MAfZVu5g6PpXH03XgVnNc%2FnLjEd8Y2gqIppCM%3D)
2026-03-28 14:02:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SF65MRS/698522124/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/SF65MRS/42810141?sv=2020-08-04&st=2026-03-28T14%3A01%3A23Z&se=2026-03-28T14%3A26%3A23Z&sr=b&sp=r&sig=pKcKPXIMRDrpvR7qgfCAU8Cghh7jF%2FL25jpHeT9Gs0U%3D)
2026-03-28 14:02:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SH14BOU/698522122/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/SH14BOU/42810142?sv=2020-08-04&st=2026-03-28T14%3A01%3A23Z&se=2026-03-28T14%3A26%3A23Z&sr=b&sp=r&sig=qF%2Fj8vLm9uL8z4mTnCxa7QRX8NL1HO0if01okEQdE50%3D)
2026-03-28 14:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698920564%27 HTTP/1.1" 200 None
2026-03-28 14:02:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698920564 not downloaded yet
2026-03-28 14:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698132294%27 HTTP/1.1" 200 None
2026-03-28 14:02:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698132294 not downloaded yet
2026-03-28 14:02:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VO62RAU/698928822/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/VO62RAU/42809976?sv=2020-08-04&st=2026-03-28T14%3A01%3A26Z&se=2026-03-28T14%3A26%3A26Z&sr=b&sp=r&sig=ajraupx01hOhBxj83xq2SeA0U6vZ89qgzfl3QZ0K0u0%3D)
2026-03-28 14:02:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EJ19URS/698294798/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/EJ19URS/42798170?sv=2020-08-04&st=2026-03-28T14%3A01%3A25Z&se=2026-03-28T14%3A26%3A25Z&sr=b&sp=r&sig=rAxmzY9RDaFtqRrL9CfX2gFSW4Q22XPI9rfpZk%2B4AL4%3D)
2026-03-28 14:02:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YW64DGU/698928863/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YW64DGU/42810194?sv=2020-08-04&st=2026-03-28T14%3A01%3A23Z&se=2026-03-28T14%3A26%3A23Z&sr=b&sp=r&sig=bKUUxkl%2FQOTN6xP3oKLYX53uOLW1seBVRfhSdF3FtAg%3D)
2026-03-28 14:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698920575%27 HTTP/1.1" 200 None
2026-03-28 14:02:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698920575 not downloaded yet
2026-03-28 14:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698132309%27 HTTP/1.1" 200 None
2026-03-28 14:02:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698132309 not downloaded yet
2026-03-28 14:02:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/KY19EBR/42810442?sv=2020-08-04&st=2026-03-28T14%3A01%3A57Z&se=2026-03-28T14%3A26%3A57Z&sr=b&sp=r&sig=V0CcrjxWQQpRwhNxJ6%2BBHvhoFpY%2BzGdLjfaoEpq0%2BKM%3D> (referer: https://www.bca.co.uk/)
2026-03-28 14:02:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:02:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a1ff17090>
2026-03-28 14:02:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:02:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:02:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:02:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_94badcac-d91d-5664-a6fe-32adc35ee01a/94badcac-d91d-5664-a6fe-32adc35ee01a_image_2.jpg HTTP/1.1" 201 0
2026-03-28 14:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FWM19BFN%252F698601813%252F600') HTTP/1.1" 204 0
2026-03-28 14:02:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WM19BFN/698601813/600 saved to cache
2026-03-28 14:02:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 94badcac-d91d-5664-a6fe-32adc35ee01a
2026-03-28 14:02:00 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:02:00 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:02:00 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:02:00 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:02:00 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:02:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:02:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c99c190>
2026-03-28 14:02:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:02:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:02:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:02:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_24b3d1e2-9046-567a-ba39-2d683a6b4342/24b3d1e2-9046-567a-ba39-2d683a6b4342_image_8.jpg HTTP/1.1" 201 0
2026-03-28 14:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FGU10UYN%252F698556226%252F600') HTTP/1.1" 204 0
2026-03-28 14:02:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GU10UYN/698556226/600 saved to cache
2026-03-28 14:02:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 24b3d1e2-9046-567a-ba39-2d683a6b4342
2026-03-28 14:02:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SF65MRS/698522114/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/SF65MRS/42810141?sv=2020-08-04&st=2026-03-28T14%3A01%3A23Z&se=2026-03-28T14%3A26%3A23Z&sr=b&sp=r&sig=pKcKPXIMRDrpvR7qgfCAU8Cghh7jF%2FL25jpHeT9Gs0U%3D)
2026-03-28 14:02:00 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MX22PPO/698132257/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698132257>
2026-03-28 14:02:00 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KX09XPF/698920520/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698920520>
2026-03-28 14:02:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FH21UNX/698923287/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/FH21UNX/42809938?sv=2020-08-04&st=2026-03-28T14%3A01%3A25Z&se=2026-03-28T14%3A26%3A25Z&sr=b&sp=r&sig=DX6Iqw0wYrgXXc1Kaaa%2FZcBpc9wYL%2BSdFRwB6BQgkeE%3D)
2026-03-28 14:02:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KO15JZW/698928836/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/KO15JZW/42809875?sv=2020-08-04&st=2026-03-28T14%3A01%3A23Z&se=2026-03-28T14%3A26%3A23Z&sr=b&sp=r&sig=WtTYXpKYofDjFDmXev3jjoySms%2BztrBA4DkuQ5Y14aQ%3D)
2026-03-28 14:02:00 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MX22PPO/698132253/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698132253>
2026-03-28 14:02:00 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:02:00 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:02:00 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:02:00 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:02:00 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:02:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:02:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c891790>
2026-03-28 14:02:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:02:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:02:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:02:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_228041df-5797-5c8f-89c8-2a337a640ead/228041df-5797-5c8f-89c8-2a337a640ead_image_7.jpg HTTP/1.1" 201 0
2026-03-28 14:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FSF65MRS%252F698522124%252F600') HTTP/1.1" 204 0
2026-03-28 14:02:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SF65MRS/698522124/600 saved to cache
2026-03-28 14:02:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 228041df-5797-5c8f-89c8-2a337a640ead
2026-03-28 14:02:00 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:02:00 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:02:00 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:02:00 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:02:00 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:02:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:02:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c681f10>
2026-03-28 14:02:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:02:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:02:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:02:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7ca8ff92-ba13-58b4-8b9a-c74a2e2ed8c1/7ca8ff92-ba13-58b4-8b9a-c74a2e2ed8c1_image_8.jpg HTTP/1.1" 201 0
2026-03-28 14:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FSH14BOU%252F698522122%252F600') HTTP/1.1" 204 0
2026-03-28 14:02:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SH14BOU/698522122/600 saved to cache
2026-03-28 14:02:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 7ca8ff92-ba13-58b4-8b9a-c74a2e2ed8c1
2026-03-28 14:02:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SB65CAX/697544407/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/SB65CAX/42810123?sv=2020-08-04&st=2026-03-28T14%3A01%3A23Z&se=2026-03-28T14%3A26%3A23Z&sr=b&sp=r&sig=vTzzhGIuSP84%2BuZVufy4vR0mq7%2F9VRE2bdnD30Ub%2FBU%3D)
2026-03-28 14:02:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WA15XTF/697938675/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/WA15XTF/42809463?sv=2020-08-04&st=2026-03-28T14%3A01%3A23Z&se=2026-03-28T14%3A26%3A23Z&sr=b&sp=r&sig=OVT1XXFunRJjcV5jy5Zgfxxi5O1xAq2cfTX%2F%2FcIif88%3D)
2026-03-28 14:02:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:02:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a1fd722d0>
2026-03-28 14:02:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:02:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:02:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:02:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_60bcb64c-26b9-5747-8fc6-986efaa78996/60bcb64c-26b9-5747-8fc6-986efaa78996_image_1.jpg HTTP/1.1" 201 0
2026-03-28 14:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FVO62RAU%252F698928822%252F600') HTTP/1.1" 204 0
2026-03-28 14:02:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VO62RAU/698928822/600 saved to cache
2026-03-28 14:02:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 60bcb64c-26b9-5747-8fc6-986efaa78996
2026-03-28 14:02:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:02:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2d735c50>
2026-03-28 14:02:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:02:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:02:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:02:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_755baf27-b55d-5033-a837-c4d9f3659c0e/755baf27-b55d-5033-a837-c4d9f3659c0e_image_3.jpg HTTP/1.1" 201 0
2026-03-28 14:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FEJ19URS%252F698294798%252F600') HTTP/1.1" 204 0
2026-03-28 14:02:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EJ19URS/698294798/600 saved to cache
2026-03-28 14:02:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 755baf27-b55d-5033-a837-c4d9f3659c0e
2026-03-28 14:02:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:02:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c504650>
2026-03-28 14:02:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:02:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:02:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:02:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5b546abb-9cfb-537e-b2ac-6d60a5514e55/5b546abb-9cfb-537e-b2ac-6d60a5514e55_image_5.jpg HTTP/1.1" 201 0
2026-03-28 14:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FYW64DGU%252F698928863%252F600') HTTP/1.1" 204 0
2026-03-28 14:02:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YW64DGU/698928863/600 saved to cache
2026-03-28 14:02:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 5b546abb-9cfb-537e-b2ac-6d60a5514e55
2026-03-28 14:02:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:02:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c507490>
2026-03-28 14:02:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:02:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:02:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:02:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3937afb9-0d72-5b2f-b51e-2f8c60821b71/3937afb9-0d72-5b2f-b51e-2f8c60821b71_expert_report_file_e65ffc49-1a82-428a-bc13-06cb779587e6.pdf HTTP/1.1" 201 0
2026-03-28 14:02:00 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item 3937afb9-0d72-5b2f-b51e-2f8c60821b71
2026-03-28 14:02:00 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 3937afb9-0d72-5b2f-b51e-2f8c60821b71, skipping ID generation
2026-03-28 14:02:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 3937afb9-0d72-5b2f-b51e-2f8c60821b71
2026-03-28 14:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DKY19EBR-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-28 14:02:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=KY19EBR-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-28 14:02:00 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KX09XPF/698920552/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698920552>
2026-03-28 14:02:00 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KX09XPF/698920542/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698920542>
2026-03-28 14:02:00 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MX22PPO/698132275/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698132275>
2026-03-28 14:02:00 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MX22PPO/698132261/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698132261>
2026-03-28 14:02:00 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MX22PPO/698132265/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698132265>
2026-03-28 14:02:00 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KX09XPF/698920534/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698920534>
2026-03-28 14:02:00 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MX22PPO/698132285/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698132285>
2026-03-28 14:02:00 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MX22PPO/698132309/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698132309>
2026-03-28 14:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698938671%27 HTTP/1.1" 200 None
2026-03-28 14:02:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698938671 not downloaded yet
2026-03-28 14:02:00 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:02:00 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:02:00 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:02:00 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:02:00 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:02:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:02:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c646250>
2026-03-28 14:02:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:02:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:02:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:02:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_228041df-5797-5c8f-89c8-2a337a640ead/228041df-5797-5c8f-89c8-2a337a640ead_image_6.jpg HTTP/1.1" 201 0
2026-03-28 14:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FSF65MRS%252F698522114%252F600') HTTP/1.1" 204 0
2026-03-28 14:02:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SF65MRS/698522114/600 saved to cache
2026-03-28 14:02:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 228041df-5797-5c8f-89c8-2a337a640ead
2026-03-28 14:02:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:02:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c503710>
2026-03-28 14:02:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:02:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:02:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:02:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a610f6fb-a046-5c2e-8701-0fcb295f97f1/a610f6fb-a046-5c2e-8701-0fcb295f97f1_image_3.jpg HTTP/1.1" 201 0
2026-03-28 14:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FFH21UNX%252F698923287%252F600') HTTP/1.1" 204 0
2026-03-28 14:02:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FH21UNX/698923287/600 saved to cache
2026-03-28 14:02:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item a610f6fb-a046-5c2e-8701-0fcb295f97f1
2026-03-28 14:02:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:02:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2d99e810>
2026-03-28 14:02:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:02:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:02:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:02:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7cdb5790-795c-503b-b01e-2ccf288a1773/7cdb5790-795c-503b-b01e-2ccf288a1773_image_3.jpg HTTP/1.1" 201 0
2026-03-28 14:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FKO15JZW%252F698928836%252F600') HTTP/1.1" 204 0
2026-03-28 14:02:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KO15JZW/698928836/600 saved to cache
2026-03-28 14:02:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 7cdb5790-795c-503b-b01e-2ccf288a1773
2026-03-28 14:02:01 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:02:01 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:02:01 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:02:01 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:02:01 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:02:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:02:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c5faa10>
2026-03-28 14:02:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:02:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:02:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:02:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_05412951-b5cb-5847-b7df-8f166615ed23/05412951-b5cb-5847-b7df-8f166615ed23_image_9.jpg HTTP/1.1" 201 0
2026-03-28 14:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FSB65CAX%252F697544407%252F600') HTTP/1.1" 204 0
2026-03-28 14:02:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SB65CAX/697544407/600 saved to cache
2026-03-28 14:02:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 05412951-b5cb-5847-b7df-8f166615ed23
2026-03-28 14:02:01 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:02:01 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:02:01 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:02:01 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:02:01 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:02:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:02:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a30eb50d0>
2026-03-28 14:02:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:02:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:02:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:02:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_012921cb-8763-5e72-9bbe-1684326c9a1d/012921cb-8763-5e72-9bbe-1684326c9a1d_image_6.jpg HTTP/1.1" 201 0
2026-03-28 14:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FWA15XTF%252F697938675%252F600') HTTP/1.1" 204 0
2026-03-28 14:02:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WA15XTF/697938675/600 saved to cache
2026-03-28 14:02:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 012921cb-8763-5e72-9bbe-1684326c9a1d
2026-03-28 14:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698938678%27 HTTP/1.1" 200 None
2026-03-28 14:02:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698938678 not downloaded yet
2026-03-28 14:02:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MX22PPO/698132253/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/MX22PPO/42810044?sv=2020-08-04&st=2026-03-28T14%3A01%3A54Z&se=2026-03-28T14%3A26%3A54Z&sr=b&sp=r&sig=cOivuK7Ij9PCIphPJcld%2BoxGcM6JagsRhi5zUF61PdA%3D)
2026-03-28 14:02:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MX22PPO/698132257/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/MX22PPO/42810044?sv=2020-08-04&st=2026-03-28T14%3A01%3A54Z&se=2026-03-28T14%3A26%3A54Z&sr=b&sp=r&sig=cOivuK7Ij9PCIphPJcld%2BoxGcM6JagsRhi5zUF61PdA%3D)
2026-03-28 14:02:01 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KX09XPF/698920526/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698920526>
2026-03-28 14:02:01 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KX09XPF/698920564/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698920564>
2026-03-28 14:02:01 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KX09XPF/698920513/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698920513>
2026-03-28 14:02:01 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KX09XPF/698920575/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698920575>
2026-03-28 14:02:01 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MX22PPO/698132294/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698132294>
2026-03-28 14:02:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KX09XPF/698920520/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/KX09XPF/42809692?sv=2020-08-04&st=2026-03-28T14%3A01%3A54Z&se=2026-03-28T14%3A26%3A54Z&sr=b&sp=r&sig=UaaeKrI75EkebeSUIi7%2FvDct7K9AnHCAXaF4PIxxAA8%3D)
2026-03-28 14:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698938687%27 HTTP/1.1" 200 None
2026-03-28 14:02:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698938687 not downloaded yet
2026-03-28 14:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698938697%27 HTTP/1.1" 200 None
2026-03-28 14:02:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698938697 not downloaded yet
2026-03-28 14:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698938703%27 HTTP/1.1" 200 None
2026-03-28 14:02:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698938703 not downloaded yet
2026-03-28 14:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698938716%27 HTTP/1.1" 200 None
2026-03-28 14:02:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698938716 not downloaded yet
2026-03-28 14:02:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MX22PPO/698132275/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/MX22PPO/42810044?sv=2020-08-04&st=2026-03-28T14%3A01%3A54Z&se=2026-03-28T14%3A26%3A54Z&sr=b&sp=r&sig=cOivuK7Ij9PCIphPJcld%2BoxGcM6JagsRhi5zUF61PdA%3D)
2026-03-28 14:02:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MX22PPO/698132261/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/MX22PPO/42810044?sv=2020-08-04&st=2026-03-28T14%3A01%3A54Z&se=2026-03-28T14%3A26%3A54Z&sr=b&sp=r&sig=cOivuK7Ij9PCIphPJcld%2BoxGcM6JagsRhi5zUF61PdA%3D)
2026-03-28 14:02:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MX22PPO/698132265/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/MX22PPO/42810044?sv=2020-08-04&st=2026-03-28T14%3A01%3A54Z&se=2026-03-28T14%3A26%3A54Z&sr=b&sp=r&sig=cOivuK7Ij9PCIphPJcld%2BoxGcM6JagsRhi5zUF61PdA%3D)
2026-03-28 14:02:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MX22PPO/698132285/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/MX22PPO/42810044?sv=2020-08-04&st=2026-03-28T14%3A01%3A54Z&se=2026-03-28T14%3A26%3A54Z&sr=b&sp=r&sig=cOivuK7Ij9PCIphPJcld%2BoxGcM6JagsRhi5zUF61PdA%3D)
2026-03-28 14:02:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MX22PPO/698132309/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/MX22PPO/42810044?sv=2020-08-04&st=2026-03-28T14%3A01%3A54Z&se=2026-03-28T14%3A26%3A54Z&sr=b&sp=r&sig=cOivuK7Ij9PCIphPJcld%2BoxGcM6JagsRhi5zUF61PdA%3D)
2026-03-28 14:02:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KX09XPF/698920534/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/KX09XPF/42809692?sv=2020-08-04&st=2026-03-28T14%3A01%3A54Z&se=2026-03-28T14%3A26%3A54Z&sr=b&sp=r&sig=UaaeKrI75EkebeSUIi7%2FvDct7K9AnHCAXaF4PIxxAA8%3D)
2026-03-28 14:02:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KX09XPF/698920542/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/KX09XPF/42809692?sv=2020-08-04&st=2026-03-28T14%3A01%3A54Z&se=2026-03-28T14%3A26%3A54Z&sr=b&sp=r&sig=UaaeKrI75EkebeSUIi7%2FvDct7K9AnHCAXaF4PIxxAA8%3D)
2026-03-28 14:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698938732%27 HTTP/1.1" 200 None
2026-03-28 14:02:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698938732 not downloaded yet
2026-03-28 14:02:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:02:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c0fecd0>
2026-03-28 14:02:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:02:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:02:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:02:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bbaf1f9b-e6a2-5ab9-9d30-d087740491cb/bbaf1f9b-e6a2-5ab9-9d30-d087740491cb_image_2.jpg HTTP/1.1" 201 0
2026-03-28 14:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FMX22PPO%252F698132253%252F600') HTTP/1.1" 204 0
2026-03-28 14:02:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MX22PPO/698132253/600 saved to cache
2026-03-28 14:02:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item bbaf1f9b-e6a2-5ab9-9d30-d087740491cb
2026-03-28 14:02:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:02:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2d7347d0>
2026-03-28 14:02:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:02:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:02:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:02:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bbaf1f9b-e6a2-5ab9-9d30-d087740491cb/bbaf1f9b-e6a2-5ab9-9d30-d087740491cb_image_3.jpg HTTP/1.1" 201 0
2026-03-28 14:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FMX22PPO%252F698132257%252F600') HTTP/1.1" 204 0
2026-03-28 14:02:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MX22PPO/698132257/600 saved to cache
2026-03-28 14:02:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item bbaf1f9b-e6a2-5ab9-9d30-d087740491cb
2026-03-28 14:02:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:02:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c171fd0>
2026-03-28 14:02:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:02:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:02:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:02:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_80521ed8-2cf2-526c-aee2-2d1012f8f649/80521ed8-2cf2-526c-aee2-2d1012f8f649_image_3.jpg HTTP/1.1" 201 0
2026-03-28 14:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FKX09XPF%252F698920520%252F600') HTTP/1.1" 204 0
2026-03-28 14:02:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KX09XPF/698920520/600 saved to cache
2026-03-28 14:02:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 80521ed8-2cf2-526c-aee2-2d1012f8f649
2026-03-28 14:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698938750%27 HTTP/1.1" 200 None
2026-03-28 14:02:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698938750 not downloaded yet
2026-03-28 14:02:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KX09XPF/698920552/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/KX09XPF/42809692?sv=2020-08-04&st=2026-03-28T14%3A01%3A54Z&se=2026-03-28T14%3A26%3A54Z&sr=b&sp=r&sig=UaaeKrI75EkebeSUIi7%2FvDct7K9AnHCAXaF4PIxxAA8%3D)
2026-03-28 14:02:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MX22PPO/698132294/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/MX22PPO/42810044?sv=2020-08-04&st=2026-03-28T14%3A01%3A54Z&se=2026-03-28T14%3A26%3A54Z&sr=b&sp=r&sig=cOivuK7Ij9PCIphPJcld%2BoxGcM6JagsRhi5zUF61PdA%3D)
2026-03-28 14:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698938764%27 HTTP/1.1" 200 None
2026-03-28 14:02:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698938764 not downloaded yet
2026-03-28 14:02:01 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:02:01 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:02:01 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:02:01 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:02:01 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:02:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:02:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2ca81490>
2026-03-28 14:02:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:02:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:02:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:02:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bbaf1f9b-e6a2-5ab9-9d30-d087740491cb/bbaf1f9b-e6a2-5ab9-9d30-d087740491cb_image_6.jpg HTTP/1.1" 201 0
2026-03-28 14:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FMX22PPO%252F698132275%252F600') HTTP/1.1" 204 0
2026-03-28 14:02:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MX22PPO/698132275/600 saved to cache
2026-03-28 14:02:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item bbaf1f9b-e6a2-5ab9-9d30-d087740491cb
2026-03-28 14:02:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:02:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c5d0b50>
2026-03-28 14:02:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:02:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:02:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:02:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bbaf1f9b-e6a2-5ab9-9d30-d087740491cb/bbaf1f9b-e6a2-5ab9-9d30-d087740491cb_image_4.jpg HTTP/1.1" 201 0
2026-03-28 14:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FMX22PPO%252F698132261%252F600') HTTP/1.1" 204 0
2026-03-28 14:02:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MX22PPO/698132261/600 saved to cache
2026-03-28 14:02:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item bbaf1f9b-e6a2-5ab9-9d30-d087740491cb
2026-03-28 14:02:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:02:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c76fb50>
2026-03-28 14:02:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:02:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:02:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:02:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bbaf1f9b-e6a2-5ab9-9d30-d087740491cb/bbaf1f9b-e6a2-5ab9-9d30-d087740491cb_image_5.jpg HTTP/1.1" 201 0
2026-03-28 14:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FMX22PPO%252F698132265%252F600') HTTP/1.1" 204 0
2026-03-28 14:02:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MX22PPO/698132265/600 saved to cache
2026-03-28 14:02:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item bbaf1f9b-e6a2-5ab9-9d30-d087740491cb
2026-03-28 14:02:01 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:02:01 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:02:01 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:02:01 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:02:01 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:02:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:02:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2ca8be90>
2026-03-28 14:02:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:02:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:02:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:02:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bbaf1f9b-e6a2-5ab9-9d30-d087740491cb/bbaf1f9b-e6a2-5ab9-9d30-d087740491cb_image_7.jpg HTTP/1.1" 201 0
2026-03-28 14:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FMX22PPO%252F698132285%252F600') HTTP/1.1" 204 0
2026-03-28 14:02:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MX22PPO/698132285/600 saved to cache
2026-03-28 14:02:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item bbaf1f9b-e6a2-5ab9-9d30-d087740491cb
2026-03-28 14:02:01 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:02:01 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:02:01 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:02:01 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:02:01 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:02:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:02:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2d73d8d0>
2026-03-28 14:02:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:02:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:02:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:02:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bbaf1f9b-e6a2-5ab9-9d30-d087740491cb/bbaf1f9b-e6a2-5ab9-9d30-d087740491cb_image_9.jpg HTTP/1.1" 201 0
2026-03-28 14:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FMX22PPO%252F698132309%252F600') HTTP/1.1" 204 0
2026-03-28 14:02:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MX22PPO/698132309/600 saved to cache
2026-03-28 14:02:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item bbaf1f9b-e6a2-5ab9-9d30-d087740491cb
2026-03-28 14:02:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:02:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2d73d1d0>
2026-03-28 14:02:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:02:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:02:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:02:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_80521ed8-2cf2-526c-aee2-2d1012f8f649/80521ed8-2cf2-526c-aee2-2d1012f8f649_image_5.jpg HTTP/1.1" 201 0
2026-03-28 14:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FKX09XPF%252F698920534%252F600') HTTP/1.1" 204 0
2026-03-28 14:02:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KX09XPF/698920534/600 saved to cache
2026-03-28 14:02:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 80521ed8-2cf2-526c-aee2-2d1012f8f649
2026-03-28 14:02:01 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:02:01 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:02:01 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:02:01 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:02:01 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:02:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:02:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c76fd50>
2026-03-28 14:02:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:02:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:02:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:02:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_80521ed8-2cf2-526c-aee2-2d1012f8f649/80521ed8-2cf2-526c-aee2-2d1012f8f649_image_6.jpg HTTP/1.1" 201 0
2026-03-28 14:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FKX09XPF%252F698920542%252F600') HTTP/1.1" 204 0
2026-03-28 14:02:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KX09XPF/698920542/600 saved to cache
2026-03-28 14:02:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 80521ed8-2cf2-526c-aee2-2d1012f8f649
2026-03-28 14:02:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KX09XPF/698920513/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/KX09XPF/42809692?sv=2020-08-04&st=2026-03-28T14%3A01%3A54Z&se=2026-03-28T14%3A26%3A54Z&sr=b&sp=r&sig=UaaeKrI75EkebeSUIi7%2FvDct7K9AnHCAXaF4PIxxAA8%3D)
2026-03-28 14:02:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KX09XPF/698920526/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/KX09XPF/42809692?sv=2020-08-04&st=2026-03-28T14%3A01%3A54Z&se=2026-03-28T14%3A26%3A54Z&sr=b&sp=r&sig=UaaeKrI75EkebeSUIi7%2FvDct7K9AnHCAXaF4PIxxAA8%3D)
2026-03-28 14:02:01 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KY19EBR/698938671/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698938671>
2026-03-28 14:02:01 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KY19EBR/698938661/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=KY19EBR-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-28 14:02:01 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MX22PPO/698132246/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698132246>
2026-03-28 14:02:01 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KY19EBR/698938703/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698938703>
2026-03-28 14:02:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KX09XPF/698920564/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/KX09XPF/42809692?sv=2020-08-04&st=2026-03-28T14%3A01%3A54Z&se=2026-03-28T14%3A26%3A54Z&sr=b&sp=r&sig=UaaeKrI75EkebeSUIi7%2FvDct7K9AnHCAXaF4PIxxAA8%3D)
2026-03-28 14:02:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KX09XPF/698920575/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/KX09XPF/42809692?sv=2020-08-04&st=2026-03-28T14%3A01%3A54Z&se=2026-03-28T14%3A26%3A54Z&sr=b&sp=r&sig=UaaeKrI75EkebeSUIi7%2FvDct7K9AnHCAXaF4PIxxAA8%3D)
2026-03-28 14:02:01 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:02:01 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:02:01 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:02:01 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:02:01 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:02:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:02:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a1fe8e190>
2026-03-28 14:02:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:02:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:02:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:02:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_80521ed8-2cf2-526c-aee2-2d1012f8f649/80521ed8-2cf2-526c-aee2-2d1012f8f649_image_7.jpg HTTP/1.1" 201 0
2026-03-28 14:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FKX09XPF%252F698920552%252F600') HTTP/1.1" 204 0
2026-03-28 14:02:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KX09XPF/698920552/600 saved to cache
2026-03-28 14:02:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 80521ed8-2cf2-526c-aee2-2d1012f8f649
2026-03-28 14:02:01 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:02:01 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:02:01 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:02:01 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:02:01 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:02:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:02:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c55ba50>
2026-03-28 14:02:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:02:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:02:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:02:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bbaf1f9b-e6a2-5ab9-9d30-d087740491cb/bbaf1f9b-e6a2-5ab9-9d30-d087740491cb_image_8.jpg HTTP/1.1" 201 0
2026-03-28 14:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FMX22PPO%252F698132294%252F600') HTTP/1.1" 204 0
2026-03-28 14:02:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MX22PPO/698132294/600 saved to cache
2026-03-28 14:02:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item bbaf1f9b-e6a2-5ab9-9d30-d087740491cb
2026-03-28 14:02:01 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KX09XPF/698920507/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698920507>
2026-03-28 14:02:01 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KY19EBR/698938716/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698938716>
2026-03-28 14:02:01 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MX22PPO/698132240/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=MX22PPO-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-28 14:02:01 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KY19EBR/698938687/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698938687>
2026-03-28 14:02:01 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KY19EBR/698938678/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698938678>
2026-03-28 14:02:01 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KY19EBR/698938697/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698938697>
2026-03-28 14:02:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:02:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c6e79d0>
2026-03-28 14:02:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:02:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:02:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:02:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_80521ed8-2cf2-526c-aee2-2d1012f8f649/80521ed8-2cf2-526c-aee2-2d1012f8f649_image_2.jpg HTTP/1.1" 201 0
2026-03-28 14:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FKX09XPF%252F698920513%252F600') HTTP/1.1" 204 0
2026-03-28 14:02:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KX09XPF/698920513/600 saved to cache
2026-03-28 14:02:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 80521ed8-2cf2-526c-aee2-2d1012f8f649
2026-03-28 14:02:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:02:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a1fd92f10>
2026-03-28 14:02:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:02:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:02:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:02:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_80521ed8-2cf2-526c-aee2-2d1012f8f649/80521ed8-2cf2-526c-aee2-2d1012f8f649_image_4.jpg HTTP/1.1" 201 0
2026-03-28 14:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FKX09XPF%252F698920526%252F600') HTTP/1.1" 204 0
2026-03-28 14:02:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KX09XPF/698920526/600 saved to cache
2026-03-28 14:02:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 80521ed8-2cf2-526c-aee2-2d1012f8f649
2026-03-28 14:02:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KY19EBR/698938661/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/KY19EBR/42810442?sv=2020-08-04&st=2026-03-28T14%3A01%3A57Z&se=2026-03-28T14%3A26%3A57Z&sr=b&sp=r&sig=V0CcrjxWQQpRwhNxJ6%2BBHvhoFpY%2BzGdLjfaoEpq0%2BKM%3D)
2026-03-28 14:02:02 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KY19EBR/698938732/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698938732>
2026-03-28 14:02:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MX22PPO/698132246/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/MX22PPO/42810044?sv=2020-08-04&st=2026-03-28T14%3A01%3A54Z&se=2026-03-28T14%3A26%3A54Z&sr=b&sp=r&sig=cOivuK7Ij9PCIphPJcld%2BoxGcM6JagsRhi5zUF61PdA%3D)
2026-03-28 14:02:02 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KY19EBR/698938750/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698938750>
2026-03-28 14:02:02 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KY19EBR/698938764/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698938764>
2026-03-28 14:02:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KY19EBR/698938671/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/KY19EBR/42810442?sv=2020-08-04&st=2026-03-28T14%3A01%3A57Z&se=2026-03-28T14%3A26%3A57Z&sr=b&sp=r&sig=V0CcrjxWQQpRwhNxJ6%2BBHvhoFpY%2BzGdLjfaoEpq0%2BKM%3D)
2026-03-28 14:02:02 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:02:02 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:02:02 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:02:02 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:02:02 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:02:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:02:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c9d6e50>
2026-03-28 14:02:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:02:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:02:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:02:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_80521ed8-2cf2-526c-aee2-2d1012f8f649/80521ed8-2cf2-526c-aee2-2d1012f8f649_image_8.jpg HTTP/1.1" 201 0
2026-03-28 14:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FKX09XPF%252F698920564%252F600') HTTP/1.1" 204 0
2026-03-28 14:02:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KX09XPF/698920564/600 saved to cache
2026-03-28 14:02:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 80521ed8-2cf2-526c-aee2-2d1012f8f649
2026-03-28 14:02:02 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:02:02 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:02:02 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:02:02 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:02:02 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:02:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:02:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c605490>
2026-03-28 14:02:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:02:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:02:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:02:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_80521ed8-2cf2-526c-aee2-2d1012f8f649/80521ed8-2cf2-526c-aee2-2d1012f8f649_image_9.jpg HTTP/1.1" 201 0
2026-03-28 14:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FKX09XPF%252F698920575%252F600') HTTP/1.1" 204 0
2026-03-28 14:02:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KX09XPF/698920575/600 saved to cache
2026-03-28 14:02:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 80521ed8-2cf2-526c-aee2-2d1012f8f649
2026-03-28 14:02:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KY19EBR/698938703/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/KY19EBR/42810442?sv=2020-08-04&st=2026-03-28T14%3A01%3A57Z&se=2026-03-28T14%3A26%3A57Z&sr=b&sp=r&sig=V0CcrjxWQQpRwhNxJ6%2BBHvhoFpY%2BzGdLjfaoEpq0%2BKM%3D)
2026-03-28 14:02:02 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KX09XPF/698920501/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=KX09XPF-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-28 14:02:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:02:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2ca0cf50>
2026-03-28 14:02:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:02:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:02:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:02:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3937afb9-0d72-5b2f-b51e-2f8c60821b71/3937afb9-0d72-5b2f-b51e-2f8c60821b71_image_0.jpg HTTP/1.1" 201 0
2026-03-28 14:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FKY19EBR%252F698938661%252F600') HTTP/1.1" 204 0
2026-03-28 14:02:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KY19EBR/698938661/600 saved to cache
2026-03-28 14:02:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 3937afb9-0d72-5b2f-b51e-2f8c60821b71
2026-03-28 14:02:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:02:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2da1cd10>
2026-03-28 14:02:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:02:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:02:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:02:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bbaf1f9b-e6a2-5ab9-9d30-d087740491cb/bbaf1f9b-e6a2-5ab9-9d30-d087740491cb_image_1.jpg HTTP/1.1" 201 0
2026-03-28 14:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FMX22PPO%252F698132246%252F600') HTTP/1.1" 204 0
2026-03-28 14:02:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MX22PPO/698132246/600 saved to cache
2026-03-28 14:02:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item bbaf1f9b-e6a2-5ab9-9d30-d087740491cb
2026-03-28 14:02:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:02:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2d945150>
2026-03-28 14:02:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:02:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:02:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:02:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3937afb9-0d72-5b2f-b51e-2f8c60821b71/3937afb9-0d72-5b2f-b51e-2f8c60821b71_image_1.jpg HTTP/1.1" 201 0
2026-03-28 14:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FKY19EBR%252F698938671%252F600') HTTP/1.1" 204 0
2026-03-28 14:02:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KY19EBR/698938671/600 saved to cache
2026-03-28 14:02:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 3937afb9-0d72-5b2f-b51e-2f8c60821b71
2026-03-28 14:02:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KY19EBR/698938678/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/KY19EBR/42810442?sv=2020-08-04&st=2026-03-28T14%3A01%3A57Z&se=2026-03-28T14%3A26%3A57Z&sr=b&sp=r&sig=V0CcrjxWQQpRwhNxJ6%2BBHvhoFpY%2BzGdLjfaoEpq0%2BKM%3D)
2026-03-28 14:02:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KY19EBR/698938687/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/KY19EBR/42810442?sv=2020-08-04&st=2026-03-28T14%3A01%3A57Z&se=2026-03-28T14%3A26%3A57Z&sr=b&sp=r&sig=V0CcrjxWQQpRwhNxJ6%2BBHvhoFpY%2BzGdLjfaoEpq0%2BKM%3D)
2026-03-28 14:02:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MX22PPO/698132240/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/MX22PPO/42810044?sv=2020-08-04&st=2026-03-28T14%3A01%3A54Z&se=2026-03-28T14%3A26%3A54Z&sr=b&sp=r&sig=cOivuK7Ij9PCIphPJcld%2BoxGcM6JagsRhi5zUF61PdA%3D)
2026-03-28 14:02:02 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AM58MHU/698970545/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698970545>
2026-03-28 14:02:02 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LM20BCX/42809490?sv=2020-08-04&st=2026-03-28T14%3A02%3A02Z&se=2026-03-28T14%3A27%3A02Z&sr=b&sp=r&sig=g557aIjJSDwFB6Q4O2a74JuAlQnchKG2JnTAytjD834%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=LM20%20BCX-GB>
2026-03-28 14:02:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KY19EBR/698938697/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/KY19EBR/42810442?sv=2020-08-04&st=2026-03-28T14%3A01%3A57Z&se=2026-03-28T14%3A26%3A57Z&sr=b&sp=r&sig=V0CcrjxWQQpRwhNxJ6%2BBHvhoFpY%2BzGdLjfaoEpq0%2BKM%3D)
2026-03-28 14:02:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KX09XPF/698920507/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/KX09XPF/42809692?sv=2020-08-04&st=2026-03-28T14%3A01%3A54Z&se=2026-03-28T14%3A26%3A54Z&sr=b&sp=r&sig=UaaeKrI75EkebeSUIi7%2FvDct7K9AnHCAXaF4PIxxAA8%3D)
2026-03-28 14:02:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KY19EBR/698938716/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/KY19EBR/42810442?sv=2020-08-04&st=2026-03-28T14%3A01%3A57Z&se=2026-03-28T14%3A26%3A57Z&sr=b&sp=r&sig=V0CcrjxWQQpRwhNxJ6%2BBHvhoFpY%2BzGdLjfaoEpq0%2BKM%3D)
2026-03-28 14:02:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:02:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c76c2d0>
2026-03-28 14:02:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:02:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:02:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:02:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3937afb9-0d72-5b2f-b51e-2f8c60821b71/3937afb9-0d72-5b2f-b51e-2f8c60821b71_image_5.jpg HTTP/1.1" 201 0
2026-03-28 14:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FKY19EBR%252F698938703%252F600') HTTP/1.1" 204 0
2026-03-28 14:02:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KY19EBR/698938703/600 saved to cache
2026-03-28 14:02:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 3937afb9-0d72-5b2f-b51e-2f8c60821b71
2026-03-28 14:02:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KX09XPF/698920501/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/KX09XPF/42809692?sv=2020-08-04&st=2026-03-28T14%3A01%3A54Z&se=2026-03-28T14%3A26%3A54Z&sr=b&sp=r&sig=UaaeKrI75EkebeSUIi7%2FvDct7K9AnHCAXaF4PIxxAA8%3D)
2026-03-28 14:02:02 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VO62RAU/698928795/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=VO62RAU-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-28 14:02:02 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YW64DGU/698928849/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698928849>
2026-03-28 14:02:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KY19EBR/698938750/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/KY19EBR/42810442?sv=2020-08-04&st=2026-03-28T14%3A01%3A57Z&se=2026-03-28T14%3A26%3A57Z&sr=b&sp=r&sig=V0CcrjxWQQpRwhNxJ6%2BBHvhoFpY%2BzGdLjfaoEpq0%2BKM%3D)
2026-03-28 14:02:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KY19EBR/698938764/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/KY19EBR/42810442?sv=2020-08-04&st=2026-03-28T14%3A01%3A57Z&se=2026-03-28T14%3A26%3A57Z&sr=b&sp=r&sig=V0CcrjxWQQpRwhNxJ6%2BBHvhoFpY%2BzGdLjfaoEpq0%2BKM%3D)
2026-03-28 14:02:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KY19EBR/698938732/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/KY19EBR/42810442?sv=2020-08-04&st=2026-03-28T14%3A01%3A57Z&se=2026-03-28T14%3A26%3A57Z&sr=b&sp=r&sig=V0CcrjxWQQpRwhNxJ6%2BBHvhoFpY%2BzGdLjfaoEpq0%2BKM%3D)
2026-03-28 14:02:02 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/KM69NXO/42810238?sv=2020-08-04&st=2026-03-28T14%3A02%3A02Z&se=2026-03-28T14%3A27%3A02Z&sr=b&sp=r&sig=eleTkVzAg4kayIg0miOr76ihVO5eK6DPyxPFH4fmeZ8%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=KM69%20NXO-GB>
2026-03-28 14:02:02 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GU10UYN/698556209/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698556209>
2026-03-28 14:02:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:02:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c9d44d0>
2026-03-28 14:02:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:02:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:02:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:02:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3937afb9-0d72-5b2f-b51e-2f8c60821b71/3937afb9-0d72-5b2f-b51e-2f8c60821b71_image_2.jpg HTTP/1.1" 201 0
2026-03-28 14:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FKY19EBR%252F698938678%252F600') HTTP/1.1" 204 0
2026-03-28 14:02:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KY19EBR/698938678/600 saved to cache
2026-03-28 14:02:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 3937afb9-0d72-5b2f-b51e-2f8c60821b71
2026-03-28 14:02:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:02:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2d95be10>
2026-03-28 14:02:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:02:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:02:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:02:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3937afb9-0d72-5b2f-b51e-2f8c60821b71/3937afb9-0d72-5b2f-b51e-2f8c60821b71_image_3.jpg HTTP/1.1" 201 0
2026-03-28 14:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FKY19EBR%252F698938687%252F600') HTTP/1.1" 204 0
2026-03-28 14:02:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KY19EBR/698938687/600 saved to cache
2026-03-28 14:02:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 3937afb9-0d72-5b2f-b51e-2f8c60821b71
2026-03-28 14:02:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:02:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2d901610>
2026-03-28 14:02:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:02:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:02:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:02:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bbaf1f9b-e6a2-5ab9-9d30-d087740491cb/bbaf1f9b-e6a2-5ab9-9d30-d087740491cb_image_0.jpg HTTP/1.1" 201 0
2026-03-28 14:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FMX22PPO%252F698132240%252F600') HTTP/1.1" 204 0
2026-03-28 14:02:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MX22PPO/698132240/600 saved to cache
2026-03-28 14:02:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item bbaf1f9b-e6a2-5ab9-9d30-d087740491cb
2026-03-28 14:02:02 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: bbaf1f9b-e6a2-5ab9-9d30-d087740491cb, skipping ID generation
2026-03-28 14:02:02 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item bbaf1f9b-e6a2-5ab9-9d30-d087740491cb sending to next pipeline
2026-03-28 14:02:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: bbaf1f9b-e6a2-5ab9-9d30-d087740491cb, identifier: MX22%20PPO
2026-03-28 14:02:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:02:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a30123f90>
2026-03-28 14:02:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:02:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:02:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:02:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3937afb9-0d72-5b2f-b51e-2f8c60821b71/3937afb9-0d72-5b2f-b51e-2f8c60821b71_image_4.jpg HTTP/1.1" 201 0
2026-03-28 14:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FKY19EBR%252F698938697%252F600') HTTP/1.1" 204 0
2026-03-28 14:02:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KY19EBR/698938697/600 saved to cache
2026-03-28 14:02:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 3937afb9-0d72-5b2f-b51e-2f8c60821b71
2026-03-28 14:02:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:02:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2d686750>
2026-03-28 14:02:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:02:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:02:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:02:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_80521ed8-2cf2-526c-aee2-2d1012f8f649/80521ed8-2cf2-526c-aee2-2d1012f8f649_image_1.jpg HTTP/1.1" 201 0
2026-03-28 14:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FKX09XPF%252F698920507%252F600') HTTP/1.1" 204 0
2026-03-28 14:02:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KX09XPF/698920507/600 saved to cache
2026-03-28 14:02:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 80521ed8-2cf2-526c-aee2-2d1012f8f649
2026-03-28 14:02:03 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:02:03 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:02:03 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:02:03 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:02:03 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:02:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:02:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c6b0e50>
2026-03-28 14:02:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:02:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:02:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:02:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3937afb9-0d72-5b2f-b51e-2f8c60821b71/3937afb9-0d72-5b2f-b51e-2f8c60821b71_image_6.jpg HTTP/1.1" 201 0
2026-03-28 14:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FKY19EBR%252F698938716%252F600') HTTP/1.1" 204 0
2026-03-28 14:02:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KY19EBR/698938716/600 saved to cache
2026-03-28 14:02:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 3937afb9-0d72-5b2f-b51e-2f8c60821b71
2026-03-28 14:02:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: bbaf1f9b-e6a2-5ab9-9d30-d087740491cb with identifier: MX22%20PPO
2026-03-28 14:02:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: bbaf1f9b-e6a2-5ab9-9d30-d087740491cb with identifier: MX22%20PPO
2026-03-28 14:02:03 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: bbaf1f9b-e6a2-5ab9-9d30-d087740491cb with identifier: MX22%20PPO to the API
2026-03-28 14:02:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:02:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:02:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MX22PPO/698132240/600>
{'auction_title': '',
'c_o_2_emission_value': 106,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bbaf1f9b-e6a2-5ab9-9d30-d087740491cb/bbaf1f9b-e6a2-5ab9-9d30-d087740491cb_expert_report_file_f9df7ee1-184f-4f4a-8e35-90d2dae2e700.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=MX22%20PPO-GB',
'category': 'Car',
'color': 'grey',
'currency': 'GBP',
'doors_number': 3,
'engine': '1.0L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol',
'id': 'bbaf1f9b-e6a2-5ab9-9d30-d087740491cb',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'MX22 PPO',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=MX22%20PPO&vehicleType=*',
'listing': 'auction',
'location': 'Bristol',
'make': 'FIAT',
'model': '500',
'odometer': 21337,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 11,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bbaf1f9b-e6a2-5ab9-9d30-d087740491cb/bbaf1f9b-e6a2-5ab9-9d30-d087740491cb_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 47829,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MX22PPO/698132240/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bbaf1f9b-e6a2-5ab9-9d30-d087740491cb/bbaf1f9b-e6a2-5ab9-9d30-d087740491cb_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 46728,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MX22PPO/698132246/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bbaf1f9b-e6a2-5ab9-9d30-d087740491cb/bbaf1f9b-e6a2-5ab9-9d30-d087740491cb_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 44225,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MX22PPO/698132253/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bbaf1f9b-e6a2-5ab9-9d30-d087740491cb/bbaf1f9b-e6a2-5ab9-9d30-d087740491cb_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 45852,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MX22PPO/698132257/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bbaf1f9b-e6a2-5ab9-9d30-d087740491cb/bbaf1f9b-e6a2-5ab9-9d30-d087740491cb_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 46294,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MX22PPO/698132261/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bbaf1f9b-e6a2-5ab9-9d30-d087740491cb/bbaf1f9b-e6a2-5ab9-9d30-d087740491cb_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 43175,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MX22PPO/698132265/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bbaf1f9b-e6a2-5ab9-9d30-d087740491cb/bbaf1f9b-e6a2-5ab9-9d30-d087740491cb_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 96529,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MX22PPO/698132275/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bbaf1f9b-e6a2-5ab9-9d30-d087740491cb/bbaf1f9b-e6a2-5ab9-9d30-d087740491cb_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 77221,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MX22PPO/698132285/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bbaf1f9b-e6a2-5ab9-9d30-d087740491cb/bbaf1f9b-e6a2-5ab9-9d30-d087740491cb_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 92198,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MX22PPO/698132294/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bbaf1f9b-e6a2-5ab9-9d30-d087740491cb/bbaf1f9b-e6a2-5ab9-9d30-d087740491cb_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 91992,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MX22PPO/698132309/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-01-01',
'seller_name': None,
'title': 'FIAT 500 1.0 M/H RED Hatchback',
'transmission': 'manual',
'trim': 'M/H RED',
'vin': 'ZFACF1CJ9NJF90412',
'year': 2022}
2026-03-28 14:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MX22%2520PPO%27 HTTP/1.1" 200 None
2026-03-28 14:02:03 [bca.uk] INFO: Saving data for MX22%20PPO: {'created_time': 1774706523.847321, 'last_price_update_time': 1774706523.847334, 'auction_closing_time': 1774864800.0}
2026-03-28 14:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='MX22%2520PPO') HTTP/1.1" 204 0
2026-03-28 14:02:03 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SH14BOU/698522113/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698522113>
2026-03-28 14:02:03 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WM19BFN/698601797/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698601797>
2026-03-28 14:02:03 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EJ19URS/698294784/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698294784>
2026-03-28 14:02:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AM58MHU/698970545/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/AM58MHU/42810635?sv=2020-08-04&st=2026-03-28T14%3A01%3A23Z&se=2026-03-28T14%3A26%3A23Z&sr=b&sp=r&sig=MTxN3XqRDWL9DG88ixDAxTc9KDbrCYbR3DQJ2mNHaYw%3D)
2026-03-28 14:02:03 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KO15JZW/698928815/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698928815>
2026-03-28 14:02:03 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FH21UNX/698923269/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698923269>
2026-03-28 14:02:03 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WA15XTF/697938658/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=697938658>
2026-03-28 14:02:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LM20BCX/42809490?sv=2020-08-04&st=2026-03-28T14%3A02%3A02Z&se=2026-03-28T14%3A27%3A02Z&sr=b&sp=r&sig=g557aIjJSDwFB6Q4O2a74JuAlQnchKG2JnTAytjD834%3D> (referer: https://www.bca.co.uk/)
2026-03-28 14:02:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:02:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2d737b50>
2026-03-28 14:02:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:02:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:02:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:02:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_80521ed8-2cf2-526c-aee2-2d1012f8f649/80521ed8-2cf2-526c-aee2-2d1012f8f649_image_0.jpg HTTP/1.1" 201 0
2026-03-28 14:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FKX09XPF%252F698920501%252F600') HTTP/1.1" 204 0
2026-03-28 14:02:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KX09XPF/698920501/600 saved to cache
2026-03-28 14:02:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 80521ed8-2cf2-526c-aee2-2d1012f8f649
2026-03-28 14:02:04 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 80521ed8-2cf2-526c-aee2-2d1012f8f649, skipping ID generation
2026-03-28 14:02:04 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 80521ed8-2cf2-526c-aee2-2d1012f8f649 sending to next pipeline
2026-03-28 14:02:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 80521ed8-2cf2-526c-aee2-2d1012f8f649, identifier: KX09%20XPF
2026-03-28 14:02:04 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:02:04 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:02:04 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:02:04 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:02:04 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:02:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:02:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c761f90>
2026-03-28 14:02:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:02:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:02:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:02:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3937afb9-0d72-5b2f-b51e-2f8c60821b71/3937afb9-0d72-5b2f-b51e-2f8c60821b71_image_8.jpg HTTP/1.1" 201 0
2026-03-28 14:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FKY19EBR%252F698938750%252F600') HTTP/1.1" 204 0
2026-03-28 14:02:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KY19EBR/698938750/600 saved to cache
2026-03-28 14:02:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 3937afb9-0d72-5b2f-b51e-2f8c60821b71
2026-03-28 14:02:04 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:02:04 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:02:04 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:02:04 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:02:04 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:02:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:02:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a1ffb2550>
2026-03-28 14:02:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:02:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:02:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:02:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3937afb9-0d72-5b2f-b51e-2f8c60821b71/3937afb9-0d72-5b2f-b51e-2f8c60821b71_image_9.jpg HTTP/1.1" 201 0
2026-03-28 14:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FKY19EBR%252F698938764%252F600') HTTP/1.1" 204 0
2026-03-28 14:02:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KY19EBR/698938764/600 saved to cache
2026-03-28 14:02:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 3937afb9-0d72-5b2f-b51e-2f8c60821b71
2026-03-28 14:02:04 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:02:04 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:02:04 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:02:04 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:02:04 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:02:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:02:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2d991950>
2026-03-28 14:02:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:02:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:02:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:02:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3937afb9-0d72-5b2f-b51e-2f8c60821b71/3937afb9-0d72-5b2f-b51e-2f8c60821b71_image_7.jpg HTTP/1.1" 201 0
2026-03-28 14:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FKY19EBR%252F698938732%252F600') HTTP/1.1" 204 0
2026-03-28 14:02:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KY19EBR/698938732/600 saved to cache
2026-03-28 14:02:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 3937afb9-0d72-5b2f-b51e-2f8c60821b71
2026-03-28 14:02:04 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 3937afb9-0d72-5b2f-b51e-2f8c60821b71, skipping ID generation
2026-03-28 14:02:04 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 3937afb9-0d72-5b2f-b51e-2f8c60821b71 sending to next pipeline
2026-03-28 14:02:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 3937afb9-0d72-5b2f-b51e-2f8c60821b71, identifier: KY19%20EBR
2026-03-28 14:02:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 80521ed8-2cf2-526c-aee2-2d1012f8f649 with identifier: KX09%20XPF
2026-03-28 14:02:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-28 14:02:04 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=blue HTTP/1.1" 200 None
2026-03-28 14:02:04 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-28 14:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-28 14:02:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 80521ed8-2cf2-526c-aee2-2d1012f8f649 with identifier: KX09%20XPF
2026-03-28 14:02:04 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 80521ed8-2cf2-526c-aee2-2d1012f8f649 with identifier: KX09%20XPF to the API
2026-03-28 14:02:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:02:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:02:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KX09XPF/698920501/600>
{'auction_title': '',
'c_o_2_emission_value': 140,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_80521ed8-2cf2-526c-aee2-2d1012f8f649/80521ed8-2cf2-526c-aee2-2d1012f8f649_expert_report_file_7a21ce13-1f9e-4570-8896-015edddaa8fa.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=KX09%20XPF-GB',
'category': 'Car',
'color': 'blue',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.4L',
'expiration_date': '2026-03-29T10:00:00Z',
'fuel_type': 'Petrol',
'id': '80521ed8-2cf2-526c-aee2-2d1012f8f649',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'KX09 XPF',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=KX09%20XPF&vehicleType=*',
'listing': 'auction',
'location': 'Measham',
'make': 'PEUGEOT',
'model': '207',
'odometer': 86662,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 11,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_80521ed8-2cf2-526c-aee2-2d1012f8f649/80521ed8-2cf2-526c-aee2-2d1012f8f649_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 44987,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KX09XPF/698920501/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_80521ed8-2cf2-526c-aee2-2d1012f8f649/80521ed8-2cf2-526c-aee2-2d1012f8f649_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 41729,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KX09XPF/698920507/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_80521ed8-2cf2-526c-aee2-2d1012f8f649/80521ed8-2cf2-526c-aee2-2d1012f8f649_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 44409,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KX09XPF/698920513/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_80521ed8-2cf2-526c-aee2-2d1012f8f649/80521ed8-2cf2-526c-aee2-2d1012f8f649_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 41265,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KX09XPF/698920520/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_80521ed8-2cf2-526c-aee2-2d1012f8f649/80521ed8-2cf2-526c-aee2-2d1012f8f649_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 42428,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KX09XPF/698920526/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_80521ed8-2cf2-526c-aee2-2d1012f8f649/80521ed8-2cf2-526c-aee2-2d1012f8f649_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 42588,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KX09XPF/698920534/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_80521ed8-2cf2-526c-aee2-2d1012f8f649/80521ed8-2cf2-526c-aee2-2d1012f8f649_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 87782,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KX09XPF/698920542/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_80521ed8-2cf2-526c-aee2-2d1012f8f649/80521ed8-2cf2-526c-aee2-2d1012f8f649_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 83419,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KX09XPF/698920552/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_80521ed8-2cf2-526c-aee2-2d1012f8f649/80521ed8-2cf2-526c-aee2-2d1012f8f649_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 98552,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KX09XPF/698920564/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_80521ed8-2cf2-526c-aee2-2d1012f8f649/80521ed8-2cf2-526c-aee2-2d1012f8f649_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 81513,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KX09XPF/698920575/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2009-01-01',
'seller_name': None,
'title': 'PEUGEOT 207 1.4 95 VTI SPORT Hatchback',
'transmission': 'manual',
'trim': '95 VTI SPORT',
'vin': 'VF3WC8FSC9E031446',
'year': 2009}
2026-03-28 14:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KX09%2520XPF%27 HTTP/1.1" 200 None
2026-03-28 14:02:04 [bca.uk] INFO: Saving data for KX09%20XPF: {'created_time': 1774706524.945138, 'last_price_update_time': 1774706524.945161, 'auction_closing_time': 1774778400.0}
2026-03-28 14:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='KX09%2520XPF') HTTP/1.1" 204 0
2026-03-28 14:02:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 3937afb9-0d72-5b2f-b51e-2f8c60821b71 with identifier: KY19%20EBR
2026-03-28 14:02:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 3937afb9-0d72-5b2f-b51e-2f8c60821b71 with identifier: KY19%20EBR
2026-03-28 14:02:05 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 3937afb9-0d72-5b2f-b51e-2f8c60821b71 with identifier: KY19%20EBR to the API
2026-03-28 14:02:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:02:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:02:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KY19EBR/698938732/600>
{'auction_title': '',
'c_o_2_emission_value': 152,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3937afb9-0d72-5b2f-b51e-2f8c60821b71/3937afb9-0d72-5b2f-b51e-2f8c60821b71_expert_report_file_e65ffc49-1a82-428a-bc13-06cb779587e6.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=KY19%20EBR-GB',
'category': 'Car',
'color': 'black',
'currency': 'GBP',
'doors_number': 5,
'engine': '2.0L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Diesel',
'id': '3937afb9-0d72-5b2f-b51e-2f8c60821b71',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'KY19 EBR',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=KY19%20EBR&vehicleType=*',
'listing': 'auction',
'location': 'Measham',
'make': 'FORD',
'model': 'KUGA',
'odometer': 71368,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 11,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3937afb9-0d72-5b2f-b51e-2f8c60821b71/3937afb9-0d72-5b2f-b51e-2f8c60821b71_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 45706,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KY19EBR/698938661/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3937afb9-0d72-5b2f-b51e-2f8c60821b71/3937afb9-0d72-5b2f-b51e-2f8c60821b71_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 42730,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KY19EBR/698938671/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3937afb9-0d72-5b2f-b51e-2f8c60821b71/3937afb9-0d72-5b2f-b51e-2f8c60821b71_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 44989,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KY19EBR/698938678/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3937afb9-0d72-5b2f-b51e-2f8c60821b71/3937afb9-0d72-5b2f-b51e-2f8c60821b71_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 44061,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KY19EBR/698938687/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3937afb9-0d72-5b2f-b51e-2f8c60821b71/3937afb9-0d72-5b2f-b51e-2f8c60821b71_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 44010,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KY19EBR/698938697/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3937afb9-0d72-5b2f-b51e-2f8c60821b71/3937afb9-0d72-5b2f-b51e-2f8c60821b71_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 42723,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KY19EBR/698938703/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3937afb9-0d72-5b2f-b51e-2f8c60821b71/3937afb9-0d72-5b2f-b51e-2f8c60821b71_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 76499,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KY19EBR/698938716/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3937afb9-0d72-5b2f-b51e-2f8c60821b71/3937afb9-0d72-5b2f-b51e-2f8c60821b71_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 79121,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KY19EBR/698938732/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3937afb9-0d72-5b2f-b51e-2f8c60821b71/3937afb9-0d72-5b2f-b51e-2f8c60821b71_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 88014,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KY19EBR/698938750/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3937afb9-0d72-5b2f-b51e-2f8c60821b71/3937afb9-0d72-5b2f-b51e-2f8c60821b71_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 88260,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KY19EBR/698938764/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-01-01',
'seller_name': None,
'title': 'FORD KUGA 2.0 TDCI 150 2WD TITANIUM ED. StationWagon',
'transmission': 'manual',
'trim': 'TDCI 150 2WD TITANIUM ED.',
'vin': 'WF0AXXWPMAKE01259',
'year': 2019}
2026-03-28 14:02:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KY19%2520EBR%27 HTTP/1.1" 200 None
2026-03-28 14:02:05 [bca.uk] INFO: Saving data for KY19%20EBR: {'created_time': 1774706525.441176, 'last_price_update_time': 1774706525.441189, 'auction_closing_time': 1774864800.0}
2026-03-28 14:02:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='KY19%2520EBR') HTTP/1.1" 204 0
2026-03-28 14:02:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VO62RAU/698928795/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/VO62RAU/42809976?sv=2020-08-04&st=2026-03-28T14%3A01%3A26Z&se=2026-03-28T14%3A26%3A26Z&sr=b&sp=r&sig=ajraupx01hOhBxj83xq2SeA0U6vZ89qgzfl3QZ0K0u0%3D)
2026-03-28 14:02:05 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AM58MHU/698953189/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698953189>
2026-03-28 14:02:05 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SB65CAX/697544395/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=697544395>
2026-03-28 14:02:05 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SF65MRS/698522099/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698522099>
2026-03-28 14:02:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YW64DGU/698928849/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YW64DGU/42810194?sv=2020-08-04&st=2026-03-28T14%3A01%3A23Z&se=2026-03-28T14%3A26%3A23Z&sr=b&sp=r&sig=bKUUxkl%2FQOTN6xP3oKLYX53uOLW1seBVRfhSdF3FtAg%3D)
2026-03-28 14:02:05 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/FG69CVL/42809636?sv=2020-08-04&st=2026-03-28T14%3A02%3A04Z&se=2026-03-28T14%3A27%3A04Z&sr=b&sp=r&sig=P34fgJ9Qf70HeZZwk9%2FG1lItlUdcz1Isp5BChiVs1ZQ%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=FG69%20CVL-GB>
2026-03-28 14:02:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/KM69NXO/42810238?sv=2020-08-04&st=2026-03-28T14%3A02%3A02Z&se=2026-03-28T14%3A27%3A02Z&sr=b&sp=r&sig=eleTkVzAg4kayIg0miOr76ihVO5eK6DPyxPFH4fmeZ8%3D> (referer: https://www.bca.co.uk/)
2026-03-28 14:02:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:02:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2ca342d0>
2026-03-28 14:02:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:02:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:02:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:02:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_29da6c1c-854f-50ff-9030-4ad1ff36e423/29da6c1c-854f-50ff-9030-4ad1ff36e423_image_9.jpg HTTP/1.1" 201 0
2026-03-28 14:02:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FAM58MHU%252F698970545%252F600') HTTP/1.1" 204 0
2026-03-28 14:02:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AM58MHU/698970545/600 saved to cache
2026-03-28 14:02:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 29da6c1c-854f-50ff-9030-4ad1ff36e423
2026-03-28 14:02:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:02:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a1fe90550>
2026-03-28 14:02:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:02:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:02:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:02:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_62f297d6-6b1d-5054-88b1-7c86565bdaf1/62f297d6-6b1d-5054-88b1-7c86565bdaf1_expert_report_file_5c5b1752-6db3-4334-9982-0193eede31e6.pdf HTTP/1.1" 201 0
2026-03-28 14:02:05 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item 62f297d6-6b1d-5054-88b1-7c86565bdaf1
2026-03-28 14:02:05 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 62f297d6-6b1d-5054-88b1-7c86565bdaf1, skipping ID generation
2026-03-28 14:02:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 62f297d6-6b1d-5054-88b1-7c86565bdaf1
2026-03-28 14:02:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DLM20BCX-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-28 14:02:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=LM20BCX-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-28 14:02:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GU10UYN/698556209/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/GU10UYN/42810320?sv=2020-08-04&st=2026-03-28T14%3A01%3A23Z&se=2026-03-28T14%3A26%3A23Z&sr=b&sp=r&sig=mGNhX9MAfZVu5g6PpXH03XgVnNc%2FnLjEd8Y2gqIppCM%3D)
2026-03-28 14:02:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D697881117%27 HTTP/1.1" 200 None
2026-03-28 14:02:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=697881117 not downloaded yet
2026-03-28 14:02:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D697881122%27 HTTP/1.1" 200 None
2026-03-28 14:02:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=697881122 not downloaded yet
2026-03-28 14:02:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:02:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2d973890>
2026-03-28 14:02:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:02:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:02:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:02:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_60bcb64c-26b9-5747-8fc6-986efaa78996/60bcb64c-26b9-5747-8fc6-986efaa78996_image_0.jpg HTTP/1.1" 201 0
2026-03-28 14:02:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FVO62RAU%252F698928795%252F600') HTTP/1.1" 204 0
2026-03-28 14:02:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VO62RAU/698928795/600 saved to cache
2026-03-28 14:02:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 60bcb64c-26b9-5747-8fc6-986efaa78996
2026-03-28 14:02:05 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 60bcb64c-26b9-5747-8fc6-986efaa78996, skipping ID generation
2026-03-28 14:02:05 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 60bcb64c-26b9-5747-8fc6-986efaa78996 sending to next pipeline
2026-03-28 14:02:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 60bcb64c-26b9-5747-8fc6-986efaa78996, identifier: VO62%20RAU
2026-03-28 14:02:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:02:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a1ff2c510>
2026-03-28 14:02:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:02:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:02:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:02:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5b546abb-9cfb-537e-b2ac-6d60a5514e55/5b546abb-9cfb-537e-b2ac-6d60a5514e55_image_4.jpg HTTP/1.1" 201 0
2026-03-28 14:02:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FYW64DGU%252F698928849%252F600') HTTP/1.1" 204 0
2026-03-28 14:02:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YW64DGU/698928849/600 saved to cache
2026-03-28 14:02:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 5b546abb-9cfb-537e-b2ac-6d60a5514e55
2026-03-28 14:02:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:02:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2d99f9d0>
2026-03-28 14:02:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:02:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:02:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:02:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_494cffc1-9b07-5d98-9c75-414638ff32d2/494cffc1-9b07-5d98-9c75-414638ff32d2_expert_report_file_65d461db-2006-4323-b4f8-6e2474297fcd.pdf HTTP/1.1" 201 0
2026-03-28 14:02:05 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item 494cffc1-9b07-5d98-9c75-414638ff32d2
2026-03-28 14:02:05 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 494cffc1-9b07-5d98-9c75-414638ff32d2, skipping ID generation
2026-03-28 14:02:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 494cffc1-9b07-5d98-9c75-414638ff32d2
2026-03-28 14:02:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DKM69NXO-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-28 14:02:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=KM69NXO-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-28 14:02:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D697881125%27 HTTP/1.1" 200 None
2026-03-28 14:02:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=697881125 not downloaded yet
2026-03-28 14:02:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 60bcb64c-26b9-5747-8fc6-986efaa78996 with identifier: VO62%20RAU
2026-03-28 14:02:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 60bcb64c-26b9-5747-8fc6-986efaa78996 with identifier: VO62%20RAU
2026-03-28 14:02:05 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 60bcb64c-26b9-5747-8fc6-986efaa78996 with identifier: VO62%20RAU to the API
2026-03-28 14:02:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:02:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:02:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VO62RAU/698928795/600>
{'auction_title': '',
'c_o_2_emission_value': 149,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_60bcb64c-26b9-5747-8fc6-986efaa78996/60bcb64c-26b9-5747-8fc6-986efaa78996_expert_report_file_b11751e7-eebb-4353-a8b4-176fb6a99869.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=VO62%20RAU-GB',
'category': 'Car',
'color': 'silver',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.6L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol',
'id': '60bcb64c-26b9-5747-8fc6-986efaa78996',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'VO62 RAU',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=VO62%20RAU&vehicleType=*',
'listing': 'auction',
'location': 'Enfield',
'make': 'FORD',
'model': 'FOCUS',
'odometer': 100313,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 11,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_60bcb64c-26b9-5747-8fc6-986efaa78996/60bcb64c-26b9-5747-8fc6-986efaa78996_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 48177,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VO62RAU/698928795/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_60bcb64c-26b9-5747-8fc6-986efaa78996/60bcb64c-26b9-5747-8fc6-986efaa78996_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 46845,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VO62RAU/698928822/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_60bcb64c-26b9-5747-8fc6-986efaa78996/60bcb64c-26b9-5747-8fc6-986efaa78996_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 45297,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VO62RAU/698928851/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_60bcb64c-26b9-5747-8fc6-986efaa78996/60bcb64c-26b9-5747-8fc6-986efaa78996_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 45998,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VO62RAU/698928871/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_60bcb64c-26b9-5747-8fc6-986efaa78996/60bcb64c-26b9-5747-8fc6-986efaa78996_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 46852,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VO62RAU/698928885/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_60bcb64c-26b9-5747-8fc6-986efaa78996/60bcb64c-26b9-5747-8fc6-986efaa78996_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 45678,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VO62RAU/698928900/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_60bcb64c-26b9-5747-8fc6-986efaa78996/60bcb64c-26b9-5747-8fc6-986efaa78996_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 71616,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VO62RAU/698928925/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_60bcb64c-26b9-5747-8fc6-986efaa78996/60bcb64c-26b9-5747-8fc6-986efaa78996_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 63447,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VO62RAU/698928946/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_60bcb64c-26b9-5747-8fc6-986efaa78996/60bcb64c-26b9-5747-8fc6-986efaa78996_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 73470,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VO62RAU/698928975/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_60bcb64c-26b9-5747-8fc6-986efaa78996/60bcb64c-26b9-5747-8fc6-986efaa78996_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 82408,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VO62RAU/698929002/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2012-01-01',
'seller_name': None,
'title': 'FORD FOCUS 1.6 TI-VCT 125 TITANIUM P/S Hatchback',
'transmission': 'automatic',
'trim': 'TI-VCT 125 TITANIUM P/S',
'vin': 'WF0KXXGCBKCE03462',
'year': 2012}
2026-03-28 14:02:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27VO62%2520RAU%27 HTTP/1.1" 200 None
2026-03-28 14:02:06 [bca.uk] INFO: Saving data for VO62%20RAU: {'created_time': 1774706526.345179, 'last_price_update_time': 1774706526.345199, 'auction_closing_time': 1774864800.0}
2026-03-28 14:02:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='VO62%2520RAU') HTTP/1.1" 204 0
2026-03-28 14:02:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KO15JZW/698928815/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/KO15JZW/42809875?sv=2020-08-04&st=2026-03-28T14%3A01%3A23Z&se=2026-03-28T14%3A26%3A23Z&sr=b&sp=r&sig=WtTYXpKYofDjFDmXev3jjoySms%2BztrBA4DkuQ5Y14aQ%3D)
2026-03-28 14:02:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EJ19URS/698294784/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/EJ19URS/42798170?sv=2020-08-04&st=2026-03-28T14%3A01%3A25Z&se=2026-03-28T14%3A26%3A25Z&sr=b&sp=r&sig=rAxmzY9RDaFtqRrL9CfX2gFSW4Q22XPI9rfpZk%2B4AL4%3D)
2026-03-28 14:02:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FH21UNX/698923269/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/FH21UNX/42809938?sv=2020-08-04&st=2026-03-28T14%3A01%3A25Z&se=2026-03-28T14%3A26%3A25Z&sr=b&sp=r&sig=DX6Iqw0wYrgXXc1Kaaa%2FZcBpc9wYL%2BSdFRwB6BQgkeE%3D)
2026-03-28 14:02:06 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YW64DGU/698928824/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698928824>
2026-03-28 14:02:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WA15XTF/697938658/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/WA15XTF/42809463?sv=2020-08-04&st=2026-03-28T14%3A01%3A23Z&se=2026-03-28T14%3A26%3A23Z&sr=b&sp=r&sig=OVT1XXFunRJjcV5jy5Zgfxxi5O1xAq2cfTX%2F%2FcIif88%3D)
2026-03-28 14:02:06 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GU10UYN/698556192/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698556192>
2026-03-28 14:02:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WM19BFN/698601797/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/WM19BFN/42804238?sv=2020-08-04&st=2026-03-28T14%3A01%3A26Z&se=2026-03-28T14%3A26%3A26Z&sr=b&sp=r&sig=EfjfS2OdrtC4SA3uZ5XRiTu1xsVnQ9sqSYyb4MkUK3s%3D)
2026-03-28 14:02:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698513023%27 HTTP/1.1" 200 None
2026-03-28 14:02:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698513023 not downloaded yet
2026-03-28 14:02:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SH14BOU/698522113/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/SH14BOU/42810142?sv=2020-08-04&st=2026-03-28T14%3A01%3A23Z&se=2026-03-28T14%3A26%3A23Z&sr=b&sp=r&sig=qF%2Fj8vLm9uL8z4mTnCxa7QRX8NL1HO0if01okEQdE50%3D)
2026-03-28 14:02:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D697881127%27 HTTP/1.1" 200 None
2026-03-28 14:02:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=697881127 not downloaded yet
2026-03-28 14:02:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698513038%27 HTTP/1.1" 200 None
2026-03-28 14:02:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698513038 not downloaded yet
2026-03-28 14:02:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D697881130%27 HTTP/1.1" 200 None
2026-03-28 14:02:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=697881130 not downloaded yet
2026-03-28 14:02:06 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:02:06 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:02:06 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:02:06 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:02:06 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:02:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:02:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a1fd74550>
2026-03-28 14:02:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:02:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:02:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:02:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_24b3d1e2-9046-567a-ba39-2d683a6b4342/24b3d1e2-9046-567a-ba39-2d683a6b4342_image_7.jpg HTTP/1.1" 201 0
2026-03-28 14:02:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FGU10UYN%252F698556209%252F600') HTTP/1.1" 204 0
2026-03-28 14:02:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GU10UYN/698556209/600 saved to cache
2026-03-28 14:02:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 24b3d1e2-9046-567a-ba39-2d683a6b4342
2026-03-28 14:02:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698513049%27 HTTP/1.1" 200 None
2026-03-28 14:02:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698513049 not downloaded yet
2026-03-28 14:02:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AM58MHU/698953189/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/AM58MHU/42810635?sv=2020-08-04&st=2026-03-28T14%3A01%3A23Z&se=2026-03-28T14%3A26%3A23Z&sr=b&sp=r&sig=MTxN3XqRDWL9DG88ixDAxTc9KDbrCYbR3DQJ2mNHaYw%3D)
2026-03-28 14:02:06 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SH14BOU/698522101/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698522101>
2026-03-28 14:02:06 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EJ19URS/698294773/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698294773>
2026-03-28 14:02:06 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WM19BFN/698601787/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=WM19BFN-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-28 14:02:06 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LM20BCX/697881111/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=LM20BCX-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-28 14:02:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D697881133%27 HTTP/1.1" 200 None
2026-03-28 14:02:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=697881133 not downloaded yet
2026-03-28 14:02:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SB65CAX/697544395/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/SB65CAX/42810123?sv=2020-08-04&st=2026-03-28T14%3A01%3A23Z&se=2026-03-28T14%3A26%3A23Z&sr=b&sp=r&sig=vTzzhGIuSP84%2BuZVufy4vR0mq7%2F9VRE2bdnD30Ub%2FBU%3D)
2026-03-28 14:02:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SF65MRS/698522099/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/SF65MRS/42810141?sv=2020-08-04&st=2026-03-28T14%3A01%3A23Z&se=2026-03-28T14%3A26%3A23Z&sr=b&sp=r&sig=pKcKPXIMRDrpvR7qgfCAU8Cghh7jF%2FL25jpHeT9Gs0U%3D)
2026-03-28 14:02:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698513056%27 HTTP/1.1" 200 None
2026-03-28 14:02:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698513056 not downloaded yet
2026-03-28 14:02:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D697881137%27 HTTP/1.1" 200 None
2026-03-28 14:02:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=697881137 not downloaded yet
2026-03-28 14:02:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698513066%27 HTTP/1.1" 200 None
2026-03-28 14:02:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698513066 not downloaded yet
2026-03-28 14:02:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:02:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2d99da10>
2026-03-28 14:02:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:02:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:02:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:02:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7cdb5790-795c-503b-b01e-2ccf288a1773/7cdb5790-795c-503b-b01e-2ccf288a1773_image_2.jpg HTTP/1.1" 201 0
2026-03-28 14:02:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FKO15JZW%252F698928815%252F600') HTTP/1.1" 204 0
2026-03-28 14:02:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KO15JZW/698928815/600 saved to cache
2026-03-28 14:02:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 7cdb5790-795c-503b-b01e-2ccf288a1773
2026-03-28 14:02:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:02:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2ca80a90>
2026-03-28 14:02:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:02:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:02:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:02:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_755baf27-b55d-5033-a837-c4d9f3659c0e/755baf27-b55d-5033-a837-c4d9f3659c0e_image_2.jpg HTTP/1.1" 201 0
2026-03-28 14:02:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FEJ19URS%252F698294784%252F600') HTTP/1.1" 204 0
2026-03-28 14:02:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EJ19URS/698294784/600 saved to cache
2026-03-28 14:02:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 755baf27-b55d-5033-a837-c4d9f3659c0e
2026-03-28 14:02:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:02:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c0d8ed0>
2026-03-28 14:02:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:02:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:02:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:02:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a610f6fb-a046-5c2e-8701-0fcb295f97f1/a610f6fb-a046-5c2e-8701-0fcb295f97f1_image_2.jpg HTTP/1.1" 201 0
2026-03-28 14:02:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FFH21UNX%252F698923269%252F600') HTTP/1.1" 204 0
2026-03-28 14:02:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FH21UNX/698923269/600 saved to cache
2026-03-28 14:02:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item a610f6fb-a046-5c2e-8701-0fcb295f97f1
2026-03-28 14:02:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:02:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a30122a50>
2026-03-28 14:02:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:02:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:02:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:02:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_012921cb-8763-5e72-9bbe-1684326c9a1d/012921cb-8763-5e72-9bbe-1684326c9a1d_image_5.jpg HTTP/1.1" 201 0
2026-03-28 14:02:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FWA15XTF%252F697938658%252F600') HTTP/1.1" 204 0
2026-03-28 14:02:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WA15XTF/697938658/600 saved to cache
2026-03-28 14:02:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 012921cb-8763-5e72-9bbe-1684326c9a1d
2026-03-28 14:02:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:02:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a1ff16c10>
2026-03-28 14:02:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:02:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:02:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:02:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_94badcac-d91d-5664-a6fe-32adc35ee01a/94badcac-d91d-5664-a6fe-32adc35ee01a_image_1.jpg HTTP/1.1" 201 0
2026-03-28 14:02:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FWM19BFN%252F698601797%252F600') HTTP/1.1" 204 0
2026-03-28 14:02:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WM19BFN/698601797/600 saved to cache
2026-03-28 14:02:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 94badcac-d91d-5664-a6fe-32adc35ee01a
2026-03-28 14:02:06 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:02:06 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:02:06 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:02:06 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:02:06 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:02:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:02:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c78b050>
2026-03-28 14:02:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:02:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:02:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:02:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7ca8ff92-ba13-58b4-8b9a-c74a2e2ed8c1/7ca8ff92-ba13-58b4-8b9a-c74a2e2ed8c1_image_7.jpg HTTP/1.1" 201 0
2026-03-28 14:02:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FSH14BOU%252F698522113%252F600') HTTP/1.1" 204 0
2026-03-28 14:02:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SH14BOU/698522113/600 saved to cache
2026-03-28 14:02:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 7ca8ff92-ba13-58b4-8b9a-c74a2e2ed8c1
2026-03-28 14:02:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/FG69CVL/42809636?sv=2020-08-04&st=2026-03-28T14%3A02%3A04Z&se=2026-03-28T14%3A27%3A04Z&sr=b&sp=r&sig=P34fgJ9Qf70HeZZwk9%2FG1lItlUdcz1Isp5BChiVs1ZQ%3D> (referer: https://www.bca.co.uk/)
2026-03-28 14:02:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D697881140%27 HTTP/1.1" 200 None
2026-03-28 14:02:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=697881140 not downloaded yet
2026-03-28 14:02:06 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LM20BCX/697881117/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=697881117>
2026-03-28 14:02:06 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KM69NXO/698513010/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=KM69NXO-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-28 14:02:06 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LM20BCX/697881122/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=697881122>
2026-03-28 14:02:06 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FH21UNX/698923258/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698923258>
2026-03-28 14:02:06 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KO15JZW/698928796/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698928796>
2026-03-28 14:02:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YW64DGU/698928824/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YW64DGU/42810194?sv=2020-08-04&st=2026-03-28T14%3A01%3A23Z&se=2026-03-28T14%3A26%3A23Z&sr=b&sp=r&sig=bKUUxkl%2FQOTN6xP3oKLYX53uOLW1seBVRfhSdF3FtAg%3D)
2026-03-28 14:02:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GU10UYN/698556192/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/GU10UYN/42810320?sv=2020-08-04&st=2026-03-28T14%3A01%3A23Z&se=2026-03-28T14%3A26%3A23Z&sr=b&sp=r&sig=mGNhX9MAfZVu5g6PpXH03XgVnNc%2FnLjEd8Y2gqIppCM%3D)
2026-03-28 14:02:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698513085%27 HTTP/1.1" 200 None
2026-03-28 14:02:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698513085 not downloaded yet
2026-03-28 14:02:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D697881143%27 HTTP/1.1" 200 None
2026-03-28 14:02:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=697881143 not downloaded yet
2026-03-28 14:02:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698513101%27 HTTP/1.1" 200 None
2026-03-28 14:02:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698513101 not downloaded yet
2026-03-28 14:02:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:02:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2d9823d0>
2026-03-28 14:02:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:02:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:02:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:02:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_29da6c1c-854f-50ff-9030-4ad1ff36e423/29da6c1c-854f-50ff-9030-4ad1ff36e423_image_8.jpg HTTP/1.1" 201 0
2026-03-28 14:02:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FAM58MHU%252F698953189%252F600') HTTP/1.1" 204 0
2026-03-28 14:02:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AM58MHU/698953189/600 saved to cache
2026-03-28 14:02:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 29da6c1c-854f-50ff-9030-4ad1ff36e423
2026-03-28 14:02:07 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:02:07 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:02:07 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:02:07 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:02:07 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:02:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:02:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a1fe8fe10>
2026-03-28 14:02:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:02:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:02:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:02:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_05412951-b5cb-5847-b7df-8f166615ed23/05412951-b5cb-5847-b7df-8f166615ed23_image_8.jpg HTTP/1.1" 201 0
2026-03-28 14:02:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FSB65CAX%252F697544395%252F600') HTTP/1.1" 204 0
2026-03-28 14:02:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SB65CAX/697544395/600 saved to cache
2026-03-28 14:02:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 05412951-b5cb-5847-b7df-8f166615ed23
2026-03-28 14:02:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:02:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c4d08d0>
2026-03-28 14:02:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:02:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:02:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:02:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_228041df-5797-5c8f-89c8-2a337a640ead/228041df-5797-5c8f-89c8-2a337a640ead_image_5.jpg HTTP/1.1" 201 0
2026-03-28 14:02:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FSF65MRS%252F698522099%252F600') HTTP/1.1" 204 0
2026-03-28 14:02:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SF65MRS/698522099/600 saved to cache
2026-03-28 14:02:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 228041df-5797-5c8f-89c8-2a337a640ead
2026-03-28 14:02:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698513122%27 HTTP/1.1" 200 None
2026-03-28 14:02:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698513122 not downloaded yet
2026-03-28 14:02:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WM19BFN/698601787/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/WM19BFN/42804238?sv=2020-08-04&st=2026-03-28T14%3A01%3A26Z&se=2026-03-28T14%3A26%3A26Z&sr=b&sp=r&sig=EfjfS2OdrtC4SA3uZ5XRiTu1xsVnQ9sqSYyb4MkUK3s%3D)
2026-03-28 14:02:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LM20BCX/697881111/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LM20BCX/42809490?sv=2020-08-04&st=2026-03-28T14%3A02%3A02Z&se=2026-03-28T14%3A27%3A02Z&sr=b&sp=r&sig=g557aIjJSDwFB6Q4O2a74JuAlQnchKG2JnTAytjD834%3D)
2026-03-28 14:02:07 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LM20BCX/697881125/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=697881125>
2026-03-28 14:02:07 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KM69NXO/698513038/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698513038>
2026-03-28 14:02:07 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KM69NXO/698513049/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698513049>
2026-03-28 14:02:07 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LM20BCX/697881130/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=697881130>
2026-03-28 14:02:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EJ19URS/698294773/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/EJ19URS/42798170?sv=2020-08-04&st=2026-03-28T14%3A01%3A25Z&se=2026-03-28T14%3A26%3A25Z&sr=b&sp=r&sig=rAxmzY9RDaFtqRrL9CfX2gFSW4Q22XPI9rfpZk%2B4AL4%3D)
2026-03-28 14:02:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SH14BOU/698522101/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/SH14BOU/42810142?sv=2020-08-04&st=2026-03-28T14%3A01%3A23Z&se=2026-03-28T14%3A26%3A23Z&sr=b&sp=r&sig=qF%2Fj8vLm9uL8z4mTnCxa7QRX8NL1HO0if01okEQdE50%3D)
2026-03-28 14:02:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698513136%27 HTTP/1.1" 200 None
2026-03-28 14:02:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698513136 not downloaded yet
2026-03-28 14:02:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:02:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c5f8e90>
2026-03-28 14:02:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:02:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:02:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:02:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a61064e7-41bf-5802-a31a-8f53de5bad6b/a61064e7-41bf-5802-a31a-8f53de5bad6b_expert_report_file_a4707147-8062-449e-b7dc-cc7fb5858535.pdf HTTP/1.1" 201 0
2026-03-28 14:02:07 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item a61064e7-41bf-5802-a31a-8f53de5bad6b
2026-03-28 14:02:07 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: a61064e7-41bf-5802-a31a-8f53de5bad6b, skipping ID generation
2026-03-28 14:02:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item a61064e7-41bf-5802-a31a-8f53de5bad6b
2026-03-28 14:02:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DFG69CVL-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-28 14:02:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=FG69CVL-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-28 14:02:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:02:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a1ff4e9d0>
2026-03-28 14:02:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:02:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:02:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:02:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5b546abb-9cfb-537e-b2ac-6d60a5514e55/5b546abb-9cfb-537e-b2ac-6d60a5514e55_image_3.jpg HTTP/1.1" 201 0
2026-03-28 14:02:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FYW64DGU%252F698928824%252F600') HTTP/1.1" 204 0
2026-03-28 14:02:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YW64DGU/698928824/600 saved to cache
2026-03-28 14:02:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 5b546abb-9cfb-537e-b2ac-6d60a5514e55
2026-03-28 14:02:07 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:02:07 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:02:07 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:02:07 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:02:07 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:02:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:02:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c606550>
2026-03-28 14:02:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:02:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:02:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:02:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_24b3d1e2-9046-567a-ba39-2d683a6b4342/24b3d1e2-9046-567a-ba39-2d683a6b4342_image_6.jpg HTTP/1.1" 201 0
2026-03-28 14:02:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FGU10UYN%252F698556192%252F600') HTTP/1.1" 204 0
2026-03-28 14:02:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GU10UYN/698556192/600 saved to cache
2026-03-28 14:02:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 24b3d1e2-9046-567a-ba39-2d683a6b4342
2026-03-28 14:02:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KM69NXO/698513010/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/KM69NXO/42810238?sv=2020-08-04&st=2026-03-28T14%3A02%3A02Z&se=2026-03-28T14%3A27%3A02Z&sr=b&sp=r&sig=eleTkVzAg4kayIg0miOr76ihVO5eK6DPyxPFH4fmeZ8%3D)
2026-03-28 14:02:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FH21UNX/698923258/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/FH21UNX/42809938?sv=2020-08-04&st=2026-03-28T14%3A01%3A25Z&se=2026-03-28T14%3A26%3A25Z&sr=b&sp=r&sig=DX6Iqw0wYrgXXc1Kaaa%2FZcBpc9wYL%2BSdFRwB6BQgkeE%3D)
2026-03-28 14:02:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LM20BCX/697881122/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LM20BCX/42809490?sv=2020-08-04&st=2026-03-28T14%3A02%3A02Z&se=2026-03-28T14%3A27%3A02Z&sr=b&sp=r&sig=g557aIjJSDwFB6Q4O2a74JuAlQnchKG2JnTAytjD834%3D)
2026-03-28 14:02:07 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LM20BCX/697881137/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=697881137>
2026-03-28 14:02:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LM20BCX/697881117/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LM20BCX/42809490?sv=2020-08-04&st=2026-03-28T14%3A02%3A02Z&se=2026-03-28T14%3A27%3A02Z&sr=b&sp=r&sig=g557aIjJSDwFB6Q4O2a74JuAlQnchKG2JnTAytjD834%3D)
2026-03-28 14:02:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KO15JZW/698928796/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/KO15JZW/42809875?sv=2020-08-04&st=2026-03-28T14%3A01%3A23Z&se=2026-03-28T14%3A26%3A23Z&sr=b&sp=r&sig=WtTYXpKYofDjFDmXev3jjoySms%2BztrBA4DkuQ5Y14aQ%3D)
2026-03-28 14:02:07 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KM69NXO/698513056/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698513056>
2026-03-28 14:02:07 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KM69NXO/698513066/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698513066>
2026-03-28 14:02:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698920510%27 HTTP/1.1" 200 None
2026-03-28 14:02:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698920510 not downloaded yet
2026-03-28 14:02:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698920518%27 HTTP/1.1" 200 None
2026-03-28 14:02:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698920518 not downloaded yet
2026-03-28 14:02:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:02:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c9ddb10>
2026-03-28 14:02:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:02:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:02:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:02:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_94badcac-d91d-5664-a6fe-32adc35ee01a/94badcac-d91d-5664-a6fe-32adc35ee01a_image_0.jpg HTTP/1.1" 201 0
2026-03-28 14:02:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FWM19BFN%252F698601787%252F600') HTTP/1.1" 204 0
2026-03-28 14:02:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WM19BFN/698601787/600 saved to cache
2026-03-28 14:02:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 94badcac-d91d-5664-a6fe-32adc35ee01a
2026-03-28 14:02:07 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 94badcac-d91d-5664-a6fe-32adc35ee01a, skipping ID generation
2026-03-28 14:02:07 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 94badcac-d91d-5664-a6fe-32adc35ee01a sending to next pipeline
2026-03-28 14:02:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 94badcac-d91d-5664-a6fe-32adc35ee01a, identifier: WM19%20BFN
2026-03-28 14:02:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:02:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2ca815d0>
2026-03-28 14:02:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:02:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:02:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:02:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_62f297d6-6b1d-5054-88b1-7c86565bdaf1/62f297d6-6b1d-5054-88b1-7c86565bdaf1_image_0.jpg HTTP/1.1" 201 0
2026-03-28 14:02:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLM20BCX%252F697881111%252F600') HTTP/1.1" 204 0
2026-03-28 14:02:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LM20BCX/697881111/600 saved to cache
2026-03-28 14:02:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 62f297d6-6b1d-5054-88b1-7c86565bdaf1
2026-03-28 14:02:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:02:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c9c9810>
2026-03-28 14:02:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:02:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:02:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:02:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_755baf27-b55d-5033-a837-c4d9f3659c0e/755baf27-b55d-5033-a837-c4d9f3659c0e_image_1.jpg HTTP/1.1" 201 0
2026-03-28 14:02:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FEJ19URS%252F698294773%252F600') HTTP/1.1" 204 0
2026-03-28 14:02:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EJ19URS/698294773/600 saved to cache
2026-03-28 14:02:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 755baf27-b55d-5033-a837-c4d9f3659c0e
2026-03-28 14:02:07 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 755baf27-b55d-5033-a837-c4d9f3659c0e, skipping ID generation
2026-03-28 14:02:07 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 755baf27-b55d-5033-a837-c4d9f3659c0e sending to next pipeline
2026-03-28 14:02:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 755baf27-b55d-5033-a837-c4d9f3659c0e, identifier: EJ19%20URS
2026-03-28 14:02:07 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:02:07 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:02:07 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:02:07 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:02:07 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:02:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:02:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2d756e90>
2026-03-28 14:02:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:02:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:02:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:02:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7ca8ff92-ba13-58b4-8b9a-c74a2e2ed8c1/7ca8ff92-ba13-58b4-8b9a-c74a2e2ed8c1_image_6.jpg HTTP/1.1" 201 0
2026-03-28 14:02:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FSH14BOU%252F698522101%252F600') HTTP/1.1" 204 0
2026-03-28 14:02:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SH14BOU/698522101/600 saved to cache
2026-03-28 14:02:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 7ca8ff92-ba13-58b4-8b9a-c74a2e2ed8c1
2026-03-28 14:02:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698920524%27 HTTP/1.1" 200 None
2026-03-28 14:02:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698920524 not downloaded yet
2026-03-28 14:02:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 94badcac-d91d-5664-a6fe-32adc35ee01a with identifier: WM19%20BFN
2026-03-28 14:02:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 94badcac-d91d-5664-a6fe-32adc35ee01a with identifier: WM19%20BFN
2026-03-28 14:02:08 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 94badcac-d91d-5664-a6fe-32adc35ee01a with identifier: WM19%20BFN to the API
2026-03-28 14:02:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:02:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:02:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WM19BFN/698601787/600>
{'auction_title': '',
'c_o_2_emission_value': 126,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_94badcac-d91d-5664-a6fe-32adc35ee01a/94badcac-d91d-5664-a6fe-32adc35ee01a_expert_report_file_57fdc3e2-ee9b-4e08-ba5e-8f54121aacdc.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=WM19%20BFN-GB',
'category': 'Car',
'color': 'black',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.0L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol',
'id': '94badcac-d91d-5664-a6fe-32adc35ee01a',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'WM19 BFN',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=WM19%20BFN&vehicleType=*',
'listing': 'auction',
'location': 'Enfield',
'make': 'FORD',
'model': 'FOCUS',
'odometer': 81059,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 11,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_94badcac-d91d-5664-a6fe-32adc35ee01a/94badcac-d91d-5664-a6fe-32adc35ee01a_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 47523,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WM19BFN/698601787/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_94badcac-d91d-5664-a6fe-32adc35ee01a/94badcac-d91d-5664-a6fe-32adc35ee01a_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 46853,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WM19BFN/698601797/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_94badcac-d91d-5664-a6fe-32adc35ee01a/94badcac-d91d-5664-a6fe-32adc35ee01a_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 43712,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WM19BFN/698601813/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_94badcac-d91d-5664-a6fe-32adc35ee01a/94badcac-d91d-5664-a6fe-32adc35ee01a_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 44061,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WM19BFN/698601833/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_94badcac-d91d-5664-a6fe-32adc35ee01a/94badcac-d91d-5664-a6fe-32adc35ee01a_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 44135,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WM19BFN/698601845/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_94badcac-d91d-5664-a6fe-32adc35ee01a/94badcac-d91d-5664-a6fe-32adc35ee01a_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 42885,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WM19BFN/698601858/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_94badcac-d91d-5664-a6fe-32adc35ee01a/94badcac-d91d-5664-a6fe-32adc35ee01a_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 90442,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WM19BFN/698601888/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_94badcac-d91d-5664-a6fe-32adc35ee01a/94badcac-d91d-5664-a6fe-32adc35ee01a_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 84999,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WM19BFN/698601908/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_94badcac-d91d-5664-a6fe-32adc35ee01a/94badcac-d91d-5664-a6fe-32adc35ee01a_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 92155,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WM19BFN/698601922/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_94badcac-d91d-5664-a6fe-32adc35ee01a/94badcac-d91d-5664-a6fe-32adc35ee01a_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 76043,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WM19BFN/698601937/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-01-01',
'seller_name': None,
'title': 'FORD FOCUS 1.0 E/B 125 TITANIUM Hatchback',
'transmission': 'automatic',
'trim': 'E/B 125 TITANIUM',
'vin': 'WF0NXXGCHNKE24057',
'year': 2019}
2026-03-28 14:02:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WM19%2520BFN%27 HTTP/1.1" 200 None
2026-03-28 14:02:08 [bca.uk] INFO: Saving data for WM19%20BFN: {'created_time': 1774706528.402707, 'last_price_update_time': 1774706528.40272, 'auction_closing_time': 1774864800.0}
2026-03-28 14:02:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='WM19%2520BFN') HTTP/1.1" 204 0
2026-03-28 14:02:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 755baf27-b55d-5033-a837-c4d9f3659c0e with identifier: EJ19%20URS
2026-03-28 14:02:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 755baf27-b55d-5033-a837-c4d9f3659c0e with identifier: EJ19%20URS
2026-03-28 14:02:08 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 755baf27-b55d-5033-a837-c4d9f3659c0e with identifier: EJ19%20URS to the API
2026-03-28 14:02:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:02:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:02:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EJ19URS/698294773/600>
{'auction_title': '',
'c_o_2_emission_value': 136,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_755baf27-b55d-5033-a837-c4d9f3659c0e/755baf27-b55d-5033-a837-c4d9f3659c0e_expert_report_file_0c806693-de04-4ce0-9d98-46286799b122.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=EJ19%20URS-GB',
'category': 'Car',
'color': 'grey',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.5L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Diesel',
'id': '755baf27-b55d-5033-a837-c4d9f3659c0e',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'EJ19 URS',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=EJ19%20URS&vehicleType=*',
'listing': 'auction',
'location': 'Enfield',
'make': 'FORD',
'model': 'KUGA',
'odometer': 60892,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 11,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_755baf27-b55d-5033-a837-c4d9f3659c0e/755baf27-b55d-5033-a837-c4d9f3659c0e_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 48342,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EJ19URS/698294761/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_755baf27-b55d-5033-a837-c4d9f3659c0e/755baf27-b55d-5033-a837-c4d9f3659c0e_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 47344,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EJ19URS/698294773/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_755baf27-b55d-5033-a837-c4d9f3659c0e/755baf27-b55d-5033-a837-c4d9f3659c0e_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 44454,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EJ19URS/698294784/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_755baf27-b55d-5033-a837-c4d9f3659c0e/755baf27-b55d-5033-a837-c4d9f3659c0e_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 44487,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EJ19URS/698294798/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_755baf27-b55d-5033-a837-c4d9f3659c0e/755baf27-b55d-5033-a837-c4d9f3659c0e_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 45517,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EJ19URS/698294807/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_755baf27-b55d-5033-a837-c4d9f3659c0e/755baf27-b55d-5033-a837-c4d9f3659c0e_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 45125,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EJ19URS/698294822/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_755baf27-b55d-5033-a837-c4d9f3659c0e/755baf27-b55d-5033-a837-c4d9f3659c0e_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 85095,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EJ19URS/698294830/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_755baf27-b55d-5033-a837-c4d9f3659c0e/755baf27-b55d-5033-a837-c4d9f3659c0e_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 77306,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EJ19URS/698294848/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_755baf27-b55d-5033-a837-c4d9f3659c0e/755baf27-b55d-5033-a837-c4d9f3659c0e_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 87840,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EJ19URS/698294858/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_755baf27-b55d-5033-a837-c4d9f3659c0e/755baf27-b55d-5033-a837-c4d9f3659c0e_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 90969,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EJ19URS/698294872/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-01-01',
'seller_name': None,
'title': 'FORD KUGA 1.5 TDCI 120 2WD ST-LINE StationWagon',
'transmission': 'manual',
'trim': 'TDCI 120 2WD ST-LINE',
'vin': 'WF0AXXWPMAKK08268',
'year': 2019}
2026-03-28 14:02:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27EJ19%2520URS%27 HTTP/1.1" 200 None
2026-03-28 14:02:08 [bca.uk] INFO: Saving data for EJ19%20URS: {'created_time': 1774706528.789576, 'last_price_update_time': 1774706528.789587, 'auction_closing_time': 1774864800.0}
2026-03-28 14:02:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='EJ19%2520URS') HTTP/1.1" 204 0
2026-03-28 14:02:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KM69NXO/698513038/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/KM69NXO/42810238?sv=2020-08-04&st=2026-03-28T14%3A02%3A02Z&se=2026-03-28T14%3A27%3A02Z&sr=b&sp=r&sig=eleTkVzAg4kayIg0miOr76ihVO5eK6DPyxPFH4fmeZ8%3D)
2026-03-28 14:02:08 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KM69NXO/698513122/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698513122>
2026-03-28 14:02:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KM69NXO/698513049/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/KM69NXO/42810238?sv=2020-08-04&st=2026-03-28T14%3A02%3A02Z&se=2026-03-28T14%3A27%3A02Z&sr=b&sp=r&sig=eleTkVzAg4kayIg0miOr76ihVO5eK6DPyxPFH4fmeZ8%3D)
2026-03-28 14:02:08 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LM20BCX/697881143/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=697881143>
2026-03-28 14:02:08 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KM69NXO/698513085/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698513085>
2026-03-28 14:02:08 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KM69NXO/698513101/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698513101>
2026-03-28 14:02:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LM20BCX/697881125/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LM20BCX/42809490?sv=2020-08-04&st=2026-03-28T14%3A02%3A02Z&se=2026-03-28T14%3A27%3A02Z&sr=b&sp=r&sig=g557aIjJSDwFB6Q4O2a74JuAlQnchKG2JnTAytjD834%3D)
2026-03-28 14:02:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LM20BCX/697881130/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LM20BCX/42809490?sv=2020-08-04&st=2026-03-28T14%3A02%3A02Z&se=2026-03-28T14%3A27%3A02Z&sr=b&sp=r&sig=g557aIjJSDwFB6Q4O2a74JuAlQnchKG2JnTAytjD834%3D)
2026-03-28 14:02:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698920530%27 HTTP/1.1" 200 None
2026-03-28 14:02:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698920530 not downloaded yet
2026-03-28 14:02:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698920537%27 HTTP/1.1" 200 None
2026-03-28 14:02:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698920537 not downloaded yet
2026-03-28 14:02:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:02:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c644190>
2026-03-28 14:02:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:02:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:02:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:02:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_494cffc1-9b07-5d98-9c75-414638ff32d2/494cffc1-9b07-5d98-9c75-414638ff32d2_image_0.jpg HTTP/1.1" 201 0
2026-03-28 14:02:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FKM69NXO%252F698513010%252F600') HTTP/1.1" 204 0
2026-03-28 14:02:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KM69NXO/698513010/600 saved to cache
2026-03-28 14:02:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 494cffc1-9b07-5d98-9c75-414638ff32d2
2026-03-28 14:02:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:02:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2deab290>
2026-03-28 14:02:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:02:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:02:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:02:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a610f6fb-a046-5c2e-8701-0fcb295f97f1/a610f6fb-a046-5c2e-8701-0fcb295f97f1_image_1.jpg HTTP/1.1" 201 0
2026-03-28 14:02:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FFH21UNX%252F698923258%252F600') HTTP/1.1" 204 0
2026-03-28 14:02:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FH21UNX/698923258/600 saved to cache
2026-03-28 14:02:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item a610f6fb-a046-5c2e-8701-0fcb295f97f1
2026-03-28 14:02:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:02:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2d734c50>
2026-03-28 14:02:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:02:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:02:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:02:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_62f297d6-6b1d-5054-88b1-7c86565bdaf1/62f297d6-6b1d-5054-88b1-7c86565bdaf1_image_2.jpg HTTP/1.1" 201 0
2026-03-28 14:02:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLM20BCX%252F697881122%252F600') HTTP/1.1" 204 0
2026-03-28 14:02:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LM20BCX/697881122/600 saved to cache
2026-03-28 14:02:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 62f297d6-6b1d-5054-88b1-7c86565bdaf1
2026-03-28 14:02:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:02:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2ddfb4d0>
2026-03-28 14:02:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:02:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:02:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:02:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_62f297d6-6b1d-5054-88b1-7c86565bdaf1/62f297d6-6b1d-5054-88b1-7c86565bdaf1_image_1.jpg HTTP/1.1" 201 0
2026-03-28 14:02:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLM20BCX%252F697881117%252F600') HTTP/1.1" 204 0
2026-03-28 14:02:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LM20BCX/697881117/600 saved to cache
2026-03-28 14:02:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 62f297d6-6b1d-5054-88b1-7c86565bdaf1
2026-03-28 14:02:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:02:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2d981d10>
2026-03-28 14:02:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:02:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:02:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:02:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7cdb5790-795c-503b-b01e-2ccf288a1773/7cdb5790-795c-503b-b01e-2ccf288a1773_image_1.jpg HTTP/1.1" 201 0
2026-03-28 14:02:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FKO15JZW%252F698928796%252F600') HTTP/1.1" 204 0
2026-03-28 14:02:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KO15JZW/698928796/600 saved to cache
2026-03-28 14:02:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 7cdb5790-795c-503b-b01e-2ccf288a1773
2026-03-28 14:02:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KM69NXO/698513056/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/KM69NXO/42810238?sv=2020-08-04&st=2026-03-28T14%3A02%3A02Z&se=2026-03-28T14%3A27%3A02Z&sr=b&sp=r&sig=eleTkVzAg4kayIg0miOr76ihVO5eK6DPyxPFH4fmeZ8%3D)
2026-03-28 14:02:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KM69NXO/698513066/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/KM69NXO/42810238?sv=2020-08-04&st=2026-03-28T14%3A02%3A02Z&se=2026-03-28T14%3A27%3A02Z&sr=b&sp=r&sig=eleTkVzAg4kayIg0miOr76ihVO5eK6DPyxPFH4fmeZ8%3D)
2026-03-28 14:02:09 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LM20BCX/697881127/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=697881127>
2026-03-28 14:02:09 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LM20BCX/697881133/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=697881133>
2026-03-28 14:02:09 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LM20BCX/697881140/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=697881140>
2026-03-28 14:02:09 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KM69NXO/698513136/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698513136>
2026-03-28 14:02:09 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FG69CVL/698920504/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=FG69CVL-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-28 14:02:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698920549%27 HTTP/1.1" 200 None
2026-03-28 14:02:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698920549 not downloaded yet
2026-03-28 14:02:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LM20BCX/697881137/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LM20BCX/42809490?sv=2020-08-04&st=2026-03-28T14%3A02%3A02Z&se=2026-03-28T14%3A27%3A02Z&sr=b&sp=r&sig=g557aIjJSDwFB6Q4O2a74JuAlQnchKG2JnTAytjD834%3D)
2026-03-28 14:02:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698920562%27 HTTP/1.1" 200 None
2026-03-28 14:02:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698920562 not downloaded yet
2026-03-28 14:02:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:02:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2d73da50>
2026-03-28 14:02:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:02:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:02:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:02:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_494cffc1-9b07-5d98-9c75-414638ff32d2/494cffc1-9b07-5d98-9c75-414638ff32d2_image_2.jpg HTTP/1.1" 201 0
2026-03-28 14:02:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FKM69NXO%252F698513038%252F600') HTTP/1.1" 204 0
2026-03-28 14:02:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KM69NXO/698513038/600 saved to cache
2026-03-28 14:02:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 494cffc1-9b07-5d98-9c75-414638ff32d2
2026-03-28 14:02:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:02:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c0eff90>
2026-03-28 14:02:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:02:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:02:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:02:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_494cffc1-9b07-5d98-9c75-414638ff32d2/494cffc1-9b07-5d98-9c75-414638ff32d2_image_3.jpg HTTP/1.1" 201 0
2026-03-28 14:02:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FKM69NXO%252F698513049%252F600') HTTP/1.1" 204 0
2026-03-28 14:02:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KM69NXO/698513049/600 saved to cache
2026-03-28 14:02:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 494cffc1-9b07-5d98-9c75-414638ff32d2
2026-03-28 14:02:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:02:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a1feb0750>
2026-03-28 14:02:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:02:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:02:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:02:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_62f297d6-6b1d-5054-88b1-7c86565bdaf1/62f297d6-6b1d-5054-88b1-7c86565bdaf1_image_3.jpg HTTP/1.1" 201 0
2026-03-28 14:02:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLM20BCX%252F697881125%252F600') HTTP/1.1" 204 0
2026-03-28 14:02:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LM20BCX/697881125/600 saved to cache
2026-03-28 14:02:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 62f297d6-6b1d-5054-88b1-7c86565bdaf1
2026-03-28 14:02:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:02:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c0ee610>
2026-03-28 14:02:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:02:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:02:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:02:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_62f297d6-6b1d-5054-88b1-7c86565bdaf1/62f297d6-6b1d-5054-88b1-7c86565bdaf1_image_5.jpg HTTP/1.1" 201 0
2026-03-28 14:02:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLM20BCX%252F697881130%252F600') HTTP/1.1" 204 0
2026-03-28 14:02:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LM20BCX/697881130/600 saved to cache
2026-03-28 14:02:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 62f297d6-6b1d-5054-88b1-7c86565bdaf1
2026-03-28 14:02:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698920572%27 HTTP/1.1" 200 None
2026-03-28 14:02:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698920572 not downloaded yet
2026-03-28 14:02:09 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FG69CVL/698920518/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698920518>
2026-03-28 14:02:09 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WA15XTF/697938651/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=697938651>
2026-03-28 14:02:09 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KM69NXO/698513023/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698513023>
2026-03-28 14:02:09 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FG69CVL/698920510/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698920510>
2026-03-28 14:02:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KM69NXO/698513122/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/KM69NXO/42810238?sv=2020-08-04&st=2026-03-28T14%3A02%3A02Z&se=2026-03-28T14%3A27%3A02Z&sr=b&sp=r&sig=eleTkVzAg4kayIg0miOr76ihVO5eK6DPyxPFH4fmeZ8%3D)
2026-03-28 14:02:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KM69NXO/698513101/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/KM69NXO/42810238?sv=2020-08-04&st=2026-03-28T14%3A02%3A02Z&se=2026-03-28T14%3A27%3A02Z&sr=b&sp=r&sig=eleTkVzAg4kayIg0miOr76ihVO5eK6DPyxPFH4fmeZ8%3D)
2026-03-28 14:02:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KM69NXO/698513085/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/KM69NXO/42810238?sv=2020-08-04&st=2026-03-28T14%3A02%3A02Z&se=2026-03-28T14%3A27%3A02Z&sr=b&sp=r&sig=eleTkVzAg4kayIg0miOr76ihVO5eK6DPyxPFH4fmeZ8%3D)
2026-03-28 14:02:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LM20BCX/697881143/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LM20BCX/42809490?sv=2020-08-04&st=2026-03-28T14%3A02%3A02Z&se=2026-03-28T14%3A27%3A02Z&sr=b&sp=r&sig=g557aIjJSDwFB6Q4O2a74JuAlQnchKG2JnTAytjD834%3D)
2026-03-28 14:02:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698920584%27 HTTP/1.1" 200 None
2026-03-28 14:02:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698920584 not downloaded yet
2026-03-28 14:02:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:02:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c9f52d0>
2026-03-28 14:02:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:02:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:02:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:02:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_494cffc1-9b07-5d98-9c75-414638ff32d2/494cffc1-9b07-5d98-9c75-414638ff32d2_image_4.jpg HTTP/1.1" 201 0
2026-03-28 14:02:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FKM69NXO%252F698513056%252F600') HTTP/1.1" 204 0
2026-03-28 14:02:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KM69NXO/698513056/600 saved to cache
2026-03-28 14:02:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 494cffc1-9b07-5d98-9c75-414638ff32d2
2026-03-28 14:02:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:02:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c823e90>
2026-03-28 14:02:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:02:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:02:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:02:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_494cffc1-9b07-5d98-9c75-414638ff32d2/494cffc1-9b07-5d98-9c75-414638ff32d2_image_5.jpg HTTP/1.1" 201 0
2026-03-28 14:02:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FKM69NXO%252F698513066%252F600') HTTP/1.1" 204 0
2026-03-28 14:02:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KM69NXO/698513066/600 saved to cache
2026-03-28 14:02:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 494cffc1-9b07-5d98-9c75-414638ff32d2
2026-03-28 14:02:09 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:02:09 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:02:09 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:02:09 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:02:09 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:02:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:02:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2d73d610>
2026-03-28 14:02:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:02:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:02:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:02:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_62f297d6-6b1d-5054-88b1-7c86565bdaf1/62f297d6-6b1d-5054-88b1-7c86565bdaf1_image_7.jpg HTTP/1.1" 201 0
2026-03-28 14:02:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLM20BCX%252F697881137%252F600') HTTP/1.1" 204 0
2026-03-28 14:02:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LM20BCX/697881137/600 saved to cache
2026-03-28 14:02:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 62f297d6-6b1d-5054-88b1-7c86565bdaf1
2026-03-28 14:02:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FG69CVL/698920504/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/FG69CVL/42809636?sv=2020-08-04&st=2026-03-28T14%3A02%3A04Z&se=2026-03-28T14%3A27%3A04Z&sr=b&sp=r&sig=P34fgJ9Qf70HeZZwk9%2FG1lItlUdcz1Isp5BChiVs1ZQ%3D)
2026-03-28 14:02:09 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FG69CVL/698920537/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698920537>
2026-03-28 14:02:09 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FG69CVL/698920524/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698920524>
2026-03-28 14:02:09 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FG69CVL/698920530/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698920530>
2026-03-28 14:02:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KM69NXO/698513136/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/KM69NXO/42810238?sv=2020-08-04&st=2026-03-28T14%3A02%3A02Z&se=2026-03-28T14%3A27%3A02Z&sr=b&sp=r&sig=eleTkVzAg4kayIg0miOr76ihVO5eK6DPyxPFH4fmeZ8%3D)
2026-03-28 14:02:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LM20BCX/697881140/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LM20BCX/42809490?sv=2020-08-04&st=2026-03-28T14%3A02%3A02Z&se=2026-03-28T14%3A27%3A02Z&sr=b&sp=r&sig=g557aIjJSDwFB6Q4O2a74JuAlQnchKG2JnTAytjD834%3D)
2026-03-28 14:02:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LM20BCX/697881133/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LM20BCX/42809490?sv=2020-08-04&st=2026-03-28T14%3A02%3A02Z&se=2026-03-28T14%3A27%3A02Z&sr=b&sp=r&sig=g557aIjJSDwFB6Q4O2a74JuAlQnchKG2JnTAytjD834%3D)
2026-03-28 14:02:09 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:02:09 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:02:09 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:02:09 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:02:09 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:02:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:02:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c0cf090>
2026-03-28 14:02:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:02:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:02:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:02:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_494cffc1-9b07-5d98-9c75-414638ff32d2/494cffc1-9b07-5d98-9c75-414638ff32d2_image_8.jpg HTTP/1.1" 201 0
2026-03-28 14:02:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FKM69NXO%252F698513122%252F600') HTTP/1.1" 204 0
2026-03-28 14:02:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KM69NXO/698513122/600 saved to cache
2026-03-28 14:02:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 494cffc1-9b07-5d98-9c75-414638ff32d2
2026-03-28 14:02:09 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:02:09 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:02:09 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:02:09 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:02:09 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:02:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:02:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c856cd0>
2026-03-28 14:02:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:02:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:02:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:02:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_494cffc1-9b07-5d98-9c75-414638ff32d2/494cffc1-9b07-5d98-9c75-414638ff32d2_image_7.jpg HTTP/1.1" 201 0
2026-03-28 14:02:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FKM69NXO%252F698513101%252F600') HTTP/1.1" 204 0
2026-03-28 14:02:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KM69NXO/698513101/600 saved to cache
2026-03-28 14:02:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 494cffc1-9b07-5d98-9c75-414638ff32d2
2026-03-28 14:02:09 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:02:09 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:02:09 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:02:09 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:02:09 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:02:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:02:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c134d90>
2026-03-28 14:02:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:02:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:02:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:02:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_494cffc1-9b07-5d98-9c75-414638ff32d2/494cffc1-9b07-5d98-9c75-414638ff32d2_image_6.jpg HTTP/1.1" 201 0
2026-03-28 14:02:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FKM69NXO%252F698513085%252F600') HTTP/1.1" 204 0
2026-03-28 14:02:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KM69NXO/698513085/600 saved to cache
2026-03-28 14:02:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 494cffc1-9b07-5d98-9c75-414638ff32d2
2026-03-28 14:02:09 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:02:09 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:02:09 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:02:09 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:02:09 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:02:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:02:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a1ff35190>
2026-03-28 14:02:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:02:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:02:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:02:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_62f297d6-6b1d-5054-88b1-7c86565bdaf1/62f297d6-6b1d-5054-88b1-7c86565bdaf1_image_9.jpg HTTP/1.1" 201 0
2026-03-28 14:02:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLM20BCX%252F697881143%252F600') HTTP/1.1" 204 0
2026-03-28 14:02:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LM20BCX/697881143/600 saved to cache
2026-03-28 14:02:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 62f297d6-6b1d-5054-88b1-7c86565bdaf1
2026-03-28 14:02:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LM20BCX/697881127/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LM20BCX/42809490?sv=2020-08-04&st=2026-03-28T14%3A02%3A02Z&se=2026-03-28T14%3A27%3A02Z&sr=b&sp=r&sig=g557aIjJSDwFB6Q4O2a74JuAlQnchKG2JnTAytjD834%3D)
2026-03-28 14:02:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FG69CVL/698920518/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/FG69CVL/42809636?sv=2020-08-04&st=2026-03-28T14%3A02%3A04Z&se=2026-03-28T14%3A27%3A04Z&sr=b&sp=r&sig=P34fgJ9Qf70HeZZwk9%2FG1lItlUdcz1Isp5BChiVs1ZQ%3D)
2026-03-28 14:02:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FG69CVL/698920510/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/FG69CVL/42809636?sv=2020-08-04&st=2026-03-28T14%3A02%3A04Z&se=2026-03-28T14%3A27%3A04Z&sr=b&sp=r&sig=P34fgJ9Qf70HeZZwk9%2FG1lItlUdcz1Isp5BChiVs1ZQ%3D)
2026-03-28 14:02:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WA15XTF/697938651/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/WA15XTF/42809463?sv=2020-08-04&st=2026-03-28T14%3A01%3A23Z&se=2026-03-28T14%3A26%3A23Z&sr=b&sp=r&sig=OVT1XXFunRJjcV5jy5Zgfxxi5O1xAq2cfTX%2F%2FcIif88%3D)
2026-03-28 14:02:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KM69NXO/698513023/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/KM69NXO/42810238?sv=2020-08-04&st=2026-03-28T14%3A02%3A02Z&se=2026-03-28T14%3A27%3A02Z&sr=b&sp=r&sig=eleTkVzAg4kayIg0miOr76ihVO5eK6DPyxPFH4fmeZ8%3D)
2026-03-28 14:02:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:02:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c1734d0>
2026-03-28 14:02:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:02:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:02:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:02:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a61064e7-41bf-5802-a31a-8f53de5bad6b/a61064e7-41bf-5802-a31a-8f53de5bad6b_image_0.jpg HTTP/1.1" 201 0
2026-03-28 14:02:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FFG69CVL%252F698920504%252F600') HTTP/1.1" 204 0
2026-03-28 14:02:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FG69CVL/698920504/600 saved to cache
2026-03-28 14:02:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item a61064e7-41bf-5802-a31a-8f53de5bad6b
2026-03-28 14:02:09 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:02:09 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:02:09 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:02:09 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:02:09 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:02:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:02:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a1ff37210>
2026-03-28 14:02:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:02:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:02:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:02:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_494cffc1-9b07-5d98-9c75-414638ff32d2/494cffc1-9b07-5d98-9c75-414638ff32d2_image_9.jpg HTTP/1.1" 201 0
2026-03-28 14:02:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FKM69NXO%252F698513136%252F600') HTTP/1.1" 204 0
2026-03-28 14:02:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KM69NXO/698513136/600 saved to cache
2026-03-28 14:02:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 494cffc1-9b07-5d98-9c75-414638ff32d2
2026-03-28 14:02:09 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:02:09 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:02:09 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:02:09 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:02:09 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:02:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:02:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c9df650>
2026-03-28 14:02:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:02:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:02:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:02:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_62f297d6-6b1d-5054-88b1-7c86565bdaf1/62f297d6-6b1d-5054-88b1-7c86565bdaf1_image_8.jpg HTTP/1.1" 201 0
2026-03-28 14:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLM20BCX%252F697881140%252F600') HTTP/1.1" 204 0
2026-03-28 14:02:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LM20BCX/697881140/600 saved to cache
2026-03-28 14:02:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 62f297d6-6b1d-5054-88b1-7c86565bdaf1
2026-03-28 14:02:10 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:02:10 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:02:10 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:02:10 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:02:10 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:02:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:02:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c899f50>
2026-03-28 14:02:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:02:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:02:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:02:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_62f297d6-6b1d-5054-88b1-7c86565bdaf1/62f297d6-6b1d-5054-88b1-7c86565bdaf1_image_6.jpg HTTP/1.1" 201 0
2026-03-28 14:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLM20BCX%252F697881133%252F600') HTTP/1.1" 204 0
2026-03-28 14:02:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LM20BCX/697881133/600 saved to cache
2026-03-28 14:02:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 62f297d6-6b1d-5054-88b1-7c86565bdaf1
2026-03-28 14:02:10 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FG69CVL/698920549/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698920549>
2026-03-28 14:02:10 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FG69CVL/698920562/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698920562>
2026-03-28 14:02:10 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FG69CVL/698920572/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698920572>
2026-03-28 14:02:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FG69CVL/698920537/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/FG69CVL/42809636?sv=2020-08-04&st=2026-03-28T14%3A02%3A04Z&se=2026-03-28T14%3A27%3A04Z&sr=b&sp=r&sig=P34fgJ9Qf70HeZZwk9%2FG1lItlUdcz1Isp5BChiVs1ZQ%3D)
2026-03-28 14:02:10 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FG69CVL/698920584/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698920584>
2026-03-28 14:02:10 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SF65MRS/698522093/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698522093>
2026-03-28 14:02:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FG69CVL/698920524/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/FG69CVL/42809636?sv=2020-08-04&st=2026-03-28T14%3A02%3A04Z&se=2026-03-28T14%3A27%3A04Z&sr=b&sp=r&sig=P34fgJ9Qf70HeZZwk9%2FG1lItlUdcz1Isp5BChiVs1ZQ%3D)
2026-03-28 14:02:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FG69CVL/698920530/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/FG69CVL/42809636?sv=2020-08-04&st=2026-03-28T14%3A02%3A04Z&se=2026-03-28T14%3A27%3A04Z&sr=b&sp=r&sig=P34fgJ9Qf70HeZZwk9%2FG1lItlUdcz1Isp5BChiVs1ZQ%3D)
2026-03-28 14:02:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:02:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c0cf6d0>
2026-03-28 14:02:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:02:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:02:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:02:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_62f297d6-6b1d-5054-88b1-7c86565bdaf1/62f297d6-6b1d-5054-88b1-7c86565bdaf1_image_4.jpg HTTP/1.1" 201 0
2026-03-28 14:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLM20BCX%252F697881127%252F600') HTTP/1.1" 204 0
2026-03-28 14:02:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LM20BCX/697881127/600 saved to cache
2026-03-28 14:02:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 62f297d6-6b1d-5054-88b1-7c86565bdaf1
2026-03-28 14:02:10 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 62f297d6-6b1d-5054-88b1-7c86565bdaf1, skipping ID generation
2026-03-28 14:02:10 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 62f297d6-6b1d-5054-88b1-7c86565bdaf1 sending to next pipeline
2026-03-28 14:02:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 62f297d6-6b1d-5054-88b1-7c86565bdaf1, identifier: LM20%20BCX
2026-03-28 14:02:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:02:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c0ff210>
2026-03-28 14:02:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:02:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:02:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:02:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a61064e7-41bf-5802-a31a-8f53de5bad6b/a61064e7-41bf-5802-a31a-8f53de5bad6b_image_2.jpg HTTP/1.1" 201 0
2026-03-28 14:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FFG69CVL%252F698920518%252F600') HTTP/1.1" 204 0
2026-03-28 14:02:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FG69CVL/698920518/600 saved to cache
2026-03-28 14:02:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item a61064e7-41bf-5802-a31a-8f53de5bad6b
2026-03-28 14:02:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:02:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c43ad90>
2026-03-28 14:02:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:02:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:02:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:02:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a61064e7-41bf-5802-a31a-8f53de5bad6b/a61064e7-41bf-5802-a31a-8f53de5bad6b_image_1.jpg HTTP/1.1" 201 0
2026-03-28 14:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FFG69CVL%252F698920510%252F600') HTTP/1.1" 204 0
2026-03-28 14:02:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FG69CVL/698920510/600 saved to cache
2026-03-28 14:02:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item a61064e7-41bf-5802-a31a-8f53de5bad6b
2026-03-28 14:02:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:02:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2d958d50>
2026-03-28 14:02:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:02:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:02:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:02:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_012921cb-8763-5e72-9bbe-1684326c9a1d/012921cb-8763-5e72-9bbe-1684326c9a1d_image_4.jpg HTTP/1.1" 201 0
2026-03-28 14:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FWA15XTF%252F697938651%252F600') HTTP/1.1" 204 0
2026-03-28 14:02:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WA15XTF/697938651/600 saved to cache
2026-03-28 14:02:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 012921cb-8763-5e72-9bbe-1684326c9a1d
2026-03-28 14:02:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:02:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c6b3710>
2026-03-28 14:02:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:02:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:02:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:02:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_494cffc1-9b07-5d98-9c75-414638ff32d2/494cffc1-9b07-5d98-9c75-414638ff32d2_image_1.jpg HTTP/1.1" 201 0
2026-03-28 14:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FKM69NXO%252F698513023%252F600') HTTP/1.1" 204 0
2026-03-28 14:02:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KM69NXO/698513023/600 saved to cache
2026-03-28 14:02:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 494cffc1-9b07-5d98-9c75-414638ff32d2
2026-03-28 14:02:10 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 494cffc1-9b07-5d98-9c75-414638ff32d2, skipping ID generation
2026-03-28 14:02:10 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 494cffc1-9b07-5d98-9c75-414638ff32d2 sending to next pipeline
2026-03-28 14:02:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 494cffc1-9b07-5d98-9c75-414638ff32d2, identifier: KM69%20NXO
2026-03-28 14:02:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 62f297d6-6b1d-5054-88b1-7c86565bdaf1 with identifier: LM20%20BCX
2026-03-28 14:02:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 62f297d6-6b1d-5054-88b1-7c86565bdaf1 with identifier: LM20%20BCX
2026-03-28 14:02:10 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 62f297d6-6b1d-5054-88b1-7c86565bdaf1 with identifier: LM20%20BCX to the API
2026-03-28 14:02:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:02:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:02:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LM20BCX/697881127/600>
{'auction_title': '',
'c_o_2_emission_value': 177,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_62f297d6-6b1d-5054-88b1-7c86565bdaf1/62f297d6-6b1d-5054-88b1-7c86565bdaf1_expert_report_file_5c5b1752-6db3-4334-9982-0193eede31e6.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=LM20%20BCX-GB',
'category': 'Car',
'color': 'grey',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.6L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol',
'id': '62f297d6-6b1d-5054-88b1-7c86565bdaf1',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'LM20 BCX',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=LM20%20BCX&vehicleType=*',
'listing': 'auction',
'location': 'Bristol',
'make': 'KIA',
'model': 'SPORTAGE',
'odometer': 30412,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 11,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_62f297d6-6b1d-5054-88b1-7c86565bdaf1/62f297d6-6b1d-5054-88b1-7c86565bdaf1_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 46402,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LM20BCX/697881111/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_62f297d6-6b1d-5054-88b1-7c86565bdaf1/62f297d6-6b1d-5054-88b1-7c86565bdaf1_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 46636,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LM20BCX/697881117/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_62f297d6-6b1d-5054-88b1-7c86565bdaf1/62f297d6-6b1d-5054-88b1-7c86565bdaf1_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 42679,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LM20BCX/697881122/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_62f297d6-6b1d-5054-88b1-7c86565bdaf1/62f297d6-6b1d-5054-88b1-7c86565bdaf1_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 43445,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LM20BCX/697881125/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_62f297d6-6b1d-5054-88b1-7c86565bdaf1/62f297d6-6b1d-5054-88b1-7c86565bdaf1_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 42504,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LM20BCX/697881127/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_62f297d6-6b1d-5054-88b1-7c86565bdaf1/62f297d6-6b1d-5054-88b1-7c86565bdaf1_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 41075,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LM20BCX/697881130/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_62f297d6-6b1d-5054-88b1-7c86565bdaf1/62f297d6-6b1d-5054-88b1-7c86565bdaf1_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 88973,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LM20BCX/697881133/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_62f297d6-6b1d-5054-88b1-7c86565bdaf1/62f297d6-6b1d-5054-88b1-7c86565bdaf1_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 75668,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LM20BCX/697881137/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_62f297d6-6b1d-5054-88b1-7c86565bdaf1/62f297d6-6b1d-5054-88b1-7c86565bdaf1_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 83595,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LM20BCX/697881140/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_62f297d6-6b1d-5054-88b1-7c86565bdaf1/62f297d6-6b1d-5054-88b1-7c86565bdaf1_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 68220,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LM20BCX/697881143/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-01-01',
'seller_name': None,
'title': 'KIA SPORTAGE 1.6 GDI 2 ISG StationWagon',
'transmission': 'manual',
'trim': 'GDI 2 ISG',
'vin': 'U5YPH814LML923940',
'year': 2020}
2026-03-28 14:02:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LM20%2520BCX%27 HTTP/1.1" 200 None
2026-03-28 14:02:11 [bca.uk] INFO: Saving data for LM20%20BCX: {'created_time': 1774706531.06187, 'last_price_update_time': 1774706531.061882, 'auction_closing_time': 1774864800.0}
2026-03-28 14:02:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='LM20%2520BCX') HTTP/1.1" 204 0
2026-03-28 14:02:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 494cffc1-9b07-5d98-9c75-414638ff32d2 with identifier: KM69%20NXO
2026-03-28 14:02:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 494cffc1-9b07-5d98-9c75-414638ff32d2 with identifier: KM69%20NXO
2026-03-28 14:02:11 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 494cffc1-9b07-5d98-9c75-414638ff32d2 with identifier: KM69%20NXO to the API
2026-03-28 14:02:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:02:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:02:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KM69NXO/698513023/600>
{'auction_title': '',
'c_o_2_emission_value': 114,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_494cffc1-9b07-5d98-9c75-414638ff32d2/494cffc1-9b07-5d98-9c75-414638ff32d2_expert_report_file_65d461db-2006-4323-b4f8-6e2474297fcd.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=KM69%20NXO-GB',
'category': 'Car',
'color': 'grey',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.1L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol',
'id': '494cffc1-9b07-5d98-9c75-414638ff32d2',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'KM69 NXO',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=KM69%20NXO&vehicleType=*',
'listing': 'auction',
'location': 'Measham',
'make': 'FORD',
'model': 'FIESTA',
'odometer': 48361,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 11,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_494cffc1-9b07-5d98-9c75-414638ff32d2/494cffc1-9b07-5d98-9c75-414638ff32d2_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 41320,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KM69NXO/698513010/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_494cffc1-9b07-5d98-9c75-414638ff32d2/494cffc1-9b07-5d98-9c75-414638ff32d2_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 42042,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KM69NXO/698513023/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_494cffc1-9b07-5d98-9c75-414638ff32d2/494cffc1-9b07-5d98-9c75-414638ff32d2_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 44443,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KM69NXO/698513038/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_494cffc1-9b07-5d98-9c75-414638ff32d2/494cffc1-9b07-5d98-9c75-414638ff32d2_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 43076,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KM69NXO/698513049/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_494cffc1-9b07-5d98-9c75-414638ff32d2/494cffc1-9b07-5d98-9c75-414638ff32d2_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 43001,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KM69NXO/698513056/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_494cffc1-9b07-5d98-9c75-414638ff32d2/494cffc1-9b07-5d98-9c75-414638ff32d2_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 42700,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KM69NXO/698513066/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_494cffc1-9b07-5d98-9c75-414638ff32d2/494cffc1-9b07-5d98-9c75-414638ff32d2_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 88839,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KM69NXO/698513085/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_494cffc1-9b07-5d98-9c75-414638ff32d2/494cffc1-9b07-5d98-9c75-414638ff32d2_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 71215,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KM69NXO/698513101/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_494cffc1-9b07-5d98-9c75-414638ff32d2/494cffc1-9b07-5d98-9c75-414638ff32d2_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 80235,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KM69NXO/698513122/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_494cffc1-9b07-5d98-9c75-414638ff32d2/494cffc1-9b07-5d98-9c75-414638ff32d2_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 70915,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KM69NXO/698513136/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-01-01',
'seller_name': None,
'title': 'FORD FIESTA 1.1 85 ZETEC Hatchback',
'transmission': 'manual',
'trim': '85 ZETEC',
'vin': 'WF0JXXGAHJKL00302',
'year': 2019}
2026-03-28 14:02:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KM69%2520NXO%27 HTTP/1.1" 200 None
2026-03-28 14:02:11 [bca.uk] INFO: Saving data for KM69%20NXO: {'created_time': 1774706531.589208, 'last_price_update_time': 1774706531.589221, 'auction_closing_time': 1774864800.0}
2026-03-28 14:02:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='KM69%2520NXO') HTTP/1.1" 204 0
2026-03-28 14:02:11 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WA15XTF/697938638/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=697938638>
2026-03-28 14:02:11 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SB65CAX/697544382/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=697544382>
2026-03-28 14:02:11 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KO15JZW/698928775/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=KO15JZW-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-28 14:02:11 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SH14BOU/698522088/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698522088>
2026-03-28 14:02:11 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/RA68WZE/42809489?sv=2020-08-04&st=2026-03-28T14%3A02%3A10Z&se=2026-03-28T14%3A27%3A10Z&sr=b&sp=r&sig=sGVqi7zLckoYL6nZquTH3Sr6GS2wBULLpmfzj%2F1aDfg%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=RA68%20WZE-GB>
2026-03-28 14:02:11 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FH21UNX/698923249/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=FH21UNX-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-28 14:02:11 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AM58MHU/698970540/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698970540>
2026-03-28 14:02:11 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/BG72UUY/42810237?sv=2020-08-04&st=2026-03-28T14%3A02%3A10Z&se=2026-03-28T14%3A27%3A10Z&sr=b&sp=r&sig=yK8cIYpeZ9TamlFDpK%2BgLwUjKNRsv8EzcqtGcUy7mrQ%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=BG72%20UUY-GB>
2026-03-28 14:02:11 [scrapy.extensions.logstats] INFO: Crawled 56 pages (at 40 pages/min), scraped 59 items (at 43 items/min)
2026-03-28 14:02:11 [scrapy.extensions.memusage] INFO: Peak memory usage is 191MiB
2026-03-28 14:02:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:02:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c4d2010>
2026-03-28 14:02:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:02:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:02:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:02:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a61064e7-41bf-5802-a31a-8f53de5bad6b/a61064e7-41bf-5802-a31a-8f53de5bad6b_image_5.jpg HTTP/1.1" 201 0
2026-03-28 14:02:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FFG69CVL%252F698920537%252F600') HTTP/1.1" 204 0
2026-03-28 14:02:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FG69CVL/698920537/600 saved to cache
2026-03-28 14:02:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item a61064e7-41bf-5802-a31a-8f53de5bad6b
2026-03-28 14:02:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:02:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c78a150>
2026-03-28 14:02:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:02:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:02:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:02:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a61064e7-41bf-5802-a31a-8f53de5bad6b/a61064e7-41bf-5802-a31a-8f53de5bad6b_image_3.jpg HTTP/1.1" 201 0
2026-03-28 14:02:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FFG69CVL%252F698920524%252F600') HTTP/1.1" 204 0
2026-03-28 14:02:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FG69CVL/698920524/600 saved to cache
2026-03-28 14:02:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item a61064e7-41bf-5802-a31a-8f53de5bad6b
2026-03-28 14:02:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:02:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c892d50>
2026-03-28 14:02:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:02:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:02:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:02:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a61064e7-41bf-5802-a31a-8f53de5bad6b/a61064e7-41bf-5802-a31a-8f53de5bad6b_image_4.jpg HTTP/1.1" 201 0
2026-03-28 14:02:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FFG69CVL%252F698920530%252F600') HTTP/1.1" 204 0
2026-03-28 14:02:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FG69CVL/698920530/600 saved to cache
2026-03-28 14:02:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item a61064e7-41bf-5802-a31a-8f53de5bad6b
2026-03-28 14:02:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FG69CVL/698920562/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/FG69CVL/42809636?sv=2020-08-04&st=2026-03-28T14%3A02%3A04Z&se=2026-03-28T14%3A27%3A04Z&sr=b&sp=r&sig=P34fgJ9Qf70HeZZwk9%2FG1lItlUdcz1Isp5BChiVs1ZQ%3D)
2026-03-28 14:02:11 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SB65CAX/697544370/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=697544370>
2026-03-28 14:02:11 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AM58MHU/698953175/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698953175>
2026-03-28 14:02:11 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SF65MRS/698522077/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698522077>
2026-03-28 14:02:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SF65MRS/698522093/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/SF65MRS/42810141?sv=2020-08-04&st=2026-03-28T14%3A01%3A23Z&se=2026-03-28T14%3A26%3A23Z&sr=b&sp=r&sig=pKcKPXIMRDrpvR7qgfCAU8Cghh7jF%2FL25jpHeT9Gs0U%3D)
2026-03-28 14:02:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FG69CVL/698920572/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/FG69CVL/42809636?sv=2020-08-04&st=2026-03-28T14%3A02%3A04Z&se=2026-03-28T14%3A27%3A04Z&sr=b&sp=r&sig=P34fgJ9Qf70HeZZwk9%2FG1lItlUdcz1Isp5BChiVs1ZQ%3D)
2026-03-28 14:02:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FG69CVL/698920584/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/FG69CVL/42809636?sv=2020-08-04&st=2026-03-28T14%3A02%3A04Z&se=2026-03-28T14%3A27%3A04Z&sr=b&sp=r&sig=P34fgJ9Qf70HeZZwk9%2FG1lItlUdcz1Isp5BChiVs1ZQ%3D)
2026-03-28 14:02:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FG69CVL/698920549/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/FG69CVL/42809636?sv=2020-08-04&st=2026-03-28T14%3A02%3A04Z&se=2026-03-28T14%3A27%3A04Z&sr=b&sp=r&sig=P34fgJ9Qf70HeZZwk9%2FG1lItlUdcz1Isp5BChiVs1ZQ%3D)
2026-03-28 14:02:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KO15JZW/698928775/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/KO15JZW/42809875?sv=2020-08-04&st=2026-03-28T14%3A01%3A23Z&se=2026-03-28T14%3A26%3A23Z&sr=b&sp=r&sig=WtTYXpKYofDjFDmXev3jjoySms%2BztrBA4DkuQ5Y14aQ%3D)
2026-03-28 14:02:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WA15XTF/697938638/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/WA15XTF/42809463?sv=2020-08-04&st=2026-03-28T14%3A01%3A23Z&se=2026-03-28T14%3A26%3A23Z&sr=b&sp=r&sig=OVT1XXFunRJjcV5jy5Zgfxxi5O1xAq2cfTX%2F%2FcIif88%3D)
2026-03-28 14:02:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SB65CAX/697544382/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/SB65CAX/42810123?sv=2020-08-04&st=2026-03-28T14%3A01%3A23Z&se=2026-03-28T14%3A26%3A23Z&sr=b&sp=r&sig=vTzzhGIuSP84%2BuZVufy4vR0mq7%2F9VRE2bdnD30Ub%2FBU%3D)
2026-03-28 14:02:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SH14BOU/698522088/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/SH14BOU/42810142?sv=2020-08-04&st=2026-03-28T14%3A01%3A23Z&se=2026-03-28T14%3A26%3A23Z&sr=b&sp=r&sig=qF%2Fj8vLm9uL8z4mTnCxa7QRX8NL1HO0if01okEQdE50%3D)
2026-03-28 14:02:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FH21UNX/698923249/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/FH21UNX/42809938?sv=2020-08-04&st=2026-03-28T14%3A01%3A25Z&se=2026-03-28T14%3A26%3A25Z&sr=b&sp=r&sig=DX6Iqw0wYrgXXc1Kaaa%2FZcBpc9wYL%2BSdFRwB6BQgkeE%3D)
2026-03-28 14:02:11 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:02:11 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:02:11 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:02:11 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:02:11 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:02:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:02:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2d946090>
2026-03-28 14:02:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:02:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:02:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:02:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a61064e7-41bf-5802-a31a-8f53de5bad6b/a61064e7-41bf-5802-a31a-8f53de5bad6b_image_7.jpg HTTP/1.1" 201 0
2026-03-28 14:02:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FFG69CVL%252F698920562%252F600') HTTP/1.1" 204 0
2026-03-28 14:02:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FG69CVL/698920562/600 saved to cache
2026-03-28 14:02:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item a61064e7-41bf-5802-a31a-8f53de5bad6b
2026-03-28 14:02:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AM58MHU/698970540/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/AM58MHU/42810635?sv=2020-08-04&st=2026-03-28T14%3A01%3A23Z&se=2026-03-28T14%3A26%3A23Z&sr=b&sp=r&sig=MTxN3XqRDWL9DG88ixDAxTc9KDbrCYbR3DQJ2mNHaYw%3D)
2026-03-28 14:02:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SF65MRS/698522077/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/SF65MRS/42810141?sv=2020-08-04&st=2026-03-28T14%3A01%3A23Z&se=2026-03-28T14%3A26%3A23Z&sr=b&sp=r&sig=pKcKPXIMRDrpvR7qgfCAU8Cghh7jF%2FL25jpHeT9Gs0U%3D)
2026-03-28 14:02:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/RA68WZE/42809489?sv=2020-08-04&st=2026-03-28T14%3A02%3A10Z&se=2026-03-28T14%3A27%3A10Z&sr=b&sp=r&sig=sGVqi7zLckoYL6nZquTH3Sr6GS2wBULLpmfzj%2F1aDfg%3D> (referer: https://www.bca.co.uk/)
2026-03-28 14:02:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:02:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2d685d90>
2026-03-28 14:02:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:02:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:02:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:02:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_228041df-5797-5c8f-89c8-2a337a640ead/228041df-5797-5c8f-89c8-2a337a640ead_image_4.jpg HTTP/1.1" 201 0
2026-03-28 14:02:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FSF65MRS%252F698522093%252F600') HTTP/1.1" 204 0
2026-03-28 14:02:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SF65MRS/698522093/600 saved to cache
2026-03-28 14:02:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 228041df-5797-5c8f-89c8-2a337a640ead
2026-03-28 14:02:11 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:02:11 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:02:11 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:02:11 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:02:11 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:02:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:02:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2ddf9d10>
2026-03-28 14:02:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:02:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:02:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:02:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a61064e7-41bf-5802-a31a-8f53de5bad6b/a61064e7-41bf-5802-a31a-8f53de5bad6b_image_8.jpg HTTP/1.1" 201 0
2026-03-28 14:02:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FFG69CVL%252F698920572%252F600') HTTP/1.1" 204 0
2026-03-28 14:02:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FG69CVL/698920572/600 saved to cache
2026-03-28 14:02:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item a61064e7-41bf-5802-a31a-8f53de5bad6b
2026-03-28 14:02:12 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:02:12 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:02:12 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:02:12 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:02:12 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:02:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:02:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2d9a4e10>
2026-03-28 14:02:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:02:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:02:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:02:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a61064e7-41bf-5802-a31a-8f53de5bad6b/a61064e7-41bf-5802-a31a-8f53de5bad6b_image_9.jpg HTTP/1.1" 201 0
2026-03-28 14:02:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FFG69CVL%252F698920584%252F600') HTTP/1.1" 204 0
2026-03-28 14:02:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FG69CVL/698920584/600 saved to cache
2026-03-28 14:02:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item a61064e7-41bf-5802-a31a-8f53de5bad6b
2026-03-28 14:02:12 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:02:12 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:02:12 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:02:12 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:02:12 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:02:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:02:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c4e9390>
2026-03-28 14:02:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:02:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:02:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:02:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a61064e7-41bf-5802-a31a-8f53de5bad6b/a61064e7-41bf-5802-a31a-8f53de5bad6b_image_6.jpg HTTP/1.1" 201 0
2026-03-28 14:02:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FFG69CVL%252F698920549%252F600') HTTP/1.1" 204 0
2026-03-28 14:02:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FG69CVL/698920549/600 saved to cache
2026-03-28 14:02:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item a61064e7-41bf-5802-a31a-8f53de5bad6b
2026-03-28 14:02:12 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: a61064e7-41bf-5802-a31a-8f53de5bad6b, skipping ID generation
2026-03-28 14:02:12 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item a61064e7-41bf-5802-a31a-8f53de5bad6b sending to next pipeline
2026-03-28 14:02:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: a61064e7-41bf-5802-a31a-8f53de5bad6b, identifier: FG69%20CVL
2026-03-28 14:02:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: a61064e7-41bf-5802-a31a-8f53de5bad6b with identifier: FG69%20CVL
2026-03-28 14:02:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: a61064e7-41bf-5802-a31a-8f53de5bad6b with identifier: FG69%20CVL
2026-03-28 14:02:12 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: a61064e7-41bf-5802-a31a-8f53de5bad6b with identifier: FG69%20CVL to the API
2026-03-28 14:02:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:02:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:02:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FG69CVL/698920549/600>
{'auction_title': '',
'c_o_2_emission_value': 152,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a61064e7-41bf-5802-a31a-8f53de5bad6b/a61064e7-41bf-5802-a31a-8f53de5bad6b_expert_report_file_a4707147-8062-449e-b7dc-cc7fb5858535.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=FG69%20CVL-GB',
'category': 'Car',
'color': 'silver',
'currency': 'GBP',
'doors_number': 5,
'engine': '2.0L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Diesel',
'id': 'a61064e7-41bf-5802-a31a-8f53de5bad6b',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'FG69 CVL',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=FG69%20CVL&vehicleType=*',
'listing': 'auction',
'location': 'Measham',
'make': 'FORD',
'model': 'KUGA',
'odometer': 68416,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 11,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a61064e7-41bf-5802-a31a-8f53de5bad6b/a61064e7-41bf-5802-a31a-8f53de5bad6b_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 44118,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FG69CVL/698920504/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a61064e7-41bf-5802-a31a-8f53de5bad6b/a61064e7-41bf-5802-a31a-8f53de5bad6b_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 41452,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FG69CVL/698920510/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a61064e7-41bf-5802-a31a-8f53de5bad6b/a61064e7-41bf-5802-a31a-8f53de5bad6b_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 43583,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FG69CVL/698920518/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a61064e7-41bf-5802-a31a-8f53de5bad6b/a61064e7-41bf-5802-a31a-8f53de5bad6b_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 42028,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FG69CVL/698920524/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a61064e7-41bf-5802-a31a-8f53de5bad6b/a61064e7-41bf-5802-a31a-8f53de5bad6b_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 43667,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FG69CVL/698920530/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a61064e7-41bf-5802-a31a-8f53de5bad6b/a61064e7-41bf-5802-a31a-8f53de5bad6b_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 41322,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FG69CVL/698920537/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a61064e7-41bf-5802-a31a-8f53de5bad6b/a61064e7-41bf-5802-a31a-8f53de5bad6b_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 76020,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FG69CVL/698920549/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a61064e7-41bf-5802-a31a-8f53de5bad6b/a61064e7-41bf-5802-a31a-8f53de5bad6b_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 61621,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FG69CVL/698920562/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a61064e7-41bf-5802-a31a-8f53de5bad6b/a61064e7-41bf-5802-a31a-8f53de5bad6b_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 84468,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FG69CVL/698920572/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a61064e7-41bf-5802-a31a-8f53de5bad6b/a61064e7-41bf-5802-a31a-8f53de5bad6b_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 82051,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FG69CVL/698920584/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-01-01',
'seller_name': None,
'title': 'FORD KUGA 2.0 TDCI 150 2WD TITANIUM ED. StationWagon',
'transmission': 'manual',
'trim': 'TDCI 150 2WD TITANIUM ED.',
'vin': 'WF0AXXWPMAKY69045',
'year': 2019}
2026-03-28 14:02:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FG69%2520CVL%27 HTTP/1.1" 200 None
2026-03-28 14:02:12 [bca.uk] INFO: Saving data for FG69%20CVL: {'created_time': 1774706532.780371, 'last_price_update_time': 1774706532.780383, 'auction_closing_time': 1774864800.0}
2026-03-28 14:02:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='FG69%2520CVL') HTTP/1.1" 204 0
2026-03-28 14:02:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/BG72UUY/42810237?sv=2020-08-04&st=2026-03-28T14%3A02%3A10Z&se=2026-03-28T14%3A27%3A10Z&sr=b&sp=r&sig=yK8cIYpeZ9TamlFDpK%2BgLwUjKNRsv8EzcqtGcUy7mrQ%3D> (referer: https://www.bca.co.uk/)
2026-03-28 14:02:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SB65CAX/697544370/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/SB65CAX/42810123?sv=2020-08-04&st=2026-03-28T14%3A01%3A23Z&se=2026-03-28T14%3A26%3A23Z&sr=b&sp=r&sig=vTzzhGIuSP84%2BuZVufy4vR0mq7%2F9VRE2bdnD30Ub%2FBU%3D)
2026-03-28 14:02:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AM58MHU/698953175/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/AM58MHU/42810635?sv=2020-08-04&st=2026-03-28T14%3A01%3A23Z&se=2026-03-28T14%3A26%3A23Z&sr=b&sp=r&sig=MTxN3XqRDWL9DG88ixDAxTc9KDbrCYbR3DQJ2mNHaYw%3D)
2026-03-28 14:02:12 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YW64DGU/698928782/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698928782>
2026-03-28 14:02:12 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/AF71XUK/42810232?sv=2020-08-04&st=2026-03-28T14%3A02%3A11Z&se=2026-03-28T14%3A27%3A11Z&sr=b&sp=r&sig=tGq7RNNjcl9do17viZhXDHgcWKPhPxb%2FskLZ1LkjXQQ%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=AF71%20XUK-GB>
2026-03-28 14:02:12 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GU10UYN/698556165/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698556165>
2026-03-28 14:02:12 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SH14BOU/698522076/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698522076>
2026-03-28 14:02:12 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SB65CAX/697544362/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=697544362>
2026-03-28 14:02:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:02:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2d9a4a10>
2026-03-28 14:02:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:02:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:02:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:02:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7cdb5790-795c-503b-b01e-2ccf288a1773/7cdb5790-795c-503b-b01e-2ccf288a1773_image_0.jpg HTTP/1.1" 201 0
2026-03-28 14:02:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FKO15JZW%252F698928775%252F600') HTTP/1.1" 204 0
2026-03-28 14:02:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KO15JZW/698928775/600 saved to cache
2026-03-28 14:02:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 7cdb5790-795c-503b-b01e-2ccf288a1773
2026-03-28 14:02:12 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 7cdb5790-795c-503b-b01e-2ccf288a1773, skipping ID generation
2026-03-28 14:02:12 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 7cdb5790-795c-503b-b01e-2ccf288a1773 sending to next pipeline
2026-03-28 14:02:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 7cdb5790-795c-503b-b01e-2ccf288a1773, identifier: KO15%20JZW
2026-03-28 14:02:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:02:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c762a50>
2026-03-28 14:02:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:02:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:02:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:02:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_012921cb-8763-5e72-9bbe-1684326c9a1d/012921cb-8763-5e72-9bbe-1684326c9a1d_image_3.jpg HTTP/1.1" 201 0
2026-03-28 14:02:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FWA15XTF%252F697938638%252F600') HTTP/1.1" 204 0
2026-03-28 14:02:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WA15XTF/697938638/600 saved to cache
2026-03-28 14:02:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 012921cb-8763-5e72-9bbe-1684326c9a1d
2026-03-28 14:02:12 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:02:12 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:02:12 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:02:12 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:02:12 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:02:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:02:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a1fd70710>
2026-03-28 14:02:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:02:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:02:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:02:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_05412951-b5cb-5847-b7df-8f166615ed23/05412951-b5cb-5847-b7df-8f166615ed23_image_7.jpg HTTP/1.1" 201 0
2026-03-28 14:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FSB65CAX%252F697544382%252F600') HTTP/1.1" 204 0
2026-03-28 14:02:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SB65CAX/697544382/600 saved to cache
2026-03-28 14:02:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 05412951-b5cb-5847-b7df-8f166615ed23
2026-03-28 14:02:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:02:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c519850>
2026-03-28 14:02:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:02:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:02:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:02:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7ca8ff92-ba13-58b4-8b9a-c74a2e2ed8c1/7ca8ff92-ba13-58b4-8b9a-c74a2e2ed8c1_image_5.jpg HTTP/1.1" 201 0
2026-03-28 14:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FSH14BOU%252F698522088%252F600') HTTP/1.1" 204 0
2026-03-28 14:02:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SH14BOU/698522088/600 saved to cache
2026-03-28 14:02:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 7ca8ff92-ba13-58b4-8b9a-c74a2e2ed8c1
2026-03-28 14:02:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:02:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a1fd71490>
2026-03-28 14:02:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:02:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:02:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:02:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a610f6fb-a046-5c2e-8701-0fcb295f97f1/a610f6fb-a046-5c2e-8701-0fcb295f97f1_image_0.jpg HTTP/1.1" 201 0
2026-03-28 14:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FFH21UNX%252F698923249%252F600') HTTP/1.1" 204 0
2026-03-28 14:02:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FH21UNX/698923249/600 saved to cache
2026-03-28 14:02:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item a610f6fb-a046-5c2e-8701-0fcb295f97f1
2026-03-28 14:02:13 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: a610f6fb-a046-5c2e-8701-0fcb295f97f1, skipping ID generation
2026-03-28 14:02:13 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item a610f6fb-a046-5c2e-8701-0fcb295f97f1 sending to next pipeline
2026-03-28 14:02:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: a610f6fb-a046-5c2e-8701-0fcb295f97f1, identifier: FH21%20UNX
2026-03-28 14:02:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:02:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c502050>
2026-03-28 14:02:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:02:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:02:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:02:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_29da6c1c-854f-50ff-9030-4ad1ff36e423/29da6c1c-854f-50ff-9030-4ad1ff36e423_image_7.jpg HTTP/1.1" 201 0
2026-03-28 14:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FAM58MHU%252F698970540%252F600') HTTP/1.1" 204 0
2026-03-28 14:02:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AM58MHU/698970540/600 saved to cache
2026-03-28 14:02:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 29da6c1c-854f-50ff-9030-4ad1ff36e423
2026-03-28 14:02:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:02:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a301203d0>
2026-03-28 14:02:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:02:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:02:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:02:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_228041df-5797-5c8f-89c8-2a337a640ead/228041df-5797-5c8f-89c8-2a337a640ead_image_3.jpg HTTP/1.1" 201 0
2026-03-28 14:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FSF65MRS%252F698522077%252F600') HTTP/1.1" 204 0
2026-03-28 14:02:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SF65MRS/698522077/600 saved to cache
2026-03-28 14:02:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 228041df-5797-5c8f-89c8-2a337a640ead
2026-03-28 14:02:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:02:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c89b710>
2026-03-28 14:02:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:02:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:02:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:02:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4de18175-834b-5b06-b8ed-75c0641e29ce/4de18175-834b-5b06-b8ed-75c0641e29ce_expert_report_file_64ffeece-90b9-4ef5-a507-53ad5690037f.pdf HTTP/1.1" 201 0
2026-03-28 14:02:13 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item 4de18175-834b-5b06-b8ed-75c0641e29ce
2026-03-28 14:02:13 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 4de18175-834b-5b06-b8ed-75c0641e29ce, skipping ID generation
2026-03-28 14:02:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 4de18175-834b-5b06-b8ed-75c0641e29ce
2026-03-28 14:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DRA68WZE-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-28 14:02:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=RA68WZE-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-28 14:02:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 7cdb5790-795c-503b-b01e-2ccf288a1773 with identifier: KO15%20JZW
2026-03-28 14:02:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 7cdb5790-795c-503b-b01e-2ccf288a1773 with identifier: KO15%20JZW
2026-03-28 14:02:13 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 7cdb5790-795c-503b-b01e-2ccf288a1773 with identifier: KO15%20JZW to the API
2026-03-28 14:02:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:02:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:02:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KO15JZW/698928775/600>
{'auction_title': '',
'c_o_2_emission_value': 97,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7cdb5790-795c-503b-b01e-2ccf288a1773/7cdb5790-795c-503b-b01e-2ccf288a1773_expert_report_file_9b9a7f8a-1a60-42a1-9fcd-1ae330d21703.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=KO15%20JZW-GB',
'category': 'Car',
'color': 'grey',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.6L',
'expiration_date': '2026-03-29T10:00:00Z',
'fuel_type': 'Diesel',
'id': '7cdb5790-795c-503b-b01e-2ccf288a1773',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'KO15 JZW',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=KO15%20JZW&vehicleType=*',
'listing': 'auction',
'location': 'Enfield',
'make': 'VAUXHALL',
'model': 'ASTRA',
'odometer': 133263,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 11,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7cdb5790-795c-503b-b01e-2ccf288a1773/7cdb5790-795c-503b-b01e-2ccf288a1773_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 46034,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KO15JZW/698928775/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7cdb5790-795c-503b-b01e-2ccf288a1773/7cdb5790-795c-503b-b01e-2ccf288a1773_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 44809,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KO15JZW/698928796/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7cdb5790-795c-503b-b01e-2ccf288a1773/7cdb5790-795c-503b-b01e-2ccf288a1773_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 42642,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KO15JZW/698928815/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7cdb5790-795c-503b-b01e-2ccf288a1773/7cdb5790-795c-503b-b01e-2ccf288a1773_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 43169,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KO15JZW/698928836/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7cdb5790-795c-503b-b01e-2ccf288a1773/7cdb5790-795c-503b-b01e-2ccf288a1773_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 44063,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KO15JZW/698928858/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7cdb5790-795c-503b-b01e-2ccf288a1773/7cdb5790-795c-503b-b01e-2ccf288a1773_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 43134,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KO15JZW/698928877/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7cdb5790-795c-503b-b01e-2ccf288a1773/7cdb5790-795c-503b-b01e-2ccf288a1773_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 62341,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KO15JZW/698928899/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7cdb5790-795c-503b-b01e-2ccf288a1773/7cdb5790-795c-503b-b01e-2ccf288a1773_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 64946,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KO15JZW/698928924/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7cdb5790-795c-503b-b01e-2ccf288a1773/7cdb5790-795c-503b-b01e-2ccf288a1773_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 82438,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KO15JZW/698928945/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7cdb5790-795c-503b-b01e-2ccf288a1773/7cdb5790-795c-503b-b01e-2ccf288a1773_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 88399,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KO15JZW/698928974/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-01-01',
'seller_name': None,
'title': 'VAUXHALL ASTRA 1.6 CDTI 110 E/F TECH LINE Hatchback',
'transmission': 'manual',
'trim': 'CDTI 110 E/F TECH LINE',
'vin': 'W0LPD6E68FG144090',
'year': 2015}
2026-03-28 14:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KO15%2520JZW%27 HTTP/1.1" 200 None
2026-03-28 14:02:13 [bca.uk] INFO: Saving data for KO15%20JZW: {'created_time': 1774706533.733515, 'last_price_update_time': 1774706533.733528, 'auction_closing_time': 1774778400.0}
2026-03-28 14:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='KO15%2520JZW') HTTP/1.1" 204 0
2026-03-28 14:02:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: a610f6fb-a046-5c2e-8701-0fcb295f97f1 with identifier: FH21%20UNX
2026-03-28 14:02:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: a610f6fb-a046-5c2e-8701-0fcb295f97f1 with identifier: FH21%20UNX
2026-03-28 14:02:13 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: a610f6fb-a046-5c2e-8701-0fcb295f97f1 with identifier: FH21%20UNX to the API
2026-03-28 14:02:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:02:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:02:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FH21UNX/698923249/600>
{'auction_title': '',
'c_o_2_emission_value': 92,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a610f6fb-a046-5c2e-8701-0fcb295f97f1/a610f6fb-a046-5c2e-8701-0fcb295f97f1_expert_report_file_a7a6cc68-ddc2-4719-9006-da72e7ecedb1.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=FH21%20UNX-GB',
'category': 'Car',
'color': 'blue',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.5L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol/Electric',
'id': 'a610f6fb-a046-5c2e-8701-0fcb295f97f1',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'FH21 UNX',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=FH21%20UNX&vehicleType=*',
'listing': 'auction',
'location': 'Nottingham',
'make': 'TOYOTA',
'model': 'YARIS',
'odometer': 32599,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 11,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a610f6fb-a046-5c2e-8701-0fcb295f97f1/a610f6fb-a046-5c2e-8701-0fcb295f97f1_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 49344,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FH21UNX/698923249/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a610f6fb-a046-5c2e-8701-0fcb295f97f1/a610f6fb-a046-5c2e-8701-0fcb295f97f1_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 49722,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FH21UNX/698923258/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a610f6fb-a046-5c2e-8701-0fcb295f97f1/a610f6fb-a046-5c2e-8701-0fcb295f97f1_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 46257,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FH21UNX/698923269/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a610f6fb-a046-5c2e-8701-0fcb295f97f1/a610f6fb-a046-5c2e-8701-0fcb295f97f1_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 47764,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FH21UNX/698923287/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a610f6fb-a046-5c2e-8701-0fcb295f97f1/a610f6fb-a046-5c2e-8701-0fcb295f97f1_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 45766,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FH21UNX/698923307/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a610f6fb-a046-5c2e-8701-0fcb295f97f1/a610f6fb-a046-5c2e-8701-0fcb295f97f1_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 44355,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FH21UNX/698923325/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a610f6fb-a046-5c2e-8701-0fcb295f97f1/a610f6fb-a046-5c2e-8701-0fcb295f97f1_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 92441,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FH21UNX/698923356/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a610f6fb-a046-5c2e-8701-0fcb295f97f1/a610f6fb-a046-5c2e-8701-0fcb295f97f1_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 90646,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FH21UNX/698923386/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a610f6fb-a046-5c2e-8701-0fcb295f97f1/a610f6fb-a046-5c2e-8701-0fcb295f97f1_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 95221,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FH21UNX/698923419/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a610f6fb-a046-5c2e-8701-0fcb295f97f1/a610f6fb-a046-5c2e-8701-0fcb295f97f1_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 95107,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FH21UNX/698923445/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-01-01',
'seller_name': None,
'title': 'TOYOTA YARIS 1.5 HYBRID DESIGN Hatchback',
'transmission': 'automatic',
'trim': 'HYBRID DESIGN',
'vin': 'VNKKBAC320A159618',
'year': 2021}
2026-03-28 14:02:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FH21%2520UNX%27 HTTP/1.1" 200 None
2026-03-28 14:02:14 [bca.uk] INFO: Saving data for FH21%20UNX: {'created_time': 1774706534.130324, 'last_price_update_time': 1774706534.130335, 'auction_closing_time': 1774864800.0}
2026-03-28 14:02:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='FH21%2520UNX') HTTP/1.1" 204 0
2026-03-28 14:02:14 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SB65CAX/697544352/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=697544352>
2026-03-28 14:02:14 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SH14BOU/698522068/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698522068>
2026-03-28 14:02:14 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GU10UYN/698556155/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698556155>
2026-03-28 14:02:14 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YW64DGU/698928761/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=YW64DGU-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-28 14:02:14 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AM58MHU/698970537/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698970537>
2026-03-28 14:02:14 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SF65MRS/698522052/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698522052>
2026-03-28 14:02:14 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/ND19VHL/42810243?sv=2020-08-04&st=2026-03-28T14%3A02%3A12Z&se=2026-03-28T14%3A27%3A12Z&sr=b&sp=r&sig=NwiuSm%2BGmVjPsuAr5oUGhIAXqOanP4zOrkP6mfv72zY%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=ND19%20VHL-GB>
2026-03-28 14:02:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698229700%27 HTTP/1.1" 200 None
2026-03-28 14:02:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698229700 not downloaded yet
2026-03-28 14:02:14 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AM58MHU/698953163/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698953163>
2026-03-28 14:02:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:02:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a1fd76090>
2026-03-28 14:02:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:02:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:02:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:02:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c2dfa08a-04ba-520a-b1ba-0b0dcf2d9ee2/c2dfa08a-04ba-520a-b1ba-0b0dcf2d9ee2_expert_report_file_9d6b653e-bfac-4c2e-9d78-93443eceb764.pdf HTTP/1.1" 201 0
2026-03-28 14:02:14 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item c2dfa08a-04ba-520a-b1ba-0b0dcf2d9ee2
2026-03-28 14:02:14 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: c2dfa08a-04ba-520a-b1ba-0b0dcf2d9ee2, skipping ID generation
2026-03-28 14:02:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item c2dfa08a-04ba-520a-b1ba-0b0dcf2d9ee2
2026-03-28 14:02:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DBG72UUY-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-28 14:02:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=BG72UUY-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-28 14:02:14 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:02:14 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:02:14 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:02:14 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:02:14 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:02:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:02:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2d736590>
2026-03-28 14:02:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:02:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:02:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:02:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_05412951-b5cb-5847-b7df-8f166615ed23/05412951-b5cb-5847-b7df-8f166615ed23_image_6.jpg HTTP/1.1" 201 0
2026-03-28 14:02:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FSB65CAX%252F697544370%252F600') HTTP/1.1" 204 0
2026-03-28 14:02:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SB65CAX/697544370/600 saved to cache
2026-03-28 14:02:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 05412951-b5cb-5847-b7df-8f166615ed23
2026-03-28 14:02:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:02:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c5058d0>
2026-03-28 14:02:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:02:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:02:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:02:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_29da6c1c-854f-50ff-9030-4ad1ff36e423/29da6c1c-854f-50ff-9030-4ad1ff36e423_image_6.jpg HTTP/1.1" 201 0
2026-03-28 14:02:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FAM58MHU%252F698953175%252F600') HTTP/1.1" 204 0
2026-03-28 14:02:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AM58MHU/698953175/600 saved to cache
2026-03-28 14:02:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 29da6c1c-854f-50ff-9030-4ad1ff36e423
2026-03-28 14:02:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698229708%27 HTTP/1.1" 200 None
2026-03-28 14:02:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698229708 not downloaded yet
2026-03-28 14:02:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698459096%27 HTTP/1.1" 200 None
2026-03-28 14:02:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698459096 not downloaded yet
2026-03-28 14:02:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698229715%27 HTTP/1.1" 200 None
2026-03-28 14:02:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698229715 not downloaded yet
2026-03-28 14:02:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698459100%27 HTTP/1.1" 200 None
2026-03-28 14:02:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698459100 not downloaded yet
2026-03-28 14:02:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698229725%27 HTTP/1.1" 200 None
2026-03-28 14:02:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698229725 not downloaded yet
2026-03-28 14:02:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SH14BOU/698522076/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/SH14BOU/42810142?sv=2020-08-04&st=2026-03-28T14%3A01%3A23Z&se=2026-03-28T14%3A26%3A23Z&sr=b&sp=r&sig=qF%2Fj8vLm9uL8z4mTnCxa7QRX8NL1HO0if01okEQdE50%3D)
2026-03-28 14:02:14 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VO17FMZ/698274476/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698274476>
2026-03-28 14:02:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SB65CAX/697544362/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/SB65CAX/42810123?sv=2020-08-04&st=2026-03-28T14%3A01%3A23Z&se=2026-03-28T14%3A26%3A23Z&sr=b&sp=r&sig=vTzzhGIuSP84%2BuZVufy4vR0mq7%2F9VRE2bdnD30Ub%2FBU%3D)
2026-03-28 14:02:14 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/PE10DXZ/42777447?sv=2020-08-04&st=2026-03-28T14%3A02%3A14Z&se=2026-03-28T14%3A27%3A14Z&sr=b&sp=r&sig=C8TA9FPCoH3d5KD%2BHIeQ7hc2gf2IEb2X5rEfOjKKKI4%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=PE10%20DXZ-GB>
2026-03-28 14:02:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698459105%27 HTTP/1.1" 200 None
2026-03-28 14:02:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698459105 not downloaded yet
2026-03-28 14:02:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GU10UYN/698556165/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/GU10UYN/42810320?sv=2020-08-04&st=2026-03-28T14%3A01%3A23Z&se=2026-03-28T14%3A26%3A23Z&sr=b&sp=r&sig=mGNhX9MAfZVu5g6PpXH03XgVnNc%2FnLjEd8Y2gqIppCM%3D)
2026-03-28 14:02:14 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/FJ70HFF/42809908?sv=2020-08-04&st=2026-03-28T14%3A02%3A14Z&se=2026-03-28T14%3A27%3A14Z&sr=b&sp=r&sig=BLkTOcAQXlC6tflFfVlnOiQji6BjZlMn9%2BOPeKNwW40%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=FJ70%20HFF-GB>
2026-03-28 14:02:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698229733%27 HTTP/1.1" 200 None
2026-03-28 14:02:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698229733 not downloaded yet
2026-03-28 14:02:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698459107%27 HTTP/1.1" 200 None
2026-03-28 14:02:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698459107 not downloaded yet
2026-03-28 14:02:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698229742%27 HTTP/1.1" 200 None
2026-03-28 14:02:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698229742 not downloaded yet
2026-03-28 14:02:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698459109%27 HTTP/1.1" 200 None
2026-03-28 14:02:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698459109 not downloaded yet
2026-03-28 14:02:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/AF71XUK/42810232?sv=2020-08-04&st=2026-03-28T14%3A02%3A11Z&se=2026-03-28T14%3A27%3A11Z&sr=b&sp=r&sig=tGq7RNNjcl9do17viZhXDHgcWKPhPxb%2FskLZ1LkjXQQ%3D> (referer: https://www.bca.co.uk/)
2026-03-28 14:02:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698229754%27 HTTP/1.1" 200 None
2026-03-28 14:02:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698229754 not downloaded yet
2026-03-28 14:02:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698459113%27 HTTP/1.1" 200 None
2026-03-28 14:02:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698459113 not downloaded yet
2026-03-28 14:02:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YW64DGU/698928782/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YW64DGU/42810194?sv=2020-08-04&st=2026-03-28T14%3A01%3A23Z&se=2026-03-28T14%3A26%3A23Z&sr=b&sp=r&sig=bKUUxkl%2FQOTN6xP3oKLYX53uOLW1seBVRfhSdF3FtAg%3D)
2026-03-28 14:02:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GU10UYN/698556155/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/GU10UYN/42810320?sv=2020-08-04&st=2026-03-28T14%3A01%3A23Z&se=2026-03-28T14%3A26%3A23Z&sr=b&sp=r&sig=mGNhX9MAfZVu5g6PpXH03XgVnNc%2FnLjEd8Y2gqIppCM%3D)
2026-03-28 14:02:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698229763%27 HTTP/1.1" 200 None
2026-03-28 14:02:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698229763 not downloaded yet
2026-03-28 14:02:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:02:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c6de9d0>
2026-03-28 14:02:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:02:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:02:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:02:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7ca8ff92-ba13-58b4-8b9a-c74a2e2ed8c1/7ca8ff92-ba13-58b4-8b9a-c74a2e2ed8c1_image_4.jpg HTTP/1.1" 201 0
2026-03-28 14:02:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FSH14BOU%252F698522076%252F600') HTTP/1.1" 204 0
2026-03-28 14:02:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SH14BOU/698522076/600 saved to cache
2026-03-28 14:02:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 7ca8ff92-ba13-58b4-8b9a-c74a2e2ed8c1
2026-03-28 14:02:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YW64DGU/698928761/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YW64DGU/42810194?sv=2020-08-04&st=2026-03-28T14%3A01%3A23Z&se=2026-03-28T14%3A26%3A23Z&sr=b&sp=r&sig=bKUUxkl%2FQOTN6xP3oKLYX53uOLW1seBVRfhSdF3FtAg%3D)
2026-03-28 14:02:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698459122%27 HTTP/1.1" 200 None
2026-03-28 14:02:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698459122 not downloaded yet
2026-03-28 14:02:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AM58MHU/698953163/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/AM58MHU/42810635?sv=2020-08-04&st=2026-03-28T14%3A01%3A23Z&se=2026-03-28T14%3A26%3A23Z&sr=b&sp=r&sig=MTxN3XqRDWL9DG88ixDAxTc9KDbrCYbR3DQJ2mNHaYw%3D)
2026-03-28 14:02:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AM58MHU/698970537/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/AM58MHU/42810635?sv=2020-08-04&st=2026-03-28T14%3A01%3A23Z&se=2026-03-28T14%3A26%3A23Z&sr=b&sp=r&sig=MTxN3XqRDWL9DG88ixDAxTc9KDbrCYbR3DQJ2mNHaYw%3D)
2026-03-28 14:02:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SF65MRS/698522052/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/SF65MRS/42810141?sv=2020-08-04&st=2026-03-28T14%3A01%3A23Z&se=2026-03-28T14%3A26%3A23Z&sr=b&sp=r&sig=pKcKPXIMRDrpvR7qgfCAU8Cghh7jF%2FL25jpHeT9Gs0U%3D)
2026-03-28 14:02:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SH14BOU/698522068/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/SH14BOU/42810142?sv=2020-08-04&st=2026-03-28T14%3A01%3A23Z&se=2026-03-28T14%3A26%3A23Z&sr=b&sp=r&sig=qF%2Fj8vLm9uL8z4mTnCxa7QRX8NL1HO0if01okEQdE50%3D)
2026-03-28 14:02:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698229776%27 HTTP/1.1" 200 None
2026-03-28 14:02:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698229776 not downloaded yet
2026-03-28 14:02:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:02:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a1ff21ed0>
2026-03-28 14:02:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:02:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:02:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:02:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_05412951-b5cb-5847-b7df-8f166615ed23/05412951-b5cb-5847-b7df-8f166615ed23_image_5.jpg HTTP/1.1" 201 0
2026-03-28 14:02:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FSB65CAX%252F697544362%252F600') HTTP/1.1" 204 0
2026-03-28 14:02:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SB65CAX/697544362/600 saved to cache
2026-03-28 14:02:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 05412951-b5cb-5847-b7df-8f166615ed23
2026-03-28 14:02:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:02:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a3008cd10>
2026-03-28 14:02:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:02:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:02:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:02:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_24b3d1e2-9046-567a-ba39-2d683a6b4342/24b3d1e2-9046-567a-ba39-2d683a6b4342_image_4.jpg HTTP/1.1" 201 0
2026-03-28 14:02:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FGU10UYN%252F698556165%252F600') HTTP/1.1" 204 0
2026-03-28 14:02:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GU10UYN/698556165/600 saved to cache
2026-03-28 14:02:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 24b3d1e2-9046-567a-ba39-2d683a6b4342
2026-03-28 14:02:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/ND19VHL/42810243?sv=2020-08-04&st=2026-03-28T14%3A02%3A12Z&se=2026-03-28T14%3A27%3A12Z&sr=b&sp=r&sig=NwiuSm%2BGmVjPsuAr5oUGhIAXqOanP4zOrkP6mfv72zY%3D> (referer: https://www.bca.co.uk/)
2026-03-28 14:02:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698459128%27 HTTP/1.1" 200 None
2026-03-28 14:02:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698459128 not downloaded yet
2026-03-28 14:02:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SB65CAX/697544352/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/SB65CAX/42810123?sv=2020-08-04&st=2026-03-28T14%3A01%3A23Z&se=2026-03-28T14%3A26%3A23Z&sr=b&sp=r&sig=vTzzhGIuSP84%2BuZVufy4vR0mq7%2F9VRE2bdnD30Ub%2FBU%3D)
2026-03-28 14:02:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698459134%27 HTTP/1.1" 200 None
2026-03-28 14:02:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698459134 not downloaded yet
2026-03-28 14:02:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:02:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a3c5b43d0>
2026-03-28 14:02:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:02:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:02:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:02:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ca8b23b7-2e66-554c-8e62-feb13d6c73d4/ca8b23b7-2e66-554c-8e62-feb13d6c73d4_expert_report_file_7132a155-c7e3-4ce9-b80e-007b9a64e6a6.pdf HTTP/1.1" 201 0
2026-03-28 14:02:14 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item ca8b23b7-2e66-554c-8e62-feb13d6c73d4
2026-03-28 14:02:14 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: ca8b23b7-2e66-554c-8e62-feb13d6c73d4, skipping ID generation
2026-03-28 14:02:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item ca8b23b7-2e66-554c-8e62-feb13d6c73d4
2026-03-28 14:02:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DAF71XUK-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-28 14:02:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=AF71XUK-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-28 14:02:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:02:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a1fd75790>
2026-03-28 14:02:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:02:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:02:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:02:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5b546abb-9cfb-537e-b2ac-6d60a5514e55/5b546abb-9cfb-537e-b2ac-6d60a5514e55_image_1.jpg HTTP/1.1" 201 0
2026-03-28 14:02:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FYW64DGU%252F698928782%252F600') HTTP/1.1" 204 0
2026-03-28 14:02:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YW64DGU/698928782/600 saved to cache
2026-03-28 14:02:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 5b546abb-9cfb-537e-b2ac-6d60a5514e55
2026-03-28 14:02:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:02:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c5a8d10>
2026-03-28 14:02:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:02:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:02:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:02:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_24b3d1e2-9046-567a-ba39-2d683a6b4342/24b3d1e2-9046-567a-ba39-2d683a6b4342_image_3.jpg HTTP/1.1" 201 0
2026-03-28 14:02:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FGU10UYN%252F698556155%252F600') HTTP/1.1" 204 0
2026-03-28 14:02:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GU10UYN/698556155/600 saved to cache
2026-03-28 14:02:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 24b3d1e2-9046-567a-ba39-2d683a6b4342
2026-03-28 14:02:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:02:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a1fe85910>
2026-03-28 14:02:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:02:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:02:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:02:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5b546abb-9cfb-537e-b2ac-6d60a5514e55/5b546abb-9cfb-537e-b2ac-6d60a5514e55_image_0.jpg HTTP/1.1" 201 0
2026-03-28 14:02:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FYW64DGU%252F698928761%252F600') HTTP/1.1" 204 0
2026-03-28 14:02:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YW64DGU/698928761/600 saved to cache
2026-03-28 14:02:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 5b546abb-9cfb-537e-b2ac-6d60a5514e55
2026-03-28 14:02:14 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 5b546abb-9cfb-537e-b2ac-6d60a5514e55, skipping ID generation
2026-03-28 14:02:14 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 5b546abb-9cfb-537e-b2ac-6d60a5514e55 sending to next pipeline
2026-03-28 14:02:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 5b546abb-9cfb-537e-b2ac-6d60a5514e55, identifier: YW64%20DGU
2026-03-28 14:02:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 5b546abb-9cfb-537e-b2ac-6d60a5514e55 with identifier: YW64%20DGU
2026-03-28 14:02:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 5b546abb-9cfb-537e-b2ac-6d60a5514e55 with identifier: YW64%20DGU
2026-03-28 14:02:15 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 5b546abb-9cfb-537e-b2ac-6d60a5514e55 with identifier: YW64%20DGU to the API
2026-03-28 14:02:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:02:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:02:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YW64DGU/698928761/600>
{'auction_title': '',
'c_o_2_emission_value': 198,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5b546abb-9cfb-537e-b2ac-6d60a5514e55/5b546abb-9cfb-537e-b2ac-6d60a5514e55_expert_report_file_ca43bd53-f8a5-46b9-abe3-e74b1fea6979.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=YW64%20DGU-GB',
'category': 'Car',
'color': 'white',
'currency': 'GBP',
'doors_number': 5,
'engine': '3.0L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Diesel',
'id': '5b546abb-9cfb-537e-b2ac-6d60a5514e55',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'YW64 DGU',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=YW64%20DGU&vehicleType=*',
'listing': 'auction',
'location': 'Paddock Wood',
'make': 'JEEP',
'model': 'GRAND CHEROKEE',
'odometer': 93901,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 11,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5b546abb-9cfb-537e-b2ac-6d60a5514e55/5b546abb-9cfb-537e-b2ac-6d60a5514e55_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 46807,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YW64DGU/698928761/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5b546abb-9cfb-537e-b2ac-6d60a5514e55/5b546abb-9cfb-537e-b2ac-6d60a5514e55_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 44691,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YW64DGU/698928782/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5b546abb-9cfb-537e-b2ac-6d60a5514e55/5b546abb-9cfb-537e-b2ac-6d60a5514e55_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 45932,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YW64DGU/698928804/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5b546abb-9cfb-537e-b2ac-6d60a5514e55/5b546abb-9cfb-537e-b2ac-6d60a5514e55_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 44632,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YW64DGU/698928824/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5b546abb-9cfb-537e-b2ac-6d60a5514e55/5b546abb-9cfb-537e-b2ac-6d60a5514e55_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 42373,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YW64DGU/698928849/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5b546abb-9cfb-537e-b2ac-6d60a5514e55/5b546abb-9cfb-537e-b2ac-6d60a5514e55_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 41745,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YW64DGU/698928863/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5b546abb-9cfb-537e-b2ac-6d60a5514e55/5b546abb-9cfb-537e-b2ac-6d60a5514e55_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 90069,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YW64DGU/698928896/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5b546abb-9cfb-537e-b2ac-6d60a5514e55/5b546abb-9cfb-537e-b2ac-6d60a5514e55_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 57870,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YW64DGU/698928923/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5b546abb-9cfb-537e-b2ac-6d60a5514e55/5b546abb-9cfb-537e-b2ac-6d60a5514e55_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 71678,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YW64DGU/698928956/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5b546abb-9cfb-537e-b2ac-6d60a5514e55/5b546abb-9cfb-537e-b2ac-6d60a5514e55_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 82363,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YW64DGU/698928973/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-01-01',
'seller_name': None,
'title': 'JEEP GRAND CHEROKEE 3.0 CRD SUMMIT StationWagon',
'transmission': 'automatic',
'trim': 'CRD SUMMIT',
'vin': '1C4RJFKM5FC626416',
'year': 2015}
2026-03-28 14:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YW64%2520DGU%27 HTTP/1.1" 200 None
2026-03-28 14:02:15 [bca.uk] INFO: Saving data for YW64%20DGU: {'created_time': 1774706535.460521, 'last_price_update_time': 1774706535.460538, 'auction_closing_time': 1774864800.0}
2026-03-28 14:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='YW64%2520DGU') HTTP/1.1" 204 0
2026-03-28 14:02:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/FJ70HFF/42809908?sv=2020-08-04&st=2026-03-28T14%3A02%3A14Z&se=2026-03-28T14%3A27%3A14Z&sr=b&sp=r&sig=BLkTOcAQXlC6tflFfVlnOiQji6BjZlMn9%2BOPeKNwW40%3D> (referer: https://www.bca.co.uk/)
2026-03-28 14:02:15 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BG72UUY/698459100/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698459100>
2026-03-28 14:02:15 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RA68WZE/698229725/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698229725>
2026-03-28 14:02:15 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RA68WZE/698229715/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698229715>
2026-03-28 14:02:15 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RA68WZE/698229742/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698229742>
2026-03-28 14:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698250309%27 HTTP/1.1" 200 None
2026-03-28 14:02:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698250309 not downloaded yet
2026-03-28 14:02:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:02:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2ca7ee10>
2026-03-28 14:02:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:02:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:02:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:02:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_29da6c1c-854f-50ff-9030-4ad1ff36e423/29da6c1c-854f-50ff-9030-4ad1ff36e423_image_4.jpg HTTP/1.1" 201 0
2026-03-28 14:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FAM58MHU%252F698953163%252F600') HTTP/1.1" 204 0
2026-03-28 14:02:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AM58MHU/698953163/600 saved to cache
2026-03-28 14:02:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 29da6c1c-854f-50ff-9030-4ad1ff36e423
2026-03-28 14:02:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:02:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a1ff50d50>
2026-03-28 14:02:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:02:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:02:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:02:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_29da6c1c-854f-50ff-9030-4ad1ff36e423/29da6c1c-854f-50ff-9030-4ad1ff36e423_image_5.jpg HTTP/1.1" 201 0
2026-03-28 14:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FAM58MHU%252F698970537%252F600') HTTP/1.1" 204 0
2026-03-28 14:02:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AM58MHU/698970537/600 saved to cache
2026-03-28 14:02:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 29da6c1c-854f-50ff-9030-4ad1ff36e423
2026-03-28 14:02:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:02:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c0db490>
2026-03-28 14:02:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:02:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:02:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:02:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_228041df-5797-5c8f-89c8-2a337a640ead/228041df-5797-5c8f-89c8-2a337a640ead_image_1.jpg HTTP/1.1" 201 0
2026-03-28 14:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FSF65MRS%252F698522052%252F600') HTTP/1.1" 204 0
2026-03-28 14:02:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SF65MRS/698522052/600 saved to cache
2026-03-28 14:02:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 228041df-5797-5c8f-89c8-2a337a640ead
2026-03-28 14:02:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:02:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a1fd907d0>
2026-03-28 14:02:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:02:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:02:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:02:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7ca8ff92-ba13-58b4-8b9a-c74a2e2ed8c1/7ca8ff92-ba13-58b4-8b9a-c74a2e2ed8c1_image_3.jpg HTTP/1.1" 201 0
2026-03-28 14:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FSH14BOU%252F698522068%252F600') HTTP/1.1" 204 0
2026-03-28 14:02:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SH14BOU/698522068/600 saved to cache
2026-03-28 14:02:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 7ca8ff92-ba13-58b4-8b9a-c74a2e2ed8c1
2026-03-28 14:02:15 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RA68WZE/698229754/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698229754>
2026-03-28 14:02:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VO17FMZ/698274476/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/VO17FMZ/42810377?sv=2020-08-04&st=2026-03-28T14%3A01%3A10Z&se=2026-03-28T14%3A26%3A10Z&sr=b&sp=r&sig=PEm9gdKL%2BNRnVtrVK0%2F5sWr2YcEbrtVNzeob8CJbr3c%3D)
2026-03-28 14:02:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:02:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c61a250>
2026-03-28 14:02:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:02:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:02:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:02:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3da52437-88a6-5c28-8143-adc9baabdca3/3da52437-88a6-5c28-8143-adc9baabdca3_expert_report_file_a454e7d3-c920-4b65-af76-fd66ed90b8b5.pdf HTTP/1.1" 201 0
2026-03-28 14:02:15 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item 3da52437-88a6-5c28-8143-adc9baabdca3
2026-03-28 14:02:15 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 3da52437-88a6-5c28-8143-adc9baabdca3, skipping ID generation
2026-03-28 14:02:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 3da52437-88a6-5c28-8143-adc9baabdca3
2026-03-28 14:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DND19VHL-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-28 14:02:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=ND19VHL-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-28 14:02:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:02:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2d6aeb10>
2026-03-28 14:02:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:02:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:02:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:02:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_05412951-b5cb-5847-b7df-8f166615ed23/05412951-b5cb-5847-b7df-8f166615ed23_image_4.jpg HTTP/1.1" 201 0
2026-03-28 14:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FSB65CAX%252F697544352%252F600') HTTP/1.1" 204 0
2026-03-28 14:02:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SB65CAX/697544352/600 saved to cache
2026-03-28 14:02:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 05412951-b5cb-5847-b7df-8f166615ed23
2026-03-28 14:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698250321%27 HTTP/1.1" 200 None
2026-03-28 14:02:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698250321 not downloaded yet
2026-03-28 14:02:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/PE10DXZ/42777447?sv=2020-08-04&st=2026-03-28T14%3A02%3A14Z&se=2026-03-28T14%3A27%3A14Z&sr=b&sp=r&sig=C8TA9FPCoH3d5KD%2BHIeQ7hc2gf2IEb2X5rEfOjKKKI4%3D> (referer: https://www.bca.co.uk/)
2026-03-28 14:02:15 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BG72UUY/698459109/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698459109>
2026-03-28 14:02:15 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RA68WZE/698229763/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698229763>
2026-03-28 14:02:15 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BG72UUY/698459107/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698459107>
2026-03-28 14:02:15 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BG72UUY/698459113/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698459113>
2026-03-28 14:02:15 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RA68WZE/698229733/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698229733>
2026-03-28 14:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698691117%27 HTTP/1.1" 200 None
2026-03-28 14:02:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698691117 not downloaded yet
2026-03-28 14:02:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:02:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2fe0fed0>
2026-03-28 14:02:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:02:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:02:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:02:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_210bede2-fc35-5c06-850c-0f613a811123/210bede2-fc35-5c06-850c-0f613a811123_expert_report_file_b56eb7ed-2a90-4f7a-b94b-9028020e4043.pdf HTTP/1.1" 201 0
2026-03-28 14:02:15 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item 210bede2-fc35-5c06-850c-0f613a811123
2026-03-28 14:02:15 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 210bede2-fc35-5c06-850c-0f613a811123, skipping ID generation
2026-03-28 14:02:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 210bede2-fc35-5c06-850c-0f613a811123
2026-03-28 14:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DFJ70HFF-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-28 14:02:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=FJ70HFF-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-28 14:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698250326%27 HTTP/1.1" 200 None
2026-03-28 14:02:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698250326 not downloaded yet
2026-03-28 14:02:15 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BG72UUY/698459122/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698459122>
2026-03-28 14:02:15 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BG72UUY/698459105/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698459105>
2026-03-28 14:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698691138%27 HTTP/1.1" 200 None
2026-03-28 14:02:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698691138 not downloaded yet
2026-03-28 14:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698938676%27 HTTP/1.1" 200 None
2026-03-28 14:02:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698938676 not downloaded yet
2026-03-28 14:02:15 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:02:15 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:02:15 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:02:15 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:02:15 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:02:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:02:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2d99d3d0>
2026-03-28 14:02:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:02:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:02:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:02:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7b233ce6-aa01-5f24-ac34-ccc770845b54/7b233ce6-aa01-5f24-ac34-ccc770845b54_image_9.jpg HTTP/1.1" 201 0
2026-03-28 14:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FVO17FMZ%252F698274476%252F600') HTTP/1.1" 204 0
2026-03-28 14:02:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VO17FMZ/698274476/600 saved to cache
2026-03-28 14:02:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 7b233ce6-aa01-5f24-ac34-ccc770845b54
2026-03-28 14:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698250341%27 HTTP/1.1" 200 None
2026-03-28 14:02:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698250341 not downloaded yet
2026-03-28 14:02:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RA68WZE/698229715/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/RA68WZE/42809489?sv=2020-08-04&st=2026-03-28T14%3A02%3A10Z&se=2026-03-28T14%3A27%3A10Z&sr=b&sp=r&sig=sGVqi7zLckoYL6nZquTH3Sr6GS2wBULLpmfzj%2F1aDfg%3D)
2026-03-28 14:02:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BG72UUY/698459100/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/BG72UUY/42810237?sv=2020-08-04&st=2026-03-28T14%3A02%3A10Z&se=2026-03-28T14%3A27%3A10Z&sr=b&sp=r&sig=yK8cIYpeZ9TamlFDpK%2BgLwUjKNRsv8EzcqtGcUy7mrQ%3D)
2026-03-28 14:02:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RA68WZE/698229725/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/RA68WZE/42809489?sv=2020-08-04&st=2026-03-28T14%3A02%3A10Z&se=2026-03-28T14%3A27%3A10Z&sr=b&sp=r&sig=sGVqi7zLckoYL6nZquTH3Sr6GS2wBULLpmfzj%2F1aDfg%3D)
2026-03-28 14:02:16 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BG72UUY/698459128/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698459128>
2026-03-28 14:02:16 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AF71XUK/698250303/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=AF71XUK-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-28 14:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698691165%27 HTTP/1.1" 200 None
2026-03-28 14:02:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698691165 not downloaded yet
2026-03-28 14:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698938684%27 HTTP/1.1" 200 None
2026-03-28 14:02:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698938684 not downloaded yet
2026-03-28 14:02:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RA68WZE/698229742/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/RA68WZE/42809489?sv=2020-08-04&st=2026-03-28T14%3A02%3A10Z&se=2026-03-28T14%3A27%3A10Z&sr=b&sp=r&sig=sGVqi7zLckoYL6nZquTH3Sr6GS2wBULLpmfzj%2F1aDfg%3D)
2026-03-28 14:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698250356%27 HTTP/1.1" 200 None
2026-03-28 14:02:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698250356 not downloaded yet
2026-03-28 14:02:16 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BG72UUY/698459134/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698459134>
2026-03-28 14:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698691192%27 HTTP/1.1" 200 None
2026-03-28 14:02:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698691192 not downloaded yet
2026-03-28 14:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698938693%27 HTTP/1.1" 200 None
2026-03-28 14:02:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698938693 not downloaded yet
2026-03-28 14:02:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RA68WZE/698229754/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/RA68WZE/42809489?sv=2020-08-04&st=2026-03-28T14%3A02%3A10Z&se=2026-03-28T14%3A27%3A10Z&sr=b&sp=r&sig=sGVqi7zLckoYL6nZquTH3Sr6GS2wBULLpmfzj%2F1aDfg%3D)
2026-03-28 14:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698250385%27 HTTP/1.1" 200 None
2026-03-28 14:02:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698250385 not downloaded yet
2026-03-28 14:02:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:02:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2fe31cd0>
2026-03-28 14:02:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:02:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:02:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:02:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4a813d3c-3e8d-5a38-9bde-5cc88840a6e8/4a813d3c-3e8d-5a38-9bde-5cc88840a6e8_expert_report_file_959eea12-666a-4e55-a226-aa72ac617f2d.pdf HTTP/1.1" 201 0
2026-03-28 14:02:16 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item 4a813d3c-3e8d-5a38-9bde-5cc88840a6e8
2026-03-28 14:02:16 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 4a813d3c-3e8d-5a38-9bde-5cc88840a6e8, skipping ID generation
2026-03-28 14:02:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 4a813d3c-3e8d-5a38-9bde-5cc88840a6e8
2026-03-28 14:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DPE10DXZ-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-28 14:02:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=PE10DXZ-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-28 14:02:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BG72UUY/698459109/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/BG72UUY/42810237?sv=2020-08-04&st=2026-03-28T14%3A02%3A10Z&se=2026-03-28T14%3A27%3A10Z&sr=b&sp=r&sig=yK8cIYpeZ9TamlFDpK%2BgLwUjKNRsv8EzcqtGcUy7mrQ%3D)
2026-03-28 14:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698691207%27 HTTP/1.1" 200 None
2026-03-28 14:02:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698691207 not downloaded yet
2026-03-28 14:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698938701%27 HTTP/1.1" 200 None
2026-03-28 14:02:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698938701 not downloaded yet
2026-03-28 14:02:16 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/ND19VHL/698691081/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=ND19VHL-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-28 14:02:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RA68WZE/698229733/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/RA68WZE/42809489?sv=2020-08-04&st=2026-03-28T14%3A02%3A10Z&se=2026-03-28T14%3A27%3A10Z&sr=b&sp=r&sig=sGVqi7zLckoYL6nZquTH3Sr6GS2wBULLpmfzj%2F1aDfg%3D)
2026-03-28 14:02:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BG72UUY/698459107/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/BG72UUY/42810237?sv=2020-08-04&st=2026-03-28T14%3A02%3A10Z&se=2026-03-28T14%3A27%3A10Z&sr=b&sp=r&sig=yK8cIYpeZ9TamlFDpK%2BgLwUjKNRsv8EzcqtGcUy7mrQ%3D)
2026-03-28 14:02:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RA68WZE/698229763/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/RA68WZE/42809489?sv=2020-08-04&st=2026-03-28T14%3A02%3A10Z&se=2026-03-28T14%3A27%3A10Z&sr=b&sp=r&sig=sGVqi7zLckoYL6nZquTH3Sr6GS2wBULLpmfzj%2F1aDfg%3D)
2026-03-28 14:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698250396%27 HTTP/1.1" 200 None
2026-03-28 14:02:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698250396 not downloaded yet
2026-03-28 14:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D697208825%27 HTTP/1.1" 200 None
2026-03-28 14:02:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=697208825 not downloaded yet
2026-03-28 14:02:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:02:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c0ccc10>
2026-03-28 14:02:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:02:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:02:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:02:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4de18175-834b-5b06-b8ed-75c0641e29ce/4de18175-834b-5b06-b8ed-75c0641e29ce_image_3.jpg HTTP/1.1" 201 0
2026-03-28 14:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FRA68WZE%252F698229715%252F600') HTTP/1.1" 204 0
2026-03-28 14:02:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RA68WZE/698229715/600 saved to cache
2026-03-28 14:02:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 4de18175-834b-5b06-b8ed-75c0641e29ce
2026-03-28 14:02:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:02:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2ca81950>
2026-03-28 14:02:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:02:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:02:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:02:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c2dfa08a-04ba-520a-b1ba-0b0dcf2d9ee2/c2dfa08a-04ba-520a-b1ba-0b0dcf2d9ee2_image_2.jpg HTTP/1.1" 201 0
2026-03-28 14:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FBG72UUY%252F698459100%252F600') HTTP/1.1" 204 0
2026-03-28 14:02:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BG72UUY/698459100/600 saved to cache
2026-03-28 14:02:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item c2dfa08a-04ba-520a-b1ba-0b0dcf2d9ee2
2026-03-28 14:02:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:02:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2ca80c10>
2026-03-28 14:02:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:02:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:02:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:02:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4de18175-834b-5b06-b8ed-75c0641e29ce/4de18175-834b-5b06-b8ed-75c0641e29ce_image_4.jpg HTTP/1.1" 201 0
2026-03-28 14:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FRA68WZE%252F698229725%252F600') HTTP/1.1" 204 0
2026-03-28 14:02:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RA68WZE/698229725/600 saved to cache
2026-03-28 14:02:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 4de18175-834b-5b06-b8ed-75c0641e29ce
2026-03-28 14:02:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BG72UUY/698459113/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/BG72UUY/42810237?sv=2020-08-04&st=2026-03-28T14%3A02%3A10Z&se=2026-03-28T14%3A27%3A10Z&sr=b&sp=r&sig=yK8cIYpeZ9TamlFDpK%2BgLwUjKNRsv8EzcqtGcUy7mrQ%3D)
2026-03-28 14:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698691253%27 HTTP/1.1" 200 None
2026-03-28 14:02:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698691253 not downloaded yet
2026-03-28 14:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698938708%27 HTTP/1.1" 200 None
2026-03-28 14:02:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698938708 not downloaded yet
2026-03-28 14:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698250402%27 HTTP/1.1" 200 None
2026-03-28 14:02:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698250402 not downloaded yet
2026-03-28 14:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D697208860%27 HTTP/1.1" 200 None
2026-03-28 14:02:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=697208860 not downloaded yet
2026-03-28 14:02:16 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:02:16 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:02:16 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:02:16 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:02:16 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:02:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:02:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2eb11350>
2026-03-28 14:02:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:02:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:02:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:02:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4de18175-834b-5b06-b8ed-75c0641e29ce/4de18175-834b-5b06-b8ed-75c0641e29ce_image_6.jpg HTTP/1.1" 201 0
2026-03-28 14:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FRA68WZE%252F698229742%252F600') HTTP/1.1" 204 0
2026-03-28 14:02:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RA68WZE/698229742/600 saved to cache
2026-03-28 14:02:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 4de18175-834b-5b06-b8ed-75c0641e29ce
2026-03-28 14:02:16 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:02:16 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:02:16 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:02:16 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:02:16 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:02:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:02:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c11c6d0>
2026-03-28 14:02:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:02:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:02:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:02:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4de18175-834b-5b06-b8ed-75c0641e29ce/4de18175-834b-5b06-b8ed-75c0641e29ce_image_7.jpg HTTP/1.1" 201 0
2026-03-28 14:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FRA68WZE%252F698229754%252F600') HTTP/1.1" 204 0
2026-03-28 14:02:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RA68WZE/698229754/600 saved to cache
2026-03-28 14:02:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 4de18175-834b-5b06-b8ed-75c0641e29ce
2026-03-28 14:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698691283%27 HTTP/1.1" 200 None
2026-03-28 14:02:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698691283 not downloaded yet
2026-03-28 14:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698938723%27 HTTP/1.1" 200 None
2026-03-28 14:02:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698938723 not downloaded yet
2026-03-28 14:02:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BG72UUY/698459105/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/BG72UUY/42810237?sv=2020-08-04&st=2026-03-28T14%3A02%3A10Z&se=2026-03-28T14%3A27%3A10Z&sr=b&sp=r&sig=yK8cIYpeZ9TamlFDpK%2BgLwUjKNRsv8EzcqtGcUy7mrQ%3D)
2026-03-28 14:02:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AF71XUK/698250303/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/AF71XUK/42810232?sv=2020-08-04&st=2026-03-28T14%3A02%3A11Z&se=2026-03-28T14%3A27%3A11Z&sr=b&sp=r&sig=tGq7RNNjcl9do17viZhXDHgcWKPhPxb%2FskLZ1LkjXQQ%3D)
2026-03-28 14:02:16 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AF71XUK/698250326/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698250326>
2026-03-28 14:02:16 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/ND19VHL/698691138/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698691138>
2026-03-28 14:02:16 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FJ70HFF/698938676/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698938676>
2026-03-28 14:02:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BG72UUY/698459122/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/BG72UUY/42810237?sv=2020-08-04&st=2026-03-28T14%3A02%3A10Z&se=2026-03-28T14%3A27%3A10Z&sr=b&sp=r&sig=yK8cIYpeZ9TamlFDpK%2BgLwUjKNRsv8EzcqtGcUy7mrQ%3D)
2026-03-28 14:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698250413%27 HTTP/1.1" 200 None
2026-03-28 14:02:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698250413 not downloaded yet
2026-03-28 14:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D697208881%27 HTTP/1.1" 200 None
2026-03-28 14:02:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=697208881 not downloaded yet
2026-03-28 14:02:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BG72UUY/698459128/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/BG72UUY/42810237?sv=2020-08-04&st=2026-03-28T14%3A02%3A10Z&se=2026-03-28T14%3A27%3A10Z&sr=b&sp=r&sig=yK8cIYpeZ9TamlFDpK%2BgLwUjKNRsv8EzcqtGcUy7mrQ%3D)
2026-03-28 14:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698691309%27 HTTP/1.1" 200 None
2026-03-28 14:02:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698691309 not downloaded yet
2026-03-28 14:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698938735%27 HTTP/1.1" 200 None
2026-03-28 14:02:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698938735 not downloaded yet
2026-03-28 14:02:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:02:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2d950c50>
2026-03-28 14:02:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:02:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:02:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:02:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c2dfa08a-04ba-520a-b1ba-0b0dcf2d9ee2/c2dfa08a-04ba-520a-b1ba-0b0dcf2d9ee2_image_5.jpg HTTP/1.1" 201 0
2026-03-28 14:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FBG72UUY%252F698459109%252F600') HTTP/1.1" 204 0
2026-03-28 14:02:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BG72UUY/698459109/600 saved to cache
2026-03-28 14:02:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item c2dfa08a-04ba-520a-b1ba-0b0dcf2d9ee2
2026-03-28 14:02:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:02:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2fe0ad10>
2026-03-28 14:02:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:02:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:02:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:02:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4de18175-834b-5b06-b8ed-75c0641e29ce/4de18175-834b-5b06-b8ed-75c0641e29ce_image_5.jpg HTTP/1.1" 201 0
2026-03-28 14:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FRA68WZE%252F698229733%252F600') HTTP/1.1" 204 0
2026-03-28 14:02:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RA68WZE/698229733/600 saved to cache
2026-03-28 14:02:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 4de18175-834b-5b06-b8ed-75c0641e29ce
2026-03-28 14:02:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:02:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c4d0e50>
2026-03-28 14:02:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:02:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:02:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:02:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c2dfa08a-04ba-520a-b1ba-0b0dcf2d9ee2/c2dfa08a-04ba-520a-b1ba-0b0dcf2d9ee2_image_4.jpg HTTP/1.1" 201 0
2026-03-28 14:02:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FBG72UUY%252F698459107%252F600') HTTP/1.1" 204 0
2026-03-28 14:02:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BG72UUY/698459107/600 saved to cache
2026-03-28 14:02:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item c2dfa08a-04ba-520a-b1ba-0b0dcf2d9ee2
2026-03-28 14:02:17 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:02:17 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:02:17 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:02:17 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:02:17 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:02:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:02:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c0da050>
2026-03-28 14:02:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:02:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:02:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:02:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4de18175-834b-5b06-b8ed-75c0641e29ce/4de18175-834b-5b06-b8ed-75c0641e29ce_image_8.jpg HTTP/1.1" 201 0
2026-03-28 14:02:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FRA68WZE%252F698229763%252F600') HTTP/1.1" 204 0
2026-03-28 14:02:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RA68WZE/698229763/600 saved to cache
2026-03-28 14:02:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 4de18175-834b-5b06-b8ed-75c0641e29ce
2026-03-28 14:02:17 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:02:17 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:02:17 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:02:17 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:02:17 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:02:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:02:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c55a210>
2026-03-28 14:02:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:02:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:02:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:02:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c2dfa08a-04ba-520a-b1ba-0b0dcf2d9ee2/c2dfa08a-04ba-520a-b1ba-0b0dcf2d9ee2_image_6.jpg HTTP/1.1" 201 0
2026-03-28 14:02:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FBG72UUY%252F698459113%252F600') HTTP/1.1" 204 0
2026-03-28 14:02:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BG72UUY/698459113/600 saved to cache
2026-03-28 14:02:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item c2dfa08a-04ba-520a-b1ba-0b0dcf2d9ee2
2026-03-28 14:02:17 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AF71XUK/698250341/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698250341>
2026-03-28 14:02:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D697208909%27 HTTP/1.1" 200 None
2026-03-28 14:02:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=697208909 not downloaded yet
2026-03-28 14:02:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698691330%27 HTTP/1.1" 200 None
2026-03-28 14:02:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698691330 not downloaded yet
2026-03-28 14:02:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698938747%27 HTTP/1.1" 200 None
2026-03-28 14:02:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698938747 not downloaded yet
2026-03-28 14:02:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D697208935%27 HTTP/1.1" 200 None
2026-03-28 14:02:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=697208935 not downloaded yet
2026-03-28 14:02:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:02:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c43ce10>
2026-03-28 14:02:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:02:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:02:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:02:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c2dfa08a-04ba-520a-b1ba-0b0dcf2d9ee2/c2dfa08a-04ba-520a-b1ba-0b0dcf2d9ee2_image_3.jpg HTTP/1.1" 201 0
2026-03-28 14:02:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FBG72UUY%252F698459105%252F600') HTTP/1.1" 204 0
2026-03-28 14:02:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BG72UUY/698459105/600 saved to cache
2026-03-28 14:02:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item c2dfa08a-04ba-520a-b1ba-0b0dcf2d9ee2
2026-03-28 14:02:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:02:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a1ff50190>
2026-03-28 14:02:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:02:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:02:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:02:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ca8b23b7-2e66-554c-8e62-feb13d6c73d4/ca8b23b7-2e66-554c-8e62-feb13d6c73d4_image_0.jpg HTTP/1.1" 201 0
2026-03-28 14:02:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FAF71XUK%252F698250303%252F600') HTTP/1.1" 204 0
2026-03-28 14:02:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AF71XUK/698250303/600 saved to cache
2026-03-28 14:02:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item ca8b23b7-2e66-554c-8e62-feb13d6c73d4
2026-03-28 14:02:17 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:02:17 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:02:17 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:02:17 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:02:17 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:02:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:02:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a1fd59790>
2026-03-28 14:02:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:02:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:02:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:02:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c2dfa08a-04ba-520a-b1ba-0b0dcf2d9ee2/c2dfa08a-04ba-520a-b1ba-0b0dcf2d9ee2_image_7.jpg HTTP/1.1" 201 0
2026-03-28 14:02:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FBG72UUY%252F698459122%252F600') HTTP/1.1" 204 0
2026-03-28 14:02:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BG72UUY/698459122/600 saved to cache
2026-03-28 14:02:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item c2dfa08a-04ba-520a-b1ba-0b0dcf2d9ee2
2026-03-28 14:02:17 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:02:17 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:02:17 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:02:17 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:02:17 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:02:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:02:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a1ff51c90>
2026-03-28 14:02:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:02:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:02:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:02:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c2dfa08a-04ba-520a-b1ba-0b0dcf2d9ee2/c2dfa08a-04ba-520a-b1ba-0b0dcf2d9ee2_image_8.jpg HTTP/1.1" 201 0
2026-03-28 14:02:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FBG72UUY%252F698459128%252F600') HTTP/1.1" 204 0
2026-03-28 14:02:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BG72UUY/698459128/600 saved to cache
2026-03-28 14:02:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item c2dfa08a-04ba-520a-b1ba-0b0dcf2d9ee2
2026-03-28 14:02:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/ND19VHL/698691081/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/ND19VHL/42810243?sv=2020-08-04&st=2026-03-28T14%3A02%3A12Z&se=2026-03-28T14%3A27%3A12Z&sr=b&sp=r&sig=NwiuSm%2BGmVjPsuAr5oUGhIAXqOanP4zOrkP6mfv72zY%3D)
2026-03-28 14:02:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698938762%27 HTTP/1.1" 200 None
2026-03-28 14:02:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698938762 not downloaded yet
2026-03-28 14:02:17 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AF71XUK/698250385/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698250385>
2026-03-28 14:02:17 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FJ70HFF/698938693/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698938693>
2026-03-28 14:02:17 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PE10DXZ/697208794/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=PE10DXZ-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-28 14:02:17 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AF71XUK/698250356/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698250356>
2026-03-28 14:02:17 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/ND19VHL/698691192/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698691192>
2026-03-28 14:02:17 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PE10DXZ/697208825/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=697208825>
2026-03-28 14:02:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D697208963%27 HTTP/1.1" 200 None
2026-03-28 14:02:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=697208963 not downloaded yet
2026-03-28 14:02:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BG72UUY/698459134/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/BG72UUY/42810237?sv=2020-08-04&st=2026-03-28T14%3A02%3A10Z&se=2026-03-28T14%3A27%3A10Z&sr=b&sp=r&sig=yK8cIYpeZ9TamlFDpK%2BgLwUjKNRsv8EzcqtGcUy7mrQ%3D)
2026-03-28 14:02:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D697208992%27 HTTP/1.1" 200 None
2026-03-28 14:02:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=697208992 not downloaded yet
2026-03-28 14:02:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D697209030%27 HTTP/1.1" 200 None
2026-03-28 14:02:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=697209030 not downloaded yet
2026-03-28 14:02:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D697209053%27 HTTP/1.1" 200 None
2026-03-28 14:02:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=697209053 not downloaded yet
2026-03-28 14:02:17 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/ND19VHL/698691283/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698691283>
2026-03-28 14:02:17 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PE10DXZ/697208860/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=697208860>
2026-03-28 14:02:17 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AF71XUK/698250402/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698250402>
2026-03-28 14:02:17 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FJ70HFF/698938723/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698938723>
2026-03-28 14:02:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:02:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c9f7050>
2026-03-28 14:02:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:02:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:02:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:02:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3da52437-88a6-5c28-8143-adc9baabdca3/3da52437-88a6-5c28-8143-adc9baabdca3_image_0.jpg HTTP/1.1" 201 0
2026-03-28 14:02:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FND19VHL%252F698691081%252F600') HTTP/1.1" 204 0
2026-03-28 14:02:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/ND19VHL/698691081/600 saved to cache
2026-03-28 14:02:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 3da52437-88a6-5c28-8143-adc9baabdca3
2026-03-28 14:02:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/ND19VHL/698691138/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/ND19VHL/42810243?sv=2020-08-04&st=2026-03-28T14%3A02%3A12Z&se=2026-03-28T14%3A27%3A12Z&sr=b&sp=r&sig=NwiuSm%2BGmVjPsuAr5oUGhIAXqOanP4zOrkP6mfv72zY%3D)
2026-03-28 14:02:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FJ70HFF/698938676/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/FJ70HFF/42809908?sv=2020-08-04&st=2026-03-28T14%3A02%3A14Z&se=2026-03-28T14%3A27%3A14Z&sr=b&sp=r&sig=BLkTOcAQXlC6tflFfVlnOiQji6BjZlMn9%2BOPeKNwW40%3D)
2026-03-28 14:02:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AF71XUK/698250341/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/AF71XUK/42810232?sv=2020-08-04&st=2026-03-28T14%3A02%3A11Z&se=2026-03-28T14%3A27%3A11Z&sr=b&sp=r&sig=tGq7RNNjcl9do17viZhXDHgcWKPhPxb%2FskLZ1LkjXQQ%3D)
2026-03-28 14:02:17 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:02:17 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:02:17 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:02:17 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:02:17 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:02:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:02:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a1fec55d0>
2026-03-28 14:02:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:02:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:02:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:02:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c2dfa08a-04ba-520a-b1ba-0b0dcf2d9ee2/c2dfa08a-04ba-520a-b1ba-0b0dcf2d9ee2_image_9.jpg HTTP/1.1" 201 0
2026-03-28 14:02:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FBG72UUY%252F698459134%252F600') HTTP/1.1" 204 0
2026-03-28 14:02:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BG72UUY/698459134/600 saved to cache
2026-03-28 14:02:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item c2dfa08a-04ba-520a-b1ba-0b0dcf2d9ee2
2026-03-28 14:02:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AF71XUK/698250326/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/AF71XUK/42810232?sv=2020-08-04&st=2026-03-28T14%3A02%3A11Z&se=2026-03-28T14%3A27%3A11Z&sr=b&sp=r&sig=tGq7RNNjcl9do17viZhXDHgcWKPhPxb%2FskLZ1LkjXQQ%3D)
2026-03-28 14:02:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FJ70HFF/698938693/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/FJ70HFF/42809908?sv=2020-08-04&st=2026-03-28T14%3A02%3A14Z&se=2026-03-28T14%3A27%3A14Z&sr=b&sp=r&sig=BLkTOcAQXlC6tflFfVlnOiQji6BjZlMn9%2BOPeKNwW40%3D)
2026-03-28 14:02:17 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FJ70HFF/698938747/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698938747>
2026-03-28 14:02:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PE10DXZ/697208794/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/PE10DXZ/42777447?sv=2020-08-04&st=2026-03-28T14%3A02%3A14Z&se=2026-03-28T14%3A27%3A14Z&sr=b&sp=r&sig=C8TA9FPCoH3d5KD%2BHIeQ7hc2gf2IEb2X5rEfOjKKKI4%3D)
2026-03-28 14:02:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AF71XUK/698250356/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/AF71XUK/42810232?sv=2020-08-04&st=2026-03-28T14%3A02%3A11Z&se=2026-03-28T14%3A27%3A11Z&sr=b&sp=r&sig=tGq7RNNjcl9do17viZhXDHgcWKPhPxb%2FskLZ1LkjXQQ%3D)
2026-03-28 14:02:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/ND19VHL/698691192/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/ND19VHL/42810243?sv=2020-08-04&st=2026-03-28T14%3A02%3A12Z&se=2026-03-28T14%3A27%3A12Z&sr=b&sp=r&sig=NwiuSm%2BGmVjPsuAr5oUGhIAXqOanP4zOrkP6mfv72zY%3D)
2026-03-28 14:02:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AF71XUK/698250385/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/AF71XUK/42810232?sv=2020-08-04&st=2026-03-28T14%3A02%3A11Z&se=2026-03-28T14%3A27%3A11Z&sr=b&sp=r&sig=tGq7RNNjcl9do17viZhXDHgcWKPhPxb%2FskLZ1LkjXQQ%3D)
2026-03-28 14:02:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:02:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a1fec5890>
2026-03-28 14:02:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:02:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:02:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:02:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3da52437-88a6-5c28-8143-adc9baabdca3/3da52437-88a6-5c28-8143-adc9baabdca3_image_2.jpg HTTP/1.1" 201 0
2026-03-28 14:02:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FND19VHL%252F698691138%252F600') HTTP/1.1" 204 0
2026-03-28 14:02:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/ND19VHL/698691138/600 saved to cache
2026-03-28 14:02:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 3da52437-88a6-5c28-8143-adc9baabdca3
2026-03-28 14:02:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:02:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a1fd6d910>
2026-03-28 14:02:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:02:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:02:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:02:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_210bede2-fc35-5c06-850c-0f613a811123/210bede2-fc35-5c06-850c-0f613a811123_image_1.jpg HTTP/1.1" 201 0
2026-03-28 14:02:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FFJ70HFF%252F698938676%252F600') HTTP/1.1" 204 0
2026-03-28 14:02:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FJ70HFF/698938676/600 saved to cache
2026-03-28 14:02:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 210bede2-fc35-5c06-850c-0f613a811123
2026-03-28 14:02:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:02:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c461550>
2026-03-28 14:02:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:02:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:02:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:02:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ca8b23b7-2e66-554c-8e62-feb13d6c73d4/ca8b23b7-2e66-554c-8e62-feb13d6c73d4_image_4.jpg HTTP/1.1" 201 0
2026-03-28 14:02:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FAF71XUK%252F698250341%252F600') HTTP/1.1" 204 0
2026-03-28 14:02:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AF71XUK/698250341/600 saved to cache
2026-03-28 14:02:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item ca8b23b7-2e66-554c-8e62-feb13d6c73d4
2026-03-28 14:02:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PE10DXZ/697208825/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/PE10DXZ/42777447?sv=2020-08-04&st=2026-03-28T14%3A02%3A14Z&se=2026-03-28T14%3A27%3A14Z&sr=b&sp=r&sig=C8TA9FPCoH3d5KD%2BHIeQ7hc2gf2IEb2X5rEfOjKKKI4%3D)
2026-03-28 14:02:17 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FJ70HFF/698938762/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698938762>
2026-03-28 14:02:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PE10DXZ/697208860/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/PE10DXZ/42777447?sv=2020-08-04&st=2026-03-28T14%3A02%3A14Z&se=2026-03-28T14%3A27%3A14Z&sr=b&sp=r&sig=C8TA9FPCoH3d5KD%2BHIeQ7hc2gf2IEb2X5rEfOjKKKI4%3D)
2026-03-28 14:02:17 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PE10DXZ/697209053/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=697209053>
2026-03-28 14:02:17 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PE10DXZ/697209030/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=697209030>
2026-03-28 14:02:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AF71XUK/698250402/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/AF71XUK/42810232?sv=2020-08-04&st=2026-03-28T14%3A02%3A11Z&se=2026-03-28T14%3A27%3A11Z&sr=b&sp=r&sig=tGq7RNNjcl9do17viZhXDHgcWKPhPxb%2FskLZ1LkjXQQ%3D)
2026-03-28 14:02:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FJ70HFF/698938723/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/FJ70HFF/42809908?sv=2020-08-04&st=2026-03-28T14%3A02%3A14Z&se=2026-03-28T14%3A27%3A14Z&sr=b&sp=r&sig=BLkTOcAQXlC6tflFfVlnOiQji6BjZlMn9%2BOPeKNwW40%3D)
2026-03-28 14:02:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/ND19VHL/698691283/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/ND19VHL/42810243?sv=2020-08-04&st=2026-03-28T14%3A02%3A12Z&se=2026-03-28T14%3A27%3A12Z&sr=b&sp=r&sig=NwiuSm%2BGmVjPsuAr5oUGhIAXqOanP4zOrkP6mfv72zY%3D)
2026-03-28 14:02:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:02:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a1fd91710>
2026-03-28 14:02:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:02:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:02:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:02:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ca8b23b7-2e66-554c-8e62-feb13d6c73d4/ca8b23b7-2e66-554c-8e62-feb13d6c73d4_image_3.jpg HTTP/1.1" 201 0
2026-03-28 14:02:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FAF71XUK%252F698250326%252F600') HTTP/1.1" 204 0
2026-03-28 14:02:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AF71XUK/698250326/600 saved to cache
2026-03-28 14:02:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item ca8b23b7-2e66-554c-8e62-feb13d6c73d4
2026-03-28 14:02:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:02:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c0d91d0>
2026-03-28 14:02:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:02:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:02:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:02:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_210bede2-fc35-5c06-850c-0f613a811123/210bede2-fc35-5c06-850c-0f613a811123_image_3.jpg HTTP/1.1" 201 0
2026-03-28 14:02:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FFJ70HFF%252F698938693%252F600') HTTP/1.1" 204 0
2026-03-28 14:02:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FJ70HFF/698938693/600 saved to cache
2026-03-28 14:02:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 210bede2-fc35-5c06-850c-0f613a811123
2026-03-28 14:02:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:02:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c593650>
2026-03-28 14:02:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:02:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:02:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:02:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4a813d3c-3e8d-5a38-9bde-5cc88840a6e8/4a813d3c-3e8d-5a38-9bde-5cc88840a6e8_image_0.jpg HTTP/1.1" 201 0
2026-03-28 14:02:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FPE10DXZ%252F697208794%252F600') HTTP/1.1" 204 0
2026-03-28 14:02:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PE10DXZ/697208794/600 saved to cache
2026-03-28 14:02:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 4a813d3c-3e8d-5a38-9bde-5cc88840a6e8
2026-03-28 14:02:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:02:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c9b4ad0>
2026-03-28 14:02:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:02:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:02:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:02:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ca8b23b7-2e66-554c-8e62-feb13d6c73d4/ca8b23b7-2e66-554c-8e62-feb13d6c73d4_image_5.jpg HTTP/1.1" 201 0
2026-03-28 14:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FAF71XUK%252F698250356%252F600') HTTP/1.1" 204 0
2026-03-28 14:02:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AF71XUK/698250356/600 saved to cache
2026-03-28 14:02:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item ca8b23b7-2e66-554c-8e62-feb13d6c73d4
2026-03-28 14:02:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:02:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c5935d0>
2026-03-28 14:02:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:02:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:02:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:02:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3da52437-88a6-5c28-8143-adc9baabdca3/3da52437-88a6-5c28-8143-adc9baabdca3_image_4.jpg HTTP/1.1" 201 0
2026-03-28 14:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FND19VHL%252F698691192%252F600') HTTP/1.1" 204 0
2026-03-28 14:02:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/ND19VHL/698691192/600 saved to cache
2026-03-28 14:02:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 3da52437-88a6-5c28-8143-adc9baabdca3
2026-03-28 14:02:18 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:02:18 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:02:18 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:02:18 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:02:18 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:02:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:02:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c857390>
2026-03-28 14:02:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:02:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:02:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:02:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ca8b23b7-2e66-554c-8e62-feb13d6c73d4/ca8b23b7-2e66-554c-8e62-feb13d6c73d4_image_6.jpg HTTP/1.1" 201 0
2026-03-28 14:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FAF71XUK%252F698250385%252F600') HTTP/1.1" 204 0
2026-03-28 14:02:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AF71XUK/698250385/600 saved to cache
2026-03-28 14:02:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item ca8b23b7-2e66-554c-8e62-feb13d6c73d4
2026-03-28 14:02:18 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PE10DXZ/697208935/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=697208935>
2026-03-28 14:02:18 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/ND19VHL/698691330/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698691330>
2026-03-28 14:02:18 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PE10DXZ/697208963/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=697208963>
2026-03-28 14:02:18 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PE10DXZ/697208992/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=697208992>
2026-03-28 14:02:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FJ70HFF/698938747/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/FJ70HFF/42809908?sv=2020-08-04&st=2026-03-28T14%3A02%3A14Z&se=2026-03-28T14%3A27%3A14Z&sr=b&sp=r&sig=BLkTOcAQXlC6tflFfVlnOiQji6BjZlMn9%2BOPeKNwW40%3D)
2026-03-28 14:02:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:02:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c6b3d90>
2026-03-28 14:02:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:02:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:02:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:02:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4a813d3c-3e8d-5a38-9bde-5cc88840a6e8/4a813d3c-3e8d-5a38-9bde-5cc88840a6e8_image_1.jpg HTTP/1.1" 201 0
2026-03-28 14:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FPE10DXZ%252F697208825%252F600') HTTP/1.1" 204 0
2026-03-28 14:02:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PE10DXZ/697208825/600 saved to cache
2026-03-28 14:02:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 4a813d3c-3e8d-5a38-9bde-5cc88840a6e8
2026-03-28 14:02:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:02:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2ca5c350>
2026-03-28 14:02:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:02:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:02:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:02:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4a813d3c-3e8d-5a38-9bde-5cc88840a6e8/4a813d3c-3e8d-5a38-9bde-5cc88840a6e8_image_2.jpg HTTP/1.1" 201 0
2026-03-28 14:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FPE10DXZ%252F697208860%252F600') HTTP/1.1" 204 0
2026-03-28 14:02:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PE10DXZ/697208860/600 saved to cache
2026-03-28 14:02:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 4a813d3c-3e8d-5a38-9bde-5cc88840a6e8
2026-03-28 14:02:18 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:02:18 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:02:18 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:02:18 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:02:18 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:02:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:02:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c604390>
2026-03-28 14:02:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:02:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:02:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:02:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ca8b23b7-2e66-554c-8e62-feb13d6c73d4/ca8b23b7-2e66-554c-8e62-feb13d6c73d4_image_8.jpg HTTP/1.1" 201 0
2026-03-28 14:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FAF71XUK%252F698250402%252F600') HTTP/1.1" 204 0
2026-03-28 14:02:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AF71XUK/698250402/600 saved to cache
2026-03-28 14:02:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item ca8b23b7-2e66-554c-8e62-feb13d6c73d4
2026-03-28 14:02:18 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:02:18 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:02:18 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:02:18 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:02:18 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:02:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:02:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2ca5c810>
2026-03-28 14:02:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:02:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:02:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:02:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_210bede2-fc35-5c06-850c-0f613a811123/210bede2-fc35-5c06-850c-0f613a811123_image_6.jpg HTTP/1.1" 201 0
2026-03-28 14:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FFJ70HFF%252F698938723%252F600') HTTP/1.1" 204 0
2026-03-28 14:02:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FJ70HFF/698938723/600 saved to cache
2026-03-28 14:02:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 210bede2-fc35-5c06-850c-0f613a811123
2026-03-28 14:02:18 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:02:18 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:02:18 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:02:18 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:02:18 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:02:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:02:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c7785d0>
2026-03-28 14:02:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:02:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:02:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:02:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3da52437-88a6-5c28-8143-adc9baabdca3/3da52437-88a6-5c28-8143-adc9baabdca3_image_7.jpg HTTP/1.1" 201 0
2026-03-28 14:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FND19VHL%252F698691283%252F600') HTTP/1.1" 204 0
2026-03-28 14:02:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/ND19VHL/698691283/600 saved to cache
2026-03-28 14:02:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 3da52437-88a6-5c28-8143-adc9baabdca3
2026-03-28 14:02:18 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FJ70HFF/698938735/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698938735>
2026-03-28 14:02:18 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/ND19VHL/698691309/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698691309>
2026-03-28 14:02:18 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PE10DXZ/697208909/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=697208909>
2026-03-28 14:02:18 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PE10DXZ/697208881/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=697208881>
2026-03-28 14:02:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PE10DXZ/697209030/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/PE10DXZ/42777447?sv=2020-08-04&st=2026-03-28T14%3A02%3A14Z&se=2026-03-28T14%3A27%3A14Z&sr=b&sp=r&sig=C8TA9FPCoH3d5KD%2BHIeQ7hc2gf2IEb2X5rEfOjKKKI4%3D)
2026-03-28 14:02:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FJ70HFF/698938762/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/FJ70HFF/42809908?sv=2020-08-04&st=2026-03-28T14%3A02%3A14Z&se=2026-03-28T14%3A27%3A14Z&sr=b&sp=r&sig=BLkTOcAQXlC6tflFfVlnOiQji6BjZlMn9%2BOPeKNwW40%3D)
2026-03-28 14:02:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PE10DXZ/697209053/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/PE10DXZ/42777447?sv=2020-08-04&st=2026-03-28T14%3A02%3A14Z&se=2026-03-28T14%3A27%3A14Z&sr=b&sp=r&sig=C8TA9FPCoH3d5KD%2BHIeQ7hc2gf2IEb2X5rEfOjKKKI4%3D)
2026-03-28 14:02:18 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:02:18 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:02:18 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:02:18 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:02:18 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:02:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:02:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a1fd6da90>
2026-03-28 14:02:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:02:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:02:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:02:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_210bede2-fc35-5c06-850c-0f613a811123/210bede2-fc35-5c06-850c-0f613a811123_image_8.jpg HTTP/1.1" 201 0
2026-03-28 14:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FFJ70HFF%252F698938747%252F600') HTTP/1.1" 204 0
2026-03-28 14:02:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FJ70HFF/698938747/600 saved to cache
2026-03-28 14:02:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 210bede2-fc35-5c06-850c-0f613a811123
2026-03-28 14:02:18 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AF71XUK/698250413/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698250413>
2026-03-28 14:02:18 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FJ70HFF/698938708/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698938708>
2026-03-28 14:02:18 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AF71XUK/698250396/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698250396>
2026-03-28 14:02:18 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/ND19VHL/698691253/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698691253>
2026-03-28 14:02:18 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:02:18 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:02:18 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:02:18 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:02:18 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:02:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:02:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c6928d0>
2026-03-28 14:02:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:02:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:02:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:02:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4a813d3c-3e8d-5a38-9bde-5cc88840a6e8/4a813d3c-3e8d-5a38-9bde-5cc88840a6e8_image_8.jpg HTTP/1.1" 201 0
2026-03-28 14:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FPE10DXZ%252F697209030%252F600') HTTP/1.1" 204 0
2026-03-28 14:02:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PE10DXZ/697209030/600 saved to cache
2026-03-28 14:02:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 4a813d3c-3e8d-5a38-9bde-5cc88840a6e8
2026-03-28 14:02:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PE10DXZ/697208935/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/PE10DXZ/42777447?sv=2020-08-04&st=2026-03-28T14%3A02%3A14Z&se=2026-03-28T14%3A27%3A14Z&sr=b&sp=r&sig=C8TA9FPCoH3d5KD%2BHIeQ7hc2gf2IEb2X5rEfOjKKKI4%3D)
2026-03-28 14:02:18 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FJ70HFF/698938701/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698938701>
2026-03-28 14:02:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PE10DXZ/697208992/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/PE10DXZ/42777447?sv=2020-08-04&st=2026-03-28T14%3A02%3A14Z&se=2026-03-28T14%3A27%3A14Z&sr=b&sp=r&sig=C8TA9FPCoH3d5KD%2BHIeQ7hc2gf2IEb2X5rEfOjKKKI4%3D)
2026-03-28 14:02:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/ND19VHL/698691330/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/ND19VHL/42810243?sv=2020-08-04&st=2026-03-28T14%3A02%3A12Z&se=2026-03-28T14%3A27%3A12Z&sr=b&sp=r&sig=NwiuSm%2BGmVjPsuAr5oUGhIAXqOanP4zOrkP6mfv72zY%3D)
2026-03-28 14:02:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/ND19VHL/698691309/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/ND19VHL/42810243?sv=2020-08-04&st=2026-03-28T14%3A02%3A12Z&se=2026-03-28T14%3A27%3A12Z&sr=b&sp=r&sig=NwiuSm%2BGmVjPsuAr5oUGhIAXqOanP4zOrkP6mfv72zY%3D)
2026-03-28 14:02:18 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:02:18 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:02:18 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:02:18 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:02:18 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:02:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:02:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c9b4550>
2026-03-28 14:02:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:02:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:02:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:02:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_210bede2-fc35-5c06-850c-0f613a811123/210bede2-fc35-5c06-850c-0f613a811123_image_9.jpg HTTP/1.1" 201 0
2026-03-28 14:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FFJ70HFF%252F698938762%252F600') HTTP/1.1" 204 0
2026-03-28 14:02:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FJ70HFF/698938762/600 saved to cache
2026-03-28 14:02:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 210bede2-fc35-5c06-850c-0f613a811123
2026-03-28 14:02:18 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:02:18 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:02:18 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:02:18 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:02:18 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:02:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:02:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a30120a50>
2026-03-28 14:02:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:02:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:02:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:02:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4a813d3c-3e8d-5a38-9bde-5cc88840a6e8/4a813d3c-3e8d-5a38-9bde-5cc88840a6e8_image_9.jpg HTTP/1.1" 201 0
2026-03-28 14:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FPE10DXZ%252F697209053%252F600') HTTP/1.1" 204 0
2026-03-28 14:02:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PE10DXZ/697209053/600 saved to cache
2026-03-28 14:02:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 4a813d3c-3e8d-5a38-9bde-5cc88840a6e8
2026-03-28 14:02:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PE10DXZ/697208963/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/PE10DXZ/42777447?sv=2020-08-04&st=2026-03-28T14%3A02%3A14Z&se=2026-03-28T14%3A27%3A14Z&sr=b&sp=r&sig=C8TA9FPCoH3d5KD%2BHIeQ7hc2gf2IEb2X5rEfOjKKKI4%3D)
2026-03-28 14:02:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PE10DXZ/697208881/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/PE10DXZ/42777447?sv=2020-08-04&st=2026-03-28T14%3A02%3A14Z&se=2026-03-28T14%3A27%3A14Z&sr=b&sp=r&sig=C8TA9FPCoH3d5KD%2BHIeQ7hc2gf2IEb2X5rEfOjKKKI4%3D)
2026-03-28 14:02:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PE10DXZ/697208909/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/PE10DXZ/42777447?sv=2020-08-04&st=2026-03-28T14%3A02%3A14Z&se=2026-03-28T14%3A27%3A14Z&sr=b&sp=r&sig=C8TA9FPCoH3d5KD%2BHIeQ7hc2gf2IEb2X5rEfOjKKKI4%3D)
2026-03-28 14:02:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:02:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2ddfa410>
2026-03-28 14:02:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:02:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:02:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:02:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4a813d3c-3e8d-5a38-9bde-5cc88840a6e8/4a813d3c-3e8d-5a38-9bde-5cc88840a6e8_image_5.jpg HTTP/1.1" 201 0
2026-03-28 14:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FPE10DXZ%252F697208935%252F600') HTTP/1.1" 204 0
2026-03-28 14:02:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PE10DXZ/697208935/600 saved to cache
2026-03-28 14:02:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 4a813d3c-3e8d-5a38-9bde-5cc88840a6e8
2026-03-28 14:02:18 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:02:18 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:02:18 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:02:18 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:02:18 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:02:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:02:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a1ff23890>
2026-03-28 14:02:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:02:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:02:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:02:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4a813d3c-3e8d-5a38-9bde-5cc88840a6e8/4a813d3c-3e8d-5a38-9bde-5cc88840a6e8_image_7.jpg HTTP/1.1" 201 0
2026-03-28 14:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FPE10DXZ%252F697208992%252F600') HTTP/1.1" 204 0
2026-03-28 14:02:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PE10DXZ/697208992/600 saved to cache
2026-03-28 14:02:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 4a813d3c-3e8d-5a38-9bde-5cc88840a6e8
2026-03-28 14:02:18 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:02:18 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:02:18 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:02:18 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:02:18 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:02:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:02:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c5e9ed0>
2026-03-28 14:02:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:02:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:02:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:02:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3da52437-88a6-5c28-8143-adc9baabdca3/3da52437-88a6-5c28-8143-adc9baabdca3_image_9.jpg HTTP/1.1" 201 0
2026-03-28 14:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FND19VHL%252F698691330%252F600') HTTP/1.1" 204 0
2026-03-28 14:02:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/ND19VHL/698691330/600 saved to cache
2026-03-28 14:02:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 3da52437-88a6-5c28-8143-adc9baabdca3
2026-03-28 14:02:18 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:02:18 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:02:18 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:02:18 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:02:18 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:02:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:02:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a3d390250>
2026-03-28 14:02:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:02:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:02:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:02:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3da52437-88a6-5c28-8143-adc9baabdca3/3da52437-88a6-5c28-8143-adc9baabdca3_image_8.jpg HTTP/1.1" 201 0
2026-03-28 14:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FND19VHL%252F698691309%252F600') HTTP/1.1" 204 0
2026-03-28 14:02:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/ND19VHL/698691309/600 saved to cache
2026-03-28 14:02:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 3da52437-88a6-5c28-8143-adc9baabdca3
2026-03-28 14:02:18 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/ND19VHL/698691207/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698691207>
2026-03-28 14:02:18 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FJ70HFF/698938684/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698938684>
2026-03-28 14:02:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FJ70HFF/698938708/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/FJ70HFF/42809908?sv=2020-08-04&st=2026-03-28T14%3A02%3A14Z&se=2026-03-28T14%3A27%3A14Z&sr=b&sp=r&sig=BLkTOcAQXlC6tflFfVlnOiQji6BjZlMn9%2BOPeKNwW40%3D)
2026-03-28 14:02:18 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/ND19VHL/698691165/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698691165>
2026-03-28 14:02:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AF71XUK/698250413/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/AF71XUK/42810232?sv=2020-08-04&st=2026-03-28T14%3A02%3A11Z&se=2026-03-28T14%3A27%3A11Z&sr=b&sp=r&sig=tGq7RNNjcl9do17viZhXDHgcWKPhPxb%2FskLZ1LkjXQQ%3D)
2026-03-28 14:02:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FJ70HFF/698938735/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/FJ70HFF/42809908?sv=2020-08-04&st=2026-03-28T14%3A02%3A14Z&se=2026-03-28T14%3A27%3A14Z&sr=b&sp=r&sig=BLkTOcAQXlC6tflFfVlnOiQji6BjZlMn9%2BOPeKNwW40%3D)
2026-03-28 14:02:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/ND19VHL/698691253/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/ND19VHL/42810243?sv=2020-08-04&st=2026-03-28T14%3A02%3A12Z&se=2026-03-28T14%3A27%3A12Z&sr=b&sp=r&sig=NwiuSm%2BGmVjPsuAr5oUGhIAXqOanP4zOrkP6mfv72zY%3D)
2026-03-28 14:02:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AF71XUK/698250396/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/AF71XUK/42810232?sv=2020-08-04&st=2026-03-28T14%3A02%3A11Z&se=2026-03-28T14%3A27%3A11Z&sr=b&sp=r&sig=tGq7RNNjcl9do17viZhXDHgcWKPhPxb%2FskLZ1LkjXQQ%3D)
2026-03-28 14:02:18 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:02:18 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:02:18 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:02:18 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:02:18 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:02:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:02:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c5e1490>
2026-03-28 14:02:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:02:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:02:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:02:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4a813d3c-3e8d-5a38-9bde-5cc88840a6e8/4a813d3c-3e8d-5a38-9bde-5cc88840a6e8_image_6.jpg HTTP/1.1" 201 0
2026-03-28 14:02:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FPE10DXZ%252F697208963%252F600') HTTP/1.1" 204 0
2026-03-28 14:02:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PE10DXZ/697208963/600 saved to cache
2026-03-28 14:02:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 4a813d3c-3e8d-5a38-9bde-5cc88840a6e8
2026-03-28 14:02:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:02:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c4622d0>
2026-03-28 14:02:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:02:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:02:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:02:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4a813d3c-3e8d-5a38-9bde-5cc88840a6e8/4a813d3c-3e8d-5a38-9bde-5cc88840a6e8_image_3.jpg HTTP/1.1" 201 0
2026-03-28 14:02:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FPE10DXZ%252F697208881%252F600') HTTP/1.1" 204 0
2026-03-28 14:02:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PE10DXZ/697208881/600 saved to cache
2026-03-28 14:02:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 4a813d3c-3e8d-5a38-9bde-5cc88840a6e8
2026-03-28 14:02:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:02:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2deaa390>
2026-03-28 14:02:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:02:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:02:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:02:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4a813d3c-3e8d-5a38-9bde-5cc88840a6e8/4a813d3c-3e8d-5a38-9bde-5cc88840a6e8_image_4.jpg HTTP/1.1" 201 0
2026-03-28 14:02:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FPE10DXZ%252F697208909%252F600') HTTP/1.1" 204 0
2026-03-28 14:02:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PE10DXZ/697208909/600 saved to cache
2026-03-28 14:02:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 4a813d3c-3e8d-5a38-9bde-5cc88840a6e8
2026-03-28 14:02:19 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 4a813d3c-3e8d-5a38-9bde-5cc88840a6e8, skipping ID generation
2026-03-28 14:02:19 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 4a813d3c-3e8d-5a38-9bde-5cc88840a6e8 sending to next pipeline
2026-03-28 14:02:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 4a813d3c-3e8d-5a38-9bde-5cc88840a6e8, identifier: PE10%20DXZ
2026-03-28 14:02:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FJ70HFF/698938701/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/FJ70HFF/42809908?sv=2020-08-04&st=2026-03-28T14%3A02%3A14Z&se=2026-03-28T14%3A27%3A14Z&sr=b&sp=r&sig=BLkTOcAQXlC6tflFfVlnOiQji6BjZlMn9%2BOPeKNwW40%3D)
2026-03-28 14:02:19 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/ND19VHL/698691117/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698691117>
2026-03-28 14:02:19 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FJ70HFF/698938668/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=FJ70HFF-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-28 14:02:19 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AF71XUK/698250321/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698250321>
2026-03-28 14:02:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 4a813d3c-3e8d-5a38-9bde-5cc88840a6e8 with identifier: PE10%20DXZ
2026-03-28 14:02:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 4a813d3c-3e8d-5a38-9bde-5cc88840a6e8 with identifier: PE10%20DXZ
2026-03-28 14:02:19 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 4a813d3c-3e8d-5a38-9bde-5cc88840a6e8 with identifier: PE10%20DXZ to the API
2026-03-28 14:02:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:02:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:02:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PE10DXZ/697208909/600>
{'auction_title': '',
'c_o_2_emission_value': 196,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4a813d3c-3e8d-5a38-9bde-5cc88840a6e8/4a813d3c-3e8d-5a38-9bde-5cc88840a6e8_expert_report_file_959eea12-666a-4e55-a226-aa72ac617f2d.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=PE10%20DXZ-GB',
'category': 'Car',
'color': 'black',
'currency': 'GBP',
'doors_number': 2,
'engine': '1.8L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol',
'id': '4a813d3c-3e8d-5a38-9bde-5cc88840a6e8',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'PE10 DXZ',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=PE10%20DXZ&vehicleType=*',
'listing': 'auction',
'location': 'Edinburgh',
'make': 'MERCEDES-BENZ',
'model': 'SLK 200K',
'odometer': 83305,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 11,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4a813d3c-3e8d-5a38-9bde-5cc88840a6e8/4a813d3c-3e8d-5a38-9bde-5cc88840a6e8_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 57615,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PE10DXZ/697208794/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4a813d3c-3e8d-5a38-9bde-5cc88840a6e8/4a813d3c-3e8d-5a38-9bde-5cc88840a6e8_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 58782,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PE10DXZ/697208825/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4a813d3c-3e8d-5a38-9bde-5cc88840a6e8/4a813d3c-3e8d-5a38-9bde-5cc88840a6e8_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 55756,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PE10DXZ/697208860/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4a813d3c-3e8d-5a38-9bde-5cc88840a6e8/4a813d3c-3e8d-5a38-9bde-5cc88840a6e8_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 55805,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PE10DXZ/697208881/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4a813d3c-3e8d-5a38-9bde-5cc88840a6e8/4a813d3c-3e8d-5a38-9bde-5cc88840a6e8_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 49411,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PE10DXZ/697208909/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4a813d3c-3e8d-5a38-9bde-5cc88840a6e8/4a813d3c-3e8d-5a38-9bde-5cc88840a6e8_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 51040,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PE10DXZ/697208935/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4a813d3c-3e8d-5a38-9bde-5cc88840a6e8/4a813d3c-3e8d-5a38-9bde-5cc88840a6e8_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 100003,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PE10DXZ/697208963/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4a813d3c-3e8d-5a38-9bde-5cc88840a6e8/4a813d3c-3e8d-5a38-9bde-5cc88840a6e8_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 98464,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PE10DXZ/697208992/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4a813d3c-3e8d-5a38-9bde-5cc88840a6e8/4a813d3c-3e8d-5a38-9bde-5cc88840a6e8_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 91757,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PE10DXZ/697209030/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4a813d3c-3e8d-5a38-9bde-5cc88840a6e8/4a813d3c-3e8d-5a38-9bde-5cc88840a6e8_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 81645,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PE10DXZ/697209053/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2010-01-01',
'seller_name': None,
'title': 'MERCEDES-BENZ SLK 200K 1.8 TIP Roadster',
'transmission': 'manual',
'trim': 'TIP',
'vin': 'WDB1714452F227853',
'year': 2010}
2026-03-28 14:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27PE10%2520DXZ%27 HTTP/1.1" 200 None
2026-03-28 14:02:20 [bca.uk] INFO: Saving data for PE10%20DXZ: {'created_time': 1774706540.010957, 'last_price_update_time': 1774706540.010968, 'auction_closing_time': 1774864800.0}
2026-03-28 14:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='PE10%2520DXZ') HTTP/1.1" 204 0
2026-03-28 14:02:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:02:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2ca81ad0>
2026-03-28 14:02:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:02:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:02:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:02:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_210bede2-fc35-5c06-850c-0f613a811123/210bede2-fc35-5c06-850c-0f613a811123_image_5.jpg HTTP/1.1" 201 0
2026-03-28 14:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FFJ70HFF%252F698938708%252F600') HTTP/1.1" 204 0
2026-03-28 14:02:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FJ70HFF/698938708/600 saved to cache
2026-03-28 14:02:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 210bede2-fc35-5c06-850c-0f613a811123
2026-03-28 14:02:20 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BG72UUY/698459096/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698459096>
2026-03-28 14:02:20 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RA68WZE/698229708/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698229708>
2026-03-28 14:02:20 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RA68WZE/698229776/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698229776>
2026-03-28 14:02:20 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AF71XUK/698250309/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698250309>
2026-03-28 14:02:20 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:02:20 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:02:20 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:02:20 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:02:20 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:02:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:02:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2ca13f10>
2026-03-28 14:02:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:02:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:02:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:02:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ca8b23b7-2e66-554c-8e62-feb13d6c73d4/ca8b23b7-2e66-554c-8e62-feb13d6c73d4_image_9.jpg HTTP/1.1" 201 0
2026-03-28 14:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FAF71XUK%252F698250413%252F600') HTTP/1.1" 204 0
2026-03-28 14:02:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AF71XUK/698250413/600 saved to cache
2026-03-28 14:02:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item ca8b23b7-2e66-554c-8e62-feb13d6c73d4
2026-03-28 14:02:20 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:02:20 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:02:20 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:02:20 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:02:20 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:02:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:02:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c76c650>
2026-03-28 14:02:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:02:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:02:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:02:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_210bede2-fc35-5c06-850c-0f613a811123/210bede2-fc35-5c06-850c-0f613a811123_image_7.jpg HTTP/1.1" 201 0
2026-03-28 14:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FFJ70HFF%252F698938735%252F600') HTTP/1.1" 204 0
2026-03-28 14:02:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FJ70HFF/698938735/600 saved to cache
2026-03-28 14:02:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 210bede2-fc35-5c06-850c-0f613a811123
2026-03-28 14:02:20 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:02:20 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:02:20 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:02:20 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:02:20 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:02:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:02:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a30123390>
2026-03-28 14:02:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:02:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:02:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:02:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3da52437-88a6-5c28-8143-adc9baabdca3/3da52437-88a6-5c28-8143-adc9baabdca3_image_6.jpg HTTP/1.1" 201 0
2026-03-28 14:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FND19VHL%252F698691253%252F600') HTTP/1.1" 204 0
2026-03-28 14:02:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/ND19VHL/698691253/600 saved to cache
2026-03-28 14:02:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 3da52437-88a6-5c28-8143-adc9baabdca3
2026-03-28 14:02:20 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:02:20 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:02:20 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:02:20 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:02:20 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:02:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:02:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c76f790>
2026-03-28 14:02:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:02:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:02:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:02:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ca8b23b7-2e66-554c-8e62-feb13d6c73d4/ca8b23b7-2e66-554c-8e62-feb13d6c73d4_image_7.jpg HTTP/1.1" 201 0
2026-03-28 14:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FAF71XUK%252F698250396%252F600') HTTP/1.1" 204 0
2026-03-28 14:02:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AF71XUK/698250396/600 saved to cache
2026-03-28 14:02:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item ca8b23b7-2e66-554c-8e62-feb13d6c73d4
2026-03-28 14:02:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:02:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a1fd47d90>
2026-03-28 14:02:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:02:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:02:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:02:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_210bede2-fc35-5c06-850c-0f613a811123/210bede2-fc35-5c06-850c-0f613a811123_image_4.jpg HTTP/1.1" 201 0
2026-03-28 14:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FFJ70HFF%252F698938701%252F600') HTTP/1.1" 204 0
2026-03-28 14:02:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FJ70HFF/698938701/600 saved to cache
2026-03-28 14:02:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 210bede2-fc35-5c06-850c-0f613a811123
2026-03-28 14:02:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FJ70HFF/698938684/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/FJ70HFF/42809908?sv=2020-08-04&st=2026-03-28T14%3A02%3A14Z&se=2026-03-28T14%3A27%3A14Z&sr=b&sp=r&sig=BLkTOcAQXlC6tflFfVlnOiQji6BjZlMn9%2BOPeKNwW40%3D)
2026-03-28 14:02:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/ND19VHL/698691165/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/ND19VHL/42810243?sv=2020-08-04&st=2026-03-28T14%3A02%3A12Z&se=2026-03-28T14%3A27%3A12Z&sr=b&sp=r&sig=NwiuSm%2BGmVjPsuAr5oUGhIAXqOanP4zOrkP6mfv72zY%3D)
2026-03-28 14:02:20 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BG72UUY/698459094/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=BG72UUY-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-28 14:02:20 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RA68WZE/698229700/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698229700>
2026-03-28 14:02:20 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RA68WZE/698229695/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=RA68WZE-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-28 14:02:20 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SF65MRS/698522041/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=SF65MRS-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-28 14:02:20 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WA15XTF/697938596/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=WA15XTF-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-28 14:02:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/ND19VHL/698691207/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/ND19VHL/42810243?sv=2020-08-04&st=2026-03-28T14%3A02%3A12Z&se=2026-03-28T14%3A27%3A12Z&sr=b&sp=r&sig=NwiuSm%2BGmVjPsuAr5oUGhIAXqOanP4zOrkP6mfv72zY%3D)
2026-03-28 14:02:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RA68WZE/698229708/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/RA68WZE/42809489?sv=2020-08-04&st=2026-03-28T14%3A02%3A10Z&se=2026-03-28T14%3A27%3A10Z&sr=b&sp=r&sig=sGVqi7zLckoYL6nZquTH3Sr6GS2wBULLpmfzj%2F1aDfg%3D)
2026-03-28 14:02:20 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SB65CAX/697544345/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=697544345>
2026-03-28 14:02:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FJ70HFF/698938668/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/FJ70HFF/42809908?sv=2020-08-04&st=2026-03-28T14%3A02%3A14Z&se=2026-03-28T14%3A27%3A14Z&sr=b&sp=r&sig=BLkTOcAQXlC6tflFfVlnOiQji6BjZlMn9%2BOPeKNwW40%3D)
2026-03-28 14:02:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AF71XUK/698250321/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/AF71XUK/42810232?sv=2020-08-04&st=2026-03-28T14%3A02%3A11Z&se=2026-03-28T14%3A27%3A11Z&sr=b&sp=r&sig=tGq7RNNjcl9do17viZhXDHgcWKPhPxb%2FskLZ1LkjXQQ%3D)
2026-03-28 14:02:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BG72UUY/698459096/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/BG72UUY/42810237?sv=2020-08-04&st=2026-03-28T14%3A02%3A10Z&se=2026-03-28T14%3A27%3A10Z&sr=b&sp=r&sig=yK8cIYpeZ9TamlFDpK%2BgLwUjKNRsv8EzcqtGcUy7mrQ%3D)
2026-03-28 14:02:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AF71XUK/698250309/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/AF71XUK/42810232?sv=2020-08-04&st=2026-03-28T14%3A02%3A11Z&se=2026-03-28T14%3A27%3A11Z&sr=b&sp=r&sig=tGq7RNNjcl9do17viZhXDHgcWKPhPxb%2FskLZ1LkjXQQ%3D)
2026-03-28 14:02:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:02:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c854750>
2026-03-28 14:02:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:02:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:02:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:02:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_210bede2-fc35-5c06-850c-0f613a811123/210bede2-fc35-5c06-850c-0f613a811123_image_2.jpg HTTP/1.1" 201 0
2026-03-28 14:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FFJ70HFF%252F698938684%252F600') HTTP/1.1" 204 0
2026-03-28 14:02:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FJ70HFF/698938684/600 saved to cache
2026-03-28 14:02:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 210bede2-fc35-5c06-850c-0f613a811123
2026-03-28 14:02:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:02:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2d980cd0>
2026-03-28 14:02:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:02:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:02:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:02:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3da52437-88a6-5c28-8143-adc9baabdca3/3da52437-88a6-5c28-8143-adc9baabdca3_image_3.jpg HTTP/1.1" 201 0
2026-03-28 14:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FND19VHL%252F698691165%252F600') HTTP/1.1" 204 0
2026-03-28 14:02:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/ND19VHL/698691165/600 saved to cache
2026-03-28 14:02:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 3da52437-88a6-5c28-8143-adc9baabdca3
2026-03-28 14:02:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/ND19VHL/698691117/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/ND19VHL/42810243?sv=2020-08-04&st=2026-03-28T14%3A02%3A12Z&se=2026-03-28T14%3A27%3A12Z&sr=b&sp=r&sig=NwiuSm%2BGmVjPsuAr5oUGhIAXqOanP4zOrkP6mfv72zY%3D)
2026-03-28 14:02:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WA15XTF/697938596/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/WA15XTF/42809463?sv=2020-08-04&st=2026-03-28T14%3A01%3A23Z&se=2026-03-28T14%3A26%3A23Z&sr=b&sp=r&sig=OVT1XXFunRJjcV5jy5Zgfxxi5O1xAq2cfTX%2F%2FcIif88%3D)
2026-03-28 14:02:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SF65MRS/698522041/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/SF65MRS/42810141?sv=2020-08-04&st=2026-03-28T14%3A01%3A23Z&se=2026-03-28T14%3A26%3A23Z&sr=b&sp=r&sig=pKcKPXIMRDrpvR7qgfCAU8Cghh7jF%2FL25jpHeT9Gs0U%3D)
2026-03-28 14:02:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RA68WZE/698229695/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/RA68WZE/42809489?sv=2020-08-04&st=2026-03-28T14%3A02%3A10Z&se=2026-03-28T14%3A27%3A10Z&sr=b&sp=r&sig=sGVqi7zLckoYL6nZquTH3Sr6GS2wBULLpmfzj%2F1aDfg%3D)
2026-03-28 14:02:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BG72UUY/698459094/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/BG72UUY/42810237?sv=2020-08-04&st=2026-03-28T14%3A02%3A10Z&se=2026-03-28T14%3A27%3A10Z&sr=b&sp=r&sig=yK8cIYpeZ9TamlFDpK%2BgLwUjKNRsv8EzcqtGcUy7mrQ%3D)
2026-03-28 14:02:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RA68WZE/698229700/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/RA68WZE/42809489?sv=2020-08-04&st=2026-03-28T14%3A02%3A10Z&se=2026-03-28T14%3A27%3A10Z&sr=b&sp=r&sig=sGVqi7zLckoYL6nZquTH3Sr6GS2wBULLpmfzj%2F1aDfg%3D)
2026-03-28 14:02:20 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AM58MHU/698970528/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698970528>
2026-03-28 14:02:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RA68WZE/698229776/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/RA68WZE/42809489?sv=2020-08-04&st=2026-03-28T14%3A02%3A10Z&se=2026-03-28T14%3A27%3A10Z&sr=b&sp=r&sig=sGVqi7zLckoYL6nZquTH3Sr6GS2wBULLpmfzj%2F1aDfg%3D)
2026-03-28 14:02:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:02:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c462a10>
2026-03-28 14:02:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:02:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:02:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:02:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3da52437-88a6-5c28-8143-adc9baabdca3/3da52437-88a6-5c28-8143-adc9baabdca3_image_5.jpg HTTP/1.1" 201 0
2026-03-28 14:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FND19VHL%252F698691207%252F600') HTTP/1.1" 204 0
2026-03-28 14:02:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/ND19VHL/698691207/600 saved to cache
2026-03-28 14:02:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 3da52437-88a6-5c28-8143-adc9baabdca3
2026-03-28 14:02:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:02:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c99e590>
2026-03-28 14:02:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:02:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:02:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:02:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4de18175-834b-5b06-b8ed-75c0641e29ce/4de18175-834b-5b06-b8ed-75c0641e29ce_image_2.jpg HTTP/1.1" 201 0
2026-03-28 14:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FRA68WZE%252F698229708%252F600') HTTP/1.1" 204 0
2026-03-28 14:02:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RA68WZE/698229708/600 saved to cache
2026-03-28 14:02:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 4de18175-834b-5b06-b8ed-75c0641e29ce
2026-03-28 14:02:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:02:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2fe0a6d0>
2026-03-28 14:02:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:02:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:02:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:02:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_210bede2-fc35-5c06-850c-0f613a811123/210bede2-fc35-5c06-850c-0f613a811123_image_0.jpg HTTP/1.1" 201 0
2026-03-28 14:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FFJ70HFF%252F698938668%252F600') HTTP/1.1" 204 0
2026-03-28 14:02:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FJ70HFF/698938668/600 saved to cache
2026-03-28 14:02:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 210bede2-fc35-5c06-850c-0f613a811123
2026-03-28 14:02:20 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 210bede2-fc35-5c06-850c-0f613a811123, skipping ID generation
2026-03-28 14:02:20 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 210bede2-fc35-5c06-850c-0f613a811123 sending to next pipeline
2026-03-28 14:02:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 210bede2-fc35-5c06-850c-0f613a811123, identifier: FJ70%20HFF
2026-03-28 14:02:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 210bede2-fc35-5c06-850c-0f613a811123 with identifier: FJ70%20HFF
2026-03-28 14:02:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 210bede2-fc35-5c06-850c-0f613a811123 with identifier: FJ70%20HFF
2026-03-28 14:02:20 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 210bede2-fc35-5c06-850c-0f613a811123 with identifier: FJ70%20HFF to the API
2026-03-28 14:02:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:02:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:02:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FJ70HFF/698938668/600>
{'auction_title': '',
'c_o_2_emission_value': 158,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_210bede2-fc35-5c06-850c-0f613a811123/210bede2-fc35-5c06-850c-0f613a811123_expert_report_file_b56eb7ed-2a90-4f7a-b94b-9028020e4043.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=FJ70%20HFF-GB',
'category': 'Car',
'color': 'black',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.0L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol',
'id': '210bede2-fc35-5c06-850c-0f613a811123',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'FJ70 HFF',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=FJ70%20HFF&vehicleType=*',
'listing': 'auction',
'location': 'Measham',
'make': 'JEEP',
'model': 'RENEGADE',
'odometer': 25263,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 11,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_210bede2-fc35-5c06-850c-0f613a811123/210bede2-fc35-5c06-850c-0f613a811123_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 44836,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FJ70HFF/698938668/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_210bede2-fc35-5c06-850c-0f613a811123/210bede2-fc35-5c06-850c-0f613a811123_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 41605,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FJ70HFF/698938676/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_210bede2-fc35-5c06-850c-0f613a811123/210bede2-fc35-5c06-850c-0f613a811123_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 44904,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FJ70HFF/698938684/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_210bede2-fc35-5c06-850c-0f613a811123/210bede2-fc35-5c06-850c-0f613a811123_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 41478,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FJ70HFF/698938693/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_210bede2-fc35-5c06-850c-0f613a811123/210bede2-fc35-5c06-850c-0f613a811123_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 40059,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FJ70HFF/698938701/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_210bede2-fc35-5c06-850c-0f613a811123/210bede2-fc35-5c06-850c-0f613a811123_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 39640,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FJ70HFF/698938708/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_210bede2-fc35-5c06-850c-0f613a811123/210bede2-fc35-5c06-850c-0f613a811123_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 71726,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FJ70HFF/698938723/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_210bede2-fc35-5c06-850c-0f613a811123/210bede2-fc35-5c06-850c-0f613a811123_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 70378,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FJ70HFF/698938735/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_210bede2-fc35-5c06-850c-0f613a811123/210bede2-fc35-5c06-850c-0f613a811123_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 89177,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FJ70HFF/698938747/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_210bede2-fc35-5c06-850c-0f613a811123/210bede2-fc35-5c06-850c-0f613a811123_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 65394,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FJ70HFF/698938762/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-01-01',
'seller_name': None,
'title': 'JEEP RENEGADE 1.0 T3 120 GSE NIGHT EAGLE II Hatchback',
'transmission': 'manual',
'trim': 'T3 120 GSE NIGHT EAGLE II',
'vin': '1C4BU0000LPM03202',
'year': 2020}
2026-03-28 14:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FJ70%2520HFF%27 HTTP/1.1" 200 None
2026-03-28 14:02:21 [bca.uk] INFO: Saving data for FJ70%20HFF: {'created_time': 1774706541.345817, 'last_price_update_time': 1774706541.345833, 'auction_closing_time': 1774864800.0}
2026-03-28 14:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='FJ70%2520HFF') HTTP/1.1" 204 0
2026-03-28 14:02:21 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SH14BOU/698522034/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=SH14BOU-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-28 14:02:21 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VO17FMZ/698274453/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698274453>
2026-03-28 14:02:21 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GU10UYN/698556107/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=GU10UYN-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-28 14:02:21 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AM58MHU/698953147/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698953147>
2026-03-28 14:02:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SB65CAX/697544345/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/SB65CAX/42810123?sv=2020-08-04&st=2026-03-28T14%3A01%3A23Z&se=2026-03-28T14%3A26%3A23Z&sr=b&sp=r&sig=vTzzhGIuSP84%2BuZVufy4vR0mq7%2F9VRE2bdnD30Ub%2FBU%3D)
2026-03-28 14:02:21 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VO17FMZ/698274440/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698274440>
2026-03-28 14:02:21 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YC72AVN/42810244?sv=2020-08-04&st=2026-03-28T14%3A02%3A20Z&se=2026-03-28T14%3A27%3A20Z&sr=b&sp=r&sig=beG5fN%2BBH0Z%2FDIpkhCSt8zTlTgu277%2B2D8NvIf%2FKCVY%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=YC72%20AVN-GB>
2026-03-28 14:02:21 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/RF08TZP/42781844?sv=2020-08-04&st=2026-03-28T14%3A02%3A20Z&se=2026-03-28T14%3A27%3A20Z&sr=b&sp=r&sig=6hLicjIfZGVTK7BLacvGBl2SaFBQyybl9CGTh8APRd8%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=RF08%20TZP-GB>
2026-03-28 14:02:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:02:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a1ff3c2d0>
2026-03-28 14:02:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:02:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:02:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:02:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ca8b23b7-2e66-554c-8e62-feb13d6c73d4/ca8b23b7-2e66-554c-8e62-feb13d6c73d4_image_2.jpg HTTP/1.1" 201 0
2026-03-28 14:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FAF71XUK%252F698250321%252F600') HTTP/1.1" 204 0
2026-03-28 14:02:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AF71XUK/698250321/600 saved to cache
2026-03-28 14:02:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item ca8b23b7-2e66-554c-8e62-feb13d6c73d4
2026-03-28 14:02:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:02:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a301e4b90>
2026-03-28 14:02:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:02:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:02:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:02:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c2dfa08a-04ba-520a-b1ba-0b0dcf2d9ee2/c2dfa08a-04ba-520a-b1ba-0b0dcf2d9ee2_image_1.jpg HTTP/1.1" 201 0
2026-03-28 14:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FBG72UUY%252F698459096%252F600') HTTP/1.1" 204 0
2026-03-28 14:02:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BG72UUY/698459096/600 saved to cache
2026-03-28 14:02:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item c2dfa08a-04ba-520a-b1ba-0b0dcf2d9ee2
2026-03-28 14:02:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:02:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a30117a10>
2026-03-28 14:02:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:02:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:02:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:02:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ca8b23b7-2e66-554c-8e62-feb13d6c73d4/ca8b23b7-2e66-554c-8e62-feb13d6c73d4_image_1.jpg HTTP/1.1" 201 0
2026-03-28 14:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FAF71XUK%252F698250309%252F600') HTTP/1.1" 204 0
2026-03-28 14:02:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AF71XUK/698250309/600 saved to cache
2026-03-28 14:02:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item ca8b23b7-2e66-554c-8e62-feb13d6c73d4
2026-03-28 14:02:21 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: ca8b23b7-2e66-554c-8e62-feb13d6c73d4, skipping ID generation
2026-03-28 14:02:21 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item ca8b23b7-2e66-554c-8e62-feb13d6c73d4 sending to next pipeline
2026-03-28 14:02:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: ca8b23b7-2e66-554c-8e62-feb13d6c73d4, identifier: AF71%20XUK
2026-03-28 14:02:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:02:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a1fec7d50>
2026-03-28 14:02:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:02:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:02:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:02:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3da52437-88a6-5c28-8143-adc9baabdca3/3da52437-88a6-5c28-8143-adc9baabdca3_image_1.jpg HTTP/1.1" 201 0
2026-03-28 14:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FND19VHL%252F698691117%252F600') HTTP/1.1" 204 0
2026-03-28 14:02:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/ND19VHL/698691117/600 saved to cache
2026-03-28 14:02:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 3da52437-88a6-5c28-8143-adc9baabdca3
2026-03-28 14:02:21 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 3da52437-88a6-5c28-8143-adc9baabdca3, skipping ID generation
2026-03-28 14:02:21 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 3da52437-88a6-5c28-8143-adc9baabdca3 sending to next pipeline
2026-03-28 14:02:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 3da52437-88a6-5c28-8143-adc9baabdca3, identifier: ND19%20VHL
2026-03-28 14:02:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:02:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a1fed1c10>
2026-03-28 14:02:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:02:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:02:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:02:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_012921cb-8763-5e72-9bbe-1684326c9a1d/012921cb-8763-5e72-9bbe-1684326c9a1d_image_0.jpg HTTP/1.1" 201 0
2026-03-28 14:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FWA15XTF%252F697938596%252F600') HTTP/1.1" 204 0
2026-03-28 14:02:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WA15XTF/697938596/600 saved to cache
2026-03-28 14:02:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 012921cb-8763-5e72-9bbe-1684326c9a1d
2026-03-28 14:02:21 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 012921cb-8763-5e72-9bbe-1684326c9a1d, skipping ID generation
2026-03-28 14:02:21 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 012921cb-8763-5e72-9bbe-1684326c9a1d sending to next pipeline
2026-03-28 14:02:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 012921cb-8763-5e72-9bbe-1684326c9a1d, identifier: WA15%20XTF
2026-03-28 14:02:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:02:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2fe09710>
2026-03-28 14:02:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:02:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:02:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:02:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_228041df-5797-5c8f-89c8-2a337a640ead/228041df-5797-5c8f-89c8-2a337a640ead_image_0.jpg HTTP/1.1" 201 0
2026-03-28 14:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FSF65MRS%252F698522041%252F600') HTTP/1.1" 204 0
2026-03-28 14:02:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SF65MRS/698522041/600 saved to cache
2026-03-28 14:02:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 228041df-5797-5c8f-89c8-2a337a640ead
2026-03-28 14:02:22 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 228041df-5797-5c8f-89c8-2a337a640ead, skipping ID generation
2026-03-28 14:02:22 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 228041df-5797-5c8f-89c8-2a337a640ead sending to next pipeline
2026-03-28 14:02:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 228041df-5797-5c8f-89c8-2a337a640ead, identifier: SF65%20MRS
2026-03-28 14:02:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:02:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a1fd73490>
2026-03-28 14:02:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:02:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:02:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:02:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4de18175-834b-5b06-b8ed-75c0641e29ce/4de18175-834b-5b06-b8ed-75c0641e29ce_image_0.jpg HTTP/1.1" 201 0
2026-03-28 14:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FRA68WZE%252F698229695%252F600') HTTP/1.1" 204 0
2026-03-28 14:02:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RA68WZE/698229695/600 saved to cache
2026-03-28 14:02:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 4de18175-834b-5b06-b8ed-75c0641e29ce
2026-03-28 14:02:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:02:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a1ff16150>
2026-03-28 14:02:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:02:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:02:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:02:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c2dfa08a-04ba-520a-b1ba-0b0dcf2d9ee2/c2dfa08a-04ba-520a-b1ba-0b0dcf2d9ee2_image_0.jpg HTTP/1.1" 201 0
2026-03-28 14:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FBG72UUY%252F698459094%252F600') HTTP/1.1" 204 0
2026-03-28 14:02:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BG72UUY/698459094/600 saved to cache
2026-03-28 14:02:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item c2dfa08a-04ba-520a-b1ba-0b0dcf2d9ee2
2026-03-28 14:02:22 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: c2dfa08a-04ba-520a-b1ba-0b0dcf2d9ee2, skipping ID generation
2026-03-28 14:02:22 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item c2dfa08a-04ba-520a-b1ba-0b0dcf2d9ee2 sending to next pipeline
2026-03-28 14:02:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: c2dfa08a-04ba-520a-b1ba-0b0dcf2d9ee2, identifier: BG72%20UUY
2026-03-28 14:02:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:02:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c854d10>
2026-03-28 14:02:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:02:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:02:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:02:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4de18175-834b-5b06-b8ed-75c0641e29ce/4de18175-834b-5b06-b8ed-75c0641e29ce_image_1.jpg HTTP/1.1" 201 0
2026-03-28 14:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FRA68WZE%252F698229700%252F600') HTTP/1.1" 204 0
2026-03-28 14:02:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RA68WZE/698229700/600 saved to cache
2026-03-28 14:02:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 4de18175-834b-5b06-b8ed-75c0641e29ce
2026-03-28 14:02:22 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:02:22 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:02:22 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:02:22 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:02:22 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:02:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:02:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c7183d0>
2026-03-28 14:02:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:02:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:02:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:02:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4de18175-834b-5b06-b8ed-75c0641e29ce/4de18175-834b-5b06-b8ed-75c0641e29ce_image_9.jpg HTTP/1.1" 201 0
2026-03-28 14:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FRA68WZE%252F698229776%252F600') HTTP/1.1" 204 0
2026-03-28 14:02:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RA68WZE/698229776/600 saved to cache
2026-03-28 14:02:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 4de18175-834b-5b06-b8ed-75c0641e29ce
2026-03-28 14:02:22 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 4de18175-834b-5b06-b8ed-75c0641e29ce, skipping ID generation
2026-03-28 14:02:22 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 4de18175-834b-5b06-b8ed-75c0641e29ce sending to next pipeline
2026-03-28 14:02:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 4de18175-834b-5b06-b8ed-75c0641e29ce, identifier: RA68%20WZE
2026-03-28 14:02:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: ca8b23b7-2e66-554c-8e62-feb13d6c73d4 with identifier: AF71%20XUK
2026-03-28 14:02:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: ca8b23b7-2e66-554c-8e62-feb13d6c73d4 with identifier: AF71%20XUK
2026-03-28 14:02:22 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: ca8b23b7-2e66-554c-8e62-feb13d6c73d4 with identifier: AF71%20XUK to the API
2026-03-28 14:02:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:02:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:02:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AF71XUK/698250309/600>
{'auction_title': '',
'c_o_2_emission_value': 118,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ca8b23b7-2e66-554c-8e62-feb13d6c73d4/ca8b23b7-2e66-554c-8e62-feb13d6c73d4_expert_report_file_7132a155-c7e3-4ce9-b80e-007b9a64e6a6.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=AF71%20XUK-GB',
'category': 'Car',
'color': 'black',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.2L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol',
'id': 'ca8b23b7-2e66-554c-8e62-feb13d6c73d4',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'AF71 XUK',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=AF71%20XUK&vehicleType=*',
'listing': 'auction',
'location': 'Measham',
'make': 'VAUXHALL',
'model': 'CORSA',
'odometer': 44944,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 11,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ca8b23b7-2e66-554c-8e62-feb13d6c73d4/ca8b23b7-2e66-554c-8e62-feb13d6c73d4_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 42999,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AF71XUK/698250303/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ca8b23b7-2e66-554c-8e62-feb13d6c73d4/ca8b23b7-2e66-554c-8e62-feb13d6c73d4_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 39692,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AF71XUK/698250309/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ca8b23b7-2e66-554c-8e62-feb13d6c73d4/ca8b23b7-2e66-554c-8e62-feb13d6c73d4_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 44112,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AF71XUK/698250321/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ca8b23b7-2e66-554c-8e62-feb13d6c73d4/ca8b23b7-2e66-554c-8e62-feb13d6c73d4_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 41921,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AF71XUK/698250326/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ca8b23b7-2e66-554c-8e62-feb13d6c73d4/ca8b23b7-2e66-554c-8e62-feb13d6c73d4_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 40584,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AF71XUK/698250341/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ca8b23b7-2e66-554c-8e62-feb13d6c73d4/ca8b23b7-2e66-554c-8e62-feb13d6c73d4_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 39468,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AF71XUK/698250356/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ca8b23b7-2e66-554c-8e62-feb13d6c73d4/ca8b23b7-2e66-554c-8e62-feb13d6c73d4_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 88572,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AF71XUK/698250385/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ca8b23b7-2e66-554c-8e62-feb13d6c73d4/ca8b23b7-2e66-554c-8e62-feb13d6c73d4_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 76792,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AF71XUK/698250396/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ca8b23b7-2e66-554c-8e62-feb13d6c73d4/ca8b23b7-2e66-554c-8e62-feb13d6c73d4_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 91124,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AF71XUK/698250402/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ca8b23b7-2e66-554c-8e62-feb13d6c73d4/ca8b23b7-2e66-554c-8e62-feb13d6c73d4_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 78441,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AF71XUK/698250413/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-01-01',
'seller_name': None,
'title': 'VAUXHALL CORSA 1.2 SE Hatchback',
'transmission': 'manual',
'trim': 'SE',
'vin': 'VXKUPHMHDM4290753',
'year': 2021}
2026-03-28 14:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27AF71%2520XUK%27 HTTP/1.1" 200 None
2026-03-28 14:02:23 [bca.uk] INFO: Saving data for AF71%20XUK: {'created_time': 1774706543.098636, 'last_price_update_time': 1774706543.098649, 'auction_closing_time': 1774864800.0}
2026-03-28 14:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='AF71%2520XUK') HTTP/1.1" 204 0
2026-03-28 14:02:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 3da52437-88a6-5c28-8143-adc9baabdca3 with identifier: ND19%20VHL
2026-03-28 14:02:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 3da52437-88a6-5c28-8143-adc9baabdca3 with identifier: ND19%20VHL
2026-03-28 14:02:23 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 3da52437-88a6-5c28-8143-adc9baabdca3 with identifier: ND19%20VHL to the API
2026-03-28 14:02:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:02:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:02:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/ND19VHL/698691117/600>
{'auction_title': '',
'c_o_2_emission_value': 206,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3da52437-88a6-5c28-8143-adc9baabdca3/3da52437-88a6-5c28-8143-adc9baabdca3_expert_report_file_a454e7d3-c920-4b65-af76-fd66ed90b8b5.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=ND19%20VHL-GB',
'category': 'Car',
'color': 'blue',
'currency': 'GBP',
'doors_number': 5,
'engine': '3.0L',
'expiration_date': '2026-03-29T10:00:00Z',
'fuel_type': 'Petrol',
'id': '3da52437-88a6-5c28-8143-adc9baabdca3',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'ND19 VHL',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=ND19%20VHL&vehicleType=*',
'listing': 'auction',
'location': 'Measham',
'make': 'BMW',
'model': 'X3',
'odometer': 46778,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 11,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3da52437-88a6-5c28-8143-adc9baabdca3/3da52437-88a6-5c28-8143-adc9baabdca3_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 48543,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/ND19VHL/698691081/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3da52437-88a6-5c28-8143-adc9baabdca3/3da52437-88a6-5c28-8143-adc9baabdca3_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 44220,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/ND19VHL/698691117/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3da52437-88a6-5c28-8143-adc9baabdca3/3da52437-88a6-5c28-8143-adc9baabdca3_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 46912,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/ND19VHL/698691138/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3da52437-88a6-5c28-8143-adc9baabdca3/3da52437-88a6-5c28-8143-adc9baabdca3_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 45385,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/ND19VHL/698691165/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3da52437-88a6-5c28-8143-adc9baabdca3/3da52437-88a6-5c28-8143-adc9baabdca3_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 45461,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/ND19VHL/698691192/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3da52437-88a6-5c28-8143-adc9baabdca3/3da52437-88a6-5c28-8143-adc9baabdca3_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 43417,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/ND19VHL/698691207/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3da52437-88a6-5c28-8143-adc9baabdca3/3da52437-88a6-5c28-8143-adc9baabdca3_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 75773,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/ND19VHL/698691253/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3da52437-88a6-5c28-8143-adc9baabdca3/3da52437-88a6-5c28-8143-adc9baabdca3_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 82083,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/ND19VHL/698691283/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3da52437-88a6-5c28-8143-adc9baabdca3/3da52437-88a6-5c28-8143-adc9baabdca3_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 99370,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/ND19VHL/698691309/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3da52437-88a6-5c28-8143-adc9baabdca3/3da52437-88a6-5c28-8143-adc9baabdca3_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 80293,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/ND19VHL/698691330/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-01-01',
'seller_name': None,
'title': 'BMW X3 3.0 XDRIVE M40I STEP StationWagon',
'transmission': 'manual',
'trim': 'XDRIVE M40I STEP',
'vin': 'WBATS32040LP75158',
'year': 2019}
2026-03-28 14:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27ND19%2520VHL%27 HTTP/1.1" 200 None
2026-03-28 14:02:23 [bca.uk] INFO: Saving data for ND19%20VHL: {'created_time': 1774706543.524976, 'last_price_update_time': 1774706543.524987, 'auction_closing_time': 1774778400.0}
2026-03-28 14:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='ND19%2520VHL') HTTP/1.1" 204 0
2026-03-28 14:02:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 012921cb-8763-5e72-9bbe-1684326c9a1d with identifier: WA15%20XTF
2026-03-28 14:02:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 012921cb-8763-5e72-9bbe-1684326c9a1d with identifier: WA15%20XTF
2026-03-28 14:02:23 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 012921cb-8763-5e72-9bbe-1684326c9a1d with identifier: WA15%20XTF to the API
2026-03-28 14:02:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:02:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:02:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WA15XTF/697938596/600>
{'auction_title': '',
'c_o_2_emission_value': 150,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_012921cb-8763-5e72-9bbe-1684326c9a1d/012921cb-8763-5e72-9bbe-1684326c9a1d_expert_report_file_bb1aa5b4-3b08-4172-9b77-19636627d2d2.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=WA15%20XTF-GB',
'category': 'Car',
'color': 'grey',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.6L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol',
'id': '012921cb-8763-5e72-9bbe-1684326c9a1d',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'WA15 XTF',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=WA15%20XTF&vehicleType=*',
'listing': 'auction',
'location': 'Paddock Wood',
'make': 'PEUGEOT',
'model': '2008',
'odometer': 75970,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 11,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_012921cb-8763-5e72-9bbe-1684326c9a1d/012921cb-8763-5e72-9bbe-1684326c9a1d_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 52592,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WA15XTF/697938596/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_012921cb-8763-5e72-9bbe-1684326c9a1d/012921cb-8763-5e72-9bbe-1684326c9a1d_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 51161,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WA15XTF/697938611/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_012921cb-8763-5e72-9bbe-1684326c9a1d/012921cb-8763-5e72-9bbe-1684326c9a1d_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 49598,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WA15XTF/697938624/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_012921cb-8763-5e72-9bbe-1684326c9a1d/012921cb-8763-5e72-9bbe-1684326c9a1d_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 47264,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WA15XTF/697938638/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_012921cb-8763-5e72-9bbe-1684326c9a1d/012921cb-8763-5e72-9bbe-1684326c9a1d_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 47280,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WA15XTF/697938651/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_012921cb-8763-5e72-9bbe-1684326c9a1d/012921cb-8763-5e72-9bbe-1684326c9a1d_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 46432,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WA15XTF/697938658/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_012921cb-8763-5e72-9bbe-1684326c9a1d/012921cb-8763-5e72-9bbe-1684326c9a1d_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 92928,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WA15XTF/697938675/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_012921cb-8763-5e72-9bbe-1684326c9a1d/012921cb-8763-5e72-9bbe-1684326c9a1d_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 66624,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WA15XTF/697938692/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_012921cb-8763-5e72-9bbe-1684326c9a1d/012921cb-8763-5e72-9bbe-1684326c9a1d_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 86211,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WA15XTF/697938708/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_012921cb-8763-5e72-9bbe-1684326c9a1d/012921cb-8763-5e72-9bbe-1684326c9a1d_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 92023,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WA15XTF/697938732/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-01-01',
'seller_name': None,
'title': 'PEUGEOT 2008 1.6 VTI ALLURE MPV',
'transmission': 'automatic',
'trim': 'VTI ALLURE',
'vin': 'VF3CU5FS9EY135532',
'year': 2015}
2026-03-28 14:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WA15%2520XTF%27 HTTP/1.1" 200 None
2026-03-28 14:02:23 [bca.uk] INFO: Saving data for WA15%20XTF: {'created_time': 1774706543.923676, 'last_price_update_time': 1774706543.923691, 'auction_closing_time': 1774864800.0}
2026-03-28 14:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='WA15%2520XTF') HTTP/1.1" 204 0
2026-03-28 14:02:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 228041df-5797-5c8f-89c8-2a337a640ead with identifier: SF65%20MRS
2026-03-28 14:02:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 228041df-5797-5c8f-89c8-2a337a640ead with identifier: SF65%20MRS
2026-03-28 14:02:24 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 228041df-5797-5c8f-89c8-2a337a640ead with identifier: SF65%20MRS to the API
2026-03-28 14:02:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:02:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:02:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SF65MRS/698522041/600>
{'auction_title': '',
'c_o_2_emission_value': 114,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_228041df-5797-5c8f-89c8-2a337a640ead/228041df-5797-5c8f-89c8-2a337a640ead_expert_report_file_64ee7556-60d7-43df-940e-622e13378213.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=SF65%20MRS-GB',
'category': 'Car',
'color': 'white',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.2L',
'expiration_date': '2026-03-29T10:00:00Z',
'fuel_type': 'Petrol',
'id': '228041df-5797-5c8f-89c8-2a337a640ead',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'SF65 MRS',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=SF65%20MRS&vehicleType=*',
'listing': 'auction',
'location': 'Glasgow - East',
'make': 'SEAT',
'model': 'LEON',
'odometer': 68426,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 11,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_228041df-5797-5c8f-89c8-2a337a640ead/228041df-5797-5c8f-89c8-2a337a640ead_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 45025,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SF65MRS/698522041/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_228041df-5797-5c8f-89c8-2a337a640ead/228041df-5797-5c8f-89c8-2a337a640ead_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 41343,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SF65MRS/698522052/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_228041df-5797-5c8f-89c8-2a337a640ead/228041df-5797-5c8f-89c8-2a337a640ead_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 43690,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SF65MRS/698522063/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_228041df-5797-5c8f-89c8-2a337a640ead/228041df-5797-5c8f-89c8-2a337a640ead_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 43959,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SF65MRS/698522077/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_228041df-5797-5c8f-89c8-2a337a640ead/228041df-5797-5c8f-89c8-2a337a640ead_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 44857,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SF65MRS/698522093/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_228041df-5797-5c8f-89c8-2a337a640ead/228041df-5797-5c8f-89c8-2a337a640ead_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 42424,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SF65MRS/698522099/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_228041df-5797-5c8f-89c8-2a337a640ead/228041df-5797-5c8f-89c8-2a337a640ead_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 71865,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SF65MRS/698522114/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_228041df-5797-5c8f-89c8-2a337a640ead/228041df-5797-5c8f-89c8-2a337a640ead_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 57721,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SF65MRS/698522124/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_228041df-5797-5c8f-89c8-2a337a640ead/228041df-5797-5c8f-89c8-2a337a640ead_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 69744,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SF65MRS/698522140/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_228041df-5797-5c8f-89c8-2a337a640ead/228041df-5797-5c8f-89c8-2a337a640ead_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 77188,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SF65MRS/698522154/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-01-01',
'seller_name': None,
'title': 'SEAT LEON 1.2 TSI 110 SE Hatchback',
'transmission': 'manual',
'trim': 'TSI 110 SE',
'vin': 'VSSZZZ5FZGR077691',
'year': 2016}
2026-03-28 14:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SF65%2520MRS%27 HTTP/1.1" 200 None
2026-03-28 14:02:24 [bca.uk] INFO: Saving data for SF65%20MRS: {'created_time': 1774706544.327951, 'last_price_update_time': 1774706544.327962, 'auction_closing_time': 1774778400.0}
2026-03-28 14:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='SF65%2520MRS') HTTP/1.1" 204 0
2026-03-28 14:02:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: c2dfa08a-04ba-520a-b1ba-0b0dcf2d9ee2 with identifier: BG72%20UUY
2026-03-28 14:02:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: c2dfa08a-04ba-520a-b1ba-0b0dcf2d9ee2 with identifier: BG72%20UUY
2026-03-28 14:02:24 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: c2dfa08a-04ba-520a-b1ba-0b0dcf2d9ee2 with identifier: BG72%20UUY to the API
2026-03-28 14:02:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:02:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:02:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BG72UUY/698459094/600>
{'auction_title': '',
'c_o_2_emission_value': 110,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c2dfa08a-04ba-520a-b1ba-0b0dcf2d9ee2/c2dfa08a-04ba-520a-b1ba-0b0dcf2d9ee2_expert_report_file_9d6b653e-bfac-4c2e-9d78-93443eceb764.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=BG72%20UUY-GB',
'category': 'Car',
'color': 'green',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.0L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol',
'id': 'c2dfa08a-04ba-520a-b1ba-0b0dcf2d9ee2',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'BG72 UUY',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=BG72%20UUY&vehicleType=*',
'listing': 'auction',
'location': 'Measham',
'make': 'TOYOTA',
'model': 'AYGO X',
'odometer': 15060,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 11,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c2dfa08a-04ba-520a-b1ba-0b0dcf2d9ee2/c2dfa08a-04ba-520a-b1ba-0b0dcf2d9ee2_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 42695,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BG72UUY/698459094/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c2dfa08a-04ba-520a-b1ba-0b0dcf2d9ee2/c2dfa08a-04ba-520a-b1ba-0b0dcf2d9ee2_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 39586,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BG72UUY/698459096/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c2dfa08a-04ba-520a-b1ba-0b0dcf2d9ee2/c2dfa08a-04ba-520a-b1ba-0b0dcf2d9ee2_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 44053,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BG72UUY/698459100/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c2dfa08a-04ba-520a-b1ba-0b0dcf2d9ee2/c2dfa08a-04ba-520a-b1ba-0b0dcf2d9ee2_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 42924,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BG72UUY/698459105/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c2dfa08a-04ba-520a-b1ba-0b0dcf2d9ee2/c2dfa08a-04ba-520a-b1ba-0b0dcf2d9ee2_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 42975,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BG72UUY/698459107/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c2dfa08a-04ba-520a-b1ba-0b0dcf2d9ee2/c2dfa08a-04ba-520a-b1ba-0b0dcf2d9ee2_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 41474,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BG72UUY/698459109/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c2dfa08a-04ba-520a-b1ba-0b0dcf2d9ee2/c2dfa08a-04ba-520a-b1ba-0b0dcf2d9ee2_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 81159,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BG72UUY/698459113/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c2dfa08a-04ba-520a-b1ba-0b0dcf2d9ee2/c2dfa08a-04ba-520a-b1ba-0b0dcf2d9ee2_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 69663,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BG72UUY/698459122/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c2dfa08a-04ba-520a-b1ba-0b0dcf2d9ee2/c2dfa08a-04ba-520a-b1ba-0b0dcf2d9ee2_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 81933,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BG72UUY/698459128/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c2dfa08a-04ba-520a-b1ba-0b0dcf2d9ee2/c2dfa08a-04ba-520a-b1ba-0b0dcf2d9ee2_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 71223,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BG72UUY/698459134/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-01-01',
'seller_name': None,
'title': 'TOYOTA AYGO X 1.0 VVT-I EDGE Hatchback',
'transmission': 'manual',
'trim': 'VVT-I EDGE',
'vin': 'JTDAGNAC200071058',
'year': 2022}
2026-03-28 14:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BG72%2520UUY%27 HTTP/1.1" 200 None
2026-03-28 14:02:24 [bca.uk] INFO: Saving data for BG72%20UUY: {'created_time': 1774706544.720737, 'last_price_update_time': 1774706544.720751, 'auction_closing_time': 1774864800.0}
2026-03-28 14:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='BG72%2520UUY') HTTP/1.1" 204 0
2026-03-28 14:02:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 4de18175-834b-5b06-b8ed-75c0641e29ce with identifier: RA68%20WZE
2026-03-28 14:02:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 4de18175-834b-5b06-b8ed-75c0641e29ce with identifier: RA68%20WZE
2026-03-28 14:02:24 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 4de18175-834b-5b06-b8ed-75c0641e29ce with identifier: RA68%20WZE to the API
2026-03-28 14:02:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:02:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:02:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RA68WZE/698229776/600>
{'auction_title': '',
'c_o_2_emission_value': 113,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4de18175-834b-5b06-b8ed-75c0641e29ce/4de18175-834b-5b06-b8ed-75c0641e29ce_expert_report_file_64ffeece-90b9-4ef5-a507-53ad5690037f.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=RA68%20WZE-GB',
'category': 'Car',
'color': 'blue',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.5L',
'expiration_date': '2026-03-29T10:00:00Z',
'fuel_type': 'Petrol',
'id': '4de18175-834b-5b06-b8ed-75c0641e29ce',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'RA68 WZE',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=RA68%20WZE&vehicleType=*',
'listing': 'auction',
'location': 'Bristol',
'make': 'VOLKSWAGEN',
'model': 'GOLF',
'odometer': 67362,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 11,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4de18175-834b-5b06-b8ed-75c0641e29ce/4de18175-834b-5b06-b8ed-75c0641e29ce_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 47392,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RA68WZE/698229695/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4de18175-834b-5b06-b8ed-75c0641e29ce/4de18175-834b-5b06-b8ed-75c0641e29ce_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 47588,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RA68WZE/698229700/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4de18175-834b-5b06-b8ed-75c0641e29ce/4de18175-834b-5b06-b8ed-75c0641e29ce_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 43402,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RA68WZE/698229708/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4de18175-834b-5b06-b8ed-75c0641e29ce/4de18175-834b-5b06-b8ed-75c0641e29ce_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 44876,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RA68WZE/698229715/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4de18175-834b-5b06-b8ed-75c0641e29ce/4de18175-834b-5b06-b8ed-75c0641e29ce_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 44091,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RA68WZE/698229725/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4de18175-834b-5b06-b8ed-75c0641e29ce/4de18175-834b-5b06-b8ed-75c0641e29ce_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 43038,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RA68WZE/698229733/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4de18175-834b-5b06-b8ed-75c0641e29ce/4de18175-834b-5b06-b8ed-75c0641e29ce_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 96094,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RA68WZE/698229742/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4de18175-834b-5b06-b8ed-75c0641e29ce/4de18175-834b-5b06-b8ed-75c0641e29ce_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 93599,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RA68WZE/698229754/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4de18175-834b-5b06-b8ed-75c0641e29ce/4de18175-834b-5b06-b8ed-75c0641e29ce_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 98495,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RA68WZE/698229763/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4de18175-834b-5b06-b8ed-75c0641e29ce/4de18175-834b-5b06-b8ed-75c0641e29ce_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 89577,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RA68WZE/698229776/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-01-01',
'seller_name': None,
'title': 'VOLKSWAGEN GOLF 1.5 TSI EVO 130 SE NAV Hatchback',
'transmission': 'manual',
'trim': 'TSI EVO 130 SE NAV',
'vin': 'WVWZZZAUZKW009013',
'year': 2019}
2026-03-28 14:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27RA68%2520WZE%27 HTTP/1.1" 200 None
2026-03-28 14:02:25 [bca.uk] INFO: Saving data for RA68%20WZE: {'created_time': 1774706545.125415, 'last_price_update_time': 1774706545.125431, 'auction_closing_time': 1774778400.0}
2026-03-28 14:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='RA68%2520WZE') HTTP/1.1" 204 0
2026-03-28 14:02:25 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VO17FMZ/698274394/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698274394>
2026-03-28 14:02:25 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SB65CAX/697544320/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=697544320>
2026-03-28 14:02:25 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AM58MHU/698970521/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698970521>
2026-03-28 14:02:25 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AM58MHU/698970517/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=AM58MHU-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-28 14:02:25 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SB65CAX/697544313/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=SB65CAX-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-28 14:02:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AM58MHU/698970528/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/AM58MHU/42810635?sv=2020-08-04&st=2026-03-28T14%3A01%3A23Z&se=2026-03-28T14%3A26%3A23Z&sr=b&sp=r&sig=MTxN3XqRDWL9DG88ixDAxTc9KDbrCYbR3DQJ2mNHaYw%3D)
2026-03-28 14:02:25 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/SM67VNV/42810251?sv=2020-08-04&st=2026-03-28T14%3A02%3A21Z&se=2026-03-28T14%3A27%3A21Z&sr=b&sp=r&sig=zKf9cm3c2GLLDCKC9h0Kq9J3NSEBcqSIr7bWiyg1hwQ%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=SM67%20VNV-GB>
2026-03-28 14:02:25 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/WP62XCK/42810245?sv=2020-08-04&st=2026-03-28T14%3A02%3A21Z&se=2026-03-28T14%3A27%3A21Z&sr=b&sp=r&sig=gyEdXM91VrVknbZjiLD2toi%2BgCj7hBqRBYqi3Ts%2BfeU%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=WP62%20XCK-GB>
2026-03-28 14:02:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:02:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c44e910>
2026-03-28 14:02:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:02:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:02:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:02:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_05412951-b5cb-5847-b7df-8f166615ed23/05412951-b5cb-5847-b7df-8f166615ed23_image_3.jpg HTTP/1.1" 201 0
2026-03-28 14:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FSB65CAX%252F697544345%252F600') HTTP/1.1" 204 0
2026-03-28 14:02:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SB65CAX/697544345/600 saved to cache
2026-03-28 14:02:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 05412951-b5cb-5847-b7df-8f166615ed23
2026-03-28 14:02:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:02:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c623050>
2026-03-28 14:02:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:02:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:02:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:02:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_29da6c1c-854f-50ff-9030-4ad1ff36e423/29da6c1c-854f-50ff-9030-4ad1ff36e423_image_3.jpg HTTP/1.1" 201 0
2026-03-28 14:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FAM58MHU%252F698970528%252F600') HTTP/1.1" 204 0
2026-03-28 14:02:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AM58MHU/698970528/600 saved to cache
2026-03-28 14:02:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 29da6c1c-854f-50ff-9030-4ad1ff36e423
2026-03-28 14:02:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AM58MHU/698953147/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/AM58MHU/42810635?sv=2020-08-04&st=2026-03-28T14%3A01%3A23Z&se=2026-03-28T14%3A26%3A23Z&sr=b&sp=r&sig=MTxN3XqRDWL9DG88ixDAxTc9KDbrCYbR3DQJ2mNHaYw%3D)
2026-03-28 14:02:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VO17FMZ/698274453/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/VO17FMZ/42810377?sv=2020-08-04&st=2026-03-28T14%3A01%3A10Z&se=2026-03-28T14%3A26%3A10Z&sr=b&sp=r&sig=PEm9gdKL%2BNRnVtrVK0%2F5sWr2YcEbrtVNzeob8CJbr3c%3D)
2026-03-28 14:02:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GU10UYN/698556107/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/GU10UYN/42810320?sv=2020-08-04&st=2026-03-28T14%3A01%3A23Z&se=2026-03-28T14%3A26%3A23Z&sr=b&sp=r&sig=mGNhX9MAfZVu5g6PpXH03XgVnNc%2FnLjEd8Y2gqIppCM%3D)
2026-03-28 14:02:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SH14BOU/698522034/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/SH14BOU/42810142?sv=2020-08-04&st=2026-03-28T14%3A01%3A23Z&se=2026-03-28T14%3A26%3A23Z&sr=b&sp=r&sig=qF%2Fj8vLm9uL8z4mTnCxa7QRX8NL1HO0if01okEQdE50%3D)
2026-03-28 14:02:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YC72AVN/42810244?sv=2020-08-04&st=2026-03-28T14%3A02%3A20Z&se=2026-03-28T14%3A27%3A20Z&sr=b&sp=r&sig=beG5fN%2BBH0Z%2FDIpkhCSt8zTlTgu277%2B2D8NvIf%2FKCVY%3D> (referer: https://www.bca.co.uk/)
2026-03-28 14:02:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VO17FMZ/698274440/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/VO17FMZ/42810377?sv=2020-08-04&st=2026-03-28T14%3A01%3A10Z&se=2026-03-28T14%3A26%3A10Z&sr=b&sp=r&sig=PEm9gdKL%2BNRnVtrVK0%2F5sWr2YcEbrtVNzeob8CJbr3c%3D)
2026-03-28 14:02:25 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/RE03XJT/42810438?sv=2020-08-04&st=2026-03-28T14%3A02%3A25Z&se=2026-03-28T14%3A27%3A25Z&sr=b&sp=r&sig=W%2BmiGFHKvJXzfBcOMLhIRCoLkA3AzDMDP5bgxDrTPQQ%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=RE03%20XJT-GB>
2026-03-28 14:02:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/RF08TZP/42781844?sv=2020-08-04&st=2026-03-28T14%3A02%3A20Z&se=2026-03-28T14%3A27%3A20Z&sr=b&sp=r&sig=6hLicjIfZGVTK7BLacvGBl2SaFBQyybl9CGTh8APRd8%3D> (referer: https://www.bca.co.uk/)
2026-03-28 14:02:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AM58MHU/698970517/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/AM58MHU/42810635?sv=2020-08-04&st=2026-03-28T14%3A01%3A23Z&se=2026-03-28T14%3A26%3A23Z&sr=b&sp=r&sig=MTxN3XqRDWL9DG88ixDAxTc9KDbrCYbR3DQJ2mNHaYw%3D)
2026-03-28 14:02:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SB65CAX/697544313/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/SB65CAX/42810123?sv=2020-08-04&st=2026-03-28T14%3A01%3A23Z&se=2026-03-28T14%3A26%3A23Z&sr=b&sp=r&sig=vTzzhGIuSP84%2BuZVufy4vR0mq7%2F9VRE2bdnD30Ub%2FBU%3D)
2026-03-28 14:02:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SB65CAX/697544320/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/SB65CAX/42810123?sv=2020-08-04&st=2026-03-28T14%3A01%3A23Z&se=2026-03-28T14%3A26%3A23Z&sr=b&sp=r&sig=vTzzhGIuSP84%2BuZVufy4vR0mq7%2F9VRE2bdnD30Ub%2FBU%3D)
2026-03-28 14:02:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:02:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a1ff53610>
2026-03-28 14:02:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:02:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:02:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:02:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_29da6c1c-854f-50ff-9030-4ad1ff36e423/29da6c1c-854f-50ff-9030-4ad1ff36e423_image_2.jpg HTTP/1.1" 201 0
2026-03-28 14:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FAM58MHU%252F698953147%252F600') HTTP/1.1" 204 0
2026-03-28 14:02:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AM58MHU/698953147/600 saved to cache
2026-03-28 14:02:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 29da6c1c-854f-50ff-9030-4ad1ff36e423
2026-03-28 14:02:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AM58MHU/698970521/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/AM58MHU/42810635?sv=2020-08-04&st=2026-03-28T14%3A01%3A23Z&se=2026-03-28T14%3A26%3A23Z&sr=b&sp=r&sig=MTxN3XqRDWL9DG88ixDAxTc9KDbrCYbR3DQJ2mNHaYw%3D)
2026-03-28 14:02:25 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:02:25 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:02:25 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:02:25 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:02:25 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:02:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:02:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2ca88ed0>
2026-03-28 14:02:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:02:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:02:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:02:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7b233ce6-aa01-5f24-ac34-ccc770845b54/7b233ce6-aa01-5f24-ac34-ccc770845b54_image_8.jpg HTTP/1.1" 201 0
2026-03-28 14:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FVO17FMZ%252F698274453%252F600') HTTP/1.1" 204 0
2026-03-28 14:02:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VO17FMZ/698274453/600 saved to cache
2026-03-28 14:02:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 7b233ce6-aa01-5f24-ac34-ccc770845b54
2026-03-28 14:02:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:02:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2ca83d90>
2026-03-28 14:02:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:02:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:02:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:02:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_24b3d1e2-9046-567a-ba39-2d683a6b4342/24b3d1e2-9046-567a-ba39-2d683a6b4342_image_0.jpg HTTP/1.1" 201 0
2026-03-28 14:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FGU10UYN%252F698556107%252F600') HTTP/1.1" 204 0
2026-03-28 14:02:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GU10UYN/698556107/600 saved to cache
2026-03-28 14:02:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 24b3d1e2-9046-567a-ba39-2d683a6b4342
2026-03-28 14:02:25 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 24b3d1e2-9046-567a-ba39-2d683a6b4342, skipping ID generation
2026-03-28 14:02:25 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 24b3d1e2-9046-567a-ba39-2d683a6b4342 sending to next pipeline
2026-03-28 14:02:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 24b3d1e2-9046-567a-ba39-2d683a6b4342, identifier: GU10%20UYN
2026-03-28 14:02:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:02:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c44fb50>
2026-03-28 14:02:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:02:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:02:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:02:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7ca8ff92-ba13-58b4-8b9a-c74a2e2ed8c1/7ca8ff92-ba13-58b4-8b9a-c74a2e2ed8c1_image_0.jpg HTTP/1.1" 201 0
2026-03-28 14:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FSH14BOU%252F698522034%252F600') HTTP/1.1" 204 0
2026-03-28 14:02:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SH14BOU/698522034/600 saved to cache
2026-03-28 14:02:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 7ca8ff92-ba13-58b4-8b9a-c74a2e2ed8c1
2026-03-28 14:02:25 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 7ca8ff92-ba13-58b4-8b9a-c74a2e2ed8c1, skipping ID generation
2026-03-28 14:02:25 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 7ca8ff92-ba13-58b4-8b9a-c74a2e2ed8c1 sending to next pipeline
2026-03-28 14:02:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 7ca8ff92-ba13-58b4-8b9a-c74a2e2ed8c1, identifier: SH14%20BOU
2026-03-28 14:02:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:02:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c9b2190>
2026-03-28 14:02:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:02:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:02:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:02:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_98f6010a-0356-55b3-9d9f-fbc61b9e1410/98f6010a-0356-55b3-9d9f-fbc61b9e1410_expert_report_file_66bb59b5-9f28-4f15-90e7-915c2e1b8f19.pdf HTTP/1.1" 201 0
2026-03-28 14:02:25 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item 98f6010a-0356-55b3-9d9f-fbc61b9e1410
2026-03-28 14:02:25 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 98f6010a-0356-55b3-9d9f-fbc61b9e1410, skipping ID generation
2026-03-28 14:02:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 98f6010a-0356-55b3-9d9f-fbc61b9e1410
2026-03-28 14:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DYC72AVN-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-28 14:02:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=YC72AVN-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-28 14:02:25 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:02:25 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:02:25 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:02:25 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:02:25 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:02:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:02:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c0f70d0>
2026-03-28 14:02:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:02:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:02:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:02:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7b233ce6-aa01-5f24-ac34-ccc770845b54/7b233ce6-aa01-5f24-ac34-ccc770845b54_image_7.jpg HTTP/1.1" 201 0
2026-03-28 14:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FVO17FMZ%252F698274440%252F600') HTTP/1.1" 204 0
2026-03-28 14:02:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VO17FMZ/698274440/600 saved to cache
2026-03-28 14:02:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 7b233ce6-aa01-5f24-ac34-ccc770845b54
2026-03-28 14:02:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 24b3d1e2-9046-567a-ba39-2d683a6b4342 with identifier: GU10%20UYN
2026-03-28 14:02:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 24b3d1e2-9046-567a-ba39-2d683a6b4342 with identifier: GU10%20UYN
2026-03-28 14:02:26 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 24b3d1e2-9046-567a-ba39-2d683a6b4342 with identifier: GU10%20UYN to the API
2026-03-28 14:02:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:02:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:02:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GU10UYN/698556107/600>
{'auction_title': '',
'c_o_2_emission_value': 142,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_24b3d1e2-9046-567a-ba39-2d683a6b4342/24b3d1e2-9046-567a-ba39-2d683a6b4342_expert_report_file_c1b99c57-cfc4-4404-9d71-2df37a247b5e.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=GU10%20UYN-GB',
'category': 'Car',
'color': 'blue',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.4L',
'expiration_date': '2026-03-29T10:00:00Z',
'fuel_type': 'Petrol',
'id': '24b3d1e2-9046-567a-ba39-2d683a6b4342',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'GU10 UYN',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=GU10%20UYN&vehicleType=*',
'listing': 'auction',
'location': 'Paddock Wood',
'make': 'SEAT',
'model': 'IBIZA',
'odometer': 51025,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 11,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_24b3d1e2-9046-567a-ba39-2d683a6b4342/24b3d1e2-9046-567a-ba39-2d683a6b4342_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 52315,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GU10UYN/698556107/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_24b3d1e2-9046-567a-ba39-2d683a6b4342/24b3d1e2-9046-567a-ba39-2d683a6b4342_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 48986,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GU10UYN/698556122/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_24b3d1e2-9046-567a-ba39-2d683a6b4342/24b3d1e2-9046-567a-ba39-2d683a6b4342_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 48010,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GU10UYN/698556136/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_24b3d1e2-9046-567a-ba39-2d683a6b4342/24b3d1e2-9046-567a-ba39-2d683a6b4342_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 45755,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GU10UYN/698556155/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_24b3d1e2-9046-567a-ba39-2d683a6b4342/24b3d1e2-9046-567a-ba39-2d683a6b4342_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 45880,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GU10UYN/698556165/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_24b3d1e2-9046-567a-ba39-2d683a6b4342/24b3d1e2-9046-567a-ba39-2d683a6b4342_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 46298,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GU10UYN/698556176/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_24b3d1e2-9046-567a-ba39-2d683a6b4342/24b3d1e2-9046-567a-ba39-2d683a6b4342_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 93291,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GU10UYN/698556192/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_24b3d1e2-9046-567a-ba39-2d683a6b4342/24b3d1e2-9046-567a-ba39-2d683a6b4342_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 73547,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GU10UYN/698556209/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_24b3d1e2-9046-567a-ba39-2d683a6b4342/24b3d1e2-9046-567a-ba39-2d683a6b4342_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 84930,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GU10UYN/698556226/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_24b3d1e2-9046-567a-ba39-2d683a6b4342/24b3d1e2-9046-567a-ba39-2d683a6b4342_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 63021,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GU10UYN/698556242/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2010-01-01',
'seller_name': None,
'title': 'SEAT IBIZA 1.4 SE Hatchback',
'transmission': 'manual',
'trim': 'SE',
'vin': 'VSSZZZ6JZAR118748',
'year': 2010}
2026-03-28 14:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GU10%2520UYN%27 HTTP/1.1" 200 None
2026-03-28 14:02:26 [bca.uk] INFO: Saving data for GU10%20UYN: {'created_time': 1774706546.348687, 'last_price_update_time': 1774706546.348704, 'auction_closing_time': 1774778400.0}
2026-03-28 14:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='GU10%2520UYN') HTTP/1.1" 204 0
2026-03-28 14:02:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 7ca8ff92-ba13-58b4-8b9a-c74a2e2ed8c1 with identifier: SH14%20BOU
2026-03-28 14:02:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 7ca8ff92-ba13-58b4-8b9a-c74a2e2ed8c1 with identifier: SH14%20BOU
2026-03-28 14:02:26 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 7ca8ff92-ba13-58b4-8b9a-c74a2e2ed8c1 with identifier: SH14%20BOU to the API
2026-03-28 14:02:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:02:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:02:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SH14BOU/698522034/600>
{'auction_title': '',
'c_o_2_emission_value': 119,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7ca8ff92-ba13-58b4-8b9a-c74a2e2ed8c1/7ca8ff92-ba13-58b4-8b9a-c74a2e2ed8c1_expert_report_file_7de6dcb5-3925-40b5-ab52-0ca5e0adffad.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=SH14%20BOU-GB',
'category': 'Car',
'color': 'blue',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.4L',
'expiration_date': '2026-03-29T10:00:00Z',
'fuel_type': 'Petrol',
'id': '7ca8ff92-ba13-58b4-8b9a-c74a2e2ed8c1',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'SH14 BOU',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=SH14%20BOU&vehicleType=*',
'listing': 'auction',
'location': 'Glasgow - East',
'make': 'SEAT',
'model': 'LEON',
'odometer': 85122,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 11,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7ca8ff92-ba13-58b4-8b9a-c74a2e2ed8c1/7ca8ff92-ba13-58b4-8b9a-c74a2e2ed8c1_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 46118,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SH14BOU/698522034/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7ca8ff92-ba13-58b4-8b9a-c74a2e2ed8c1/7ca8ff92-ba13-58b4-8b9a-c74a2e2ed8c1_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 43148,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SH14BOU/698522048/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7ca8ff92-ba13-58b4-8b9a-c74a2e2ed8c1/7ca8ff92-ba13-58b4-8b9a-c74a2e2ed8c1_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 47018,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SH14BOU/698522057/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7ca8ff92-ba13-58b4-8b9a-c74a2e2ed8c1/7ca8ff92-ba13-58b4-8b9a-c74a2e2ed8c1_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 45777,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SH14BOU/698522068/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7ca8ff92-ba13-58b4-8b9a-c74a2e2ed8c1/7ca8ff92-ba13-58b4-8b9a-c74a2e2ed8c1_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 48142,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SH14BOU/698522076/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7ca8ff92-ba13-58b4-8b9a-c74a2e2ed8c1/7ca8ff92-ba13-58b4-8b9a-c74a2e2ed8c1_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 44299,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SH14BOU/698522088/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7ca8ff92-ba13-58b4-8b9a-c74a2e2ed8c1/7ca8ff92-ba13-58b4-8b9a-c74a2e2ed8c1_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 88207,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SH14BOU/698522101/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7ca8ff92-ba13-58b4-8b9a-c74a2e2ed8c1/7ca8ff92-ba13-58b4-8b9a-c74a2e2ed8c1_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 80426,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SH14BOU/698522113/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7ca8ff92-ba13-58b4-8b9a-c74a2e2ed8c1/7ca8ff92-ba13-58b4-8b9a-c74a2e2ed8c1_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 93615,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SH14BOU/698522122/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7ca8ff92-ba13-58b4-8b9a-c74a2e2ed8c1/7ca8ff92-ba13-58b4-8b9a-c74a2e2ed8c1_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 60512,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SH14BOU/698522134/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2014-01-01',
'seller_name': None,
'title': 'SEAT LEON 1.4 TSI 140 FR Hatchback',
'transmission': 'manual',
'trim': 'TSI 140 FR',
'vin': 'VSSZZZ5FZER114692',
'year': 2014}
2026-03-28 14:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SH14%2520BOU%27 HTTP/1.1" 200 None
2026-03-28 14:02:26 [bca.uk] INFO: Saving data for SH14%20BOU: {'created_time': 1774706546.775289, 'last_price_update_time': 1774706546.7753, 'auction_closing_time': 1774778400.0}
2026-03-28 14:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='SH14%2520BOU') HTTP/1.1" 204 0
2026-03-28 14:02:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VO17FMZ/698274394/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/VO17FMZ/42810377?sv=2020-08-04&st=2026-03-28T14%3A01%3A10Z&se=2026-03-28T14%3A26%3A10Z&sr=b&sp=r&sig=PEm9gdKL%2BNRnVtrVK0%2F5sWr2YcEbrtVNzeob8CJbr3c%3D)
2026-03-28 14:02:26 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/EP19XHA/42803467?sv=2020-08-04&st=2026-03-28T14%3A02%3A25Z&se=2026-03-28T14%3A27%3A25Z&sr=b&sp=r&sig=3aXptHZNTY1xw5UUqyLl7yubHBPKRq5U01kDhdsbsYM%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=EP19%20XHA-GB>
2026-03-28 14:02:26 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/CY68EOB/42807353?sv=2020-08-04&st=2026-03-28T14%3A02%3A25Z&se=2026-03-28T14%3A27%3A25Z&sr=b&sp=r&sig=VhOAFQtPLoY4JTixFnYBwYrQPfJNMc8rMp4NstNU2cM%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=CY68%20EOB-GB>
2026-03-28 14:02:26 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/KR14OUW/42810276?sv=2020-08-04&st=2026-03-28T14%3A02%3A25Z&se=2026-03-28T14%3A27%3A25Z&sr=b&sp=r&sig=yD0HrAKd1eOENYPcHLYCjZQ9zljwYHJA7s3b8Za%2BpDw%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=KR14%20OUW-GB>
2026-03-28 14:02:26 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/FA18OJS/42809927?sv=2020-08-04&st=2026-03-28T14%3A02%3A25Z&se=2026-03-28T14%3A27%3A25Z&sr=b&sp=r&sig=wYbenAdSOJrfSZzoBonOEa6%2BD7yy%2FzPCYgKi2Sl75o8%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=FA18%20OJS-GB>
2026-03-28 14:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698691021%27 HTTP/1.1" 200 None
2026-03-28 14:02:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698691021 not downloaded yet
2026-03-28 14:02:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/SM67VNV/42810251?sv=2020-08-04&st=2026-03-28T14%3A02%3A21Z&se=2026-03-28T14%3A27%3A21Z&sr=b&sp=r&sig=zKf9cm3c2GLLDCKC9h0Kq9J3NSEBcqSIr7bWiyg1hwQ%3D> (referer: https://www.bca.co.uk/)
2026-03-28 14:02:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/WP62XCK/42810245?sv=2020-08-04&st=2026-03-28T14%3A02%3A21Z&se=2026-03-28T14%3A27%3A21Z&sr=b&sp=r&sig=gyEdXM91VrVknbZjiLD2toi%2BgCj7hBqRBYqi3Ts%2BfeU%3D> (referer: https://www.bca.co.uk/)
2026-03-28 14:02:26 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/HV58YJY/42810015?sv=2020-08-04&st=2026-03-28T14%3A02%3A25Z&se=2026-03-28T14%3A27%3A25Z&sr=b&sp=r&sig=4E7oaf6jl0JMYjcpc4K4%2F3uy5%2BGOvEW6yFoZ9j75kNU%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=HV58%20YJY-GB>
2026-03-28 14:02:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:02:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c9b35d0>
2026-03-28 14:02:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:02:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:02:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:02:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0db89969-308f-54b4-910e-308fd1f55fa4/0db89969-308f-54b4-910e-308fd1f55fa4_expert_report_file_fc161f00-5f9b-4342-a2a2-35d76566b5f2.pdf HTTP/1.1" 201 0
2026-03-28 14:02:26 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item 0db89969-308f-54b4-910e-308fd1f55fa4
2026-03-28 14:02:26 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 0db89969-308f-54b4-910e-308fd1f55fa4, skipping ID generation
2026-03-28 14:02:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 0db89969-308f-54b4-910e-308fd1f55fa4
2026-03-28 14:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DRF08TZP-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-28 14:02:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=RF08TZP-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-28 14:02:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:02:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c105150>
2026-03-28 14:02:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:02:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:02:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:02:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_29da6c1c-854f-50ff-9030-4ad1ff36e423/29da6c1c-854f-50ff-9030-4ad1ff36e423_image_0.jpg HTTP/1.1" 201 0
2026-03-28 14:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FAM58MHU%252F698970517%252F600') HTTP/1.1" 204 0
2026-03-28 14:02:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AM58MHU/698970517/600 saved to cache
2026-03-28 14:02:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 29da6c1c-854f-50ff-9030-4ad1ff36e423
2026-03-28 14:02:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:02:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2d982e90>
2026-03-28 14:02:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:02:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:02:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:02:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_05412951-b5cb-5847-b7df-8f166615ed23/05412951-b5cb-5847-b7df-8f166615ed23_image_0.jpg HTTP/1.1" 201 0
2026-03-28 14:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FSB65CAX%252F697544313%252F600') HTTP/1.1" 204 0
2026-03-28 14:02:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SB65CAX/697544313/600 saved to cache
2026-03-28 14:02:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 05412951-b5cb-5847-b7df-8f166615ed23
2026-03-28 14:02:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:02:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2ca19910>
2026-03-28 14:02:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:02:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:02:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:02:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_05412951-b5cb-5847-b7df-8f166615ed23/05412951-b5cb-5847-b7df-8f166615ed23_image_1.jpg HTTP/1.1" 201 0
2026-03-28 14:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FSB65CAX%252F697544320%252F600') HTTP/1.1" 204 0
2026-03-28 14:02:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SB65CAX/697544320/600 saved to cache
2026-03-28 14:02:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 05412951-b5cb-5847-b7df-8f166615ed23
2026-03-28 14:02:27 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 05412951-b5cb-5847-b7df-8f166615ed23, skipping ID generation
2026-03-28 14:02:27 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 05412951-b5cb-5847-b7df-8f166615ed23 sending to next pipeline
2026-03-28 14:02:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 05412951-b5cb-5847-b7df-8f166615ed23, identifier: SB65%20CAX
2026-03-28 14:02:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:02:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a1ff17710>
2026-03-28 14:02:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:02:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:02:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:02:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_29da6c1c-854f-50ff-9030-4ad1ff36e423/29da6c1c-854f-50ff-9030-4ad1ff36e423_image_1.jpg HTTP/1.1" 201 0
2026-03-28 14:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FAM58MHU%252F698970521%252F600') HTTP/1.1" 204 0
2026-03-28 14:02:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AM58MHU/698970521/600 saved to cache
2026-03-28 14:02:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 29da6c1c-854f-50ff-9030-4ad1ff36e423
2026-03-28 14:02:27 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 29da6c1c-854f-50ff-9030-4ad1ff36e423, skipping ID generation
2026-03-28 14:02:27 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 29da6c1c-854f-50ff-9030-4ad1ff36e423 sending to next pipeline
2026-03-28 14:02:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 29da6c1c-854f-50ff-9030-4ad1ff36e423, identifier: AM58%20MHU
2026-03-28 14:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698691035%27 HTTP/1.1" 200 None
2026-03-28 14:02:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698691035 not downloaded yet
2026-03-28 14:02:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 05412951-b5cb-5847-b7df-8f166615ed23 with identifier: SB65%20CAX
2026-03-28 14:02:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 05412951-b5cb-5847-b7df-8f166615ed23 with identifier: SB65%20CAX
2026-03-28 14:02:27 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 05412951-b5cb-5847-b7df-8f166615ed23 with identifier: SB65%20CAX to the API
2026-03-28 14:02:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:02:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:02:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SB65CAX/697544320/600>
{'auction_title': '',
'c_o_2_emission_value': 134,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_05412951-b5cb-5847-b7df-8f166615ed23/05412951-b5cb-5847-b7df-8f166615ed23_expert_report_file_d81d8a19-c379-46b3-b63d-6301476be8d3.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=SB65%20CAX-GB',
'category': 'Car',
'color': 'white',
'currency': 'GBP',
'doors_number': 5,
'engine': '2.0L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Diesel',
'id': '05412951-b5cb-5847-b7df-8f166615ed23',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'SB65 CAX',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=SB65%20CAX&vehicleType=*',
'listing': 'auction',
'location': 'Glasgow - East',
'make': 'LAND ROVER',
'model': 'R/R EVOQUE',
'odometer': 62523,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 11,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_05412951-b5cb-5847-b7df-8f166615ed23/05412951-b5cb-5847-b7df-8f166615ed23_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 45365,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SB65CAX/697544313/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_05412951-b5cb-5847-b7df-8f166615ed23/05412951-b5cb-5847-b7df-8f166615ed23_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 41165,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SB65CAX/697544320/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_05412951-b5cb-5847-b7df-8f166615ed23/05412951-b5cb-5847-b7df-8f166615ed23_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 43584,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SB65CAX/697544333/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_05412951-b5cb-5847-b7df-8f166615ed23/05412951-b5cb-5847-b7df-8f166615ed23_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 43922,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SB65CAX/697544345/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_05412951-b5cb-5847-b7df-8f166615ed23/05412951-b5cb-5847-b7df-8f166615ed23_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 44715,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SB65CAX/697544352/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_05412951-b5cb-5847-b7df-8f166615ed23/05412951-b5cb-5847-b7df-8f166615ed23_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 41353,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SB65CAX/697544362/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_05412951-b5cb-5847-b7df-8f166615ed23/05412951-b5cb-5847-b7df-8f166615ed23_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 64356,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SB65CAX/697544370/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_05412951-b5cb-5847-b7df-8f166615ed23/05412951-b5cb-5847-b7df-8f166615ed23_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 66948,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SB65CAX/697544382/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_05412951-b5cb-5847-b7df-8f166615ed23/05412951-b5cb-5847-b7df-8f166615ed23_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 75622,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SB65CAX/697544395/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_05412951-b5cb-5847-b7df-8f166615ed23/05412951-b5cb-5847-b7df-8f166615ed23_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 71363,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SB65CAX/697544407/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-01-01',
'seller_name': None,
'title': 'LAND ROVER R/R EVOQUE 2.0 TD4 180 4WD SE Hatchback',
'transmission': 'automatic',
'trim': 'TD4 180 4WD SE',
'vin': 'SALVA2AN1GH105319',
'year': 2015}
2026-03-28 14:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SB65%2520CAX%27 HTTP/1.1" 200 None
2026-03-28 14:02:27 [bca.uk] INFO: Saving data for SB65%20CAX: {'created_time': 1774706547.797515, 'last_price_update_time': 1774706547.797527, 'auction_closing_time': 1774864800.0}
2026-03-28 14:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='SB65%2520CAX') HTTP/1.1" 204 0
2026-03-28 14:02:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 29da6c1c-854f-50ff-9030-4ad1ff36e423 with identifier: AM58%20MHU
2026-03-28 14:02:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 29da6c1c-854f-50ff-9030-4ad1ff36e423 with identifier: AM58%20MHU
2026-03-28 14:02:27 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 29da6c1c-854f-50ff-9030-4ad1ff36e423 with identifier: AM58%20MHU to the API
2026-03-28 14:02:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:02:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:02:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AM58MHU/698970521/600>
{'auction_title': '',
'c_o_2_emission_value': 139,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_29da6c1c-854f-50ff-9030-4ad1ff36e423/29da6c1c-854f-50ff-9030-4ad1ff36e423_expert_report_file_072d043a-61b7-4d4e-98a6-87b13383474d.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=AM58%20MHU-GB',
'category': 'Car',
'color': 'blue',
'currency': 'GBP',
'doors_number': 3,
'engine': '1.2L',
'expiration_date': '2026-03-29T10:00:00Z',
'fuel_type': 'Petrol',
'id': '29da6c1c-854f-50ff-9030-4ad1ff36e423',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'AM58 MHU',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=AM58%20MHU&vehicleType=*',
'listing': 'auction',
'location': 'Paddock Wood',
'make': 'NISSAN',
'model': 'MICRA',
'odometer': 50211,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 16,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_29da6c1c-854f-50ff-9030-4ad1ff36e423/29da6c1c-854f-50ff-9030-4ad1ff36e423_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 45511,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AM58MHU/698970517/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_29da6c1c-854f-50ff-9030-4ad1ff36e423/29da6c1c-854f-50ff-9030-4ad1ff36e423_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 43351,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AM58MHU/698970521/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_29da6c1c-854f-50ff-9030-4ad1ff36e423/29da6c1c-854f-50ff-9030-4ad1ff36e423_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 49346,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AM58MHU/698953147/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_29da6c1c-854f-50ff-9030-4ad1ff36e423/29da6c1c-854f-50ff-9030-4ad1ff36e423_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 43019,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AM58MHU/698970528/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_29da6c1c-854f-50ff-9030-4ad1ff36e423/29da6c1c-854f-50ff-9030-4ad1ff36e423_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 48639,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AM58MHU/698953163/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_29da6c1c-854f-50ff-9030-4ad1ff36e423/29da6c1c-854f-50ff-9030-4ad1ff36e423_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 40257,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AM58MHU/698970537/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_29da6c1c-854f-50ff-9030-4ad1ff36e423/29da6c1c-854f-50ff-9030-4ad1ff36e423_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 45752,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AM58MHU/698953175/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_29da6c1c-854f-50ff-9030-4ad1ff36e423/29da6c1c-854f-50ff-9030-4ad1ff36e423_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 38640,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AM58MHU/698970540/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_29da6c1c-854f-50ff-9030-4ad1ff36e423/29da6c1c-854f-50ff-9030-4ad1ff36e423_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 44752,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AM58MHU/698953189/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_29da6c1c-854f-50ff-9030-4ad1ff36e423/29da6c1c-854f-50ff-9030-4ad1ff36e423_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 38856,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AM58MHU/698970545/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2008-01-01',
'seller_name': None,
'title': 'NISSAN MICRA 1.2 ACENTA 16V Hatchback',
'transmission': 'manual',
'trim': 'ACENTA 16V',
'vin': 'SJNEBAK12U3092293',
'year': 2008}
2026-03-28 14:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27AM58%2520MHU%27 HTTP/1.1" 200 None
2026-03-28 14:02:28 [bca.uk] INFO: Saving data for AM58%20MHU: {'created_time': 1774706548.2172, 'last_price_update_time': 1774706548.217211, 'auction_closing_time': 1774778400.0}
2026-03-28 14:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='AM58%2520MHU') HTTP/1.1" 204 0
2026-03-28 14:02:28 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/RE12OHA/42803024?sv=2020-08-04&st=2026-03-28T14%3A02%3A26Z&se=2026-03-28T14%3A27%3A26Z&sr=b&sp=r&sig=6BH8YhGE%2FtZL7bPaACcZWXnEkdIvYtNlALyKqaLOq1E%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=RE12%20OHA-GB>
2026-03-28 14:02:28 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/VE67DLJ/42810299?sv=2020-08-04&st=2026-03-28T14%3A02%3A26Z&se=2026-03-28T14%3A27%3A26Z&sr=b&sp=r&sig=s%2BFYsI609HRDhg5CyGwQVAsfiplztmlKAHuHQLONuoQ%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=VE67%20DLJ-GB>
2026-03-28 14:02:28 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/BO55VOP/42810137?sv=2020-08-04&st=2026-03-28T14%3A02%3A26Z&se=2026-03-28T14%3A27%3A26Z&sr=b&sp=r&sig=ClLegZn5u1dkNPwcbCwa7jDTCtqtY8g86xpgxUm2UfM%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=BO55%20VOP-GB>
2026-03-28 14:02:28 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LX66XGU/42810324?sv=2020-08-04&st=2026-03-28T14%3A02%3A26Z&se=2026-03-28T14%3A27%3A26Z&sr=b&sp=r&sig=jbz9LK9iyQlEY35Z3G5ue8uqHIh1I8l1GE31H0hzYMg%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=LX66%20XGU-GB>
2026-03-28 14:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698938679%27 HTTP/1.1" 200 None
2026-03-28 14:02:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698938679 not downloaded yet
2026-03-28 14:02:28 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EX10BXE/698923535/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698923535>
2026-03-28 14:02:28 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GF57MWW/698928941/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698928941>
2026-03-28 14:02:28 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/KM67WBP/42809464?sv=2020-08-04&st=2026-03-28T14%3A02%3A27Z&se=2026-03-28T14%3A27%3A27Z&sr=b&sp=r&sig=TFQrF%2FjkhRPUwB62qt8YSavHgBqeuo7q2b9lsdnq4W8%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=KM67%20WBP-GB>
2026-03-28 14:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698691055%27 HTTP/1.1" 200 None
2026-03-28 14:02:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698691055 not downloaded yet
2026-03-28 14:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698938690%27 HTTP/1.1" 200 None
2026-03-28 14:02:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698938690 not downloaded yet
2026-03-28 14:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698691080%27 HTTP/1.1" 200 None
2026-03-28 14:02:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698691080 not downloaded yet
2026-03-28 14:02:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:02:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c0fd710>
2026-03-28 14:02:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:02:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:02:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:02:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7b233ce6-aa01-5f24-ac34-ccc770845b54/7b233ce6-aa01-5f24-ac34-ccc770845b54_image_1.jpg HTTP/1.1" 201 0
2026-03-28 14:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FVO17FMZ%252F698274394%252F600') HTTP/1.1" 204 0
2026-03-28 14:02:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VO17FMZ/698274394/600 saved to cache
2026-03-28 14:02:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 7b233ce6-aa01-5f24-ac34-ccc770845b54
2026-03-28 14:02:28 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 7b233ce6-aa01-5f24-ac34-ccc770845b54, skipping ID generation
2026-03-28 14:02:28 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 7b233ce6-aa01-5f24-ac34-ccc770845b54 sending to next pipeline
2026-03-28 14:02:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 7b233ce6-aa01-5f24-ac34-ccc770845b54, identifier: VO17%20FMZ
2026-03-28 14:02:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:02:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c57de90>
2026-03-28 14:02:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:02:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:02:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:02:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e4b35cfb-486e-55d8-b302-6ece660ab632/e4b35cfb-486e-55d8-b302-6ece660ab632_expert_report_file_6a5d717b-4c74-4a03-bdd2-dca9cc92c5d3.pdf HTTP/1.1" 201 0
2026-03-28 14:02:28 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item e4b35cfb-486e-55d8-b302-6ece660ab632
2026-03-28 14:02:28 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: e4b35cfb-486e-55d8-b302-6ece660ab632, skipping ID generation
2026-03-28 14:02:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item e4b35cfb-486e-55d8-b302-6ece660ab632
2026-03-28 14:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DSM67VNV-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-28 14:02:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=SM67VNV-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-28 14:02:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:02:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c8a0f90>
2026-03-28 14:02:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:02:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:02:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:02:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_017f335f-f1b9-5de8-8cb9-bc79c2d2f45f/017f335f-f1b9-5de8-8cb9-bc79c2d2f45f_expert_report_file_545dedb5-2a1f-4334-9bdd-ef4425cbb169.pdf HTTP/1.1" 201 0
2026-03-28 14:02:28 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item 017f335f-f1b9-5de8-8cb9-bc79c2d2f45f
2026-03-28 14:02:28 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 017f335f-f1b9-5de8-8cb9-bc79c2d2f45f, skipping ID generation
2026-03-28 14:02:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 017f335f-f1b9-5de8-8cb9-bc79c2d2f45f
2026-03-28 14:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DWP62XCK-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-28 14:02:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=WP62XCK-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-28 14:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698938695%27 HTTP/1.1" 200 None
2026-03-28 14:02:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698938695 not downloaded yet
2026-03-28 14:02:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 7b233ce6-aa01-5f24-ac34-ccc770845b54 with identifier: VO17%20FMZ
2026-03-28 14:02:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 7b233ce6-aa01-5f24-ac34-ccc770845b54 with identifier: VO17%20FMZ
2026-03-28 14:02:28 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 7b233ce6-aa01-5f24-ac34-ccc770845b54 with identifier: VO17%20FMZ to the API
2026-03-28 14:02:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:02:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:02:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VO17FMZ/698274394/600>
{'auction_title': '',
'c_o_2_emission_value': 123,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7b233ce6-aa01-5f24-ac34-ccc770845b54/7b233ce6-aa01-5f24-ac34-ccc770845b54_expert_report_file_2e38ca68-b965-4ee1-8df0-4bb2b832560c.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=VO17%20FMZ-GB',
'category': 'Car',
'color': 'grey',
'currency': 'GBP',
'doors_number': 5,
'engine': '2.0L',
'expiration_date': '2026-03-29T10:00:00Z',
'fuel_type': 'Diesel',
'id': '7b233ce6-aa01-5f24-ac34-ccc770845b54',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'VO17 FMZ',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=VO17%20FMZ&vehicleType=*',
'listing': 'auction',
'location': 'Walsall',
'make': 'BMW',
'model': '320D',
'odometer': 122452,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 11,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7b233ce6-aa01-5f24-ac34-ccc770845b54/7b233ce6-aa01-5f24-ac34-ccc770845b54_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 44828,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VO17FMZ/698274387/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7b233ce6-aa01-5f24-ac34-ccc770845b54/7b233ce6-aa01-5f24-ac34-ccc770845b54_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 44564,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VO17FMZ/698274394/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7b233ce6-aa01-5f24-ac34-ccc770845b54/7b233ce6-aa01-5f24-ac34-ccc770845b54_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 43381,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VO17FMZ/698274399/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7b233ce6-aa01-5f24-ac34-ccc770845b54/7b233ce6-aa01-5f24-ac34-ccc770845b54_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 43308,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VO17FMZ/698274406/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7b233ce6-aa01-5f24-ac34-ccc770845b54/7b233ce6-aa01-5f24-ac34-ccc770845b54_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 40492,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VO17FMZ/698274413/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7b233ce6-aa01-5f24-ac34-ccc770845b54/7b233ce6-aa01-5f24-ac34-ccc770845b54_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 40751,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VO17FMZ/698274418/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7b233ce6-aa01-5f24-ac34-ccc770845b54/7b233ce6-aa01-5f24-ac34-ccc770845b54_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 86151,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VO17FMZ/698274432/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7b233ce6-aa01-5f24-ac34-ccc770845b54/7b233ce6-aa01-5f24-ac34-ccc770845b54_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 84169,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VO17FMZ/698274440/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7b233ce6-aa01-5f24-ac34-ccc770845b54/7b233ce6-aa01-5f24-ac34-ccc770845b54_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 95172,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VO17FMZ/698274453/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7b233ce6-aa01-5f24-ac34-ccc770845b54/7b233ce6-aa01-5f24-ac34-ccc770845b54_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 81232,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VO17FMZ/698274476/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-01-01',
'seller_name': None,
'title': 'BMW 320D 2.0 SPORT TOURING Estate',
'transmission': 'manual',
'trim': 'SPORT TOURING',
'vin': 'WBA8H920X0K605206',
'year': 2017}
2026-03-28 14:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27VO17%2520FMZ%27 HTTP/1.1" 200 None
2026-03-28 14:02:29 [bca.uk] INFO: Saving data for VO17%20FMZ: {'created_time': 1774706549.093557, 'last_price_update_time': 1774706549.093567, 'auction_closing_time': 1774778400.0}
2026-03-28 14:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='VO17%2520FMZ') HTTP/1.1" 204 0
2026-03-28 14:02:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/FA18OJS/42809927?sv=2020-08-04&st=2026-03-28T14%3A02%3A25Z&se=2026-03-28T14%3A27%3A25Z&sr=b&sp=r&sig=wYbenAdSOJrfSZzoBonOEa6%2BD7yy%2FzPCYgKi2Sl75o8%3D> (referer: https://www.bca.co.uk/)
2026-03-28 14:02:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/EP19XHA/42803467?sv=2020-08-04&st=2026-03-28T14%3A02%3A25Z&se=2026-03-28T14%3A27%3A25Z&sr=b&sp=r&sig=3aXptHZNTY1xw5UUqyLl7yubHBPKRq5U01kDhdsbsYM%3D> (referer: https://www.bca.co.uk/)
2026-03-28 14:02:29 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YC72AVN/698691008/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=YC72AVN-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-28 14:02:29 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/SB72GWA/42810143?sv=2020-08-04&st=2026-03-28T14%3A02%3A28Z&se=2026-03-28T14%3A27%3A28Z&sr=b&sp=r&sig=COnND%2FooxrhanQtXLj4FeOKa%2Fkcoi5LKjGkYGyTn0a4%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=SB72%20GWA-GB>
2026-03-28 14:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698691111%27 HTTP/1.1" 200 None
2026-03-28 14:02:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698691111 not downloaded yet
2026-03-28 14:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698094054%27 HTTP/1.1" 200 None
2026-03-28 14:02:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698094054 not downloaded yet
2026-03-28 14:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D697615097%27 HTTP/1.1" 200 None
2026-03-28 14:02:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=697615097 not downloaded yet
2026-03-28 14:02:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/RE03XJT/42810438?sv=2020-08-04&st=2026-03-28T14%3A02%3A25Z&se=2026-03-28T14%3A27%3A25Z&sr=b&sp=r&sig=W%2BmiGFHKvJXzfBcOMLhIRCoLkA3AzDMDP5bgxDrTPQQ%3D> (referer: https://www.bca.co.uk/)
2026-03-28 14:02:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/CY68EOB/42807353?sv=2020-08-04&st=2026-03-28T14%3A02%3A25Z&se=2026-03-28T14%3A27%3A25Z&sr=b&sp=r&sig=VhOAFQtPLoY4JTixFnYBwYrQPfJNMc8rMp4NstNU2cM%3D> (referer: https://www.bca.co.uk/)
2026-03-28 14:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698938702%27 HTTP/1.1" 200 None
2026-03-28 14:02:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698938702 not downloaded yet
2026-03-28 14:02:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/KR14OUW/42810276?sv=2020-08-04&st=2026-03-28T14%3A02%3A25Z&se=2026-03-28T14%3A27%3A25Z&sr=b&sp=r&sig=yD0HrAKd1eOENYPcHLYCjZQ9zljwYHJA7s3b8Za%2BpDw%3D> (referer: https://www.bca.co.uk/)
2026-03-28 14:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698691152%27 HTTP/1.1" 200 None
2026-03-28 14:02:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698691152 not downloaded yet
2026-03-28 14:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698094070%27 HTTP/1.1" 200 None
2026-03-28 14:02:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698094070 not downloaded yet
2026-03-28 14:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D697615101%27 HTTP/1.1" 200 None
2026-03-28 14:02:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=697615101 not downloaded yet
2026-03-28 14:02:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/HV58YJY/42810015?sv=2020-08-04&st=2026-03-28T14%3A02%3A25Z&se=2026-03-28T14%3A27%3A25Z&sr=b&sp=r&sig=4E7oaf6jl0JMYjcpc4K4%2F3uy5%2BGOvEW6yFoZ9j75kNU%3D> (referer: https://www.bca.co.uk/)
2026-03-28 14:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698938712%27 HTTP/1.1" 200 None
2026-03-28 14:02:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698938712 not downloaded yet
2026-03-28 14:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698691179%27 HTTP/1.1" 200 None
2026-03-28 14:02:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698691179 not downloaded yet
2026-03-28 14:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698094083%27 HTTP/1.1" 200 None
2026-03-28 14:02:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698094083 not downloaded yet
2026-03-28 14:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D697615106%27 HTTP/1.1" 200 None
2026-03-28 14:02:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=697615106 not downloaded yet
2026-03-28 14:02:29 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/ND17WHW/42810327?sv=2020-08-04&st=2026-03-28T14%3A02%3A29Z&se=2026-03-28T14%3A27%3A29Z&sr=b&sp=r&sig=zynQuQSfNuyDXNRKcXA5HSV08c7JnCbvGT8UtSuSUac%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=ND17%20WHW-GB>
2026-03-28 14:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698938725%27 HTTP/1.1" 200 None
2026-03-28 14:02:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698938725 not downloaded yet
2026-03-28 14:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698691214%27 HTTP/1.1" 200 None
2026-03-28 14:02:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698691214 not downloaded yet
2026-03-28 14:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698094093%27 HTTP/1.1" 200 None
2026-03-28 14:02:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698094093 not downloaded yet
2026-03-28 14:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D697615110%27 HTTP/1.1" 200 None
2026-03-28 14:02:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=697615110 not downloaded yet
2026-03-28 14:02:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:02:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c61a790>
2026-03-28 14:02:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:02:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:02:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:02:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_73dc1fed-646a-544c-b3e5-ff1b6aff4358/73dc1fed-646a-544c-b3e5-ff1b6aff4358_expert_report_file_4b344213-dc88-404a-86a4-f6cc33f55dc5.pdf HTTP/1.1" 201 0
2026-03-28 14:02:29 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item 73dc1fed-646a-544c-b3e5-ff1b6aff4358
2026-03-28 14:02:29 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 73dc1fed-646a-544c-b3e5-ff1b6aff4358, skipping ID generation
2026-03-28 14:02:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 73dc1fed-646a-544c-b3e5-ff1b6aff4358
2026-03-28 14:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DFA18OJS-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-28 14:02:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=FA18OJS-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-28 14:02:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:02:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c5ebbd0>
2026-03-28 14:02:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:02:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:02:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:02:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_85df4e80-1e5a-5573-ad99-0445a298364d/85df4e80-1e5a-5573-ad99-0445a298364d_expert_report_file_5ac99e97-8224-4475-985d-505732e3d665.pdf HTTP/1.1" 201 0
2026-03-28 14:02:29 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item 85df4e80-1e5a-5573-ad99-0445a298364d
2026-03-28 14:02:29 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 85df4e80-1e5a-5573-ad99-0445a298364d, skipping ID generation
2026-03-28 14:02:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 85df4e80-1e5a-5573-ad99-0445a298364d
2026-03-28 14:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DEP19XHA-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-28 14:02:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=EP19XHA-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-28 14:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698938739%27 HTTP/1.1" 200 None
2026-03-28 14:02:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698938739 not downloaded yet
2026-03-28 14:02:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/BO55VOP/42810137?sv=2020-08-04&st=2026-03-28T14%3A02%3A26Z&se=2026-03-28T14%3A27%3A26Z&sr=b&sp=r&sig=ClLegZn5u1dkNPwcbCwa7jDTCtqtY8g86xpgxUm2UfM%3D> (referer: https://www.bca.co.uk/)
2026-03-28 14:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698691238%27 HTTP/1.1" 200 None
2026-03-28 14:02:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698691238 not downloaded yet
2026-03-28 14:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698094106%27 HTTP/1.1" 200 None
2026-03-28 14:02:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698094106 not downloaded yet
2026-03-28 14:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D697615113%27 HTTP/1.1" 200 None
2026-03-28 14:02:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=697615113 not downloaded yet
2026-03-28 14:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698923281%27 HTTP/1.1" 200 None
2026-03-28 14:02:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698923281 not downloaded yet
2026-03-28 14:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698568369%27 HTTP/1.1" 200 None
2026-03-28 14:02:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698568369 not downloaded yet
2026-03-28 14:02:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:02:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c8a9110>
2026-03-28 14:02:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:02:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:02:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:02:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0d8a0ea5-df55-5526-b46c-23b49b8e0dc3/0d8a0ea5-df55-5526-b46c-23b49b8e0dc3_expert_report_file_268f0faf-f594-4f3d-9c85-f7cb8e09ed0a.pdf HTTP/1.1" 201 0
2026-03-28 14:02:29 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item 0d8a0ea5-df55-5526-b46c-23b49b8e0dc3
2026-03-28 14:02:29 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 0d8a0ea5-df55-5526-b46c-23b49b8e0dc3, skipping ID generation
2026-03-28 14:02:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 0d8a0ea5-df55-5526-b46c-23b49b8e0dc3
2026-03-28 14:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DRE03XJT-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-28 14:02:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=RE03XJT-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-28 14:02:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:02:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c6af810>
2026-03-28 14:02:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:02:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:02:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:02:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_299c12ca-ac8c-5489-8f0d-0d144c80340f/299c12ca-ac8c-5489-8f0d-0d144c80340f_expert_report_file_3d68d73e-3882-4c6d-85f2-cb8ef0828b13.pdf HTTP/1.1" 201 0
2026-03-28 14:02:29 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item 299c12ca-ac8c-5489-8f0d-0d144c80340f
2026-03-28 14:02:29 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 299c12ca-ac8c-5489-8f0d-0d144c80340f, skipping ID generation
2026-03-28 14:02:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 299c12ca-ac8c-5489-8f0d-0d144c80340f
2026-03-28 14:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DCY68EOB-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-28 14:02:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=CY68EOB-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-28 14:02:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:02:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2deab010>
2026-03-28 14:02:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:02:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:02:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:02:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5096b957-ac5c-5cc4-a891-49042e75677e/5096b957-ac5c-5cc4-a891-49042e75677e_expert_report_file_d015b35a-d107-4d5f-8541-e2584fc40c42.pdf HTTP/1.1" 201 0
2026-03-28 14:02:29 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item 5096b957-ac5c-5cc4-a891-49042e75677e
2026-03-28 14:02:29 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 5096b957-ac5c-5cc4-a891-49042e75677e, skipping ID generation
2026-03-28 14:02:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 5096b957-ac5c-5cc4-a891-49042e75677e
2026-03-28 14:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DKR14OUW-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-28 14:02:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=KR14OUW-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-28 14:02:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:02:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c84dc90>
2026-03-28 14:02:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:02:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:02:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:02:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8b64f21f-1ee3-5237-8105-b88b835030a8/8b64f21f-1ee3-5237-8105-b88b835030a8_expert_report_file_772a811b-4ccc-4293-9f12-e0dd5516c95f.pdf HTTP/1.1" 201 0
2026-03-28 14:02:29 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item 8b64f21f-1ee3-5237-8105-b88b835030a8
2026-03-28 14:02:29 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 8b64f21f-1ee3-5237-8105-b88b835030a8, skipping ID generation
2026-03-28 14:02:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 8b64f21f-1ee3-5237-8105-b88b835030a8
2026-03-28 14:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DHV58YJY-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-28 14:02:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=HV58YJY-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-28 14:02:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/RE12OHA/42803024?sv=2020-08-04&st=2026-03-28T14%3A02%3A26Z&se=2026-03-28T14%3A27%3A26Z&sr=b&sp=r&sig=6BH8YhGE%2FtZL7bPaACcZWXnEkdIvYtNlALyKqaLOq1E%3D> (referer: https://www.bca.co.uk/)
2026-03-28 14:02:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/VE67DLJ/42810299?sv=2020-08-04&st=2026-03-28T14%3A02%3A26Z&se=2026-03-28T14%3A27%3A26Z&sr=b&sp=r&sig=s%2BFYsI609HRDhg5CyGwQVAsfiplztmlKAHuHQLONuoQ%3D> (referer: https://www.bca.co.uk/)
2026-03-28 14:02:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GF57MWW/698928941/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/GF57MWW/42810309?sv=2020-08-04&st=2026-03-28T14%3A01%3A09Z&se=2026-03-28T14%3A26%3A09Z&sr=b&sp=r&sig=hJTqt8SLdbJfAcgzLjUmqtORuHZL2E6pw%2FRYFmCkjK4%3D)
2026-03-28 14:02:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EX10BXE/698923535/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/EX10BXE/42809799?sv=2020-08-04&st=2026-03-28T14%3A01%3A07Z&se=2026-03-28T14%3A26%3A07Z&sr=b&sp=r&sig=xoEQIFwTRaF8ZPdiio47BQcwaxFkt4KEonwRoN8KxQM%3D)
2026-03-28 14:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698938753%27 HTTP/1.1" 200 None
2026-03-28 14:02:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698938753 not downloaded yet
2026-03-28 14:02:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/KM67WBP/42809464?sv=2020-08-04&st=2026-03-28T14%3A02%3A27Z&se=2026-03-28T14%3A27%3A27Z&sr=b&sp=r&sig=TFQrF%2FjkhRPUwB62qt8YSavHgBqeuo7q2b9lsdnq4W8%3D> (referer: https://www.bca.co.uk/)
2026-03-28 14:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698094131%27 HTTP/1.1" 200 None
2026-03-28 14:02:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698094131 not downloaded yet
2026-03-28 14:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D697615121%27 HTTP/1.1" 200 None
2026-03-28 14:02:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=697615121 not downloaded yet
2026-03-28 14:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698923302%27 HTTP/1.1" 200 None
2026-03-28 14:02:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698923302 not downloaded yet
2026-03-28 14:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698568387%27 HTTP/1.1" 200 None
2026-03-28 14:02:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698568387 not downloaded yet
2026-03-28 14:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698933977%27 HTTP/1.1" 200 None
2026-03-28 14:02:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698933977 not downloaded yet
2026-03-28 14:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698765212%27 HTTP/1.1" 200 None
2026-03-28 14:02:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698765212 not downloaded yet
2026-03-28 14:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D696662276%27 HTTP/1.1" 200 None
2026-03-28 14:02:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=696662276 not downloaded yet
2026-03-28 14:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698928790%27 HTTP/1.1" 200 None
2026-03-28 14:02:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698928790 not downloaded yet
2026-03-28 14:02:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/SB72GWA/42810143?sv=2020-08-04&st=2026-03-28T14%3A02%3A28Z&se=2026-03-28T14%3A27%3A28Z&sr=b&sp=r&sig=COnND%2FooxrhanQtXLj4FeOKa%2Fkcoi5LKjGkYGyTn0a4%3D> (referer: https://www.bca.co.uk/)
2026-03-28 14:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698938767%27 HTTP/1.1" 200 None
2026-03-28 14:02:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698938767 not downloaded yet
2026-03-28 14:02:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YC72AVN/698691008/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YC72AVN/42810244?sv=2020-08-04&st=2026-03-28T14%3A02%3A20Z&se=2026-03-28T14%3A27%3A20Z&sr=b&sp=r&sig=beG5fN%2BBH0Z%2FDIpkhCSt8zTlTgu277%2B2D8NvIf%2FKCVY%3D)
2026-03-28 14:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698094155%27 HTTP/1.1" 200 None
2026-03-28 14:02:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698094155 not downloaded yet
2026-03-28 14:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D697615129%27 HTTP/1.1" 200 None
2026-03-28 14:02:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=697615129 not downloaded yet
2026-03-28 14:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698923326%27 HTTP/1.1" 200 None
2026-03-28 14:02:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698923326 not downloaded yet
2026-03-28 14:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698568411%27 HTTP/1.1" 200 None
2026-03-28 14:02:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698568411 not downloaded yet
2026-03-28 14:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698933995%27 HTTP/1.1" 200 None
2026-03-28 14:02:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698933995 not downloaded yet
2026-03-28 14:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698765230%27 HTTP/1.1" 200 None
2026-03-28 14:02:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698765230 not downloaded yet
2026-03-28 14:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D696662280%27 HTTP/1.1" 200 None
2026-03-28 14:02:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=696662280 not downloaded yet
2026-03-28 14:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698928812%27 HTTP/1.1" 200 None
2026-03-28 14:02:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698928812 not downloaded yet
2026-03-28 14:02:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:02:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c6ae490>
2026-03-28 14:02:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:02:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:02:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:02:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0df2aa72-34d7-5e00-86eb-dff801f0634b/0df2aa72-34d7-5e00-86eb-dff801f0634b_expert_report_file_5d9b12b1-5eec-4a34-995f-2c5bdb7bfad7.pdf HTTP/1.1" 201 0
2026-03-28 14:02:30 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item 0df2aa72-34d7-5e00-86eb-dff801f0634b
2026-03-28 14:02:30 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 0df2aa72-34d7-5e00-86eb-dff801f0634b, skipping ID generation
2026-03-28 14:02:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 0df2aa72-34d7-5e00-86eb-dff801f0634b
2026-03-28 14:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DBO55VOP-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-28 14:02:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=BO55VOP-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-28 14:02:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LX66XGU/42810324?sv=2020-08-04&st=2026-03-28T14%3A02%3A26Z&se=2026-03-28T14%3A27%3A26Z&sr=b&sp=r&sig=jbz9LK9iyQlEY35Z3G5ue8uqHIh1I8l1GE31H0hzYMg%3D> (referer: https://www.bca.co.uk/)
2026-03-28 14:02:30 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YC72AVN/698691080/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698691080>
2026-03-28 14:02:30 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RF08TZP/698938695/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698938695>
2026-03-28 14:02:30 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RF08TZP/698938702/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698938702>
2026-03-28 14:02:30 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WP62XCK/697615090/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=WP62XCK-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-28 14:02:30 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SM67VNV/698094046/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=SM67VNV-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-28 14:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698094168%27 HTTP/1.1" 200 None
2026-03-28 14:02:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698094168 not downloaded yet
2026-03-28 14:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D697615135%27 HTTP/1.1" 200 None
2026-03-28 14:02:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=697615135 not downloaded yet
2026-03-28 14:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698923357%27 HTTP/1.1" 200 None
2026-03-28 14:02:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698923357 not downloaded yet
2026-03-28 14:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698568433%27 HTTP/1.1" 200 None
2026-03-28 14:02:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698568433 not downloaded yet
2026-03-28 14:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698934011%27 HTTP/1.1" 200 None
2026-03-28 14:02:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698934011 not downloaded yet
2026-03-28 14:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698765249%27 HTTP/1.1" 200 None
2026-03-28 14:02:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698765249 not downloaded yet
2026-03-28 14:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D696662286%27 HTTP/1.1" 200 None
2026-03-28 14:02:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=696662286 not downloaded yet
2026-03-28 14:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698928826%27 HTTP/1.1" 200 None
2026-03-28 14:02:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698928826 not downloaded yet
2026-03-28 14:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698269135%27 HTTP/1.1" 200 None
2026-03-28 14:02:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698269135 not downloaded yet
2026-03-28 14:02:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:02:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c647310>
2026-03-28 14:02:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:02:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:02:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:02:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f1c7ee15-186c-50e6-9aec-cc206e8adf16/f1c7ee15-186c-50e6-9aec-cc206e8adf16_expert_report_file_c052d70c-a4a6-4368-ab2d-bb3d6c4359d2.pdf HTTP/1.1" 201 0
2026-03-28 14:02:30 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item f1c7ee15-186c-50e6-9aec-cc206e8adf16
2026-03-28 14:02:30 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: f1c7ee15-186c-50e6-9aec-cc206e8adf16, skipping ID generation
2026-03-28 14:02:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item f1c7ee15-186c-50e6-9aec-cc206e8adf16
2026-03-28 14:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DRE12OHA-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-28 14:02:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=RE12OHA-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-28 14:02:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:02:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2d73d3d0>
2026-03-28 14:02:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:02:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:02:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:02:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_306d9676-19ce-5840-84c5-e10231e34614/306d9676-19ce-5840-84c5-e10231e34614_expert_report_file_45d2b5c5-bd72-432b-b1e0-528609585745.pdf HTTP/1.1" 201 0
2026-03-28 14:02:30 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item 306d9676-19ce-5840-84c5-e10231e34614
2026-03-28 14:02:30 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 306d9676-19ce-5840-84c5-e10231e34614, skipping ID generation
2026-03-28 14:02:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 306d9676-19ce-5840-84c5-e10231e34614
2026-03-28 14:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DVE67DLJ-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-28 14:02:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=VE67DLJ-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-28 14:02:30 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:02:30 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:02:30 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:02:30 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:02:30 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:02:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:02:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a1ff2ee90>
2026-03-28 14:02:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:02:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:02:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:02:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cdcc838c-10d3-5f36-90c6-59ef07eececc/cdcc838c-10d3-5f36-90c6-59ef07eececc_image_8.jpg HTTP/1.1" 201 0
2026-03-28 14:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FGF57MWW%252F698928941%252F600') HTTP/1.1" 204 0
2026-03-28 14:02:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GF57MWW/698928941/600 saved to cache
2026-03-28 14:02:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item cdcc838c-10d3-5f36-90c6-59ef07eececc
2026-03-28 14:02:30 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:02:30 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:02:30 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:02:30 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:02:30 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:02:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:02:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2d6b4cd0>
2026-03-28 14:02:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:02:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:02:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:02:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f5f9bed7-96bb-5ef8-8a52-e232dbf0b7d5/f5f9bed7-96bb-5ef8-8a52-e232dbf0b7d5_image_9.jpg HTTP/1.1" 201 0
2026-03-28 14:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FEX10BXE%252F698923535%252F600') HTTP/1.1" 204 0
2026-03-28 14:02:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EX10BXE/698923535/600 saved to cache
2026-03-28 14:02:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item f5f9bed7-96bb-5ef8-8a52-e232dbf0b7d5
2026-03-28 14:02:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:02:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2d73c590>
2026-03-28 14:02:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:02:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:02:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:02:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e944d65b-4e9e-513c-a6ae-acea2437087d/e944d65b-4e9e-513c-a6ae-acea2437087d_expert_report_file_a17ed9c9-c38a-4a9b-b3f7-7c5f016d55cc.pdf HTTP/1.1" 201 0
2026-03-28 14:02:30 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item e944d65b-4e9e-513c-a6ae-acea2437087d
2026-03-28 14:02:30 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: e944d65b-4e9e-513c-a6ae-acea2437087d, skipping ID generation
2026-03-28 14:02:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item e944d65b-4e9e-513c-a6ae-acea2437087d
2026-03-28 14:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DKM67WBP-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-28 14:02:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=KM67WBP-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-28 14:02:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:02:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c71d210>
2026-03-28 14:02:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:02:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:02:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:02:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_76904bbf-2ca2-5c17-a3c3-eefa3b562aab/76904bbf-2ca2-5c17-a3c3-eefa3b562aab_expert_report_file_6ad985d2-db8e-4e51-a999-eb5c42d27aff.pdf HTTP/1.1" 201 0
2026-03-28 14:02:30 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item 76904bbf-2ca2-5c17-a3c3-eefa3b562aab
2026-03-28 14:02:30 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 76904bbf-2ca2-5c17-a3c3-eefa3b562aab, skipping ID generation
2026-03-28 14:02:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 76904bbf-2ca2-5c17-a3c3-eefa3b562aab
2026-03-28 14:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DSB72GWA-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-28 14:02:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=SB72GWA-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-28 14:02:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:02:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2d69dfd0>
2026-03-28 14:02:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:02:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:02:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:02:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_98f6010a-0356-55b3-9d9f-fbc61b9e1410/98f6010a-0356-55b3-9d9f-fbc61b9e1410_image_0.jpg HTTP/1.1" 201 0
2026-03-28 14:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FYC72AVN%252F698691008%252F600') HTTP/1.1" 204 0
2026-03-28 14:02:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YC72AVN/698691008/600 saved to cache
2026-03-28 14:02:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 98f6010a-0356-55b3-9d9f-fbc61b9e1410
2026-03-28 14:02:30 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WP62XCK/697615097/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=697615097>
2026-03-28 14:02:30 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EP19XHA/698568351/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=EP19XHA-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-28 14:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698094197%27 HTTP/1.1" 200 None
2026-03-28 14:02:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698094197 not downloaded yet
2026-03-28 14:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D697615142%27 HTTP/1.1" 200 None
2026-03-28 14:02:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=697615142 not downloaded yet
2026-03-28 14:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698923380%27 HTTP/1.1" 200 None
2026-03-28 14:02:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698923380 not downloaded yet
2026-03-28 14:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698568458%27 HTTP/1.1" 200 None
2026-03-28 14:02:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698568458 not downloaded yet
2026-03-28 14:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698934033%27 HTTP/1.1" 200 None
2026-03-28 14:02:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698934033 not downloaded yet
2026-03-28 14:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698765281%27 HTTP/1.1" 200 None
2026-03-28 14:02:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698765281 not downloaded yet
2026-03-28 14:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D696662290%27 HTTP/1.1" 200 None
2026-03-28 14:02:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=696662290 not downloaded yet
2026-03-28 14:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698928845%27 HTTP/1.1" 200 None
2026-03-28 14:02:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698928845 not downloaded yet
2026-03-28 14:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698269139%27 HTTP/1.1" 200 None
2026-03-28 14:02:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698269139 not downloaded yet
2026-03-28 14:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698568353%27 HTTP/1.1" 200 None
2026-03-28 14:02:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698568353 not downloaded yet
2026-03-28 14:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D697994961%27 HTTP/1.1" 200 None
2026-03-28 14:02:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=697994961 not downloaded yet
2026-03-28 14:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D697678266%27 HTTP/1.1" 200 None
2026-03-28 14:02:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=697678266 not downloaded yet
2026-03-28 14:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698536906%27 HTTP/1.1" 200 None
2026-03-28 14:02:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698536906 not downloaded yet
2026-03-28 14:02:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/ND17WHW/42810327?sv=2020-08-04&st=2026-03-28T14%3A02%3A29Z&se=2026-03-28T14%3A27%3A29Z&sr=b&sp=r&sig=zynQuQSfNuyDXNRKcXA5HSV08c7JnCbvGT8UtSuSUac%3D> (referer: https://www.bca.co.uk/)
2026-03-28 14:02:31 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KR14OUW/696662274/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=KR14OUW-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-28 14:02:31 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HV58YJY/698928767/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=HV58YJY-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-28 14:02:31 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RE03XJT/698933956/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=RE03XJT-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-28 14:02:31 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EP19XHA/698568369/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698568369>
2026-03-28 14:02:31 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CY68EOB/698765188/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=CY68EOB-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-28 14:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698923415%27 HTTP/1.1" 200 None
2026-03-28 14:02:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698923415 not downloaded yet
2026-03-28 14:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698568502%27 HTTP/1.1" 200 None
2026-03-28 14:02:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698568502 not downloaded yet
2026-03-28 14:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698934050%27 HTTP/1.1" 200 None
2026-03-28 14:02:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698934050 not downloaded yet
2026-03-28 14:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698765300%27 HTTP/1.1" 200 None
2026-03-28 14:02:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698765300 not downloaded yet
2026-03-28 14:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D696662294%27 HTTP/1.1" 200 None
2026-03-28 14:02:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=696662294 not downloaded yet
2026-03-28 14:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698928865%27 HTTP/1.1" 200 None
2026-03-28 14:02:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698928865 not downloaded yet
2026-03-28 14:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698269145%27 HTTP/1.1" 200 None
2026-03-28 14:02:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698269145 not downloaded yet
2026-03-28 14:02:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:02:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2d69fdd0>
2026-03-28 14:02:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:02:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:02:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:02:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_59e0d1bf-73d7-5811-a0ff-a2a694262d4e/59e0d1bf-73d7-5811-a0ff-a2a694262d4e_expert_report_file_56d35aaf-d3cc-4239-97ad-a0c10aaf29e9.pdf HTTP/1.1" 201 0
2026-03-28 14:02:31 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item 59e0d1bf-73d7-5811-a0ff-a2a694262d4e
2026-03-28 14:02:31 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 59e0d1bf-73d7-5811-a0ff-a2a694262d4e, skipping ID generation
2026-03-28 14:02:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 59e0d1bf-73d7-5811-a0ff-a2a694262d4e
2026-03-28 14:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DLX66XGU-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-28 14:02:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=LX66XGU-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-28 14:02:31 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KR14OUW/696662276/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=696662276>
2026-03-28 14:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698568381%27 HTTP/1.1" 200 None
2026-03-28 14:02:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698568381 not downloaded yet
2026-03-28 14:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D697994966%27 HTTP/1.1" 200 None
2026-03-28 14:02:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=697994966 not downloaded yet
2026-03-28 14:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D697678295%27 HTTP/1.1" 200 None
2026-03-28 14:02:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=697678295 not downloaded yet
2026-03-28 14:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698536917%27 HTTP/1.1" 200 None
2026-03-28 14:02:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698536917 not downloaded yet
2026-03-28 14:02:31 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HV58YJY/698928790/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698928790>
2026-03-28 14:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698923447%27 HTTP/1.1" 200 None
2026-03-28 14:02:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698923447 not downloaded yet
2026-03-28 14:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698568540%27 HTTP/1.1" 200 None
2026-03-28 14:02:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698568540 not downloaded yet
2026-03-28 14:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698934068%27 HTTP/1.1" 200 None
2026-03-28 14:02:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698934068 not downloaded yet
2026-03-28 14:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698765328%27 HTTP/1.1" 200 None
2026-03-28 14:02:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698765328 not downloaded yet
2026-03-28 14:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D696662301%27 HTTP/1.1" 200 None
2026-03-28 14:02:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=696662301 not downloaded yet
2026-03-28 14:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698928892%27 HTTP/1.1" 200 None
2026-03-28 14:02:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698928892 not downloaded yet
2026-03-28 14:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698269149%27 HTTP/1.1" 200 None
2026-03-28 14:02:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698269149 not downloaded yet
2026-03-28 14:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698585735%27 HTTP/1.1" 200 None
2026-03-28 14:02:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698585735 not downloaded yet
2026-03-28 14:02:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SM67VNV/698094046/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/SM67VNV/42810251?sv=2020-08-04&st=2026-03-28T14%3A02%3A21Z&se=2026-03-28T14%3A27%3A21Z&sr=b&sp=r&sig=zKf9cm3c2GLLDCKC9h0Kq9J3NSEBcqSIr7bWiyg1hwQ%3D)
2026-03-28 14:02:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YC72AVN/698691080/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YC72AVN/42810244?sv=2020-08-04&st=2026-03-28T14%3A02%3A20Z&se=2026-03-28T14%3A27%3A20Z&sr=b&sp=r&sig=beG5fN%2BBH0Z%2FDIpkhCSt8zTlTgu277%2B2D8NvIf%2FKCVY%3D)
2026-03-28 14:02:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WP62XCK/697615090/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/WP62XCK/42810245?sv=2020-08-04&st=2026-03-28T14%3A02%3A21Z&se=2026-03-28T14%3A27%3A21Z&sr=b&sp=r&sig=gyEdXM91VrVknbZjiLD2toi%2BgCj7hBqRBYqi3Ts%2BfeU%3D)
2026-03-28 14:02:31 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RF08TZP/698938767/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698938767>
2026-03-28 14:02:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RF08TZP/698938702/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/RF08TZP/42781844?sv=2020-08-04&st=2026-03-28T14%3A02%3A20Z&se=2026-03-28T14%3A27%3A20Z&sr=b&sp=r&sig=6hLicjIfZGVTK7BLacvGBl2SaFBQyybl9CGTh8APRd8%3D)
2026-03-28 14:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698568399%27 HTTP/1.1" 200 None
2026-03-28 14:02:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698568399 not downloaded yet
2026-03-28 14:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D697994969%27 HTTP/1.1" 200 None
2026-03-28 14:02:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=697994969 not downloaded yet
2026-03-28 14:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D697678309%27 HTTP/1.1" 200 None
2026-03-28 14:02:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=697678309 not downloaded yet
2026-03-28 14:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698536925%27 HTTP/1.1" 200 None
2026-03-28 14:02:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698536925 not downloaded yet
2026-03-28 14:02:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:02:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a1fd93f10>
2026-03-28 14:02:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:02:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:02:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:02:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_31c4dc0e-1523-5c6f-a08c-e446dee9483c/31c4dc0e-1523-5c6f-a08c-e446dee9483c_expert_report_file_68f741c4-2c99-4b2e-a236-9666ccc0eb51.pdf HTTP/1.1" 201 0
2026-03-28 14:02:31 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item 31c4dc0e-1523-5c6f-a08c-e446dee9483c
2026-03-28 14:02:31 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 31c4dc0e-1523-5c6f-a08c-e446dee9483c, skipping ID generation
2026-03-28 14:02:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 31c4dc0e-1523-5c6f-a08c-e446dee9483c
2026-03-28 14:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DND17WHW-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-28 14:02:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=ND17WHW-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-28 14:02:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RF08TZP/698938695/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/RF08TZP/42781844?sv=2020-08-04&st=2026-03-28T14%3A02%3A20Z&se=2026-03-28T14%3A27%3A20Z&sr=b&sp=r&sig=6hLicjIfZGVTK7BLacvGBl2SaFBQyybl9CGTh8APRd8%3D)
2026-03-28 14:02:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EP19XHA/698568351/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/EP19XHA/42803467?sv=2020-08-04&st=2026-03-28T14%3A02%3A25Z&se=2026-03-28T14%3A27%3A25Z&sr=b&sp=r&sig=3aXptHZNTY1xw5UUqyLl7yubHBPKRq5U01kDhdsbsYM%3D)
2026-03-28 14:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698923476%27 HTTP/1.1" 200 None
2026-03-28 14:02:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698923476 not downloaded yet
2026-03-28 14:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698568581%27 HTTP/1.1" 200 None
2026-03-28 14:02:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698568581 not downloaded yet
2026-03-28 14:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698934082%27 HTTP/1.1" 200 None
2026-03-28 14:02:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698934082 not downloaded yet
2026-03-28 14:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698765358%27 HTTP/1.1" 200 None
2026-03-28 14:02:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698765358 not downloaded yet
2026-03-28 14:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D696662307%27 HTTP/1.1" 200 None
2026-03-28 14:02:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=696662307 not downloaded yet
2026-03-28 14:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698928917%27 HTTP/1.1" 200 None
2026-03-28 14:02:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698928917 not downloaded yet
2026-03-28 14:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698269156%27 HTTP/1.1" 200 None
2026-03-28 14:02:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698269156 not downloaded yet
2026-03-28 14:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698585748%27 HTTP/1.1" 200 None
2026-03-28 14:02:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698585748 not downloaded yet
2026-03-28 14:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698568423%27 HTTP/1.1" 200 None
2026-03-28 14:02:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698568423 not downloaded yet
2026-03-28 14:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D697994972%27 HTTP/1.1" 200 None
2026-03-28 14:02:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=697994972 not downloaded yet
2026-03-28 14:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D697678321%27 HTTP/1.1" 200 None
2026-03-28 14:02:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=697678321 not downloaded yet
2026-03-28 14:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698536931%27 HTTP/1.1" 200 None
2026-03-28 14:02:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698536931 not downloaded yet
2026-03-28 14:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698647261%27 HTTP/1.1" 200 None
2026-03-28 14:02:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698647261 not downloaded yet
2026-03-28 14:02:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EP19XHA/698568369/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/EP19XHA/42803467?sv=2020-08-04&st=2026-03-28T14%3A02%3A25Z&se=2026-03-28T14%3A27%3A25Z&sr=b&sp=r&sig=3aXptHZNTY1xw5UUqyLl7yubHBPKRq5U01kDhdsbsYM%3D)
2026-03-28 14:02:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KR14OUW/696662274/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/KR14OUW/42810276?sv=2020-08-04&st=2026-03-28T14%3A02%3A25Z&se=2026-03-28T14%3A27%3A25Z&sr=b&sp=r&sig=yD0HrAKd1eOENYPcHLYCjZQ9zljwYHJA7s3b8Za%2BpDw%3D)
2026-03-28 14:02:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HV58YJY/698928767/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/HV58YJY/42810015?sv=2020-08-04&st=2026-03-28T14%3A02%3A25Z&se=2026-03-28T14%3A27%3A25Z&sr=b&sp=r&sig=4E7oaf6jl0JMYjcpc4K4%2F3uy5%2BGOvEW6yFoZ9j75kNU%3D)
2026-03-28 14:02:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RE03XJT/698933956/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/RE03XJT/42810438?sv=2020-08-04&st=2026-03-28T14%3A02%3A25Z&se=2026-03-28T14%3A27%3A25Z&sr=b&sp=r&sig=W%2BmiGFHKvJXzfBcOMLhIRCoLkA3AzDMDP5bgxDrTPQQ%3D)
2026-03-28 14:02:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CY68EOB/698765188/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/CY68EOB/42807353?sv=2020-08-04&st=2026-03-28T14%3A02%3A25Z&se=2026-03-28T14%3A27%3A25Z&sr=b&sp=r&sig=VhOAFQtPLoY4JTixFnYBwYrQPfJNMc8rMp4NstNU2cM%3D)
2026-03-28 14:02:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WP62XCK/697615097/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/WP62XCK/42810245?sv=2020-08-04&st=2026-03-28T14%3A02%3A21Z&se=2026-03-28T14%3A27%3A21Z&sr=b&sp=r&sig=gyEdXM91VrVknbZjiLD2toi%2BgCj7hBqRBYqi3Ts%2BfeU%3D)
2026-03-28 14:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698923504%27 HTTP/1.1" 200 None
2026-03-28 14:02:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698923504 not downloaded yet
2026-03-28 14:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698568618%27 HTTP/1.1" 200 None
2026-03-28 14:02:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698568618 not downloaded yet
2026-03-28 14:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698934102%27 HTTP/1.1" 200 None
2026-03-28 14:02:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698934102 not downloaded yet
2026-03-28 14:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698765391%27 HTTP/1.1" 200 None
2026-03-28 14:02:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698765391 not downloaded yet
2026-03-28 14:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D696662309%27 HTTP/1.1" 200 None
2026-03-28 14:02:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=696662309 not downloaded yet
2026-03-28 14:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698928951%27 HTTP/1.1" 200 None
2026-03-28 14:02:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698928951 not downloaded yet
2026-03-28 14:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698269165%27 HTTP/1.1" 200 None
2026-03-28 14:02:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698269165 not downloaded yet
2026-03-28 14:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698585766%27 HTTP/1.1" 200 None
2026-03-28 14:02:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698585766 not downloaded yet
2026-03-28 14:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698568448%27 HTTP/1.1" 200 None
2026-03-28 14:02:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698568448 not downloaded yet
2026-03-28 14:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D697994975%27 HTTP/1.1" 200 None
2026-03-28 14:02:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=697994975 not downloaded yet
2026-03-28 14:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D697678338%27 HTTP/1.1" 200 None
2026-03-28 14:02:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=697678338 not downloaded yet
2026-03-28 14:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698536946%27 HTTP/1.1" 200 None
2026-03-28 14:02:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698536946 not downloaded yet
2026-03-28 14:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698647276%27 HTTP/1.1" 200 None
2026-03-28 14:02:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698647276 not downloaded yet
2026-03-28 14:02:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:02:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2d7250d0>
2026-03-28 14:02:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:02:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:02:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:02:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e4b35cfb-486e-55d8-b302-6ece660ab632/e4b35cfb-486e-55d8-b302-6ece660ab632_image_0.jpg HTTP/1.1" 201 0
2026-03-28 14:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FSM67VNV%252F698094046%252F600') HTTP/1.1" 204 0
2026-03-28 14:02:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SM67VNV/698094046/600 saved to cache
2026-03-28 14:02:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item e4b35cfb-486e-55d8-b302-6ece660ab632
2026-03-28 14:02:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:02:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2de36f10>
2026-03-28 14:02:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:02:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:02:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:02:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_98f6010a-0356-55b3-9d9f-fbc61b9e1410/98f6010a-0356-55b3-9d9f-fbc61b9e1410_image_4.jpg HTTP/1.1" 201 0
2026-03-28 14:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FYC72AVN%252F698691080%252F600') HTTP/1.1" 204 0
2026-03-28 14:02:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YC72AVN/698691080/600 saved to cache
2026-03-28 14:02:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 98f6010a-0356-55b3-9d9f-fbc61b9e1410
2026-03-28 14:02:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:02:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2d800a50>
2026-03-28 14:02:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:02:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:02:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:02:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_017f335f-f1b9-5de8-8cb9-bc79c2d2f45f/017f335f-f1b9-5de8-8cb9-bc79c2d2f45f_image_0.jpg HTTP/1.1" 201 0
2026-03-28 14:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FWP62XCK%252F697615090%252F600') HTTP/1.1" 204 0
2026-03-28 14:02:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WP62XCK/697615090/600 saved to cache
2026-03-28 14:02:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 017f335f-f1b9-5de8-8cb9-bc79c2d2f45f
2026-03-28 14:02:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:02:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c659f10>
2026-03-28 14:02:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:02:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:02:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:02:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0db89969-308f-54b4-910e-308fd1f55fa4/0db89969-308f-54b4-910e-308fd1f55fa4_image_4.jpg HTTP/1.1" 201 0
2026-03-28 14:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FRF08TZP%252F698938702%252F600') HTTP/1.1" 204 0
2026-03-28 14:02:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RF08TZP/698938702/600 saved to cache
2026-03-28 14:02:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 0db89969-308f-54b4-910e-308fd1f55fa4
2026-03-28 14:02:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:02:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2d675390>
2026-03-28 14:02:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:02:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:02:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:02:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0db89969-308f-54b4-910e-308fd1f55fa4/0db89969-308f-54b4-910e-308fd1f55fa4_image_3.jpg HTTP/1.1" 201 0
2026-03-28 14:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FRF08TZP%252F698938695%252F600') HTTP/1.1" 204 0
2026-03-28 14:02:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RF08TZP/698938695/600 saved to cache
2026-03-28 14:02:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 0db89969-308f-54b4-910e-308fd1f55fa4
2026-03-28 14:02:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:02:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2d82b550>
2026-03-28 14:02:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:02:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:02:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:02:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_85df4e80-1e5a-5573-ad99-0445a298364d/85df4e80-1e5a-5573-ad99-0445a298364d_image_0.jpg HTTP/1.1" 201 0
2026-03-28 14:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FEP19XHA%252F698568351%252F600') HTTP/1.1" 204 0
2026-03-28 14:02:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EP19XHA/698568351/600 saved to cache
2026-03-28 14:02:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 85df4e80-1e5a-5573-ad99-0445a298364d
2026-03-28 14:02:32 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BO55VOP/698269139/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698269139>
2026-03-28 14:02:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KR14OUW/696662276/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/KR14OUW/42810276?sv=2020-08-04&st=2026-03-28T14%3A02%3A25Z&se=2026-03-28T14%3A27%3A25Z&sr=b&sp=r&sig=yD0HrAKd1eOENYPcHLYCjZQ9zljwYHJA7s3b8Za%2BpDw%3D)
2026-03-28 14:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698934114%27 HTTP/1.1" 200 None
2026-03-28 14:02:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698934114 not downloaded yet
2026-03-28 14:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698765416%27 HTTP/1.1" 200 None
2026-03-28 14:02:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698765416 not downloaded yet
2026-03-28 14:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D696662314%27 HTTP/1.1" 200 None
2026-03-28 14:02:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=696662314 not downloaded yet
2026-03-28 14:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698928972%27 HTTP/1.1" 200 None
2026-03-28 14:02:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698928972 not downloaded yet
2026-03-28 14:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698269171%27 HTTP/1.1" 200 None
2026-03-28 14:02:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698269171 not downloaded yet
2026-03-28 14:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698585778%27 HTTP/1.1" 200 None
2026-03-28 14:02:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698585778 not downloaded yet
2026-03-28 14:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698568488%27 HTTP/1.1" 200 None
2026-03-28 14:02:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698568488 not downloaded yet
2026-03-28 14:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D697994981%27 HTTP/1.1" 200 None
2026-03-28 14:02:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=697994981 not downloaded yet
2026-03-28 14:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D697678357%27 HTTP/1.1" 200 None
2026-03-28 14:02:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=697678357 not downloaded yet
2026-03-28 14:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698536958%27 HTTP/1.1" 200 None
2026-03-28 14:02:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698536958 not downloaded yet
2026-03-28 14:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698647291%27 HTTP/1.1" 200 None
2026-03-28 14:02:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698647291 not downloaded yet
2026-03-28 14:02:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:02:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2d9fbdd0>
2026-03-28 14:02:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:02:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:02:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:02:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_85df4e80-1e5a-5573-ad99-0445a298364d/85df4e80-1e5a-5573-ad99-0445a298364d_image_1.jpg HTTP/1.1" 201 0
2026-03-28 14:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FEP19XHA%252F698568369%252F600') HTTP/1.1" 204 0
2026-03-28 14:02:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EP19XHA/698568369/600 saved to cache
2026-03-28 14:02:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 85df4e80-1e5a-5573-ad99-0445a298364d
2026-03-28 14:02:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:02:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2d9a7f90>
2026-03-28 14:02:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:02:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:02:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:02:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5096b957-ac5c-5cc4-a891-49042e75677e/5096b957-ac5c-5cc4-a891-49042e75677e_image_0.jpg HTTP/1.1" 201 0
2026-03-28 14:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FKR14OUW%252F696662274%252F600') HTTP/1.1" 204 0
2026-03-28 14:02:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KR14OUW/696662274/600 saved to cache
2026-03-28 14:02:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 5096b957-ac5c-5cc4-a891-49042e75677e
2026-03-28 14:02:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:02:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c402050>
2026-03-28 14:02:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:02:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:02:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:02:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8b64f21f-1ee3-5237-8105-b88b835030a8/8b64f21f-1ee3-5237-8105-b88b835030a8_image_0.jpg HTTP/1.1" 201 0
2026-03-28 14:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FHV58YJY%252F698928767%252F600') HTTP/1.1" 204 0
2026-03-28 14:02:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HV58YJY/698928767/600 saved to cache
2026-03-28 14:02:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 8b64f21f-1ee3-5237-8105-b88b835030a8
2026-03-28 14:02:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:02:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a1fd58d10>
2026-03-28 14:02:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:02:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:02:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:02:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0d8a0ea5-df55-5526-b46c-23b49b8e0dc3/0d8a0ea5-df55-5526-b46c-23b49b8e0dc3_image_0.jpg HTTP/1.1" 201 0
2026-03-28 14:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FRE03XJT%252F698933956%252F600') HTTP/1.1" 204 0
2026-03-28 14:02:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RE03XJT/698933956/600 saved to cache
2026-03-28 14:02:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 0d8a0ea5-df55-5526-b46c-23b49b8e0dc3
2026-03-28 14:02:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:02:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c400dd0>
2026-03-28 14:02:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:02:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:02:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:02:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_299c12ca-ac8c-5489-8f0d-0d144c80340f/299c12ca-ac8c-5489-8f0d-0d144c80340f_image_0.jpg HTTP/1.1" 201 0
2026-03-28 14:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FCY68EOB%252F698765188%252F600') HTTP/1.1" 204 0
2026-03-28 14:02:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CY68EOB/698765188/600 saved to cache
2026-03-28 14:02:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 299c12ca-ac8c-5489-8f0d-0d144c80340f
2026-03-28 14:02:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:02:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c5f1e90>
2026-03-28 14:02:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:02:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:02:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:02:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_017f335f-f1b9-5de8-8cb9-bc79c2d2f45f/017f335f-f1b9-5de8-8cb9-bc79c2d2f45f_image_1.jpg HTTP/1.1" 201 0
2026-03-28 14:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FWP62XCK%252F697615097%252F600') HTTP/1.1" 204 0
2026-03-28 14:02:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WP62XCK/697615097/600 saved to cache
2026-03-28 14:02:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 017f335f-f1b9-5de8-8cb9-bc79c2d2f45f
2026-03-28 14:02:32 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SB72GWA/698536917/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698536917>
2026-03-28 14:02:32 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KM67WBP/697678295/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=697678295>
2026-03-28 14:02:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HV58YJY/698928790/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/HV58YJY/42810015?sv=2020-08-04&st=2026-03-28T14%3A02%3A25Z&se=2026-03-28T14%3A27%3A25Z&sr=b&sp=r&sig=4E7oaf6jl0JMYjcpc4K4%2F3uy5%2BGOvEW6yFoZ9j75kNU%3D)
2026-03-28 14:02:32 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RE12OHA/698568381/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698568381>
2026-03-28 14:02:32 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VE67DLJ/697994966/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=697994966>
2026-03-28 14:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698269180%27 HTTP/1.1" 200 None
2026-03-28 14:02:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698269180 not downloaded yet
2026-03-28 14:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698585790%27 HTTP/1.1" 200 None
2026-03-28 14:02:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698585790 not downloaded yet
2026-03-28 14:02:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RF08TZP/698938767/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/RF08TZP/42781844?sv=2020-08-04&st=2026-03-28T14%3A02%3A20Z&se=2026-03-28T14%3A27%3A20Z&sr=b&sp=r&sig=6hLicjIfZGVTK7BLacvGBl2SaFBQyybl9CGTh8APRd8%3D)
2026-03-28 14:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698568527%27 HTTP/1.1" 200 None
2026-03-28 14:02:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698568527 not downloaded yet
2026-03-28 14:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D697994988%27 HTTP/1.1" 200 None
2026-03-28 14:02:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=697994988 not downloaded yet
2026-03-28 14:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D697678374%27 HTTP/1.1" 200 None
2026-03-28 14:02:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=697678374 not downloaded yet
2026-03-28 14:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698536975%27 HTTP/1.1" 200 None
2026-03-28 14:02:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698536975 not downloaded yet
2026-03-28 14:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698647300%27 HTTP/1.1" 200 None
2026-03-28 14:02:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698647300 not downloaded yet
2026-03-28 14:02:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:02:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c3d2350>
2026-03-28 14:02:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:02:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:02:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:02:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5096b957-ac5c-5cc4-a891-49042e75677e/5096b957-ac5c-5cc4-a891-49042e75677e_image_1.jpg HTTP/1.1" 201 0
2026-03-28 14:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FKR14OUW%252F696662276%252F600') HTTP/1.1" 204 0
2026-03-28 14:02:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KR14OUW/696662276/600 saved to cache
2026-03-28 14:02:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 5096b957-ac5c-5cc4-a891-49042e75677e
2026-03-28 14:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698269189%27 HTTP/1.1" 200 None
2026-03-28 14:02:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698269189 not downloaded yet
2026-03-28 14:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698585807%27 HTTP/1.1" 200 None
2026-03-28 14:02:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698585807 not downloaded yet
2026-03-28 14:02:33 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/ND17WHW/698647248/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=ND17WHW-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-28 14:02:33 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SB72GWA/698536925/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698536925>
2026-03-28 14:02:33 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RE12OHA/698568423/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698568423>
2026-03-28 14:02:33 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KM67WBP/697678321/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=697678321>
2026-03-28 14:02:33 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SB72GWA/698536931/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698536931>
2026-03-28 14:02:33 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VE67DLJ/697994972/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=697994972>
2026-03-28 14:02:33 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/ND17WHW/698647261/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698647261>
2026-03-28 14:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698568562%27 HTTP/1.1" 200 None
2026-03-28 14:02:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698568562 not downloaded yet
2026-03-28 14:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D697994994%27 HTTP/1.1" 200 None
2026-03-28 14:02:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=697994994 not downloaded yet
2026-03-28 14:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D697678382%27 HTTP/1.1" 200 None
2026-03-28 14:02:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=697678382 not downloaded yet
2026-03-28 14:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698536990%27 HTTP/1.1" 200 None
2026-03-28 14:02:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698536990 not downloaded yet
2026-03-28 14:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698647314%27 HTTP/1.1" 200 None
2026-03-28 14:02:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698647314 not downloaded yet
2026-03-28 14:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698585847%27 HTTP/1.1" 200 None
2026-03-28 14:02:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698585847 not downloaded yet
2026-03-28 14:02:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:02:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c0cce10>
2026-03-28 14:02:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:02:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:02:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:02:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8b64f21f-1ee3-5237-8105-b88b835030a8/8b64f21f-1ee3-5237-8105-b88b835030a8_image_1.jpg HTTP/1.1" 201 0
2026-03-28 14:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FHV58YJY%252F698928790%252F600') HTTP/1.1" 204 0
2026-03-28 14:02:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HV58YJY/698928790/600 saved to cache
2026-03-28 14:02:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 8b64f21f-1ee3-5237-8105-b88b835030a8
2026-03-28 14:02:33 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:02:33 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:02:33 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:02:33 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:02:33 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:02:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:02:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a1fd12150>
2026-03-28 14:02:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:02:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:02:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:02:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0db89969-308f-54b4-910e-308fd1f55fa4/0db89969-308f-54b4-910e-308fd1f55fa4_image_9.jpg HTTP/1.1" 201 0
2026-03-28 14:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FRF08TZP%252F698938767%252F600') HTTP/1.1" 204 0
2026-03-28 14:02:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RF08TZP/698938767/600 saved to cache
2026-03-28 14:02:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 0db89969-308f-54b4-910e-308fd1f55fa4
2026-03-28 14:02:33 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LX66XGU/698585748/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698585748>
2026-03-28 14:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698568602%27 HTTP/1.1" 200 None
2026-03-28 14:02:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698568602 not downloaded yet
2026-03-28 14:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D697995002%27 HTTP/1.1" 200 None
2026-03-28 14:02:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=697995002 not downloaded yet
2026-03-28 14:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D697678387%27 HTTP/1.1" 200 None
2026-03-28 14:02:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=697678387 not downloaded yet
2026-03-28 14:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698537005%27 HTTP/1.1" 200 None
2026-03-28 14:02:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698537005 not downloaded yet
2026-03-28 14:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698647327%27 HTTP/1.1" 200 None
2026-03-28 14:02:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698647327 not downloaded yet
2026-03-28 14:02:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BO55VOP/698269139/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/BO55VOP/42810137?sv=2020-08-04&st=2026-03-28T14%3A02%3A26Z&se=2026-03-28T14%3A27%3A26Z&sr=b&sp=r&sig=ClLegZn5u1dkNPwcbCwa7jDTCtqtY8g86xpgxUm2UfM%3D)
2026-03-28 14:02:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RE12OHA/698568381/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/RE12OHA/42803024?sv=2020-08-04&st=2026-03-28T14%3A02%3A26Z&se=2026-03-28T14%3A27%3A26Z&sr=b&sp=r&sig=6BH8YhGE%2FtZL7bPaACcZWXnEkdIvYtNlALyKqaLOq1E%3D)
2026-03-28 14:02:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KM67WBP/697678295/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/KM67WBP/42809464?sv=2020-08-04&st=2026-03-28T14%3A02%3A27Z&se=2026-03-28T14%3A27%3A27Z&sr=b&sp=r&sig=TFQrF%2FjkhRPUwB62qt8YSavHgBqeuo7q2b9lsdnq4W8%3D)
2026-03-28 14:02:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SB72GWA/698536917/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/SB72GWA/42810143?sv=2020-08-04&st=2026-03-28T14%3A02%3A28Z&se=2026-03-28T14%3A27%3A28Z&sr=b&sp=r&sig=COnND%2FooxrhanQtXLj4FeOKa%2Fkcoi5LKjGkYGyTn0a4%3D)
2026-03-28 14:02:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VE67DLJ/697994966/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/VE67DLJ/42810299?sv=2020-08-04&st=2026-03-28T14%3A02%3A26Z&se=2026-03-28T14%3A27%3A26Z&sr=b&sp=r&sig=s%2BFYsI609HRDhg5CyGwQVAsfiplztmlKAHuHQLONuoQ%3D)
2026-03-28 14:02:33 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/ND17WHW/698647276/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698647276>
2026-03-28 14:02:33 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LX66XGU/698585778/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698585778>
2026-03-28 14:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698585871%27 HTTP/1.1" 200 None
2026-03-28 14:02:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698585871 not downloaded yet
2026-03-28 14:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698647345%27 HTTP/1.1" 200 None
2026-03-28 14:02:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698647345 not downloaded yet
2026-03-28 14:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698585883%27 HTTP/1.1" 200 None
2026-03-28 14:02:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698585883 not downloaded yet
2026-03-28 14:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698647361%27 HTTP/1.1" 200 None
2026-03-28 14:02:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698647361 not downloaded yet
2026-03-28 14:02:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/ND17WHW/698647248/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/ND17WHW/42810327?sv=2020-08-04&st=2026-03-28T14%3A02%3A29Z&se=2026-03-28T14%3A27%3A29Z&sr=b&sp=r&sig=zynQuQSfNuyDXNRKcXA5HSV08c7JnCbvGT8UtSuSUac%3D)
2026-03-28 14:02:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RE12OHA/698568423/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/RE12OHA/42803024?sv=2020-08-04&st=2026-03-28T14%3A02%3A26Z&se=2026-03-28T14%3A27%3A26Z&sr=b&sp=r&sig=6BH8YhGE%2FtZL7bPaACcZWXnEkdIvYtNlALyKqaLOq1E%3D)
2026-03-28 14:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698647374%27 HTTP/1.1" 200 None
2026-03-28 14:02:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698647374 not downloaded yet
2026-03-28 14:02:33 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/ND17WHW/698647291/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698647291>
2026-03-28 14:02:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KM67WBP/697678321/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/KM67WBP/42809464?sv=2020-08-04&st=2026-03-28T14%3A02%3A27Z&se=2026-03-28T14%3A27%3A27Z&sr=b&sp=r&sig=TFQrF%2FjkhRPUwB62qt8YSavHgBqeuo7q2b9lsdnq4W8%3D)
2026-03-28 14:02:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/ND17WHW/698647261/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/ND17WHW/42810327?sv=2020-08-04&st=2026-03-28T14%3A02%3A29Z&se=2026-03-28T14%3A27%3A29Z&sr=b&sp=r&sig=zynQuQSfNuyDXNRKcXA5HSV08c7JnCbvGT8UtSuSUac%3D)
2026-03-28 14:02:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:02:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c743210>
2026-03-28 14:02:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:02:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:02:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:02:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0df2aa72-34d7-5e00-86eb-dff801f0634b/0df2aa72-34d7-5e00-86eb-dff801f0634b_image_2.jpg HTTP/1.1" 201 0
2026-03-28 14:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FBO55VOP%252F698269139%252F600') HTTP/1.1" 204 0
2026-03-28 14:02:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BO55VOP/698269139/600 saved to cache
2026-03-28 14:02:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 0df2aa72-34d7-5e00-86eb-dff801f0634b
2026-03-28 14:02:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:02:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2d79e810>
2026-03-28 14:02:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:02:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:02:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:02:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f1c7ee15-186c-50e6-9aec-cc206e8adf16/f1c7ee15-186c-50e6-9aec-cc206e8adf16_image_2.jpg HTTP/1.1" 201 0
2026-03-28 14:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FRE12OHA%252F698568381%252F600') HTTP/1.1" 204 0
2026-03-28 14:02:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RE12OHA/698568381/600 saved to cache
2026-03-28 14:02:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item f1c7ee15-186c-50e6-9aec-cc206e8adf16
2026-03-28 14:02:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:02:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2d9dd0d0>
2026-03-28 14:02:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:02:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:02:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:02:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e944d65b-4e9e-513c-a6ae-acea2437087d/e944d65b-4e9e-513c-a6ae-acea2437087d_image_2.jpg HTTP/1.1" 201 0
2026-03-28 14:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FKM67WBP%252F697678295%252F600') HTTP/1.1" 204 0
2026-03-28 14:02:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KM67WBP/697678295/600 saved to cache
2026-03-28 14:02:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item e944d65b-4e9e-513c-a6ae-acea2437087d
2026-03-28 14:02:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:02:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2d78d090>
2026-03-28 14:02:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:02:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:02:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:02:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_76904bbf-2ca2-5c17-a3c3-eefa3b562aab/76904bbf-2ca2-5c17-a3c3-eefa3b562aab_image_2.jpg HTTP/1.1" 201 0
2026-03-28 14:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FSB72GWA%252F698536917%252F600') HTTP/1.1" 204 0
2026-03-28 14:02:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SB72GWA/698536917/600 saved to cache
2026-03-28 14:02:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 76904bbf-2ca2-5c17-a3c3-eefa3b562aab
2026-03-28 14:02:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:02:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c58c410>
2026-03-28 14:02:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:02:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:02:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:02:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_306d9676-19ce-5840-84c5-e10231e34614/306d9676-19ce-5840-84c5-e10231e34614_image_2.jpg HTTP/1.1" 201 0
2026-03-28 14:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FVE67DLJ%252F697994966%252F600') HTTP/1.1" 204 0
2026-03-28 14:02:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VE67DLJ/697994966/600 saved to cache
2026-03-28 14:02:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 306d9676-19ce-5840-84c5-e10231e34614
2026-03-28 14:02:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SB72GWA/698536931/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/SB72GWA/42810143?sv=2020-08-04&st=2026-03-28T14%3A02%3A28Z&se=2026-03-28T14%3A27%3A28Z&sr=b&sp=r&sig=COnND%2FooxrhanQtXLj4FeOKa%2Fkcoi5LKjGkYGyTn0a4%3D)
2026-03-28 14:02:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SB72GWA/698536925/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/SB72GWA/42810143?sv=2020-08-04&st=2026-03-28T14%3A02%3A28Z&se=2026-03-28T14%3A27%3A28Z&sr=b&sp=r&sig=COnND%2FooxrhanQtXLj4FeOKa%2Fkcoi5LKjGkYGyTn0a4%3D)
2026-03-28 14:02:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VE67DLJ/697994972/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/VE67DLJ/42810299?sv=2020-08-04&st=2026-03-28T14%3A02%3A26Z&se=2026-03-28T14%3A27%3A26Z&sr=b&sp=r&sig=s%2BFYsI609HRDhg5CyGwQVAsfiplztmlKAHuHQLONuoQ%3D)
2026-03-28 14:02:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/ND17WHW/698647276/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/ND17WHW/42810327?sv=2020-08-04&st=2026-03-28T14%3A02%3A29Z&se=2026-03-28T14%3A27%3A29Z&sr=b&sp=r&sig=zynQuQSfNuyDXNRKcXA5HSV08c7JnCbvGT8UtSuSUac%3D)
2026-03-28 14:02:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LX66XGU/698585748/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LX66XGU/42810324?sv=2020-08-04&st=2026-03-28T14%3A02%3A26Z&se=2026-03-28T14%3A27%3A26Z&sr=b&sp=r&sig=jbz9LK9iyQlEY35Z3G5ue8uqHIh1I8l1GE31H0hzYMg%3D)
2026-03-28 14:02:33 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LX66XGU/698585847/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698585847>
2026-03-28 14:02:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LX66XGU/698585778/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LX66XGU/42810324?sv=2020-08-04&st=2026-03-28T14%3A02%3A26Z&se=2026-03-28T14%3A27%3A26Z&sr=b&sp=r&sig=jbz9LK9iyQlEY35Z3G5ue8uqHIh1I8l1GE31H0hzYMg%3D)
2026-03-28 14:02:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:02:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c3b7890>
2026-03-28 14:02:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:02:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:02:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:02:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_31c4dc0e-1523-5c6f-a08c-e446dee9483c/31c4dc0e-1523-5c6f-a08c-e446dee9483c_image_0.jpg HTTP/1.1" 201 0
2026-03-28 14:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FND17WHW%252F698647248%252F600') HTTP/1.1" 204 0
2026-03-28 14:02:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/ND17WHW/698647248/600 saved to cache
2026-03-28 14:02:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 31c4dc0e-1523-5c6f-a08c-e446dee9483c
2026-03-28 14:02:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:02:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a1feddcd0>
2026-03-28 14:02:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:02:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:02:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:02:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f1c7ee15-186c-50e6-9aec-cc206e8adf16/f1c7ee15-186c-50e6-9aec-cc206e8adf16_image_4.jpg HTTP/1.1" 201 0
2026-03-28 14:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FRE12OHA%252F698568423%252F600') HTTP/1.1" 204 0
2026-03-28 14:02:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RE12OHA/698568423/600 saved to cache
2026-03-28 14:02:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item f1c7ee15-186c-50e6-9aec-cc206e8adf16
2026-03-28 14:02:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:02:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2de781d0>
2026-03-28 14:02:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:02:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:02:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:02:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e944d65b-4e9e-513c-a6ae-acea2437087d/e944d65b-4e9e-513c-a6ae-acea2437087d_image_4.jpg HTTP/1.1" 201 0
2026-03-28 14:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FKM67WBP%252F697678321%252F600') HTTP/1.1" 204 0
2026-03-28 14:02:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KM67WBP/697678321/600 saved to cache
2026-03-28 14:02:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item e944d65b-4e9e-513c-a6ae-acea2437087d
2026-03-28 14:02:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:02:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c114e10>
2026-03-28 14:02:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:02:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:02:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:02:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_31c4dc0e-1523-5c6f-a08c-e446dee9483c/31c4dc0e-1523-5c6f-a08c-e446dee9483c_image_1.jpg HTTP/1.1" 201 0
2026-03-28 14:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FND17WHW%252F698647261%252F600') HTTP/1.1" 204 0
2026-03-28 14:02:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/ND17WHW/698647261/600 saved to cache
2026-03-28 14:02:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 31c4dc0e-1523-5c6f-a08c-e446dee9483c
2026-03-28 14:02:33 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/ND17WHW/698647314/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698647314>
2026-03-28 14:02:33 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SB72GWA/698536990/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698536990>
2026-03-28 14:02:33 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KM67WBP/697678382/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=697678382>
2026-03-28 14:02:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:02:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c8e03d0>
2026-03-28 14:02:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:02:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:02:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:02:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_76904bbf-2ca2-5c17-a3c3-eefa3b562aab/76904bbf-2ca2-5c17-a3c3-eefa3b562aab_image_4.jpg HTTP/1.1" 201 0
2026-03-28 14:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FSB72GWA%252F698536931%252F600') HTTP/1.1" 204 0
2026-03-28 14:02:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SB72GWA/698536931/600 saved to cache
2026-03-28 14:02:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 76904bbf-2ca2-5c17-a3c3-eefa3b562aab
2026-03-28 14:02:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:02:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2d9bed90>
2026-03-28 14:02:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:02:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:02:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:02:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_76904bbf-2ca2-5c17-a3c3-eefa3b562aab/76904bbf-2ca2-5c17-a3c3-eefa3b562aab_image_3.jpg HTTP/1.1" 201 0
2026-03-28 14:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FSB72GWA%252F698536925%252F600') HTTP/1.1" 204 0
2026-03-28 14:02:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SB72GWA/698536925/600 saved to cache
2026-03-28 14:02:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 76904bbf-2ca2-5c17-a3c3-eefa3b562aab
2026-03-28 14:02:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:02:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2eae98d0>
2026-03-28 14:02:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:02:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:02:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:02:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_306d9676-19ce-5840-84c5-e10231e34614/306d9676-19ce-5840-84c5-e10231e34614_image_4.jpg HTTP/1.1" 201 0
2026-03-28 14:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FVE67DLJ%252F697994972%252F600') HTTP/1.1" 204 0
2026-03-28 14:02:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VE67DLJ/697994972/600 saved to cache
2026-03-28 14:02:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 306d9676-19ce-5840-84c5-e10231e34614
2026-03-28 14:02:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:02:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c68ee90>
2026-03-28 14:02:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:02:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:02:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:02:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_31c4dc0e-1523-5c6f-a08c-e446dee9483c/31c4dc0e-1523-5c6f-a08c-e446dee9483c_image_2.jpg HTTP/1.1" 201 0
2026-03-28 14:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FND17WHW%252F698647276%252F600') HTTP/1.1" 204 0
2026-03-28 14:02:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/ND17WHW/698647276/600 saved to cache
2026-03-28 14:02:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 31c4dc0e-1523-5c6f-a08c-e446dee9483c
2026-03-28 14:02:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:02:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2d693f50>
2026-03-28 14:02:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:02:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:02:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:02:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_59e0d1bf-73d7-5811-a0ff-a2a694262d4e/59e0d1bf-73d7-5811-a0ff-a2a694262d4e_image_2.jpg HTTP/1.1" 201 0
2026-03-28 14:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLX66XGU%252F698585748%252F600') HTTP/1.1" 204 0
2026-03-28 14:02:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LX66XGU/698585748/600 saved to cache
2026-03-28 14:02:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 59e0d1bf-73d7-5811-a0ff-a2a694262d4e
2026-03-28 14:02:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:02:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c8e03d0>
2026-03-28 14:02:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:02:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:02:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:02:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_59e0d1bf-73d7-5811-a0ff-a2a694262d4e/59e0d1bf-73d7-5811-a0ff-a2a694262d4e_image_4.jpg HTTP/1.1" 201 0
2026-03-28 14:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLX66XGU%252F698585778%252F600') HTTP/1.1" 204 0
2026-03-28 14:02:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LX66XGU/698585778/600 saved to cache
2026-03-28 14:02:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 59e0d1bf-73d7-5811-a0ff-a2a694262d4e
2026-03-28 14:02:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/ND17WHW/698647291/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/ND17WHW/42810327?sv=2020-08-04&st=2026-03-28T14%3A02%3A29Z&se=2026-03-28T14%3A27%3A29Z&sr=b&sp=r&sig=zynQuQSfNuyDXNRKcXA5HSV08c7JnCbvGT8UtSuSUac%3D)
2026-03-28 14:02:34 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LX66XGU/698585883/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698585883>
2026-03-28 14:02:34 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/ND17WHW/698647374/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698647374>
2026-03-28 14:02:34 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/ND17WHW/698647361/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698647361>
2026-03-28 14:02:34 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VE67DLJ/697994994/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=697994994>
2026-03-28 14:02:34 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LX66XGU/698585871/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698585871>
2026-03-28 14:02:34 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/ND17WHW/698647327/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698647327>
2026-03-28 14:02:34 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/ND17WHW/698647345/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698647345>
2026-03-28 14:02:34 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KM67WBP/697678387/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=697678387>
2026-03-28 14:02:34 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RE12OHA/698568602/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698568602>
2026-03-28 14:02:34 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VE67DLJ/697995002/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=697995002>
2026-03-28 14:02:34 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SB72GWA/698537005/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698537005>
2026-03-28 14:02:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/ND17WHW/698647314/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/ND17WHW/42810327?sv=2020-08-04&st=2026-03-28T14%3A02%3A29Z&se=2026-03-28T14%3A27%3A29Z&sr=b&sp=r&sig=zynQuQSfNuyDXNRKcXA5HSV08c7JnCbvGT8UtSuSUac%3D)
2026-03-28 14:02:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SB72GWA/698536990/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/SB72GWA/42810143?sv=2020-08-04&st=2026-03-28T14%3A02%3A28Z&se=2026-03-28T14%3A27%3A28Z&sr=b&sp=r&sig=COnND%2FooxrhanQtXLj4FeOKa%2Fkcoi5LKjGkYGyTn0a4%3D)
2026-03-28 14:02:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KM67WBP/697678382/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/KM67WBP/42809464?sv=2020-08-04&st=2026-03-28T14%3A02%3A27Z&se=2026-03-28T14%3A27%3A27Z&sr=b&sp=r&sig=TFQrF%2FjkhRPUwB62qt8YSavHgBqeuo7q2b9lsdnq4W8%3D)
2026-03-28 14:02:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:02:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a1fd348d0>
2026-03-28 14:02:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:02:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:02:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:02:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_31c4dc0e-1523-5c6f-a08c-e446dee9483c/31c4dc0e-1523-5c6f-a08c-e446dee9483c_image_3.jpg HTTP/1.1" 201 0
2026-03-28 14:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FND17WHW%252F698647291%252F600') HTTP/1.1" 204 0
2026-03-28 14:02:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/ND17WHW/698647291/600 saved to cache
2026-03-28 14:02:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 31c4dc0e-1523-5c6f-a08c-e446dee9483c
2026-03-28 14:02:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LX66XGU/698585847/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LX66XGU/42810324?sv=2020-08-04&st=2026-03-28T14%3A02%3A26Z&se=2026-03-28T14%3A27%3A26Z&sr=b&sp=r&sig=jbz9LK9iyQlEY35Z3G5ue8uqHIh1I8l1GE31H0hzYMg%3D)
2026-03-28 14:02:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VE67DLJ/697994994/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/VE67DLJ/42810299?sv=2020-08-04&st=2026-03-28T14%3A02%3A26Z&se=2026-03-28T14%3A27%3A26Z&sr=b&sp=r&sig=s%2BFYsI609HRDhg5CyGwQVAsfiplztmlKAHuHQLONuoQ%3D)
2026-03-28 14:02:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/ND17WHW/698647327/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/ND17WHW/42810327?sv=2020-08-04&st=2026-03-28T14%3A02%3A29Z&se=2026-03-28T14%3A27%3A29Z&sr=b&sp=r&sig=zynQuQSfNuyDXNRKcXA5HSV08c7JnCbvGT8UtSuSUac%3D)
2026-03-28 14:02:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LX66XGU/698585871/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LX66XGU/42810324?sv=2020-08-04&st=2026-03-28T14%3A02%3A26Z&se=2026-03-28T14%3A27%3A26Z&sr=b&sp=r&sig=jbz9LK9iyQlEY35Z3G5ue8uqHIh1I8l1GE31H0hzYMg%3D)
2026-03-28 14:02:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/ND17WHW/698647345/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/ND17WHW/42810327?sv=2020-08-04&st=2026-03-28T14%3A02%3A29Z&se=2026-03-28T14%3A27%3A29Z&sr=b&sp=r&sig=zynQuQSfNuyDXNRKcXA5HSV08c7JnCbvGT8UtSuSUac%3D)
2026-03-28 14:02:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/ND17WHW/698647361/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/ND17WHW/42810327?sv=2020-08-04&st=2026-03-28T14%3A02%3A29Z&se=2026-03-28T14%3A27%3A29Z&sr=b&sp=r&sig=zynQuQSfNuyDXNRKcXA5HSV08c7JnCbvGT8UtSuSUac%3D)
2026-03-28 14:02:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/ND17WHW/698647374/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/ND17WHW/42810327?sv=2020-08-04&st=2026-03-28T14%3A02%3A29Z&se=2026-03-28T14%3A27%3A29Z&sr=b&sp=r&sig=zynQuQSfNuyDXNRKcXA5HSV08c7JnCbvGT8UtSuSUac%3D)
2026-03-28 14:02:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:02:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c781490>
2026-03-28 14:02:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:02:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:02:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:02:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_31c4dc0e-1523-5c6f-a08c-e446dee9483c/31c4dc0e-1523-5c6f-a08c-e446dee9483c_image_5.jpg HTTP/1.1" 201 0
2026-03-28 14:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FND17WHW%252F698647314%252F600') HTTP/1.1" 204 0
2026-03-28 14:02:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/ND17WHW/698647314/600 saved to cache
2026-03-28 14:02:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 31c4dc0e-1523-5c6f-a08c-e446dee9483c
2026-03-28 14:02:34 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RE12OHA/698568562/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698568562>
2026-03-28 14:02:34 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LX66XGU/698585807/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698585807>
2026-03-28 14:02:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KM67WBP/697678387/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/KM67WBP/42809464?sv=2020-08-04&st=2026-03-28T14%3A02%3A27Z&se=2026-03-28T14%3A27%3A27Z&sr=b&sp=r&sig=TFQrF%2FjkhRPUwB62qt8YSavHgBqeuo7q2b9lsdnq4W8%3D)
2026-03-28 14:02:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LX66XGU/698585883/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LX66XGU/42810324?sv=2020-08-04&st=2026-03-28T14%3A02%3A26Z&se=2026-03-28T14%3A27%3A26Z&sr=b&sp=r&sig=jbz9LK9iyQlEY35Z3G5ue8uqHIh1I8l1GE31H0hzYMg%3D)
2026-03-28 14:02:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RE12OHA/698568602/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/RE12OHA/42803024?sv=2020-08-04&st=2026-03-28T14%3A02%3A26Z&se=2026-03-28T14%3A27%3A26Z&sr=b&sp=r&sig=6BH8YhGE%2FtZL7bPaACcZWXnEkdIvYtNlALyKqaLOq1E%3D)
2026-03-28 14:02:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VE67DLJ/697995002/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/VE67DLJ/42810299?sv=2020-08-04&st=2026-03-28T14%3A02%3A26Z&se=2026-03-28T14%3A27%3A26Z&sr=b&sp=r&sig=s%2BFYsI609HRDhg5CyGwQVAsfiplztmlKAHuHQLONuoQ%3D)
2026-03-28 14:02:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SB72GWA/698537005/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/SB72GWA/42810143?sv=2020-08-04&st=2026-03-28T14%3A02%3A28Z&se=2026-03-28T14%3A27%3A28Z&sr=b&sp=r&sig=COnND%2FooxrhanQtXLj4FeOKa%2Fkcoi5LKjGkYGyTn0a4%3D)
2026-03-28 14:02:34 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:02:34 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:02:34 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:02:34 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:02:34 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:02:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:02:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c81bcd0>
2026-03-28 14:02:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:02:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:02:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:02:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_76904bbf-2ca2-5c17-a3c3-eefa3b562aab/76904bbf-2ca2-5c17-a3c3-eefa3b562aab_image_8.jpg HTTP/1.1" 201 0
2026-03-28 14:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FSB72GWA%252F698536990%252F600') HTTP/1.1" 204 0
2026-03-28 14:02:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SB72GWA/698536990/600 saved to cache
2026-03-28 14:02:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 76904bbf-2ca2-5c17-a3c3-eefa3b562aab
2026-03-28 14:02:34 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:02:34 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:02:34 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:02:34 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:02:34 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:02:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:02:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2d767450>
2026-03-28 14:02:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:02:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:02:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:02:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e944d65b-4e9e-513c-a6ae-acea2437087d/e944d65b-4e9e-513c-a6ae-acea2437087d_image_8.jpg HTTP/1.1" 201 0
2026-03-28 14:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FKM67WBP%252F697678382%252F600') HTTP/1.1" 204 0
2026-03-28 14:02:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KM67WBP/697678382/600 saved to cache
2026-03-28 14:02:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item e944d65b-4e9e-513c-a6ae-acea2437087d
2026-03-28 14:02:34 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:02:34 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:02:34 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:02:34 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:02:34 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:02:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:02:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a1fee9750>
2026-03-28 14:02:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:02:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:02:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:02:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_59e0d1bf-73d7-5811-a0ff-a2a694262d4e/59e0d1bf-73d7-5811-a0ff-a2a694262d4e_image_7.jpg HTTP/1.1" 201 0
2026-03-28 14:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLX66XGU%252F698585847%252F600') HTTP/1.1" 204 0
2026-03-28 14:02:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LX66XGU/698585847/600 saved to cache
2026-03-28 14:02:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 59e0d1bf-73d7-5811-a0ff-a2a694262d4e
2026-03-28 14:02:34 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:02:34 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:02:34 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:02:34 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:02:34 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:02:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:02:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a1fd70590>
2026-03-28 14:02:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:02:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:02:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:02:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_306d9676-19ce-5840-84c5-e10231e34614/306d9676-19ce-5840-84c5-e10231e34614_image_8.jpg HTTP/1.1" 201 0
2026-03-28 14:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FVE67DLJ%252F697994994%252F600') HTTP/1.1" 204 0
2026-03-28 14:02:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VE67DLJ/697994994/600 saved to cache
2026-03-28 14:02:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 306d9676-19ce-5840-84c5-e10231e34614
2026-03-28 14:02:34 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:02:34 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:02:34 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:02:34 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:02:34 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:02:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:02:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2d765050>
2026-03-28 14:02:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:02:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:02:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:02:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_31c4dc0e-1523-5c6f-a08c-e446dee9483c/31c4dc0e-1523-5c6f-a08c-e446dee9483c_image_6.jpg HTTP/1.1" 201 0
2026-03-28 14:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FND17WHW%252F698647327%252F600') HTTP/1.1" 204 0
2026-03-28 14:02:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/ND17WHW/698647327/600 saved to cache
2026-03-28 14:02:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 31c4dc0e-1523-5c6f-a08c-e446dee9483c
2026-03-28 14:02:34 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:02:34 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:02:34 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:02:34 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:02:34 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:02:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:02:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2d767d90>
2026-03-28 14:02:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:02:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:02:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:02:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_59e0d1bf-73d7-5811-a0ff-a2a694262d4e/59e0d1bf-73d7-5811-a0ff-a2a694262d4e_image_8.jpg HTTP/1.1" 201 0
2026-03-28 14:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLX66XGU%252F698585871%252F600') HTTP/1.1" 204 0
2026-03-28 14:02:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LX66XGU/698585871/600 saved to cache
2026-03-28 14:02:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 59e0d1bf-73d7-5811-a0ff-a2a694262d4e
2026-03-28 14:02:34 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:02:34 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:02:34 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:02:34 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:02:34 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:02:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:02:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c726050>
2026-03-28 14:02:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:02:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:02:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:02:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_31c4dc0e-1523-5c6f-a08c-e446dee9483c/31c4dc0e-1523-5c6f-a08c-e446dee9483c_image_7.jpg HTTP/1.1" 201 0
2026-03-28 14:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FND17WHW%252F698647345%252F600') HTTP/1.1" 204 0
2026-03-28 14:02:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/ND17WHW/698647345/600 saved to cache
2026-03-28 14:02:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 31c4dc0e-1523-5c6f-a08c-e446dee9483c
2026-03-28 14:02:34 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:02:34 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:02:34 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:02:34 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:02:34 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:02:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:02:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a1fee99d0>
2026-03-28 14:02:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:02:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:02:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:02:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_31c4dc0e-1523-5c6f-a08c-e446dee9483c/31c4dc0e-1523-5c6f-a08c-e446dee9483c_image_8.jpg HTTP/1.1" 201 0
2026-03-28 14:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FND17WHW%252F698647361%252F600') HTTP/1.1" 204 0
2026-03-28 14:02:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/ND17WHW/698647361/600 saved to cache
2026-03-28 14:02:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 31c4dc0e-1523-5c6f-a08c-e446dee9483c
2026-03-28 14:02:34 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:02:34 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:02:34 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:02:34 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:02:34 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:02:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:02:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c7262d0>
2026-03-28 14:02:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:02:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:02:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:02:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_31c4dc0e-1523-5c6f-a08c-e446dee9483c/31c4dc0e-1523-5c6f-a08c-e446dee9483c_image_9.jpg HTTP/1.1" 201 0
2026-03-28 14:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FND17WHW%252F698647374%252F600') HTTP/1.1" 204 0
2026-03-28 14:02:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/ND17WHW/698647374/600 saved to cache
2026-03-28 14:02:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 31c4dc0e-1523-5c6f-a08c-e446dee9483c
2026-03-28 14:02:35 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BO55VOP/698269189/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698269189>
2026-03-28 14:02:35 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KM67WBP/697678374/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=697678374>
2026-03-28 14:02:35 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/ND17WHW/698647300/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698647300>
2026-03-28 14:02:35 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SB72GWA/698536975/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698536975>
2026-03-28 14:02:35 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:02:35 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:02:35 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:02:35 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:02:35 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:02:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:02:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a304b9910>
2026-03-28 14:02:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:02:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:02:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:02:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e944d65b-4e9e-513c-a6ae-acea2437087d/e944d65b-4e9e-513c-a6ae-acea2437087d_image_9.jpg HTTP/1.1" 201 0
2026-03-28 14:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FKM67WBP%252F697678387%252F600') HTTP/1.1" 204 0
2026-03-28 14:02:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KM67WBP/697678387/600 saved to cache
2026-03-28 14:02:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item e944d65b-4e9e-513c-a6ae-acea2437087d
2026-03-28 14:02:35 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:02:35 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:02:35 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:02:35 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:02:35 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:02:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:02:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2d7db7d0>
2026-03-28 14:02:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:02:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:02:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:02:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_59e0d1bf-73d7-5811-a0ff-a2a694262d4e/59e0d1bf-73d7-5811-a0ff-a2a694262d4e_image_9.jpg HTTP/1.1" 201 0
2026-03-28 14:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLX66XGU%252F698585883%252F600') HTTP/1.1" 204 0
2026-03-28 14:02:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LX66XGU/698585883/600 saved to cache
2026-03-28 14:02:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 59e0d1bf-73d7-5811-a0ff-a2a694262d4e
2026-03-28 14:02:35 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:02:35 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:02:35 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:02:35 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:02:35 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:02:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:02:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2d781910>
2026-03-28 14:02:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:02:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:02:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:02:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f1c7ee15-186c-50e6-9aec-cc206e8adf16/f1c7ee15-186c-50e6-9aec-cc206e8adf16_image_9.jpg HTTP/1.1" 201 0
2026-03-28 14:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FRE12OHA%252F698568602%252F600') HTTP/1.1" 204 0
2026-03-28 14:02:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RE12OHA/698568602/600 saved to cache
2026-03-28 14:02:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item f1c7ee15-186c-50e6-9aec-cc206e8adf16
2026-03-28 14:02:35 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:02:35 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:02:35 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:02:35 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:02:35 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:02:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:02:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c401750>
2026-03-28 14:02:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:02:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:02:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:02:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_306d9676-19ce-5840-84c5-e10231e34614/306d9676-19ce-5840-84c5-e10231e34614_image_9.jpg HTTP/1.1" 201 0
2026-03-28 14:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FVE67DLJ%252F697995002%252F600') HTTP/1.1" 204 0
2026-03-28 14:02:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VE67DLJ/697995002/600 saved to cache
2026-03-28 14:02:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 306d9676-19ce-5840-84c5-e10231e34614
2026-03-28 14:02:35 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:02:35 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:02:35 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:02:35 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:02:35 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:02:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:02:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2da0c190>
2026-03-28 14:02:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:02:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:02:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:02:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_76904bbf-2ca2-5c17-a3c3-eefa3b562aab/76904bbf-2ca2-5c17-a3c3-eefa3b562aab_image_9.jpg HTTP/1.1" 201 0
2026-03-28 14:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FSB72GWA%252F698537005%252F600') HTTP/1.1" 204 0
2026-03-28 14:02:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SB72GWA/698537005/600 saved to cache
2026-03-28 14:02:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 76904bbf-2ca2-5c17-a3c3-eefa3b562aab
2026-03-28 14:02:35 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BO55VOP/698269180/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698269180>
2026-03-28 14:02:35 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VE67DLJ/697994988/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=697994988>
2026-03-28 14:02:35 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RE12OHA/698568527/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698568527>
2026-03-28 14:02:35 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LX66XGU/698585790/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698585790>
2026-03-28 14:02:35 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KM67WBP/697678357/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=697678357>
2026-03-28 14:02:35 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SB72GWA/698536958/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698536958>
2026-03-28 14:02:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RE12OHA/698568562/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/RE12OHA/42803024?sv=2020-08-04&st=2026-03-28T14%3A02%3A26Z&se=2026-03-28T14%3A27%3A26Z&sr=b&sp=r&sig=6BH8YhGE%2FtZL7bPaACcZWXnEkdIvYtNlALyKqaLOq1E%3D)
2026-03-28 14:02:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LX66XGU/698585807/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LX66XGU/42810324?sv=2020-08-04&st=2026-03-28T14%3A02%3A26Z&se=2026-03-28T14%3A27%3A26Z&sr=b&sp=r&sig=jbz9LK9iyQlEY35Z3G5ue8uqHIh1I8l1GE31H0hzYMg%3D)
2026-03-28 14:02:35 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BO55VOP/698269171/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698269171>
2026-03-28 14:02:35 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HV58YJY/698928972/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698928972>
2026-03-28 14:02:35 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RE12OHA/698568488/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698568488>
2026-03-28 14:02:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/ND17WHW/698647300/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/ND17WHW/42810327?sv=2020-08-04&st=2026-03-28T14%3A02%3A29Z&se=2026-03-28T14%3A27%3A29Z&sr=b&sp=r&sig=zynQuQSfNuyDXNRKcXA5HSV08c7JnCbvGT8UtSuSUac%3D)
2026-03-28 14:02:35 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VE67DLJ/697994981/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=697994981>
2026-03-28 14:02:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SB72GWA/698536975/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/SB72GWA/42810143?sv=2020-08-04&st=2026-03-28T14%3A02%3A28Z&se=2026-03-28T14%3A27%3A28Z&sr=b&sp=r&sig=COnND%2FooxrhanQtXLj4FeOKa%2Fkcoi5LKjGkYGyTn0a4%3D)
2026-03-28 14:02:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BO55VOP/698269189/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/BO55VOP/42810137?sv=2020-08-04&st=2026-03-28T14%3A02%3A26Z&se=2026-03-28T14%3A27%3A26Z&sr=b&sp=r&sig=ClLegZn5u1dkNPwcbCwa7jDTCtqtY8g86xpgxUm2UfM%3D)
2026-03-28 14:02:36 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KR14OUW/696662314/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=696662314>
2026-03-28 14:02:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LX66XGU/698585790/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LX66XGU/42810324?sv=2020-08-04&st=2026-03-28T14%3A02%3A26Z&se=2026-03-28T14%3A27%3A26Z&sr=b&sp=r&sig=jbz9LK9iyQlEY35Z3G5ue8uqHIh1I8l1GE31H0hzYMg%3D)
2026-03-28 14:02:36 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:02:36 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:02:36 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:02:36 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:02:36 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:02:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:02:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c4286d0>
2026-03-28 14:02:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:02:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:02:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:02:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f1c7ee15-186c-50e6-9aec-cc206e8adf16/f1c7ee15-186c-50e6-9aec-cc206e8adf16_image_8.jpg HTTP/1.1" 201 0
2026-03-28 14:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FRE12OHA%252F698568562%252F600') HTTP/1.1" 204 0
2026-03-28 14:02:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RE12OHA/698568562/600 saved to cache
2026-03-28 14:02:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item f1c7ee15-186c-50e6-9aec-cc206e8adf16
2026-03-28 14:02:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SB72GWA/698536958/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/SB72GWA/42810143?sv=2020-08-04&st=2026-03-28T14%3A02%3A28Z&se=2026-03-28T14%3A27%3A28Z&sr=b&sp=r&sig=COnND%2FooxrhanQtXLj4FeOKa%2Fkcoi5LKjGkYGyTn0a4%3D)
2026-03-28 14:02:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BO55VOP/698269180/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/BO55VOP/42810137?sv=2020-08-04&st=2026-03-28T14%3A02%3A26Z&se=2026-03-28T14%3A27%3A26Z&sr=b&sp=r&sig=ClLegZn5u1dkNPwcbCwa7jDTCtqtY8g86xpgxUm2UfM%3D)
2026-03-28 14:02:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KM67WBP/697678357/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/KM67WBP/42809464?sv=2020-08-04&st=2026-03-28T14%3A02%3A27Z&se=2026-03-28T14%3A27%3A27Z&sr=b&sp=r&sig=TFQrF%2FjkhRPUwB62qt8YSavHgBqeuo7q2b9lsdnq4W8%3D)
2026-03-28 14:02:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KM67WBP/697678374/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/KM67WBP/42809464?sv=2020-08-04&st=2026-03-28T14%3A02%3A27Z&se=2026-03-28T14%3A27%3A27Z&sr=b&sp=r&sig=TFQrF%2FjkhRPUwB62qt8YSavHgBqeuo7q2b9lsdnq4W8%3D)
2026-03-28 14:02:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RE12OHA/698568527/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/RE12OHA/42803024?sv=2020-08-04&st=2026-03-28T14%3A02%3A26Z&se=2026-03-28T14%3A27%3A26Z&sr=b&sp=r&sig=6BH8YhGE%2FtZL7bPaACcZWXnEkdIvYtNlALyKqaLOq1E%3D)
2026-03-28 14:02:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VE67DLJ/697994988/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/VE67DLJ/42810299?sv=2020-08-04&st=2026-03-28T14%3A02%3A26Z&se=2026-03-28T14%3A27%3A26Z&sr=b&sp=r&sig=s%2BFYsI609HRDhg5CyGwQVAsfiplztmlKAHuHQLONuoQ%3D)
2026-03-28 14:02:36 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:02:36 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:02:36 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:02:36 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:02:36 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:02:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:02:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c8cc3d0>
2026-03-28 14:02:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:02:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:02:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:02:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_59e0d1bf-73d7-5811-a0ff-a2a694262d4e/59e0d1bf-73d7-5811-a0ff-a2a694262d4e_image_6.jpg HTTP/1.1" 201 0
2026-03-28 14:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLX66XGU%252F698585807%252F600') HTTP/1.1" 204 0
2026-03-28 14:02:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LX66XGU/698585807/600 saved to cache
2026-03-28 14:02:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 59e0d1bf-73d7-5811-a0ff-a2a694262d4e
2026-03-28 14:02:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:02:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a3025f190>
2026-03-28 14:02:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:02:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:02:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:02:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_31c4dc0e-1523-5c6f-a08c-e446dee9483c/31c4dc0e-1523-5c6f-a08c-e446dee9483c_image_4.jpg HTTP/1.1" 201 0
2026-03-28 14:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FND17WHW%252F698647300%252F600') HTTP/1.1" 204 0
2026-03-28 14:02:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/ND17WHW/698647300/600 saved to cache
2026-03-28 14:02:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 31c4dc0e-1523-5c6f-a08c-e446dee9483c
2026-03-28 14:02:36 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 31c4dc0e-1523-5c6f-a08c-e446dee9483c, skipping ID generation
2026-03-28 14:02:36 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 31c4dc0e-1523-5c6f-a08c-e446dee9483c sending to next pipeline
2026-03-28 14:02:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 31c4dc0e-1523-5c6f-a08c-e446dee9483c, identifier: ND17%20WHW
2026-03-28 14:02:36 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:02:36 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:02:36 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:02:36 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:02:36 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:02:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:02:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a3011ea10>
2026-03-28 14:02:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:02:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:02:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:02:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_76904bbf-2ca2-5c17-a3c3-eefa3b562aab/76904bbf-2ca2-5c17-a3c3-eefa3b562aab_image_7.jpg HTTP/1.1" 201 0
2026-03-28 14:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FSB72GWA%252F698536975%252F600') HTTP/1.1" 204 0
2026-03-28 14:02:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SB72GWA/698536975/600 saved to cache
2026-03-28 14:02:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 76904bbf-2ca2-5c17-a3c3-eefa3b562aab
2026-03-28 14:02:36 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:02:36 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:02:36 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:02:36 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:02:36 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:02:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:02:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c52efd0>
2026-03-28 14:02:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:02:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:02:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:02:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0df2aa72-34d7-5e00-86eb-dff801f0634b/0df2aa72-34d7-5e00-86eb-dff801f0634b_image_9.jpg HTTP/1.1" 201 0
2026-03-28 14:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FBO55VOP%252F698269189%252F600') HTTP/1.1" 204 0
2026-03-28 14:02:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BO55VOP/698269189/600 saved to cache
2026-03-28 14:02:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 0df2aa72-34d7-5e00-86eb-dff801f0634b
2026-03-28 14:02:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 31c4dc0e-1523-5c6f-a08c-e446dee9483c with identifier: ND17%20WHW
2026-03-28 14:02:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 31c4dc0e-1523-5c6f-a08c-e446dee9483c with identifier: ND17%20WHW
2026-03-28 14:02:36 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 31c4dc0e-1523-5c6f-a08c-e446dee9483c with identifier: ND17%20WHW to the API
2026-03-28 14:02:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:02:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:02:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/ND17WHW/698647300/600>
{'auction_title': '',
'c_o_2_emission_value': 110,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_31c4dc0e-1523-5c6f-a08c-e446dee9483c/31c4dc0e-1523-5c6f-a08c-e446dee9483c_expert_report_file_68f741c4-2c99-4b2e-a236-9666ccc0eb51.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=ND17%20WHW-GB',
'category': 'Car',
'color': 'red',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.2L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol',
'id': '31c4dc0e-1523-5c6f-a08c-e446dee9483c',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'ND17 WHW',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=ND17%20WHW&vehicleType=*',
'listing': 'auction',
'location': 'Paddock Wood',
'make': 'CITROEN',
'model': 'C3',
'odometer': 80632,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 11,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_31c4dc0e-1523-5c6f-a08c-e446dee9483c/31c4dc0e-1523-5c6f-a08c-e446dee9483c_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 53900,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/ND17WHW/698647248/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_31c4dc0e-1523-5c6f-a08c-e446dee9483c/31c4dc0e-1523-5c6f-a08c-e446dee9483c_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 53792,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/ND17WHW/698647261/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_31c4dc0e-1523-5c6f-a08c-e446dee9483c/31c4dc0e-1523-5c6f-a08c-e446dee9483c_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 50926,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/ND17WHW/698647276/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_31c4dc0e-1523-5c6f-a08c-e446dee9483c/31c4dc0e-1523-5c6f-a08c-e446dee9483c_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 48113,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/ND17WHW/698647291/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_31c4dc0e-1523-5c6f-a08c-e446dee9483c/31c4dc0e-1523-5c6f-a08c-e446dee9483c_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 47633,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/ND17WHW/698647300/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_31c4dc0e-1523-5c6f-a08c-e446dee9483c/31c4dc0e-1523-5c6f-a08c-e446dee9483c_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 47834,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/ND17WHW/698647314/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_31c4dc0e-1523-5c6f-a08c-e446dee9483c/31c4dc0e-1523-5c6f-a08c-e446dee9483c_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 97684,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/ND17WHW/698647327/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_31c4dc0e-1523-5c6f-a08c-e446dee9483c/31c4dc0e-1523-5c6f-a08c-e446dee9483c_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 71605,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/ND17WHW/698647345/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_31c4dc0e-1523-5c6f-a08c-e446dee9483c/31c4dc0e-1523-5c6f-a08c-e446dee9483c_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 90058,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/ND17WHW/698647361/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_31c4dc0e-1523-5c6f-a08c-e446dee9483c/31c4dc0e-1523-5c6f-a08c-e446dee9483c_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 76970,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/ND17WHW/698647374/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-01-01',
'seller_name': None,
'title': 'CITROEN C3 1.2 P/T 110 FLAIR EAT6 Hatchback',
'transmission': 'automatic',
'trim': 'P/T 110 FLAIR EAT6',
'vin': 'VF7SXHNZTHT571905',
'year': 2017}
2026-03-28 14:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27ND17%2520WHW%27 HTTP/1.1" 200 None
2026-03-28 14:02:36 [bca.uk] INFO: Saving data for ND17%20WHW: {'created_time': 1774706556.91414, 'last_price_update_time': 1774706556.91415, 'auction_closing_time': 1774864800.0}
2026-03-28 14:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='ND17%2520WHW') HTTP/1.1" 204 0
2026-03-28 14:02:36 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CY68EOB/698765416/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698765416>
2026-03-28 14:02:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BO55VOP/698269171/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/BO55VOP/42810137?sv=2020-08-04&st=2026-03-28T14%3A02%3A26Z&se=2026-03-28T14%3A27%3A26Z&sr=b&sp=r&sig=ClLegZn5u1dkNPwcbCwa7jDTCtqtY8g86xpgxUm2UfM%3D)
2026-03-28 14:02:36 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KM67WBP/697678338/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=697678338>
2026-03-28 14:02:36 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RE03XJT/698934114/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698934114>
2026-03-28 14:02:36 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SB72GWA/698536946/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698536946>
2026-03-28 14:02:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:02:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2fde7110>
2026-03-28 14:02:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:02:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:02:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:02:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_59e0d1bf-73d7-5811-a0ff-a2a694262d4e/59e0d1bf-73d7-5811-a0ff-a2a694262d4e_image_5.jpg HTTP/1.1" 201 0
2026-03-28 14:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLX66XGU%252F698585790%252F600') HTTP/1.1" 204 0
2026-03-28 14:02:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LX66XGU/698585790/600 saved to cache
2026-03-28 14:02:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 59e0d1bf-73d7-5811-a0ff-a2a694262d4e
2026-03-28 14:02:36 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:02:36 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:02:36 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:02:36 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:02:36 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:02:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:02:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a1ff21710>
2026-03-28 14:02:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:02:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:02:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:02:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_76904bbf-2ca2-5c17-a3c3-eefa3b562aab/76904bbf-2ca2-5c17-a3c3-eefa3b562aab_image_6.jpg HTTP/1.1" 201 0
2026-03-28 14:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FSB72GWA%252F698536958%252F600') HTTP/1.1" 204 0
2026-03-28 14:02:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SB72GWA/698536958/600 saved to cache
2026-03-28 14:02:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 76904bbf-2ca2-5c17-a3c3-eefa3b562aab
2026-03-28 14:02:37 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:02:37 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:02:37 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:02:37 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:02:37 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:02:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:02:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c534090>
2026-03-28 14:02:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:02:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:02:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:02:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0df2aa72-34d7-5e00-86eb-dff801f0634b/0df2aa72-34d7-5e00-86eb-dff801f0634b_image_8.jpg HTTP/1.1" 201 0
2026-03-28 14:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FBO55VOP%252F698269180%252F600') HTTP/1.1" 204 0
2026-03-28 14:02:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BO55VOP/698269180/600 saved to cache
2026-03-28 14:02:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 0df2aa72-34d7-5e00-86eb-dff801f0634b
2026-03-28 14:02:37 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:02:37 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:02:37 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:02:37 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:02:37 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:02:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:02:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a1feaaa50>
2026-03-28 14:02:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:02:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:02:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:02:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e944d65b-4e9e-513c-a6ae-acea2437087d/e944d65b-4e9e-513c-a6ae-acea2437087d_image_6.jpg HTTP/1.1" 201 0
2026-03-28 14:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FKM67WBP%252F697678357%252F600') HTTP/1.1" 204 0
2026-03-28 14:02:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KM67WBP/697678357/600 saved to cache
2026-03-28 14:02:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item e944d65b-4e9e-513c-a6ae-acea2437087d
2026-03-28 14:02:37 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:02:37 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:02:37 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:02:37 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:02:37 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:02:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:02:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2d9bd9d0>
2026-03-28 14:02:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:02:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:02:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:02:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e944d65b-4e9e-513c-a6ae-acea2437087d/e944d65b-4e9e-513c-a6ae-acea2437087d_image_7.jpg HTTP/1.1" 201 0
2026-03-28 14:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FKM67WBP%252F697678374%252F600') HTTP/1.1" 204 0
2026-03-28 14:02:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KM67WBP/697678374/600 saved to cache
2026-03-28 14:02:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item e944d65b-4e9e-513c-a6ae-acea2437087d
2026-03-28 14:02:37 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:02:37 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:02:37 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:02:37 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:02:37 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:02:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:02:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c535310>
2026-03-28 14:02:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:02:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:02:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:02:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f1c7ee15-186c-50e6-9aec-cc206e8adf16/f1c7ee15-186c-50e6-9aec-cc206e8adf16_image_7.jpg HTTP/1.1" 201 0
2026-03-28 14:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FRE12OHA%252F698568527%252F600') HTTP/1.1" 204 0
2026-03-28 14:02:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RE12OHA/698568527/600 saved to cache
2026-03-28 14:02:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item f1c7ee15-186c-50e6-9aec-cc206e8adf16
2026-03-28 14:02:37 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:02:37 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:02:37 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:02:37 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:02:37 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:02:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:02:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c52a950>
2026-03-28 14:02:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:02:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:02:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:02:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_306d9676-19ce-5840-84c5-e10231e34614/306d9676-19ce-5840-84c5-e10231e34614_image_7.jpg HTTP/1.1" 201 0
2026-03-28 14:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FVE67DLJ%252F697994988%252F600') HTTP/1.1" 204 0
2026-03-28 14:02:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VE67DLJ/697994988/600 saved to cache
2026-03-28 14:02:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 306d9676-19ce-5840-84c5-e10231e34614
2026-03-28 14:02:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HV58YJY/698928972/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/HV58YJY/42810015?sv=2020-08-04&st=2026-03-28T14%3A02%3A25Z&se=2026-03-28T14%3A27%3A25Z&sr=b&sp=r&sig=4E7oaf6jl0JMYjcpc4K4%2F3uy5%2BGOvEW6yFoZ9j75kNU%3D)
2026-03-28 14:02:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RE12OHA/698568488/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/RE12OHA/42803024?sv=2020-08-04&st=2026-03-28T14%3A02%3A26Z&se=2026-03-28T14%3A27%3A26Z&sr=b&sp=r&sig=6BH8YhGE%2FtZL7bPaACcZWXnEkdIvYtNlALyKqaLOq1E%3D)
2026-03-28 14:02:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VE67DLJ/697994981/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/VE67DLJ/42810299?sv=2020-08-04&st=2026-03-28T14%3A02%3A26Z&se=2026-03-28T14%3A27%3A26Z&sr=b&sp=r&sig=s%2BFYsI609HRDhg5CyGwQVAsfiplztmlKAHuHQLONuoQ%3D)
2026-03-28 14:02:37 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:02:37 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:02:37 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:02:37 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:02:37 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:02:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:02:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2eaeb110>
2026-03-28 14:02:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:02:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:02:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:02:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0df2aa72-34d7-5e00-86eb-dff801f0634b/0df2aa72-34d7-5e00-86eb-dff801f0634b_image_7.jpg HTTP/1.1" 201 0
2026-03-28 14:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FBO55VOP%252F698269171%252F600') HTTP/1.1" 204 0
2026-03-28 14:02:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BO55VOP/698269171/600 saved to cache
2026-03-28 14:02:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 0df2aa72-34d7-5e00-86eb-dff801f0634b
2026-03-28 14:02:37 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VE67DLJ/697994975/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=697994975>
2026-03-28 14:02:37 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BO55VOP/698269165/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698269165>
2026-03-28 14:02:37 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RE12OHA/698568448/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698568448>
2026-03-28 14:02:37 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LX66XGU/698585766/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698585766>
2026-03-28 14:02:37 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KR14OUW/696662309/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=696662309>
2026-03-28 14:02:37 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CY68EOB/698765391/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698765391>
2026-03-28 14:02:37 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HV58YJY/698928951/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698928951>
2026-03-28 14:02:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KR14OUW/696662314/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/KR14OUW/42810276?sv=2020-08-04&st=2026-03-28T14%3A02%3A25Z&se=2026-03-28T14%3A27%3A25Z&sr=b&sp=r&sig=yD0HrAKd1eOENYPcHLYCjZQ9zljwYHJA7s3b8Za%2BpDw%3D)
2026-03-28 14:02:37 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:02:37 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:02:37 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:02:37 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:02:37 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:02:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:02:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2d6401d0>
2026-03-28 14:02:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:02:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:02:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:02:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8b64f21f-1ee3-5237-8105-b88b835030a8/8b64f21f-1ee3-5237-8105-b88b835030a8_image_9.jpg HTTP/1.1" 201 0
2026-03-28 14:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FHV58YJY%252F698928972%252F600') HTTP/1.1" 204 0
2026-03-28 14:02:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HV58YJY/698928972/600 saved to cache
2026-03-28 14:02:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 8b64f21f-1ee3-5237-8105-b88b835030a8
2026-03-28 14:02:37 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RE03XJT/698934102/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698934102>
2026-03-28 14:02:37 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EP19XHA/698568618/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698568618>
2026-03-28 14:02:37 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:02:37 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:02:37 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:02:37 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:02:37 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:02:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:02:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c991bd0>
2026-03-28 14:02:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:02:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:02:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:02:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f1c7ee15-186c-50e6-9aec-cc206e8adf16/f1c7ee15-186c-50e6-9aec-cc206e8adf16_image_6.jpg HTTP/1.1" 201 0
2026-03-28 14:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FRE12OHA%252F698568488%252F600') HTTP/1.1" 204 0
2026-03-28 14:02:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RE12OHA/698568488/600 saved to cache
2026-03-28 14:02:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item f1c7ee15-186c-50e6-9aec-cc206e8adf16
2026-03-28 14:02:37 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:02:37 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:02:37 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:02:37 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:02:37 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:02:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:02:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2d78cf50>
2026-03-28 14:02:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:02:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:02:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:02:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_306d9676-19ce-5840-84c5-e10231e34614/306d9676-19ce-5840-84c5-e10231e34614_image_6.jpg HTTP/1.1" 201 0
2026-03-28 14:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FVE67DLJ%252F697994981%252F600') HTTP/1.1" 204 0
2026-03-28 14:02:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VE67DLJ/697994981/600 saved to cache
2026-03-28 14:02:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 306d9676-19ce-5840-84c5-e10231e34614
2026-03-28 14:02:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RE03XJT/698934114/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/RE03XJT/42810438?sv=2020-08-04&st=2026-03-28T14%3A02%3A25Z&se=2026-03-28T14%3A27%3A25Z&sr=b&sp=r&sig=W%2BmiGFHKvJXzfBcOMLhIRCoLkA3AzDMDP5bgxDrTPQQ%3D)
2026-03-28 14:02:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KM67WBP/697678338/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/KM67WBP/42809464?sv=2020-08-04&st=2026-03-28T14%3A02%3A27Z&se=2026-03-28T14%3A27%3A27Z&sr=b&sp=r&sig=TFQrF%2FjkhRPUwB62qt8YSavHgBqeuo7q2b9lsdnq4W8%3D)
2026-03-28 14:02:37 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BO55VOP/698269156/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698269156>
2026-03-28 14:02:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SB72GWA/698536946/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/SB72GWA/42810143?sv=2020-08-04&st=2026-03-28T14%3A02%3A28Z&se=2026-03-28T14%3A27%3A28Z&sr=b&sp=r&sig=COnND%2FooxrhanQtXLj4FeOKa%2Fkcoi5LKjGkYGyTn0a4%3D)
2026-03-28 14:02:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CY68EOB/698765416/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/CY68EOB/42807353?sv=2020-08-04&st=2026-03-28T14%3A02%3A25Z&se=2026-03-28T14%3A27%3A25Z&sr=b&sp=r&sig=VhOAFQtPLoY4JTixFnYBwYrQPfJNMc8rMp4NstNU2cM%3D)
2026-03-28 14:02:37 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:02:37 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:02:37 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:02:37 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:02:37 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:02:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:02:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c834b90>
2026-03-28 14:02:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:02:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:02:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:02:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5096b957-ac5c-5cc4-a891-49042e75677e/5096b957-ac5c-5cc4-a891-49042e75677e_image_9.jpg HTTP/1.1" 201 0
2026-03-28 14:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FKR14OUW%252F696662314%252F600') HTTP/1.1" 204 0
2026-03-28 14:02:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KR14OUW/696662314/600 saved to cache
2026-03-28 14:02:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 5096b957-ac5c-5cc4-a891-49042e75677e
2026-03-28 14:02:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KR14OUW/696662309/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/KR14OUW/42810276?sv=2020-08-04&st=2026-03-28T14%3A02%3A25Z&se=2026-03-28T14%3A27%3A25Z&sr=b&sp=r&sig=yD0HrAKd1eOENYPcHLYCjZQ9zljwYHJA7s3b8Za%2BpDw%3D)
2026-03-28 14:02:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CY68EOB/698765391/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/CY68EOB/42807353?sv=2020-08-04&st=2026-03-28T14%3A02%3A25Z&se=2026-03-28T14%3A27%3A25Z&sr=b&sp=r&sig=VhOAFQtPLoY4JTixFnYBwYrQPfJNMc8rMp4NstNU2cM%3D)
2026-03-28 14:02:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BO55VOP/698269165/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/BO55VOP/42810137?sv=2020-08-04&st=2026-03-28T14%3A02%3A26Z&se=2026-03-28T14%3A27%3A26Z&sr=b&sp=r&sig=ClLegZn5u1dkNPwcbCwa7jDTCtqtY8g86xpgxUm2UfM%3D)
2026-03-28 14:02:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HV58YJY/698928951/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/HV58YJY/42810015?sv=2020-08-04&st=2026-03-28T14%3A02%3A25Z&se=2026-03-28T14%3A27%3A25Z&sr=b&sp=r&sig=4E7oaf6jl0JMYjcpc4K4%2F3uy5%2BGOvEW6yFoZ9j75kNU%3D)
2026-03-28 14:02:37 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:02:37 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:02:37 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:02:37 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:02:37 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:02:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:02:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2de7a0d0>
2026-03-28 14:02:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:02:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:02:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:02:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0d8a0ea5-df55-5526-b46c-23b49b8e0dc3/0d8a0ea5-df55-5526-b46c-23b49b8e0dc3_image_9.jpg HTTP/1.1" 201 0
2026-03-28 14:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FRE03XJT%252F698934114%252F600') HTTP/1.1" 204 0
2026-03-28 14:02:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RE03XJT/698934114/600 saved to cache
2026-03-28 14:02:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 0d8a0ea5-df55-5526-b46c-23b49b8e0dc3
2026-03-28 14:02:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VE67DLJ/697994975/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/VE67DLJ/42810299?sv=2020-08-04&st=2026-03-28T14%3A02%3A26Z&se=2026-03-28T14%3A27%3A26Z&sr=b&sp=r&sig=s%2BFYsI609HRDhg5CyGwQVAsfiplztmlKAHuHQLONuoQ%3D)
2026-03-28 14:02:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LX66XGU/698585766/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LX66XGU/42810324?sv=2020-08-04&st=2026-03-28T14%3A02%3A26Z&se=2026-03-28T14%3A27%3A26Z&sr=b&sp=r&sig=jbz9LK9iyQlEY35Z3G5ue8uqHIh1I8l1GE31H0hzYMg%3D)
2026-03-28 14:02:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RE12OHA/698568448/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/RE12OHA/42803024?sv=2020-08-04&st=2026-03-28T14%3A02%3A26Z&se=2026-03-28T14%3A27%3A26Z&sr=b&sp=r&sig=6BH8YhGE%2FtZL7bPaACcZWXnEkdIvYtNlALyKqaLOq1E%3D)
2026-03-28 14:02:37 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FA18OJS/698923504/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698923504>
2026-03-28 14:02:37 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HV58YJY/698928917/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698928917>
2026-03-28 14:02:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BO55VOP/698269156/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/BO55VOP/42810137?sv=2020-08-04&st=2026-03-28T14%3A02%3A26Z&se=2026-03-28T14%3A27%3A26Z&sr=b&sp=r&sig=ClLegZn5u1dkNPwcbCwa7jDTCtqtY8g86xpgxUm2UfM%3D)
2026-03-28 14:02:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EP19XHA/698568618/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/EP19XHA/42803467?sv=2020-08-04&st=2026-03-28T14%3A02%3A25Z&se=2026-03-28T14%3A27%3A25Z&sr=b&sp=r&sig=3aXptHZNTY1xw5UUqyLl7yubHBPKRq5U01kDhdsbsYM%3D)
2026-03-28 14:02:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RE03XJT/698934102/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/RE03XJT/42810438?sv=2020-08-04&st=2026-03-28T14%3A02%3A25Z&se=2026-03-28T14%3A27%3A25Z&sr=b&sp=r&sig=W%2BmiGFHKvJXzfBcOMLhIRCoLkA3AzDMDP5bgxDrTPQQ%3D)
2026-03-28 14:02:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:02:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c170950>
2026-03-28 14:02:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:02:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:02:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:02:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e944d65b-4e9e-513c-a6ae-acea2437087d/e944d65b-4e9e-513c-a6ae-acea2437087d_image_5.jpg HTTP/1.1" 201 0
2026-03-28 14:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FKM67WBP%252F697678338%252F600') HTTP/1.1" 204 0
2026-03-28 14:02:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KM67WBP/697678338/600 saved to cache
2026-03-28 14:02:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item e944d65b-4e9e-513c-a6ae-acea2437087d
2026-03-28 14:02:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:02:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c57f290>
2026-03-28 14:02:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:02:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:02:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:02:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_76904bbf-2ca2-5c17-a3c3-eefa3b562aab/76904bbf-2ca2-5c17-a3c3-eefa3b562aab_image_5.jpg HTTP/1.1" 201 0
2026-03-28 14:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FSB72GWA%252F698536946%252F600') HTTP/1.1" 204 0
2026-03-28 14:02:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SB72GWA/698536946/600 saved to cache
2026-03-28 14:02:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 76904bbf-2ca2-5c17-a3c3-eefa3b562aab
2026-03-28 14:02:37 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:02:37 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:02:37 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:02:37 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:02:37 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:02:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:02:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a1fdb78d0>
2026-03-28 14:02:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:02:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:02:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:02:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_299c12ca-ac8c-5489-8f0d-0d144c80340f/299c12ca-ac8c-5489-8f0d-0d144c80340f_image_9.jpg HTTP/1.1" 201 0
2026-03-28 14:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FCY68EOB%252F698765416%252F600') HTTP/1.1" 204 0
2026-03-28 14:02:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CY68EOB/698765416/600 saved to cache
2026-03-28 14:02:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 299c12ca-ac8c-5489-8f0d-0d144c80340f
2026-03-28 14:02:37 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:02:37 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:02:37 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:02:37 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:02:37 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:02:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:02:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c57d610>
2026-03-28 14:02:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:02:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:02:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:02:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5096b957-ac5c-5cc4-a891-49042e75677e/5096b957-ac5c-5cc4-a891-49042e75677e_image_8.jpg HTTP/1.1" 201 0
2026-03-28 14:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FKR14OUW%252F696662309%252F600') HTTP/1.1" 204 0
2026-03-28 14:02:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KR14OUW/696662309/600 saved to cache
2026-03-28 14:02:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 5096b957-ac5c-5cc4-a891-49042e75677e
2026-03-28 14:02:37 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:02:37 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:02:37 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:02:37 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:02:37 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:02:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:02:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2d9dca50>
2026-03-28 14:02:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:02:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:02:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:02:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_299c12ca-ac8c-5489-8f0d-0d144c80340f/299c12ca-ac8c-5489-8f0d-0d144c80340f_image_8.jpg HTTP/1.1" 201 0
2026-03-28 14:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FCY68EOB%252F698765391%252F600') HTTP/1.1" 204 0
2026-03-28 14:02:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CY68EOB/698765391/600 saved to cache
2026-03-28 14:02:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 299c12ca-ac8c-5489-8f0d-0d144c80340f
2026-03-28 14:02:37 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:02:37 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:02:37 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:02:37 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:02:37 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:02:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:02:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2d813350>
2026-03-28 14:02:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:02:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:02:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:02:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0df2aa72-34d7-5e00-86eb-dff801f0634b/0df2aa72-34d7-5e00-86eb-dff801f0634b_image_6.jpg HTTP/1.1" 201 0
2026-03-28 14:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FBO55VOP%252F698269165%252F600') HTTP/1.1" 204 0
2026-03-28 14:02:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BO55VOP/698269165/600 saved to cache
2026-03-28 14:02:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 0df2aa72-34d7-5e00-86eb-dff801f0634b
2026-03-28 14:02:38 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:02:38 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:02:38 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:02:38 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:02:38 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:02:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:02:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2d9dc110>
2026-03-28 14:02:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:02:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:02:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:02:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8b64f21f-1ee3-5237-8105-b88b835030a8/8b64f21f-1ee3-5237-8105-b88b835030a8_image_8.jpg HTTP/1.1" 201 0
2026-03-28 14:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FHV58YJY%252F698928951%252F600') HTTP/1.1" 204 0
2026-03-28 14:02:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HV58YJY/698928951/600 saved to cache
2026-03-28 14:02:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 8b64f21f-1ee3-5237-8105-b88b835030a8
2026-03-28 14:02:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:02:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c65a010>
2026-03-28 14:02:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:02:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:02:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:02:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_306d9676-19ce-5840-84c5-e10231e34614/306d9676-19ce-5840-84c5-e10231e34614_image_5.jpg HTTP/1.1" 201 0
2026-03-28 14:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FVE67DLJ%252F697994975%252F600') HTTP/1.1" 204 0
2026-03-28 14:02:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VE67DLJ/697994975/600 saved to cache
2026-03-28 14:02:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 306d9676-19ce-5840-84c5-e10231e34614
2026-03-28 14:02:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:02:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c171d50>
2026-03-28 14:02:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:02:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:02:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:02:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_59e0d1bf-73d7-5811-a0ff-a2a694262d4e/59e0d1bf-73d7-5811-a0ff-a2a694262d4e_image_3.jpg HTTP/1.1" 201 0
2026-03-28 14:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLX66XGU%252F698585766%252F600') HTTP/1.1" 204 0
2026-03-28 14:02:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LX66XGU/698585766/600 saved to cache
2026-03-28 14:02:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 59e0d1bf-73d7-5811-a0ff-a2a694262d4e
2026-03-28 14:02:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:02:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c1715d0>
2026-03-28 14:02:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:02:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:02:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:02:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f1c7ee15-186c-50e6-9aec-cc206e8adf16/f1c7ee15-186c-50e6-9aec-cc206e8adf16_image_5.jpg HTTP/1.1" 201 0
2026-03-28 14:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FRE12OHA%252F698568448%252F600') HTTP/1.1" 204 0
2026-03-28 14:02:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RE12OHA/698568448/600 saved to cache
2026-03-28 14:02:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item f1c7ee15-186c-50e6-9aec-cc206e8adf16
2026-03-28 14:02:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:02:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2d9de550>
2026-03-28 14:02:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:02:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:02:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:02:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0df2aa72-34d7-5e00-86eb-dff801f0634b/0df2aa72-34d7-5e00-86eb-dff801f0634b_image_5.jpg HTTP/1.1" 201 0
2026-03-28 14:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FBO55VOP%252F698269156%252F600') HTTP/1.1" 204 0
2026-03-28 14:02:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BO55VOP/698269156/600 saved to cache
2026-03-28 14:02:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 0df2aa72-34d7-5e00-86eb-dff801f0634b
2026-03-28 14:02:38 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:02:38 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:02:38 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:02:38 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:02:38 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:02:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:02:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c675b90>
2026-03-28 14:02:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:02:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:02:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:02:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_85df4e80-1e5a-5573-ad99-0445a298364d/85df4e80-1e5a-5573-ad99-0445a298364d_image_9.jpg HTTP/1.1" 201 0
2026-03-28 14:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FEP19XHA%252F698568618%252F600') HTTP/1.1" 204 0
2026-03-28 14:02:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EP19XHA/698568618/600 saved to cache
2026-03-28 14:02:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 85df4e80-1e5a-5573-ad99-0445a298364d
2026-03-28 14:02:38 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:02:38 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:02:38 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:02:38 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:02:38 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:02:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:02:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2d9de810>
2026-03-28 14:02:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:02:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:02:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:02:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0d8a0ea5-df55-5526-b46c-23b49b8e0dc3/0d8a0ea5-df55-5526-b46c-23b49b8e0dc3_image_8.jpg HTTP/1.1" 201 0
2026-03-28 14:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FRE03XJT%252F698934102%252F600') HTTP/1.1" 204 0
2026-03-28 14:02:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RE03XJT/698934102/600 saved to cache
2026-03-28 14:02:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 0d8a0ea5-df55-5526-b46c-23b49b8e0dc3
2026-03-28 14:02:38 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RE12OHA/698568399/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698568399>
2026-03-28 14:02:38 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FA18OJS/698923476/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698923476>
2026-03-28 14:02:38 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VE67DLJ/697994969/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=697994969>
2026-03-28 14:02:38 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CY68EOB/698765358/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698765358>
2026-03-28 14:02:38 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KR14OUW/696662307/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=696662307>
2026-03-28 14:02:38 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EP19XHA/698568581/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698568581>
2026-03-28 14:02:38 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RE03XJT/698934082/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698934082>
2026-03-28 14:02:38 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KM67WBP/697678309/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=697678309>
2026-03-28 14:02:38 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CY68EOB/698765328/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698765328>
2026-03-28 14:02:38 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LX66XGU/698585735/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698585735>
2026-03-28 14:02:38 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HV58YJY/698928892/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698928892>
2026-03-28 14:02:38 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BO55VOP/698269149/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698269149>
2026-03-28 14:02:38 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KR14OUW/696662301/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=696662301>
2026-03-28 14:02:38 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RE03XJT/698934068/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698934068>
2026-03-28 14:02:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FA18OJS/698923504/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/FA18OJS/42809927?sv=2020-08-04&st=2026-03-28T14%3A02%3A25Z&se=2026-03-28T14%3A27%3A25Z&sr=b&sp=r&sig=wYbenAdSOJrfSZzoBonOEa6%2BD7yy%2FzPCYgKi2Sl75o8%3D)
2026-03-28 14:02:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HV58YJY/698928917/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/HV58YJY/42810015?sv=2020-08-04&st=2026-03-28T14%3A02%3A25Z&se=2026-03-28T14%3A27%3A25Z&sr=b&sp=r&sig=4E7oaf6jl0JMYjcpc4K4%2F3uy5%2BGOvEW6yFoZ9j75kNU%3D)
2026-03-28 14:02:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VE67DLJ/697994969/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/VE67DLJ/42810299?sv=2020-08-04&st=2026-03-28T14%3A02%3A26Z&se=2026-03-28T14%3A27%3A26Z&sr=b&sp=r&sig=s%2BFYsI609HRDhg5CyGwQVAsfiplztmlKAHuHQLONuoQ%3D)
2026-03-28 14:02:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CY68EOB/698765358/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/CY68EOB/42807353?sv=2020-08-04&st=2026-03-28T14%3A02%3A25Z&se=2026-03-28T14%3A27%3A25Z&sr=b&sp=r&sig=VhOAFQtPLoY4JTixFnYBwYrQPfJNMc8rMp4NstNU2cM%3D)
2026-03-28 14:02:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EP19XHA/698568581/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/EP19XHA/42803467?sv=2020-08-04&st=2026-03-28T14%3A02%3A25Z&se=2026-03-28T14%3A27%3A25Z&sr=b&sp=r&sig=3aXptHZNTY1xw5UUqyLl7yubHBPKRq5U01kDhdsbsYM%3D)
2026-03-28 14:02:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FA18OJS/698923476/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/FA18OJS/42809927?sv=2020-08-04&st=2026-03-28T14%3A02%3A25Z&se=2026-03-28T14%3A27%3A25Z&sr=b&sp=r&sig=wYbenAdSOJrfSZzoBonOEa6%2BD7yy%2FzPCYgKi2Sl75o8%3D)
2026-03-28 14:02:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KR14OUW/696662307/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/KR14OUW/42810276?sv=2020-08-04&st=2026-03-28T14%3A02%3A25Z&se=2026-03-28T14%3A27%3A25Z&sr=b&sp=r&sig=yD0HrAKd1eOENYPcHLYCjZQ9zljwYHJA7s3b8Za%2BpDw%3D)
2026-03-28 14:02:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BO55VOP/698269149/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/BO55VOP/42810137?sv=2020-08-04&st=2026-03-28T14%3A02%3A26Z&se=2026-03-28T14%3A27%3A26Z&sr=b&sp=r&sig=ClLegZn5u1dkNPwcbCwa7jDTCtqtY8g86xpgxUm2UfM%3D)
2026-03-28 14:02:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KM67WBP/697678309/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/KM67WBP/42809464?sv=2020-08-04&st=2026-03-28T14%3A02%3A27Z&se=2026-03-28T14%3A27%3A27Z&sr=b&sp=r&sig=TFQrF%2FjkhRPUwB62qt8YSavHgBqeuo7q2b9lsdnq4W8%3D)
2026-03-28 14:02:38 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:02:38 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:02:38 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:02:38 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:02:38 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:02:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:02:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c683d90>
2026-03-28 14:02:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:02:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:02:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:02:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_73dc1fed-646a-544c-b3e5-ff1b6aff4358/73dc1fed-646a-544c-b3e5-ff1b6aff4358_image_9.jpg HTTP/1.1" 201 0
2026-03-28 14:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FFA18OJS%252F698923504%252F600') HTTP/1.1" 204 0
2026-03-28 14:02:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FA18OJS/698923504/600 saved to cache
2026-03-28 14:02:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 73dc1fed-646a-544c-b3e5-ff1b6aff4358
2026-03-28 14:02:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RE03XJT/698934082/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/RE03XJT/42810438?sv=2020-08-04&st=2026-03-28T14%3A02%3A25Z&se=2026-03-28T14%3A27%3A25Z&sr=b&sp=r&sig=W%2BmiGFHKvJXzfBcOMLhIRCoLkA3AzDMDP5bgxDrTPQQ%3D)
2026-03-28 14:02:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RE12OHA/698568399/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/RE12OHA/42803024?sv=2020-08-04&st=2026-03-28T14%3A02%3A26Z&se=2026-03-28T14%3A27%3A26Z&sr=b&sp=r&sig=6BH8YhGE%2FtZL7bPaACcZWXnEkdIvYtNlALyKqaLOq1E%3D)
2026-03-28 14:02:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KR14OUW/696662301/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/KR14OUW/42810276?sv=2020-08-04&st=2026-03-28T14%3A02%3A25Z&se=2026-03-28T14%3A27%3A25Z&sr=b&sp=r&sig=yD0HrAKd1eOENYPcHLYCjZQ9zljwYHJA7s3b8Za%2BpDw%3D)
2026-03-28 14:02:38 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:02:38 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:02:38 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:02:38 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:02:38 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:02:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:02:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a30ea79d0>
2026-03-28 14:02:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:02:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:02:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:02:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8b64f21f-1ee3-5237-8105-b88b835030a8/8b64f21f-1ee3-5237-8105-b88b835030a8_image_7.jpg HTTP/1.1" 201 0
2026-03-28 14:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FHV58YJY%252F698928917%252F600') HTTP/1.1" 204 0
2026-03-28 14:02:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HV58YJY/698928917/600 saved to cache
2026-03-28 14:02:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 8b64f21f-1ee3-5237-8105-b88b835030a8
2026-03-28 14:02:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:02:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2d80b8d0>
2026-03-28 14:02:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:02:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:02:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:02:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_306d9676-19ce-5840-84c5-e10231e34614/306d9676-19ce-5840-84c5-e10231e34614_image_3.jpg HTTP/1.1" 201 0
2026-03-28 14:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FVE67DLJ%252F697994969%252F600') HTTP/1.1" 204 0
2026-03-28 14:02:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VE67DLJ/697994969/600 saved to cache
2026-03-28 14:02:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 306d9676-19ce-5840-84c5-e10231e34614
2026-03-28 14:02:38 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:02:38 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:02:38 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:02:38 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:02:38 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:02:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:02:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c7316d0>
2026-03-28 14:02:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:02:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:02:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:02:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_299c12ca-ac8c-5489-8f0d-0d144c80340f/299c12ca-ac8c-5489-8f0d-0d144c80340f_image_7.jpg HTTP/1.1" 201 0
2026-03-28 14:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FCY68EOB%252F698765358%252F600') HTTP/1.1" 204 0
2026-03-28 14:02:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CY68EOB/698765358/600 saved to cache
2026-03-28 14:02:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 299c12ca-ac8c-5489-8f0d-0d144c80340f
2026-03-28 14:02:38 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:02:38 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:02:38 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:02:38 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:02:38 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:02:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:02:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2d783a10>
2026-03-28 14:02:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:02:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:02:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:02:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_85df4e80-1e5a-5573-ad99-0445a298364d/85df4e80-1e5a-5573-ad99-0445a298364d_image_8.jpg HTTP/1.1" 201 0
2026-03-28 14:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FEP19XHA%252F698568581%252F600') HTTP/1.1" 204 0
2026-03-28 14:02:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EP19XHA/698568581/600 saved to cache
2026-03-28 14:02:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 85df4e80-1e5a-5573-ad99-0445a298364d
2026-03-28 14:02:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LX66XGU/698585735/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LX66XGU/42810324?sv=2020-08-04&st=2026-03-28T14%3A02%3A26Z&se=2026-03-28T14%3A27%3A26Z&sr=b&sp=r&sig=jbz9LK9iyQlEY35Z3G5ue8uqHIh1I8l1GE31H0hzYMg%3D)
2026-03-28 14:02:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CY68EOB/698765328/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/CY68EOB/42807353?sv=2020-08-04&st=2026-03-28T14%3A02%3A25Z&se=2026-03-28T14%3A27%3A25Z&sr=b&sp=r&sig=VhOAFQtPLoY4JTixFnYBwYrQPfJNMc8rMp4NstNU2cM%3D)
2026-03-28 14:02:38 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EP19XHA/698568540/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698568540>
2026-03-28 14:02:38 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BO55VOP/698269145/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698269145>
2026-03-28 14:02:38 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FA18OJS/698923447/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698923447>
2026-03-28 14:02:38 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LX66XGU/698585716/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=LX66XGU-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-28 14:02:38 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:02:38 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:02:38 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:02:38 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:02:38 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:02:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:02:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2de23490>
2026-03-28 14:02:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:02:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:02:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:02:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_73dc1fed-646a-544c-b3e5-ff1b6aff4358/73dc1fed-646a-544c-b3e5-ff1b6aff4358_image_8.jpg HTTP/1.1" 201 0
2026-03-28 14:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FFA18OJS%252F698923476%252F600') HTTP/1.1" 204 0
2026-03-28 14:02:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FA18OJS/698923476/600 saved to cache
2026-03-28 14:02:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 73dc1fed-646a-544c-b3e5-ff1b6aff4358
2026-03-28 14:02:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HV58YJY/698928892/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/HV58YJY/42810015?sv=2020-08-04&st=2026-03-28T14%3A02%3A25Z&se=2026-03-28T14%3A27%3A25Z&sr=b&sp=r&sig=4E7oaf6jl0JMYjcpc4K4%2F3uy5%2BGOvEW6yFoZ9j75kNU%3D)
2026-03-28 14:02:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RE03XJT/698934068/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/RE03XJT/42810438?sv=2020-08-04&st=2026-03-28T14%3A02%3A25Z&se=2026-03-28T14%3A27%3A25Z&sr=b&sp=r&sig=W%2BmiGFHKvJXzfBcOMLhIRCoLkA3AzDMDP5bgxDrTPQQ%3D)
2026-03-28 14:02:38 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FA18OJS/698923415/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698923415>
2026-03-28 14:02:38 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CY68EOB/698765300/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698765300>
2026-03-28 14:02:38 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KR14OUW/696662294/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=696662294>
2026-03-28 14:02:38 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HV58YJY/698928865/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698928865>
2026-03-28 14:02:38 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EP19XHA/698568502/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698568502>
2026-03-28 14:02:38 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RE03XJT/698934050/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698934050>
2026-03-28 14:02:38 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:02:38 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:02:38 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:02:38 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:02:38 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:02:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:02:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c5e11d0>
2026-03-28 14:02:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:02:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:02:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:02:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5096b957-ac5c-5cc4-a891-49042e75677e/5096b957-ac5c-5cc4-a891-49042e75677e_image_7.jpg HTTP/1.1" 201 0
2026-03-28 14:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FKR14OUW%252F696662307%252F600') HTTP/1.1" 204 0
2026-03-28 14:02:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KR14OUW/696662307/600 saved to cache
2026-03-28 14:02:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 5096b957-ac5c-5cc4-a891-49042e75677e
2026-03-28 14:02:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:02:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a1fd7c350>
2026-03-28 14:02:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:02:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:02:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:02:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0df2aa72-34d7-5e00-86eb-dff801f0634b/0df2aa72-34d7-5e00-86eb-dff801f0634b_image_4.jpg HTTP/1.1" 201 0
2026-03-28 14:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FBO55VOP%252F698269149%252F600') HTTP/1.1" 204 0
2026-03-28 14:02:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BO55VOP/698269149/600 saved to cache
2026-03-28 14:02:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 0df2aa72-34d7-5e00-86eb-dff801f0634b
2026-03-28 14:02:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:02:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a1ff17a50>
2026-03-28 14:02:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:02:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:02:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:02:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e944d65b-4e9e-513c-a6ae-acea2437087d/e944d65b-4e9e-513c-a6ae-acea2437087d_image_3.jpg HTTP/1.1" 201 0
2026-03-28 14:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FKM67WBP%252F697678309%252F600') HTTP/1.1" 204 0
2026-03-28 14:02:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KM67WBP/697678309/600 saved to cache
2026-03-28 14:02:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item e944d65b-4e9e-513c-a6ae-acea2437087d
2026-03-28 14:02:39 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:02:39 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:02:39 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:02:39 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:02:39 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:02:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:02:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2da0f0d0>
2026-03-28 14:02:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:02:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:02:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:02:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0d8a0ea5-df55-5526-b46c-23b49b8e0dc3/0d8a0ea5-df55-5526-b46c-23b49b8e0dc3_image_7.jpg HTTP/1.1" 201 0
2026-03-28 14:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FRE03XJT%252F698934082%252F600') HTTP/1.1" 204 0
2026-03-28 14:02:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RE03XJT/698934082/600 saved to cache
2026-03-28 14:02:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 0d8a0ea5-df55-5526-b46c-23b49b8e0dc3
2026-03-28 14:02:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:02:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a1ff17cd0>
2026-03-28 14:02:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:02:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:02:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:02:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f1c7ee15-186c-50e6-9aec-cc206e8adf16/f1c7ee15-186c-50e6-9aec-cc206e8adf16_image_3.jpg HTTP/1.1" 201 0
2026-03-28 14:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FRE12OHA%252F698568399%252F600') HTTP/1.1" 204 0
2026-03-28 14:02:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RE12OHA/698568399/600 saved to cache
2026-03-28 14:02:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item f1c7ee15-186c-50e6-9aec-cc206e8adf16
2026-03-28 14:02:39 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:02:39 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:02:39 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:02:39 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:02:39 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:02:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:02:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c5fb150>
2026-03-28 14:02:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:02:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:02:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:02:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5096b957-ac5c-5cc4-a891-49042e75677e/5096b957-ac5c-5cc4-a891-49042e75677e_image_6.jpg HTTP/1.1" 201 0
2026-03-28 14:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FKR14OUW%252F696662301%252F600') HTTP/1.1" 204 0
2026-03-28 14:02:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KR14OUW/696662301/600 saved to cache
2026-03-28 14:02:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 5096b957-ac5c-5cc4-a891-49042e75677e
2026-03-28 14:02:39 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KM67WBP/697678266/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=697678266>
2026-03-28 14:02:39 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SB72GWA/698536906/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698536906>
2026-03-28 14:02:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:02:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c4c99d0>
2026-03-28 14:02:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:02:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:02:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:02:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_59e0d1bf-73d7-5811-a0ff-a2a694262d4e/59e0d1bf-73d7-5811-a0ff-a2a694262d4e_image_1.jpg HTTP/1.1" 201 0
2026-03-28 14:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLX66XGU%252F698585735%252F600') HTTP/1.1" 204 0
2026-03-28 14:02:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LX66XGU/698585735/600 saved to cache
2026-03-28 14:02:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 59e0d1bf-73d7-5811-a0ff-a2a694262d4e
2026-03-28 14:02:39 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:02:39 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:02:39 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:02:39 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:02:39 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:02:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:02:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2d9d33d0>
2026-03-28 14:02:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:02:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:02:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:02:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_299c12ca-ac8c-5489-8f0d-0d144c80340f/299c12ca-ac8c-5489-8f0d-0d144c80340f_image_6.jpg HTTP/1.1" 201 0
2026-03-28 14:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FCY68EOB%252F698765328%252F600') HTTP/1.1" 204 0
2026-03-28 14:02:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CY68EOB/698765328/600 saved to cache
2026-03-28 14:02:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 299c12ca-ac8c-5489-8f0d-0d144c80340f
2026-03-28 14:02:39 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:02:39 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:02:39 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:02:39 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:02:39 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:02:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:02:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2d9fc650>
2026-03-28 14:02:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:02:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:02:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:02:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8b64f21f-1ee3-5237-8105-b88b835030a8/8b64f21f-1ee3-5237-8105-b88b835030a8_image_6.jpg HTTP/1.1" 201 0
2026-03-28 14:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FHV58YJY%252F698928892%252F600') HTTP/1.1" 204 0
2026-03-28 14:02:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HV58YJY/698928892/600 saved to cache
2026-03-28 14:02:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 8b64f21f-1ee3-5237-8105-b88b835030a8
2026-03-28 14:02:39 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:02:39 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:02:39 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:02:39 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:02:39 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:02:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:02:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2ca5e2d0>
2026-03-28 14:02:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:02:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:02:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:02:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0d8a0ea5-df55-5526-b46c-23b49b8e0dc3/0d8a0ea5-df55-5526-b46c-23b49b8e0dc3_image_6.jpg HTTP/1.1" 201 0
2026-03-28 14:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FRE03XJT%252F698934068%252F600') HTTP/1.1" 204 0
2026-03-28 14:02:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RE03XJT/698934068/600 saved to cache
2026-03-28 14:02:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 0d8a0ea5-df55-5526-b46c-23b49b8e0dc3
2026-03-28 14:02:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BO55VOP/698269145/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/BO55VOP/42810137?sv=2020-08-04&st=2026-03-28T14%3A02%3A26Z&se=2026-03-28T14%3A27%3A26Z&sr=b&sp=r&sig=ClLegZn5u1dkNPwcbCwa7jDTCtqtY8g86xpgxUm2UfM%3D)
2026-03-28 14:02:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LX66XGU/698585716/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LX66XGU/42810324?sv=2020-08-04&st=2026-03-28T14%3A02%3A26Z&se=2026-03-28T14%3A27%3A26Z&sr=b&sp=r&sig=jbz9LK9iyQlEY35Z3G5ue8uqHIh1I8l1GE31H0hzYMg%3D)
2026-03-28 14:02:39 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VE67DLJ/697994961/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=697994961>
2026-03-28 14:02:39 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RE12OHA/698568353/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698568353>
2026-03-28 14:02:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EP19XHA/698568540/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/EP19XHA/42803467?sv=2020-08-04&st=2026-03-28T14%3A02%3A25Z&se=2026-03-28T14%3A27%3A25Z&sr=b&sp=r&sig=3aXptHZNTY1xw5UUqyLl7yubHBPKRq5U01kDhdsbsYM%3D)
2026-03-28 14:02:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FA18OJS/698923447/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/FA18OJS/42809927?sv=2020-08-04&st=2026-03-28T14%3A02%3A25Z&se=2026-03-28T14%3A27%3A25Z&sr=b&sp=r&sig=wYbenAdSOJrfSZzoBonOEa6%2BD7yy%2FzPCYgKi2Sl75o8%3D)
2026-03-28 14:02:39 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HV58YJY/698928845/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698928845>
2026-03-28 14:02:39 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KR14OUW/696662290/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=696662290>
2026-03-28 14:02:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KR14OUW/696662294/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/KR14OUW/42810276?sv=2020-08-04&st=2026-03-28T14%3A02%3A25Z&se=2026-03-28T14%3A27%3A25Z&sr=b&sp=r&sig=yD0HrAKd1eOENYPcHLYCjZQ9zljwYHJA7s3b8Za%2BpDw%3D)
2026-03-28 14:02:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EP19XHA/698568502/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/EP19XHA/42803467?sv=2020-08-04&st=2026-03-28T14%3A02%3A25Z&se=2026-03-28T14%3A27%3A25Z&sr=b&sp=r&sig=3aXptHZNTY1xw5UUqyLl7yubHBPKRq5U01kDhdsbsYM%3D)
2026-03-28 14:02:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HV58YJY/698928865/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/HV58YJY/42810015?sv=2020-08-04&st=2026-03-28T14%3A02%3A25Z&se=2026-03-28T14%3A27%3A25Z&sr=b&sp=r&sig=4E7oaf6jl0JMYjcpc4K4%2F3uy5%2BGOvEW6yFoZ9j75kNU%3D)
2026-03-28 14:02:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FA18OJS/698923415/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/FA18OJS/42809927?sv=2020-08-04&st=2026-03-28T14%3A02%3A25Z&se=2026-03-28T14%3A27%3A25Z&sr=b&sp=r&sig=wYbenAdSOJrfSZzoBonOEa6%2BD7yy%2FzPCYgKi2Sl75o8%3D)
2026-03-28 14:02:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:02:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c628fd0>
2026-03-28 14:02:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:02:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:02:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:02:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0df2aa72-34d7-5e00-86eb-dff801f0634b/0df2aa72-34d7-5e00-86eb-dff801f0634b_image_3.jpg HTTP/1.1" 201 0
2026-03-28 14:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FBO55VOP%252F698269145%252F600') HTTP/1.1" 204 0
2026-03-28 14:02:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BO55VOP/698269145/600 saved to cache
2026-03-28 14:02:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 0df2aa72-34d7-5e00-86eb-dff801f0634b
2026-03-28 14:02:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RE03XJT/698934050/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/RE03XJT/42810438?sv=2020-08-04&st=2026-03-28T14%3A02%3A25Z&se=2026-03-28T14%3A27%3A25Z&sr=b&sp=r&sig=W%2BmiGFHKvJXzfBcOMLhIRCoLkA3AzDMDP5bgxDrTPQQ%3D)
2026-03-28 14:02:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CY68EOB/698765300/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/CY68EOB/42807353?sv=2020-08-04&st=2026-03-28T14%3A02%3A25Z&se=2026-03-28T14%3A27%3A25Z&sr=b&sp=r&sig=VhOAFQtPLoY4JTixFnYBwYrQPfJNMc8rMp4NstNU2cM%3D)
2026-03-28 14:02:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:02:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c5056d0>
2026-03-28 14:02:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:02:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:02:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:02:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_59e0d1bf-73d7-5811-a0ff-a2a694262d4e/59e0d1bf-73d7-5811-a0ff-a2a694262d4e_image_0.jpg HTTP/1.1" 201 0
2026-03-28 14:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLX66XGU%252F698585716%252F600') HTTP/1.1" 204 0
2026-03-28 14:02:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LX66XGU/698585716/600 saved to cache
2026-03-28 14:02:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 59e0d1bf-73d7-5811-a0ff-a2a694262d4e
2026-03-28 14:02:39 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 59e0d1bf-73d7-5811-a0ff-a2a694262d4e, skipping ID generation
2026-03-28 14:02:39 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 59e0d1bf-73d7-5811-a0ff-a2a694262d4e sending to next pipeline
2026-03-28 14:02:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 59e0d1bf-73d7-5811-a0ff-a2a694262d4e, identifier: LX66%20XGU
2026-03-28 14:02:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 59e0d1bf-73d7-5811-a0ff-a2a694262d4e with identifier: LX66%20XGU
2026-03-28 14:02:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 59e0d1bf-73d7-5811-a0ff-a2a694262d4e with identifier: LX66%20XGU
2026-03-28 14:02:40 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 59e0d1bf-73d7-5811-a0ff-a2a694262d4e with identifier: LX66%20XGU to the API
2026-03-28 14:02:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:02:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:02:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LX66XGU/698585716/600>
{'auction_title': '',
'c_o_2_emission_value': 144,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_59e0d1bf-73d7-5811-a0ff-a2a694262d4e/59e0d1bf-73d7-5811-a0ff-a2a694262d4e_expert_report_file_56d35aaf-d3cc-4239-97ad-a0c10aaf29e9.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=LX66%20XGU-GB',
'category': 'Car',
'color': 'black',
'currency': 'GBP',
'doors_number': 5,
'engine': '2.0L',
'expiration_date': '2026-03-29T10:00:00Z',
'fuel_type': 'Diesel',
'id': '59e0d1bf-73d7-5811-a0ff-a2a694262d4e',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'LX66 XGU',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=LX66%20XGU&vehicleType=*',
'listing': 'auction',
'location': 'Paddock Wood',
'make': 'FORD',
'model': 'S-MAX VIGNALE',
'odometer': 126071,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 11,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_59e0d1bf-73d7-5811-a0ff-a2a694262d4e/59e0d1bf-73d7-5811-a0ff-a2a694262d4e_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 55734,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LX66XGU/698585716/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_59e0d1bf-73d7-5811-a0ff-a2a694262d4e/59e0d1bf-73d7-5811-a0ff-a2a694262d4e_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 55594,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LX66XGU/698585735/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_59e0d1bf-73d7-5811-a0ff-a2a694262d4e/59e0d1bf-73d7-5811-a0ff-a2a694262d4e_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 53304,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LX66XGU/698585748/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_59e0d1bf-73d7-5811-a0ff-a2a694262d4e/59e0d1bf-73d7-5811-a0ff-a2a694262d4e_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 50133,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LX66XGU/698585766/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_59e0d1bf-73d7-5811-a0ff-a2a694262d4e/59e0d1bf-73d7-5811-a0ff-a2a694262d4e_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 48425,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LX66XGU/698585778/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_59e0d1bf-73d7-5811-a0ff-a2a694262d4e/59e0d1bf-73d7-5811-a0ff-a2a694262d4e_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 47894,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LX66XGU/698585790/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_59e0d1bf-73d7-5811-a0ff-a2a694262d4e/59e0d1bf-73d7-5811-a0ff-a2a694262d4e_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 105458,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LX66XGU/698585807/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_59e0d1bf-73d7-5811-a0ff-a2a694262d4e/59e0d1bf-73d7-5811-a0ff-a2a694262d4e_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 85988,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LX66XGU/698585847/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_59e0d1bf-73d7-5811-a0ff-a2a694262d4e/59e0d1bf-73d7-5811-a0ff-a2a694262d4e_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 81911,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LX66XGU/698585871/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_59e0d1bf-73d7-5811-a0ff-a2a694262d4e/59e0d1bf-73d7-5811-a0ff-a2a694262d4e_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 75044,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LX66XGU/698585883/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-01-01',
'seller_name': None,
'title': 'FORD S-MAX VIGNALE 2.0 TDCI 210 P/S MPV',
'transmission': 'automatic',
'trim': 'TDCI 210 P/S',
'vin': 'WF0JXXWPCJGK53805',
'year': 2016}
2026-03-28 14:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LX66%2520XGU%27 HTTP/1.1" 200 None
2026-03-28 14:02:40 [bca.uk] INFO: Saving data for LX66%20XGU: {'created_time': 1774706560.384624, 'last_price_update_time': 1774706560.384637, 'auction_closing_time': 1774778400.0}
2026-03-28 14:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='LX66%2520XGU') HTTP/1.1" 204 0
2026-03-28 14:02:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VE67DLJ/697994961/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/VE67DLJ/42810299?sv=2020-08-04&st=2026-03-28T14%3A02%3A26Z&se=2026-03-28T14%3A27%3A26Z&sr=b&sp=r&sig=s%2BFYsI609HRDhg5CyGwQVAsfiplztmlKAHuHQLONuoQ%3D)
2026-03-28 14:02:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RE12OHA/698568353/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/RE12OHA/42803024?sv=2020-08-04&st=2026-03-28T14%3A02%3A26Z&se=2026-03-28T14%3A27%3A26Z&sr=b&sp=r&sig=6BH8YhGE%2FtZL7bPaACcZWXnEkdIvYtNlALyKqaLOq1E%3D)
2026-03-28 14:02:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KM67WBP/697678266/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/KM67WBP/42809464?sv=2020-08-04&st=2026-03-28T14%3A02%3A27Z&se=2026-03-28T14%3A27%3A27Z&sr=b&sp=r&sig=TFQrF%2FjkhRPUwB62qt8YSavHgBqeuo7q2b9lsdnq4W8%3D)
2026-03-28 14:02:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SB72GWA/698536906/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/SB72GWA/42810143?sv=2020-08-04&st=2026-03-28T14%3A02%3A28Z&se=2026-03-28T14%3A27%3A28Z&sr=b&sp=r&sig=COnND%2FooxrhanQtXLj4FeOKa%2Fkcoi5LKjGkYGyTn0a4%3D)
2026-03-28 14:02:40 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CY68EOB/698765281/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698765281>
2026-03-28 14:02:40 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RE03XJT/698934033/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698934033>
2026-03-28 14:02:40 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EP19XHA/698568458/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698568458>
2026-03-28 14:02:40 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FA18OJS/698923380/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698923380>
2026-03-28 14:02:40 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:02:40 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:02:40 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:02:40 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:02:40 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:02:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:02:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a1fd5ba10>
2026-03-28 14:02:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:02:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:02:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:02:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_85df4e80-1e5a-5573-ad99-0445a298364d/85df4e80-1e5a-5573-ad99-0445a298364d_image_7.jpg HTTP/1.1" 201 0
2026-03-28 14:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FEP19XHA%252F698568540%252F600') HTTP/1.1" 204 0
2026-03-28 14:02:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EP19XHA/698568540/600 saved to cache
2026-03-28 14:02:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 85df4e80-1e5a-5573-ad99-0445a298364d
2026-03-28 14:02:40 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:02:40 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:02:40 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:02:40 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:02:40 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:02:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:02:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c6b1a90>
2026-03-28 14:02:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:02:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:02:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:02:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_73dc1fed-646a-544c-b3e5-ff1b6aff4358/73dc1fed-646a-544c-b3e5-ff1b6aff4358_image_7.jpg HTTP/1.1" 201 0
2026-03-28 14:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FFA18OJS%252F698923447%252F600') HTTP/1.1" 204 0
2026-03-28 14:02:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FA18OJS/698923447/600 saved to cache
2026-03-28 14:02:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 73dc1fed-646a-544c-b3e5-ff1b6aff4358
2026-03-28 14:02:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:02:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c0cf850>
2026-03-28 14:02:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:02:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:02:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:02:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5096b957-ac5c-5cc4-a891-49042e75677e/5096b957-ac5c-5cc4-a891-49042e75677e_image_5.jpg HTTP/1.1" 201 0
2026-03-28 14:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FKR14OUW%252F696662294%252F600') HTTP/1.1" 204 0
2026-03-28 14:02:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KR14OUW/696662294/600 saved to cache
2026-03-28 14:02:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 5096b957-ac5c-5cc4-a891-49042e75677e
2026-03-28 14:02:40 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:02:40 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:02:40 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:02:40 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:02:40 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:02:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:02:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c6b1e90>
2026-03-28 14:02:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:02:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:02:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:02:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_85df4e80-1e5a-5573-ad99-0445a298364d/85df4e80-1e5a-5573-ad99-0445a298364d_image_6.jpg HTTP/1.1" 201 0
2026-03-28 14:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FEP19XHA%252F698568502%252F600') HTTP/1.1" 204 0
2026-03-28 14:02:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EP19XHA/698568502/600 saved to cache
2026-03-28 14:02:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 85df4e80-1e5a-5573-ad99-0445a298364d
2026-03-28 14:02:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:02:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c3b4ed0>
2026-03-28 14:02:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:02:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:02:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:02:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8b64f21f-1ee3-5237-8105-b88b835030a8/8b64f21f-1ee3-5237-8105-b88b835030a8_image_5.jpg HTTP/1.1" 201 0
2026-03-28 14:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FHV58YJY%252F698928865%252F600') HTTP/1.1" 204 0
2026-03-28 14:02:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HV58YJY/698928865/600 saved to cache
2026-03-28 14:02:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 8b64f21f-1ee3-5237-8105-b88b835030a8
2026-03-28 14:02:40 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:02:40 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:02:40 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:02:40 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:02:40 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:02:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:02:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c8cd790>
2026-03-28 14:02:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:02:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:02:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:02:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_73dc1fed-646a-544c-b3e5-ff1b6aff4358/73dc1fed-646a-544c-b3e5-ff1b6aff4358_image_6.jpg HTTP/1.1" 201 0
2026-03-28 14:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FFA18OJS%252F698923415%252F600') HTTP/1.1" 204 0
2026-03-28 14:02:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FA18OJS/698923415/600 saved to cache
2026-03-28 14:02:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 73dc1fed-646a-544c-b3e5-ff1b6aff4358
2026-03-28 14:02:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:02:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c819650>
2026-03-28 14:02:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:02:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:02:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:02:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0d8a0ea5-df55-5526-b46c-23b49b8e0dc3/0d8a0ea5-df55-5526-b46c-23b49b8e0dc3_image_5.jpg HTTP/1.1" 201 0
2026-03-28 14:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FRE03XJT%252F698934050%252F600') HTTP/1.1" 204 0
2026-03-28 14:02:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RE03XJT/698934050/600 saved to cache
2026-03-28 14:02:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 0d8a0ea5-df55-5526-b46c-23b49b8e0dc3
2026-03-28 14:02:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:02:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c6b2550>
2026-03-28 14:02:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:02:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:02:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:02:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_299c12ca-ac8c-5489-8f0d-0d144c80340f/299c12ca-ac8c-5489-8f0d-0d144c80340f_image_5.jpg HTTP/1.1" 201 0
2026-03-28 14:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FCY68EOB%252F698765300%252F600') HTTP/1.1" 204 0
2026-03-28 14:02:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CY68EOB/698765300/600 saved to cache
2026-03-28 14:02:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 299c12ca-ac8c-5489-8f0d-0d144c80340f
2026-03-28 14:02:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:02:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a3063dad0>
2026-03-28 14:02:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:02:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:02:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:02:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_306d9676-19ce-5840-84c5-e10231e34614/306d9676-19ce-5840-84c5-e10231e34614_image_1.jpg HTTP/1.1" 201 0
2026-03-28 14:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FVE67DLJ%252F697994961%252F600') HTTP/1.1" 204 0
2026-03-28 14:02:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VE67DLJ/697994961/600 saved to cache
2026-03-28 14:02:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 306d9676-19ce-5840-84c5-e10231e34614
2026-03-28 14:02:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:02:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2d8e41d0>
2026-03-28 14:02:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:02:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:02:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:02:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f1c7ee15-186c-50e6-9aec-cc206e8adf16/f1c7ee15-186c-50e6-9aec-cc206e8adf16_image_1.jpg HTTP/1.1" 201 0
2026-03-28 14:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FRE12OHA%252F698568353%252F600') HTTP/1.1" 204 0
2026-03-28 14:02:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RE12OHA/698568353/600 saved to cache
2026-03-28 14:02:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item f1c7ee15-186c-50e6-9aec-cc206e8adf16
2026-03-28 14:02:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:02:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2fe311d0>
2026-03-28 14:02:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:02:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:02:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:02:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e944d65b-4e9e-513c-a6ae-acea2437087d/e944d65b-4e9e-513c-a6ae-acea2437087d_image_1.jpg HTTP/1.1" 201 0
2026-03-28 14:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FKM67WBP%252F697678266%252F600') HTTP/1.1" 204 0
2026-03-28 14:02:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KM67WBP/697678266/600 saved to cache
2026-03-28 14:02:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item e944d65b-4e9e-513c-a6ae-acea2437087d
2026-03-28 14:02:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:02:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a1fee8d10>
2026-03-28 14:02:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:02:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:02:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:02:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_76904bbf-2ca2-5c17-a3c3-eefa3b562aab/76904bbf-2ca2-5c17-a3c3-eefa3b562aab_image_1.jpg HTTP/1.1" 201 0
2026-03-28 14:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FSB72GWA%252F698536906%252F600') HTTP/1.1" 204 0
2026-03-28 14:02:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SB72GWA/698536906/600 saved to cache
2026-03-28 14:02:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 76904bbf-2ca2-5c17-a3c3-eefa3b562aab
2026-03-28 14:02:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KR14OUW/696662290/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/KR14OUW/42810276?sv=2020-08-04&st=2026-03-28T14%3A02%3A25Z&se=2026-03-28T14%3A27%3A25Z&sr=b&sp=r&sig=yD0HrAKd1eOENYPcHLYCjZQ9zljwYHJA7s3b8Za%2BpDw%3D)
2026-03-28 14:02:40 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SM67VNV/698094197/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698094197>
2026-03-28 14:02:40 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WP62XCK/697615142/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=697615142>
2026-03-28 14:02:40 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SB72GWA/698536898/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=SB72GWA-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-28 14:02:40 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VE67DLJ/697994957/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=VE67DLJ-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-28 14:02:40 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KM67WBP/697678255/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=KM67WBP-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-28 14:02:40 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RE12OHA/698568338/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=RE12OHA-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-28 14:02:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HV58YJY/698928845/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/HV58YJY/42810015?sv=2020-08-04&st=2026-03-28T14%3A02%3A25Z&se=2026-03-28T14%3A27%3A25Z&sr=b&sp=r&sig=4E7oaf6jl0JMYjcpc4K4%2F3uy5%2BGOvEW6yFoZ9j75kNU%3D)
2026-03-28 14:02:41 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BO55VOP/698269135/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698269135>
2026-03-28 14:02:41 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CY68EOB/698765249/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698765249>
2026-03-28 14:02:41 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KR14OUW/696662286/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=696662286>
2026-03-28 14:02:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EP19XHA/698568458/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/EP19XHA/42803467?sv=2020-08-04&st=2026-03-28T14%3A02%3A25Z&se=2026-03-28T14%3A27%3A25Z&sr=b&sp=r&sig=3aXptHZNTY1xw5UUqyLl7yubHBPKRq5U01kDhdsbsYM%3D)
2026-03-28 14:02:41 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HV58YJY/698928826/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698928826>
2026-03-28 14:02:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:02:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2fe30b90>
2026-03-28 14:02:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:02:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:02:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:02:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5096b957-ac5c-5cc4-a891-49042e75677e/5096b957-ac5c-5cc4-a891-49042e75677e_image_4.jpg HTTP/1.1" 201 0
2026-03-28 14:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FKR14OUW%252F696662290%252F600') HTTP/1.1" 204 0
2026-03-28 14:02:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KR14OUW/696662290/600 saved to cache
2026-03-28 14:02:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 5096b957-ac5c-5cc4-a891-49042e75677e
2026-03-28 14:02:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RE03XJT/698934033/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/RE03XJT/42810438?sv=2020-08-04&st=2026-03-28T14%3A02%3A25Z&se=2026-03-28T14%3A27%3A25Z&sr=b&sp=r&sig=W%2BmiGFHKvJXzfBcOMLhIRCoLkA3AzDMDP5bgxDrTPQQ%3D)
2026-03-28 14:02:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FA18OJS/698923380/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/FA18OJS/42809927?sv=2020-08-04&st=2026-03-28T14%3A02%3A25Z&se=2026-03-28T14%3A27%3A25Z&sr=b&sp=r&sig=wYbenAdSOJrfSZzoBonOEa6%2BD7yy%2FzPCYgKi2Sl75o8%3D)
2026-03-28 14:02:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VE67DLJ/697994957/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/VE67DLJ/42810299?sv=2020-08-04&st=2026-03-28T14%3A02%3A26Z&se=2026-03-28T14%3A27%3A26Z&sr=b&sp=r&sig=s%2BFYsI609HRDhg5CyGwQVAsfiplztmlKAHuHQLONuoQ%3D)
2026-03-28 14:02:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:02:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2d782f10>
2026-03-28 14:02:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:02:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:02:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:02:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8b64f21f-1ee3-5237-8105-b88b835030a8/8b64f21f-1ee3-5237-8105-b88b835030a8_image_4.jpg HTTP/1.1" 201 0
2026-03-28 14:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FHV58YJY%252F698928845%252F600') HTTP/1.1" 204 0
2026-03-28 14:02:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HV58YJY/698928845/600 saved to cache
2026-03-28 14:02:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 8b64f21f-1ee3-5237-8105-b88b835030a8
2026-03-28 14:02:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RE12OHA/698568338/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/RE12OHA/42803024?sv=2020-08-04&st=2026-03-28T14%3A02%3A26Z&se=2026-03-28T14%3A27%3A26Z&sr=b&sp=r&sig=6BH8YhGE%2FtZL7bPaACcZWXnEkdIvYtNlALyKqaLOq1E%3D)
2026-03-28 14:02:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SB72GWA/698536898/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/SB72GWA/42810143?sv=2020-08-04&st=2026-03-28T14%3A02%3A28Z&se=2026-03-28T14%3A27%3A28Z&sr=b&sp=r&sig=COnND%2FooxrhanQtXLj4FeOKa%2Fkcoi5LKjGkYGyTn0a4%3D)
2026-03-28 14:02:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CY68EOB/698765281/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/CY68EOB/42807353?sv=2020-08-04&st=2026-03-28T14%3A02%3A25Z&se=2026-03-28T14%3A27%3A25Z&sr=b&sp=r&sig=VhOAFQtPLoY4JTixFnYBwYrQPfJNMc8rMp4NstNU2cM%3D)
2026-03-28 14:02:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KM67WBP/697678255/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/KM67WBP/42809464?sv=2020-08-04&st=2026-03-28T14%3A02%3A27Z&se=2026-03-28T14%3A27%3A27Z&sr=b&sp=r&sig=TFQrF%2FjkhRPUwB62qt8YSavHgBqeuo7q2b9lsdnq4W8%3D)
2026-03-28 14:02:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:02:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2de3d390>
2026-03-28 14:02:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:02:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:02:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:02:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_85df4e80-1e5a-5573-ad99-0445a298364d/85df4e80-1e5a-5573-ad99-0445a298364d_image_5.jpg HTTP/1.1" 201 0
2026-03-28 14:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FEP19XHA%252F698568458%252F600') HTTP/1.1" 204 0
2026-03-28 14:02:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EP19XHA/698568458/600 saved to cache
2026-03-28 14:02:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 85df4e80-1e5a-5573-ad99-0445a298364d
2026-03-28 14:02:41 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RE03XJT/698934011/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698934011>
2026-03-28 14:02:41 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EP19XHA/698568433/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698568433>
2026-03-28 14:02:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WP62XCK/697615142/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/WP62XCK/42810245?sv=2020-08-04&st=2026-03-28T14%3A02%3A21Z&se=2026-03-28T14%3A27%3A21Z&sr=b&sp=r&sig=gyEdXM91VrVknbZjiLD2toi%2BgCj7hBqRBYqi3Ts%2BfeU%3D)
2026-03-28 14:02:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BO55VOP/698269135/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/BO55VOP/42810137?sv=2020-08-04&st=2026-03-28T14%3A02%3A26Z&se=2026-03-28T14%3A27%3A26Z&sr=b&sp=r&sig=ClLegZn5u1dkNPwcbCwa7jDTCtqtY8g86xpgxUm2UfM%3D)
2026-03-28 14:02:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SM67VNV/698094197/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/SM67VNV/42810251?sv=2020-08-04&st=2026-03-28T14%3A02%3A21Z&se=2026-03-28T14%3A27%3A21Z&sr=b&sp=r&sig=zKf9cm3c2GLLDCKC9h0Kq9J3NSEBcqSIr7bWiyg1hwQ%3D)
2026-03-28 14:02:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:02:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2d958ad0>
2026-03-28 14:02:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:02:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:02:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:02:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0d8a0ea5-df55-5526-b46c-23b49b8e0dc3/0d8a0ea5-df55-5526-b46c-23b49b8e0dc3_image_4.jpg HTTP/1.1" 201 0
2026-03-28 14:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FRE03XJT%252F698934033%252F600') HTTP/1.1" 204 0
2026-03-28 14:02:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RE03XJT/698934033/600 saved to cache
2026-03-28 14:02:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 0d8a0ea5-df55-5526-b46c-23b49b8e0dc3
2026-03-28 14:02:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:02:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2d82a3d0>
2026-03-28 14:02:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:02:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:02:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:02:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_73dc1fed-646a-544c-b3e5-ff1b6aff4358/73dc1fed-646a-544c-b3e5-ff1b6aff4358_image_5.jpg HTTP/1.1" 201 0
2026-03-28 14:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FFA18OJS%252F698923380%252F600') HTTP/1.1" 204 0
2026-03-28 14:02:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FA18OJS/698923380/600 saved to cache
2026-03-28 14:02:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 73dc1fed-646a-544c-b3e5-ff1b6aff4358
2026-03-28 14:02:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:02:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a1ff14dd0>
2026-03-28 14:02:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:02:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:02:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:02:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_306d9676-19ce-5840-84c5-e10231e34614/306d9676-19ce-5840-84c5-e10231e34614_image_0.jpg HTTP/1.1" 201 0
2026-03-28 14:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FVE67DLJ%252F697994957%252F600') HTTP/1.1" 204 0
2026-03-28 14:02:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VE67DLJ/697994957/600 saved to cache
2026-03-28 14:02:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 306d9676-19ce-5840-84c5-e10231e34614
2026-03-28 14:02:41 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 306d9676-19ce-5840-84c5-e10231e34614, skipping ID generation
2026-03-28 14:02:41 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 306d9676-19ce-5840-84c5-e10231e34614 sending to next pipeline
2026-03-28 14:02:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 306d9676-19ce-5840-84c5-e10231e34614, identifier: VE67%20DLJ
2026-03-28 14:02:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HV58YJY/698928826/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/HV58YJY/42810015?sv=2020-08-04&st=2026-03-28T14%3A02%3A25Z&se=2026-03-28T14%3A27%3A25Z&sr=b&sp=r&sig=4E7oaf6jl0JMYjcpc4K4%2F3uy5%2BGOvEW6yFoZ9j75kNU%3D)
2026-03-28 14:02:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CY68EOB/698765249/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/CY68EOB/42807353?sv=2020-08-04&st=2026-03-28T14%3A02%3A25Z&se=2026-03-28T14%3A27%3A25Z&sr=b&sp=r&sig=VhOAFQtPLoY4JTixFnYBwYrQPfJNMc8rMp4NstNU2cM%3D)
2026-03-28 14:02:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 306d9676-19ce-5840-84c5-e10231e34614 with identifier: VE67%20DLJ
2026-03-28 14:02:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 306d9676-19ce-5840-84c5-e10231e34614 with identifier: VE67%20DLJ
2026-03-28 14:02:41 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 306d9676-19ce-5840-84c5-e10231e34614 with identifier: VE67%20DLJ to the API
2026-03-28 14:02:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:02:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:02:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VE67DLJ/697994957/600>
{'auction_title': '',
'c_o_2_emission_value': 169,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_306d9676-19ce-5840-84c5-e10231e34614/306d9676-19ce-5840-84c5-e10231e34614_expert_report_file_45d2b5c5-bd72-432b-b1e0-528609585745.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=VE67%20DLJ-GB',
'category': 'Car',
'color': 'white',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.6L',
'expiration_date': '2026-03-29T10:00:00Z',
'fuel_type': 'Petrol',
'id': '306d9676-19ce-5840-84c5-e10231e34614',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'VE67 DLJ',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=VE67%20DLJ&vehicleType=*',
'listing': 'auction',
'location': 'Paddock Wood',
'make': 'KIA',
'model': 'SPORTAGE',
'odometer': 90326,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 11,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_306d9676-19ce-5840-84c5-e10231e34614/306d9676-19ce-5840-84c5-e10231e34614_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 48976,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VE67DLJ/697994957/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_306d9676-19ce-5840-84c5-e10231e34614/306d9676-19ce-5840-84c5-e10231e34614_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 47780,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VE67DLJ/697994961/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_306d9676-19ce-5840-84c5-e10231e34614/306d9676-19ce-5840-84c5-e10231e34614_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 45780,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VE67DLJ/697994966/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_306d9676-19ce-5840-84c5-e10231e34614/306d9676-19ce-5840-84c5-e10231e34614_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 42745,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VE67DLJ/697994969/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_306d9676-19ce-5840-84c5-e10231e34614/306d9676-19ce-5840-84c5-e10231e34614_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 43892,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VE67DLJ/697994972/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_306d9676-19ce-5840-84c5-e10231e34614/306d9676-19ce-5840-84c5-e10231e34614_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 43813,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VE67DLJ/697994975/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_306d9676-19ce-5840-84c5-e10231e34614/306d9676-19ce-5840-84c5-e10231e34614_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 77079,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VE67DLJ/697994981/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_306d9676-19ce-5840-84c5-e10231e34614/306d9676-19ce-5840-84c5-e10231e34614_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 66671,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VE67DLJ/697994988/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_306d9676-19ce-5840-84c5-e10231e34614/306d9676-19ce-5840-84c5-e10231e34614_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 82079,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VE67DLJ/697994994/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_306d9676-19ce-5840-84c5-e10231e34614/306d9676-19ce-5840-84c5-e10231e34614_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 66835,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VE67DLJ/697995002/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-01-01',
'seller_name': None,
'title': 'KIA SPORTAGE 1.6 T GDI GT-LINE StationWagon',
'transmission': 'manual',
'trim': 'T GDI GT-LINE',
'vin': 'U5YPK816LHL374676',
'year': 2018}
2026-03-28 14:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27VE67%2520DLJ%27 HTTP/1.1" 200 None
2026-03-28 14:02:42 [bca.uk] INFO: Saving data for VE67%20DLJ: {'created_time': 1774706562.042371, 'last_price_update_time': 1774706562.042385, 'auction_closing_time': 1774778400.0}
2026-03-28 14:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='VE67%2520DLJ') HTTP/1.1" 204 0
2026-03-28 14:02:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KR14OUW/696662286/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/KR14OUW/42810276?sv=2020-08-04&st=2026-03-28T14%3A02%3A25Z&se=2026-03-28T14%3A27%3A25Z&sr=b&sp=r&sig=yD0HrAKd1eOENYPcHLYCjZQ9zljwYHJA7s3b8Za%2BpDw%3D)
2026-03-28 14:02:42 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SM67VNV/698094168/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698094168>
2026-03-28 14:02:42 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FA18OJS/698923357/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698923357>
2026-03-28 14:02:42 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WP62XCK/697615135/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=697615135>
2026-03-28 14:02:42 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BO55VOP/698269130/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=BO55VOP-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-28 14:02:42 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HV58YJY/698928812/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698928812>
2026-03-28 14:02:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:02:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c42b8d0>
2026-03-28 14:02:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:02:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:02:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:02:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f1c7ee15-186c-50e6-9aec-cc206e8adf16/f1c7ee15-186c-50e6-9aec-cc206e8adf16_image_0.jpg HTTP/1.1" 201 0
2026-03-28 14:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FRE12OHA%252F698568338%252F600') HTTP/1.1" 204 0
2026-03-28 14:02:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RE12OHA/698568338/600 saved to cache
2026-03-28 14:02:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item f1c7ee15-186c-50e6-9aec-cc206e8adf16
2026-03-28 14:02:42 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: f1c7ee15-186c-50e6-9aec-cc206e8adf16, skipping ID generation
2026-03-28 14:02:42 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item f1c7ee15-186c-50e6-9aec-cc206e8adf16 sending to next pipeline
2026-03-28 14:02:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: f1c7ee15-186c-50e6-9aec-cc206e8adf16, identifier: RE12%20OHA
2026-03-28 14:02:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:02:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a1fdb14d0>
2026-03-28 14:02:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:02:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:02:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:02:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_76904bbf-2ca2-5c17-a3c3-eefa3b562aab/76904bbf-2ca2-5c17-a3c3-eefa3b562aab_image_0.jpg HTTP/1.1" 201 0
2026-03-28 14:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FSB72GWA%252F698536898%252F600') HTTP/1.1" 204 0
2026-03-28 14:02:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SB72GWA/698536898/600 saved to cache
2026-03-28 14:02:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 76904bbf-2ca2-5c17-a3c3-eefa3b562aab
2026-03-28 14:02:42 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 76904bbf-2ca2-5c17-a3c3-eefa3b562aab, skipping ID generation
2026-03-28 14:02:42 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 76904bbf-2ca2-5c17-a3c3-eefa3b562aab sending to next pipeline
2026-03-28 14:02:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 76904bbf-2ca2-5c17-a3c3-eefa3b562aab, identifier: SB72%20GWA
2026-03-28 14:02:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:02:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c42b8d0>
2026-03-28 14:02:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:02:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:02:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:02:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_299c12ca-ac8c-5489-8f0d-0d144c80340f/299c12ca-ac8c-5489-8f0d-0d144c80340f_image_4.jpg HTTP/1.1" 201 0
2026-03-28 14:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FCY68EOB%252F698765281%252F600') HTTP/1.1" 204 0
2026-03-28 14:02:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CY68EOB/698765281/600 saved to cache
2026-03-28 14:02:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 299c12ca-ac8c-5489-8f0d-0d144c80340f
2026-03-28 14:02:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:02:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c0cd950>
2026-03-28 14:02:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:02:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:02:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:02:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e944d65b-4e9e-513c-a6ae-acea2437087d/e944d65b-4e9e-513c-a6ae-acea2437087d_image_0.jpg HTTP/1.1" 201 0
2026-03-28 14:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FKM67WBP%252F697678255%252F600') HTTP/1.1" 204 0
2026-03-28 14:02:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KM67WBP/697678255/600 saved to cache
2026-03-28 14:02:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item e944d65b-4e9e-513c-a6ae-acea2437087d
2026-03-28 14:02:42 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: e944d65b-4e9e-513c-a6ae-acea2437087d, skipping ID generation
2026-03-28 14:02:42 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item e944d65b-4e9e-513c-a6ae-acea2437087d sending to next pipeline
2026-03-28 14:02:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: e944d65b-4e9e-513c-a6ae-acea2437087d, identifier: KM67%20WBP
2026-03-28 14:02:42 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:02:42 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:02:42 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:02:42 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:02:42 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:02:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:02:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a1fdb4050>
2026-03-28 14:02:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:02:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:02:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:02:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_017f335f-f1b9-5de8-8cb9-bc79c2d2f45f/017f335f-f1b9-5de8-8cb9-bc79c2d2f45f_image_9.jpg HTTP/1.1" 201 0
2026-03-28 14:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FWP62XCK%252F697615142%252F600') HTTP/1.1" 204 0
2026-03-28 14:02:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WP62XCK/697615142/600 saved to cache
2026-03-28 14:02:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 017f335f-f1b9-5de8-8cb9-bc79c2d2f45f
2026-03-28 14:02:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:02:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a1ff51cd0>
2026-03-28 14:02:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:02:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:02:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:02:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0df2aa72-34d7-5e00-86eb-dff801f0634b/0df2aa72-34d7-5e00-86eb-dff801f0634b_image_1.jpg HTTP/1.1" 201 0
2026-03-28 14:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FBO55VOP%252F698269135%252F600') HTTP/1.1" 204 0
2026-03-28 14:02:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BO55VOP/698269135/600 saved to cache
2026-03-28 14:02:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 0df2aa72-34d7-5e00-86eb-dff801f0634b
2026-03-28 14:02:42 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:02:42 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:02:42 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:02:42 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:02:42 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:02:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:02:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2d6af7d0>
2026-03-28 14:02:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:02:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:02:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:02:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e4b35cfb-486e-55d8-b302-6ece660ab632/e4b35cfb-486e-55d8-b302-6ece660ab632_image_9.jpg HTTP/1.1" 201 0
2026-03-28 14:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FSM67VNV%252F698094197%252F600') HTTP/1.1" 204 0
2026-03-28 14:02:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SM67VNV/698094197/600 saved to cache
2026-03-28 14:02:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item e4b35cfb-486e-55d8-b302-6ece660ab632
2026-03-28 14:02:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:02:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c730290>
2026-03-28 14:02:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:02:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:02:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:02:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8b64f21f-1ee3-5237-8105-b88b835030a8/8b64f21f-1ee3-5237-8105-b88b835030a8_image_3.jpg HTTP/1.1" 201 0
2026-03-28 14:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FHV58YJY%252F698928826%252F600') HTTP/1.1" 204 0
2026-03-28 14:02:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HV58YJY/698928826/600 saved to cache
2026-03-28 14:02:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 8b64f21f-1ee3-5237-8105-b88b835030a8
2026-03-28 14:02:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:02:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2d9ddc10>
2026-03-28 14:02:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:02:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:02:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:02:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_299c12ca-ac8c-5489-8f0d-0d144c80340f/299c12ca-ac8c-5489-8f0d-0d144c80340f_image_3.jpg HTTP/1.1" 201 0
2026-03-28 14:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FCY68EOB%252F698765249%252F600') HTTP/1.1" 204 0
2026-03-28 14:02:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CY68EOB/698765249/600 saved to cache
2026-03-28 14:02:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 299c12ca-ac8c-5489-8f0d-0d144c80340f
2026-03-28 14:02:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: f1c7ee15-186c-50e6-9aec-cc206e8adf16 with identifier: RE12%20OHA
2026-03-28 14:02:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: f1c7ee15-186c-50e6-9aec-cc206e8adf16 with identifier: RE12%20OHA
2026-03-28 14:02:43 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: f1c7ee15-186c-50e6-9aec-cc206e8adf16 with identifier: RE12%20OHA to the API
2026-03-28 14:02:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:02:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:02:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RE12OHA/698568338/600>
{'auction_title': '',
'c_o_2_emission_value': 128,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f1c7ee15-186c-50e6-9aec-cc206e8adf16/f1c7ee15-186c-50e6-9aec-cc206e8adf16_expert_report_file_c052d70c-a4a6-4368-ab2d-bb3d6c4359d2.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=RE12%20OHA-GB',
'category': 'Car',
'color': 'blue',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.2L',
'expiration_date': '2026-03-29T10:00:00Z',
'fuel_type': 'Petrol',
'id': 'f1c7ee15-186c-50e6-9aec-cc206e8adf16',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'RE12 OHA',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=RE12%20OHA&vehicleType=*',
'listing': 'auction',
'location': 'Paddock Wood',
'make': 'SUZUKI',
'model': 'SWIFT',
'odometer': 50415,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 11,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f1c7ee15-186c-50e6-9aec-cc206e8adf16/f1c7ee15-186c-50e6-9aec-cc206e8adf16_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 52796,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RE12OHA/698568338/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f1c7ee15-186c-50e6-9aec-cc206e8adf16/f1c7ee15-186c-50e6-9aec-cc206e8adf16_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 51052,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RE12OHA/698568353/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f1c7ee15-186c-50e6-9aec-cc206e8adf16/f1c7ee15-186c-50e6-9aec-cc206e8adf16_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 50490,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RE12OHA/698568381/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f1c7ee15-186c-50e6-9aec-cc206e8adf16/f1c7ee15-186c-50e6-9aec-cc206e8adf16_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 47071,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RE12OHA/698568399/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f1c7ee15-186c-50e6-9aec-cc206e8adf16/f1c7ee15-186c-50e6-9aec-cc206e8adf16_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 48534,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RE12OHA/698568423/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f1c7ee15-186c-50e6-9aec-cc206e8adf16/f1c7ee15-186c-50e6-9aec-cc206e8adf16_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 49682,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RE12OHA/698568448/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f1c7ee15-186c-50e6-9aec-cc206e8adf16/f1c7ee15-186c-50e6-9aec-cc206e8adf16_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 110715,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RE12OHA/698568488/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f1c7ee15-186c-50e6-9aec-cc206e8adf16/f1c7ee15-186c-50e6-9aec-cc206e8adf16_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 77649,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RE12OHA/698568527/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f1c7ee15-186c-50e6-9aec-cc206e8adf16/f1c7ee15-186c-50e6-9aec-cc206e8adf16_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 88579,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RE12OHA/698568562/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f1c7ee15-186c-50e6-9aec-cc206e8adf16/f1c7ee15-186c-50e6-9aec-cc206e8adf16_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 73189,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RE12OHA/698568602/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2012-01-01',
'seller_name': None,
'title': 'SUZUKI SWIFT 1.2 SZ4 Hatchback',
'transmission': 'automatic',
'trim': 'SZ4',
'vin': 'TSMNZC72S00293845',
'year': 2012}
2026-03-28 14:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27RE12%2520OHA%27 HTTP/1.1" 200 None
2026-03-28 14:02:43 [bca.uk] INFO: Saving data for RE12%20OHA: {'created_time': 1774706563.3786, 'last_price_update_time': 1774706563.378613, 'auction_closing_time': 1774778400.0}
2026-03-28 14:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='RE12%2520OHA') HTTP/1.1" 204 0
2026-03-28 14:02:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 76904bbf-2ca2-5c17-a3c3-eefa3b562aab with identifier: SB72%20GWA
2026-03-28 14:02:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 76904bbf-2ca2-5c17-a3c3-eefa3b562aab with identifier: SB72%20GWA
2026-03-28 14:02:43 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 76904bbf-2ca2-5c17-a3c3-eefa3b562aab with identifier: SB72%20GWA to the API
2026-03-28 14:02:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:02:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:02:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SB72GWA/698536898/600>
{'auction_title': '',
'c_o_2_emission_value': 106,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_76904bbf-2ca2-5c17-a3c3-eefa3b562aab/76904bbf-2ca2-5c17-a3c3-eefa3b562aab_expert_report_file_6ad985d2-db8e-4e51-a999-eb5c42d27aff.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=SB72%20GWA-GB',
'category': 'Car',
'color': 'red',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.2L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol',
'id': '76904bbf-2ca2-5c17-a3c3-eefa3b562aab',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'SB72 GWA',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=SB72%20GWA&vehicleType=*',
'listing': 'auction',
'location': 'Glasgow - East',
'make': 'SUZUKI',
'model': 'SWIFT',
'odometer': 31101,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 11,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_76904bbf-2ca2-5c17-a3c3-eefa3b562aab/76904bbf-2ca2-5c17-a3c3-eefa3b562aab_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 45927,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SB72GWA/698536898/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_76904bbf-2ca2-5c17-a3c3-eefa3b562aab/76904bbf-2ca2-5c17-a3c3-eefa3b562aab_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 43226,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SB72GWA/698536906/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_76904bbf-2ca2-5c17-a3c3-eefa3b562aab/76904bbf-2ca2-5c17-a3c3-eefa3b562aab_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 47399,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SB72GWA/698536917/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_76904bbf-2ca2-5c17-a3c3-eefa3b562aab/76904bbf-2ca2-5c17-a3c3-eefa3b562aab_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 47166,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SB72GWA/698536925/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_76904bbf-2ca2-5c17-a3c3-eefa3b562aab/76904bbf-2ca2-5c17-a3c3-eefa3b562aab_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 47050,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SB72GWA/698536931/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_76904bbf-2ca2-5c17-a3c3-eefa3b562aab/76904bbf-2ca2-5c17-a3c3-eefa3b562aab_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 44478,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SB72GWA/698536946/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_76904bbf-2ca2-5c17-a3c3-eefa3b562aab/76904bbf-2ca2-5c17-a3c3-eefa3b562aab_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 81276,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SB72GWA/698536958/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_76904bbf-2ca2-5c17-a3c3-eefa3b562aab/76904bbf-2ca2-5c17-a3c3-eefa3b562aab_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 68723,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SB72GWA/698536975/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_76904bbf-2ca2-5c17-a3c3-eefa3b562aab/76904bbf-2ca2-5c17-a3c3-eefa3b562aab_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 85106,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SB72GWA/698536990/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_76904bbf-2ca2-5c17-a3c3-eefa3b562aab/76904bbf-2ca2-5c17-a3c3-eefa3b562aab_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 97714,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SB72GWA/698537005/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2023-01-01',
'seller_name': None,
'title': 'SUZUKI SWIFT 1.2 DUALJET SHVS SZ-L Hatchback',
'transmission': 'manual',
'trim': 'DUALJET SHVS SZ-L',
'vin': 'JSAAZCA3S00572496',
'year': 2023}
2026-03-28 14:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SB72%2520GWA%27 HTTP/1.1" 200 None
2026-03-28 14:02:43 [bca.uk] INFO: Saving data for SB72%20GWA: {'created_time': 1774706563.811916, 'last_price_update_time': 1774706563.81193, 'auction_closing_time': 1774864800.0}
2026-03-28 14:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='SB72%2520GWA') HTTP/1.1" 204 0
2026-03-28 14:02:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: e944d65b-4e9e-513c-a6ae-acea2437087d with identifier: KM67%20WBP
2026-03-28 14:02:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: e944d65b-4e9e-513c-a6ae-acea2437087d with identifier: KM67%20WBP
2026-03-28 14:02:43 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: e944d65b-4e9e-513c-a6ae-acea2437087d with identifier: KM67%20WBP to the API
2026-03-28 14:02:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:02:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:02:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KM67WBP/697678255/600>
{'auction_title': '',
'c_o_2_emission_value': 49,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e944d65b-4e9e-513c-a6ae-acea2437087d/e944d65b-4e9e-513c-a6ae-acea2437087d_expert_report_file_a17ed9c9-c38a-4a9b-b3f7-7c5f016d55cc.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=KM67%20WBP-GB',
'category': 'Car',
'color': 'silver',
'currency': 'GBP',
'doors_number': 5,
'engine': '2.0L',
'expiration_date': '2026-03-29T10:00:00Z',
'fuel_type': 'Petrol/Electric',
'id': 'e944d65b-4e9e-513c-a6ae-acea2437087d',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'KM67 WBP',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=KM67%20WBP&vehicleType=*',
'listing': 'auction',
'location': 'Paddock Wood',
'make': 'VOLVO',
'model': 'XC90',
'odometer': 157626,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 11,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e944d65b-4e9e-513c-a6ae-acea2437087d/e944d65b-4e9e-513c-a6ae-acea2437087d_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 50941,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KM67WBP/697678255/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e944d65b-4e9e-513c-a6ae-acea2437087d/e944d65b-4e9e-513c-a6ae-acea2437087d_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 50051,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KM67WBP/697678266/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e944d65b-4e9e-513c-a6ae-acea2437087d/e944d65b-4e9e-513c-a6ae-acea2437087d_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 49492,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KM67WBP/697678295/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e944d65b-4e9e-513c-a6ae-acea2437087d/e944d65b-4e9e-513c-a6ae-acea2437087d_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 47247,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KM67WBP/697678309/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e944d65b-4e9e-513c-a6ae-acea2437087d/e944d65b-4e9e-513c-a6ae-acea2437087d_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 47958,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KM67WBP/697678321/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e944d65b-4e9e-513c-a6ae-acea2437087d/e944d65b-4e9e-513c-a6ae-acea2437087d_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 47044,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KM67WBP/697678338/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e944d65b-4e9e-513c-a6ae-acea2437087d/e944d65b-4e9e-513c-a6ae-acea2437087d_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 97779,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KM67WBP/697678357/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e944d65b-4e9e-513c-a6ae-acea2437087d/e944d65b-4e9e-513c-a6ae-acea2437087d_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 69938,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KM67WBP/697678374/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e944d65b-4e9e-513c-a6ae-acea2437087d/e944d65b-4e9e-513c-a6ae-acea2437087d_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 86604,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KM67WBP/697678382/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e944d65b-4e9e-513c-a6ae-acea2437087d/e944d65b-4e9e-513c-a6ae-acea2437087d_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 49643,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KM67WBP/697678387/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-01-01',
'seller_name': None,
'title': 'VOLVO XC90 2.0 T8 T/E INSCRIPTION PRO G/T StationWagon',
'transmission': 'manual',
'trim': 'T8 T/E INSCRIPTION PRO G/T',
'vin': 'YV1LFBABDJ1332484',
'year': 2017}
2026-03-28 14:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KM67%2520WBP%27 HTTP/1.1" 200 None
2026-03-28 14:02:44 [bca.uk] INFO: Saving data for KM67%20WBP: {'created_time': 1774706564.233436, 'last_price_update_time': 1774706564.233447, 'auction_closing_time': 1774778400.0}
2026-03-28 14:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='KM67%2520WBP') HTTP/1.1" 204 0
2026-03-28 14:02:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EP19XHA/698568433/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/EP19XHA/42803467?sv=2020-08-04&st=2026-03-28T14%3A02%3A25Z&se=2026-03-28T14%3A27%3A25Z&sr=b&sp=r&sig=3aXptHZNTY1xw5UUqyLl7yubHBPKRq5U01kDhdsbsYM%3D)
2026-03-28 14:02:44 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FA18OJS/698923326/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698923326>
2026-03-28 14:02:44 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CY68EOB/698765230/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698765230>
2026-03-28 14:02:44 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RE03XJT/698933995/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698933995>
2026-03-28 14:02:44 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KR14OUW/696662280/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=696662280>
2026-03-28 14:02:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RE03XJT/698934011/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/RE03XJT/42810438?sv=2020-08-04&st=2026-03-28T14%3A02%3A25Z&se=2026-03-28T14%3A27%3A25Z&sr=b&sp=r&sig=W%2BmiGFHKvJXzfBcOMLhIRCoLkA3AzDMDP5bgxDrTPQQ%3D)
2026-03-28 14:02:44 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WP62XCK/697615129/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=697615129>
2026-03-28 14:02:44 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EP19XHA/698568411/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698568411>
2026-03-28 14:02:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:02:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2ca0fb90>
2026-03-28 14:02:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:02:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:02:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:02:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5096b957-ac5c-5cc4-a891-49042e75677e/5096b957-ac5c-5cc4-a891-49042e75677e_image_3.jpg HTTP/1.1" 201 0
2026-03-28 14:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FKR14OUW%252F696662286%252F600') HTTP/1.1" 204 0
2026-03-28 14:02:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KR14OUW/696662286/600 saved to cache
2026-03-28 14:02:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 5096b957-ac5c-5cc4-a891-49042e75677e
2026-03-28 14:02:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:02:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a1fd613d0>
2026-03-28 14:02:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:02:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:02:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:02:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_85df4e80-1e5a-5573-ad99-0445a298364d/85df4e80-1e5a-5573-ad99-0445a298364d_image_4.jpg HTTP/1.1" 201 0
2026-03-28 14:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FEP19XHA%252F698568433%252F600') HTTP/1.1" 204 0
2026-03-28 14:02:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EP19XHA/698568433/600 saved to cache
2026-03-28 14:02:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 85df4e80-1e5a-5573-ad99-0445a298364d
2026-03-28 14:02:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BO55VOP/698269130/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/BO55VOP/42810137?sv=2020-08-04&st=2026-03-28T14%3A02%3A26Z&se=2026-03-28T14%3A27%3A26Z&sr=b&sp=r&sig=ClLegZn5u1dkNPwcbCwa7jDTCtqtY8g86xpgxUm2UfM%3D)
2026-03-28 14:02:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HV58YJY/698928812/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/HV58YJY/42810015?sv=2020-08-04&st=2026-03-28T14%3A02%3A25Z&se=2026-03-28T14%3A27%3A25Z&sr=b&sp=r&sig=4E7oaf6jl0JMYjcpc4K4%2F3uy5%2BGOvEW6yFoZ9j75kNU%3D)
2026-03-28 14:02:44 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CY68EOB/698765212/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698765212>
2026-03-28 14:02:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FA18OJS/698923357/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/FA18OJS/42809927?sv=2020-08-04&st=2026-03-28T14%3A02%3A25Z&se=2026-03-28T14%3A27%3A25Z&sr=b&sp=r&sig=wYbenAdSOJrfSZzoBonOEa6%2BD7yy%2FzPCYgKi2Sl75o8%3D)
2026-03-28 14:02:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SM67VNV/698094168/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/SM67VNV/42810251?sv=2020-08-04&st=2026-03-28T14%3A02%3A21Z&se=2026-03-28T14%3A27%3A21Z&sr=b&sp=r&sig=zKf9cm3c2GLLDCKC9h0Kq9J3NSEBcqSIr7bWiyg1hwQ%3D)
2026-03-28 14:02:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WP62XCK/697615135/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/WP62XCK/42810245?sv=2020-08-04&st=2026-03-28T14%3A02%3A21Z&se=2026-03-28T14%3A27%3A21Z&sr=b&sp=r&sig=gyEdXM91VrVknbZjiLD2toi%2BgCj7hBqRBYqi3Ts%2BfeU%3D)
2026-03-28 14:02:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:02:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2d9b3950>
2026-03-28 14:02:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:02:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:02:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:02:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0d8a0ea5-df55-5526-b46c-23b49b8e0dc3/0d8a0ea5-df55-5526-b46c-23b49b8e0dc3_image_3.jpg HTTP/1.1" 201 0
2026-03-28 14:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FRE03XJT%252F698934011%252F600') HTTP/1.1" 204 0
2026-03-28 14:02:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RE03XJT/698934011/600 saved to cache
2026-03-28 14:02:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 0d8a0ea5-df55-5526-b46c-23b49b8e0dc3
2026-03-28 14:02:44 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RE03XJT/698933977/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698933977>
2026-03-28 14:02:44 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SM67VNV/698094155/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698094155>
2026-03-28 14:02:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RE03XJT/698933995/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/RE03XJT/42810438?sv=2020-08-04&st=2026-03-28T14%3A02%3A25Z&se=2026-03-28T14%3A27%3A25Z&sr=b&sp=r&sig=W%2BmiGFHKvJXzfBcOMLhIRCoLkA3AzDMDP5bgxDrTPQQ%3D)
2026-03-28 14:02:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EP19XHA/698568411/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/EP19XHA/42803467?sv=2020-08-04&st=2026-03-28T14%3A02%3A25Z&se=2026-03-28T14%3A27%3A25Z&sr=b&sp=r&sig=3aXptHZNTY1xw5UUqyLl7yubHBPKRq5U01kDhdsbsYM%3D)
2026-03-28 14:02:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KR14OUW/696662280/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/KR14OUW/42810276?sv=2020-08-04&st=2026-03-28T14%3A02%3A25Z&se=2026-03-28T14%3A27%3A25Z&sr=b&sp=r&sig=yD0HrAKd1eOENYPcHLYCjZQ9zljwYHJA7s3b8Za%2BpDw%3D)
2026-03-28 14:02:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CY68EOB/698765230/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/CY68EOB/42807353?sv=2020-08-04&st=2026-03-28T14%3A02%3A25Z&se=2026-03-28T14%3A27%3A25Z&sr=b&sp=r&sig=VhOAFQtPLoY4JTixFnYBwYrQPfJNMc8rMp4NstNU2cM%3D)
2026-03-28 14:02:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:02:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c4ae5d0>
2026-03-28 14:02:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:02:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:02:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:02:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0df2aa72-34d7-5e00-86eb-dff801f0634b/0df2aa72-34d7-5e00-86eb-dff801f0634b_image_0.jpg HTTP/1.1" 201 0
2026-03-28 14:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FBO55VOP%252F698269130%252F600') HTTP/1.1" 204 0
2026-03-28 14:02:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BO55VOP/698269130/600 saved to cache
2026-03-28 14:02:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 0df2aa72-34d7-5e00-86eb-dff801f0634b
2026-03-28 14:02:44 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 0df2aa72-34d7-5e00-86eb-dff801f0634b, skipping ID generation
2026-03-28 14:02:44 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 0df2aa72-34d7-5e00-86eb-dff801f0634b sending to next pipeline
2026-03-28 14:02:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 0df2aa72-34d7-5e00-86eb-dff801f0634b, identifier: BO55%20VOP
2026-03-28 14:02:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 0df2aa72-34d7-5e00-86eb-dff801f0634b with identifier: BO55%20VOP
2026-03-28 14:02:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 0df2aa72-34d7-5e00-86eb-dff801f0634b with identifier: BO55%20VOP
2026-03-28 14:02:44 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 0df2aa72-34d7-5e00-86eb-dff801f0634b with identifier: BO55%20VOP to the API
2026-03-28 14:02:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:02:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:02:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BO55VOP/698269130/600>
{'auction_title': '',
'c_o_2_emission_value': 199,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0df2aa72-34d7-5e00-86eb-dff801f0634b/0df2aa72-34d7-5e00-86eb-dff801f0634b_expert_report_file_5d9b12b1-5eec-4a34-995f-2c5bdb7bfad7.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=BO55%20VOP-GB',
'category': 'Car',
'color': 'white',
'currency': 'GBP',
'doors_number': 5,
'engine': '3.0L',
'expiration_date': '2026-03-29T10:00:00Z',
'fuel_type': 'Diesel',
'id': '0df2aa72-34d7-5e00-86eb-dff801f0634b',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'BO55 VOP',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=BO55%20VOP&vehicleType=*',
'listing': 'auction',
'location': 'Glasgow - East',
'make': 'LAND ROVER',
'model': 'R/R SPORT',
'odometer': 171244,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 11,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0df2aa72-34d7-5e00-86eb-dff801f0634b/0df2aa72-34d7-5e00-86eb-dff801f0634b_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 43186,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BO55VOP/698269130/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0df2aa72-34d7-5e00-86eb-dff801f0634b/0df2aa72-34d7-5e00-86eb-dff801f0634b_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 39458,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BO55VOP/698269135/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0df2aa72-34d7-5e00-86eb-dff801f0634b/0df2aa72-34d7-5e00-86eb-dff801f0634b_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 40767,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BO55VOP/698269139/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0df2aa72-34d7-5e00-86eb-dff801f0634b/0df2aa72-34d7-5e00-86eb-dff801f0634b_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 41185,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BO55VOP/698269145/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0df2aa72-34d7-5e00-86eb-dff801f0634b/0df2aa72-34d7-5e00-86eb-dff801f0634b_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 40754,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BO55VOP/698269149/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0df2aa72-34d7-5e00-86eb-dff801f0634b/0df2aa72-34d7-5e00-86eb-dff801f0634b_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 37793,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BO55VOP/698269156/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0df2aa72-34d7-5e00-86eb-dff801f0634b/0df2aa72-34d7-5e00-86eb-dff801f0634b_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 67633,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BO55VOP/698269165/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0df2aa72-34d7-5e00-86eb-dff801f0634b/0df2aa72-34d7-5e00-86eb-dff801f0634b_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 64748,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BO55VOP/698269171/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0df2aa72-34d7-5e00-86eb-dff801f0634b/0df2aa72-34d7-5e00-86eb-dff801f0634b_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 71207,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BO55VOP/698269180/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0df2aa72-34d7-5e00-86eb-dff801f0634b/0df2aa72-34d7-5e00-86eb-dff801f0634b_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 71306,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BO55VOP/698269189/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2014-01-01',
'seller_name': None,
'title': 'LAND ROVER R/R SPORT 3.0 SDV6 HSE DYNAMIC StationWagon',
'transmission': 'manual',
'trim': 'SDV6 HSE DYNAMIC',
'vin': 'SALWA2KE5EA364615',
'year': 2014}
2026-03-28 14:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BO55%2520VOP%27 HTTP/1.1" 200 None
2026-03-28 14:02:45 [bca.uk] INFO: Saving data for BO55%20VOP: {'created_time': 1774706565.034632, 'last_price_update_time': 1774706565.034644, 'auction_closing_time': 1774778400.0}
2026-03-28 14:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='BO55%2520VOP') HTTP/1.1" 204 0
2026-03-28 14:02:45 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EP19XHA/698568387/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698568387>
2026-03-28 14:02:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CY68EOB/698765212/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/CY68EOB/42807353?sv=2020-08-04&st=2026-03-28T14%3A02%3A25Z&se=2026-03-28T14%3A27%3A25Z&sr=b&sp=r&sig=VhOAFQtPLoY4JTixFnYBwYrQPfJNMc8rMp4NstNU2cM%3D)
2026-03-28 14:02:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FA18OJS/698923326/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/FA18OJS/42809927?sv=2020-08-04&st=2026-03-28T14%3A02%3A25Z&se=2026-03-28T14%3A27%3A25Z&sr=b&sp=r&sig=wYbenAdSOJrfSZzoBonOEa6%2BD7yy%2FzPCYgKi2Sl75o8%3D)
2026-03-28 14:02:45 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FA18OJS/698923302/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698923302>
2026-03-28 14:02:45 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WP62XCK/697615121/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=697615121>
2026-03-28 14:02:45 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RF08TZP/698938753/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698938753>
2026-03-28 14:02:45 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SM67VNV/698094131/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698094131>
2026-03-28 14:02:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:02:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a3008d450>
2026-03-28 14:02:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:02:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:02:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:02:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8b64f21f-1ee3-5237-8105-b88b835030a8/8b64f21f-1ee3-5237-8105-b88b835030a8_image_2.jpg HTTP/1.1" 201 0
2026-03-28 14:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FHV58YJY%252F698928812%252F600') HTTP/1.1" 204 0
2026-03-28 14:02:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HV58YJY/698928812/600 saved to cache
2026-03-28 14:02:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 8b64f21f-1ee3-5237-8105-b88b835030a8
2026-03-28 14:02:45 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 8b64f21f-1ee3-5237-8105-b88b835030a8, skipping ID generation
2026-03-28 14:02:45 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 8b64f21f-1ee3-5237-8105-b88b835030a8 sending to next pipeline
2026-03-28 14:02:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 8b64f21f-1ee3-5237-8105-b88b835030a8, identifier: HV58%20YJY
2026-03-28 14:02:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WP62XCK/697615129/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/WP62XCK/42810245?sv=2020-08-04&st=2026-03-28T14%3A02%3A21Z&se=2026-03-28T14%3A27%3A21Z&sr=b&sp=r&sig=gyEdXM91VrVknbZjiLD2toi%2BgCj7hBqRBYqi3Ts%2BfeU%3D)
2026-03-28 14:02:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 8b64f21f-1ee3-5237-8105-b88b835030a8 with identifier: HV58%20YJY
2026-03-28 14:02:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 8b64f21f-1ee3-5237-8105-b88b835030a8 with identifier: HV58%20YJY
2026-03-28 14:02:45 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 8b64f21f-1ee3-5237-8105-b88b835030a8 with identifier: HV58%20YJY to the API
2026-03-28 14:02:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:02:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:02:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HV58YJY/698928812/600>
{'auction_title': '',
'c_o_2_emission_value': 174,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8b64f21f-1ee3-5237-8105-b88b835030a8/8b64f21f-1ee3-5237-8105-b88b835030a8_expert_report_file_772a811b-4ccc-4293-9f12-e0dd5516c95f.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=HV58%20YJY-GB',
'category': 'Car',
'color': 'silver',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.6L',
'expiration_date': '2026-03-29T10:00:00Z',
'fuel_type': 'Petrol',
'id': '8b64f21f-1ee3-5237-8105-b88b835030a8',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'HV58 YJY',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=HV58%20YJY&vehicleType=*',
'listing': 'auction',
'location': 'Enfield',
'make': 'PEUGEOT',
'model': '308',
'odometer': 85128,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 11,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8b64f21f-1ee3-5237-8105-b88b835030a8/8b64f21f-1ee3-5237-8105-b88b835030a8_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 49003,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HV58YJY/698928767/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8b64f21f-1ee3-5237-8105-b88b835030a8/8b64f21f-1ee3-5237-8105-b88b835030a8_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 48024,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HV58YJY/698928790/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8b64f21f-1ee3-5237-8105-b88b835030a8/8b64f21f-1ee3-5237-8105-b88b835030a8_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 44700,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HV58YJY/698928812/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8b64f21f-1ee3-5237-8105-b88b835030a8/8b64f21f-1ee3-5237-8105-b88b835030a8_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 45148,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HV58YJY/698928826/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8b64f21f-1ee3-5237-8105-b88b835030a8/8b64f21f-1ee3-5237-8105-b88b835030a8_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 47287,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HV58YJY/698928845/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8b64f21f-1ee3-5237-8105-b88b835030a8/8b64f21f-1ee3-5237-8105-b88b835030a8_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 45790,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HV58YJY/698928865/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8b64f21f-1ee3-5237-8105-b88b835030a8/8b64f21f-1ee3-5237-8105-b88b835030a8_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 91955,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HV58YJY/698928892/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8b64f21f-1ee3-5237-8105-b88b835030a8/8b64f21f-1ee3-5237-8105-b88b835030a8_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 63209,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HV58YJY/698928917/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8b64f21f-1ee3-5237-8105-b88b835030a8/8b64f21f-1ee3-5237-8105-b88b835030a8_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 77809,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HV58YJY/698928951/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8b64f21f-1ee3-5237-8105-b88b835030a8/8b64f21f-1ee3-5237-8105-b88b835030a8_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 82608,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HV58YJY/698928972/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2008-01-01',
'seller_name': None,
'title': 'PEUGEOT 308 1.6 VTI S Hatchback',
'transmission': 'automatic',
'trim': 'VTI S',
'vin': 'VF34C5FWF55353066',
'year': 2008}
2026-03-28 14:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27HV58%2520YJY%27 HTTP/1.1" 200 None
2026-03-28 14:02:45 [bca.uk] INFO: Saving data for HV58%20YJY: {'created_time': 1774706565.581135, 'last_price_update_time': 1774706565.581146, 'auction_closing_time': 1774778400.0}
2026-03-28 14:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='HV58%2520YJY') HTTP/1.1" 204 0
2026-03-28 14:02:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:02:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c710990>
2026-03-28 14:02:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:02:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:02:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:02:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_73dc1fed-646a-544c-b3e5-ff1b6aff4358/73dc1fed-646a-544c-b3e5-ff1b6aff4358_image_4.jpg HTTP/1.1" 201 0
2026-03-28 14:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FFA18OJS%252F698923357%252F600') HTTP/1.1" 204 0
2026-03-28 14:02:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FA18OJS/698923357/600 saved to cache
2026-03-28 14:02:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 73dc1fed-646a-544c-b3e5-ff1b6aff4358
2026-03-28 14:02:45 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:02:45 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:02:45 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:02:45 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:02:45 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:02:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:02:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c5f8dd0>
2026-03-28 14:02:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:02:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:02:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:02:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e4b35cfb-486e-55d8-b302-6ece660ab632/e4b35cfb-486e-55d8-b302-6ece660ab632_image_8.jpg HTTP/1.1" 201 0
2026-03-28 14:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FSM67VNV%252F698094168%252F600') HTTP/1.1" 204 0
2026-03-28 14:02:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SM67VNV/698094168/600 saved to cache
2026-03-28 14:02:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item e4b35cfb-486e-55d8-b302-6ece660ab632
2026-03-28 14:02:45 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:02:45 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:02:45 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:02:45 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:02:45 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:02:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:02:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2d685190>
2026-03-28 14:02:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:02:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:02:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:02:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_017f335f-f1b9-5de8-8cb9-bc79c2d2f45f/017f335f-f1b9-5de8-8cb9-bc79c2d2f45f_image_8.jpg HTTP/1.1" 201 0
2026-03-28 14:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FWP62XCK%252F697615135%252F600') HTTP/1.1" 204 0
2026-03-28 14:02:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WP62XCK/697615135/600 saved to cache
2026-03-28 14:02:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 017f335f-f1b9-5de8-8cb9-bc79c2d2f45f
2026-03-28 14:02:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:02:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c5f2450>
2026-03-28 14:02:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:02:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:02:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:02:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0d8a0ea5-df55-5526-b46c-23b49b8e0dc3/0d8a0ea5-df55-5526-b46c-23b49b8e0dc3_image_2.jpg HTTP/1.1" 201 0
2026-03-28 14:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FRE03XJT%252F698933995%252F600') HTTP/1.1" 204 0
2026-03-28 14:02:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RE03XJT/698933995/600 saved to cache
2026-03-28 14:02:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 0d8a0ea5-df55-5526-b46c-23b49b8e0dc3
2026-03-28 14:02:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:02:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a1fd62890>
2026-03-28 14:02:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:02:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:02:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:02:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_85df4e80-1e5a-5573-ad99-0445a298364d/85df4e80-1e5a-5573-ad99-0445a298364d_image_3.jpg HTTP/1.1" 201 0
2026-03-28 14:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FEP19XHA%252F698568411%252F600') HTTP/1.1" 204 0
2026-03-28 14:02:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EP19XHA/698568411/600 saved to cache
2026-03-28 14:02:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 85df4e80-1e5a-5573-ad99-0445a298364d
2026-03-28 14:02:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:02:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c860d50>
2026-03-28 14:02:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:02:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:02:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:02:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5096b957-ac5c-5cc4-a891-49042e75677e/5096b957-ac5c-5cc4-a891-49042e75677e_image_2.jpg HTTP/1.1" 201 0
2026-03-28 14:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FKR14OUW%252F696662280%252F600') HTTP/1.1" 204 0
2026-03-28 14:02:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KR14OUW/696662280/600 saved to cache
2026-03-28 14:02:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 5096b957-ac5c-5cc4-a891-49042e75677e
2026-03-28 14:02:45 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 5096b957-ac5c-5cc4-a891-49042e75677e, skipping ID generation
2026-03-28 14:02:45 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 5096b957-ac5c-5cc4-a891-49042e75677e sending to next pipeline
2026-03-28 14:02:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 5096b957-ac5c-5cc4-a891-49042e75677e, identifier: KR14%20OUW
2026-03-28 14:02:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:02:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c52b5d0>
2026-03-28 14:02:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:02:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:02:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:02:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_299c12ca-ac8c-5489-8f0d-0d144c80340f/299c12ca-ac8c-5489-8f0d-0d144c80340f_image_2.jpg HTTP/1.1" 201 0
2026-03-28 14:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FCY68EOB%252F698765230%252F600') HTTP/1.1" 204 0
2026-03-28 14:02:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CY68EOB/698765230/600 saved to cache
2026-03-28 14:02:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 299c12ca-ac8c-5489-8f0d-0d144c80340f
2026-03-28 14:02:45 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YC72AVN/698691238/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698691238>
2026-03-28 14:02:45 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FA18OJS/698923281/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698923281>
2026-03-28 14:02:45 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SM67VNV/698094106/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698094106>
2026-03-28 14:02:45 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RF08TZP/698938739/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698938739>
2026-03-28 14:02:45 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WP62XCK/697615113/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=697615113>
2026-03-28 14:02:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RE03XJT/698933977/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/RE03XJT/42810438?sv=2020-08-04&st=2026-03-28T14%3A02%3A25Z&se=2026-03-28T14%3A27%3A25Z&sr=b&sp=r&sig=W%2BmiGFHKvJXzfBcOMLhIRCoLkA3AzDMDP5bgxDrTPQQ%3D)
2026-03-28 14:02:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 5096b957-ac5c-5cc4-a891-49042e75677e with identifier: KR14%20OUW
2026-03-28 14:02:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-28 14:02:46 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=Diesel%2FElectric HTTP/1.1" 200 None
2026-03-28 14:02:46 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-28 14:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-28 14:02:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 5096b957-ac5c-5cc4-a891-49042e75677e with identifier: KR14%20OUW
2026-03-28 14:02:46 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 5096b957-ac5c-5cc4-a891-49042e75677e with identifier: KR14%20OUW to the API
2026-03-28 14:02:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:02:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:02:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KR14OUW/696662280/600>
{'auction_title': '',
'c_o_2_emission_value': 109,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5096b957-ac5c-5cc4-a891-49042e75677e/5096b957-ac5c-5cc4-a891-49042e75677e_expert_report_file_d015b35a-d107-4d5f-8541-e2584fc40c42.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=KR14%20OUW-GB',
'category': 'Car',
'color': 'blue',
'currency': 'GBP',
'doors_number': 4,
'engine': '2.1L',
'expiration_date': '2026-03-29T10:00:00Z',
'fuel_type': 'Diesel/Electric',
'id': '5096b957-ac5c-5cc4-a891-49042e75677e',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'KR14 OUW',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=KR14%20OUW&vehicleType=*',
'listing': 'auction',
'location': 'Nottingham',
'make': 'MERCEDES-BENZ',
'model': 'E300 HYBRID',
'odometer': 127431,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 11,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5096b957-ac5c-5cc4-a891-49042e75677e/5096b957-ac5c-5cc4-a891-49042e75677e_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 51580,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KR14OUW/696662274/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5096b957-ac5c-5cc4-a891-49042e75677e/5096b957-ac5c-5cc4-a891-49042e75677e_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 49445,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KR14OUW/696662276/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5096b957-ac5c-5cc4-a891-49042e75677e/5096b957-ac5c-5cc4-a891-49042e75677e_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 49424,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KR14OUW/696662280/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5096b957-ac5c-5cc4-a891-49042e75677e/5096b957-ac5c-5cc4-a891-49042e75677e_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 49807,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KR14OUW/696662286/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5096b957-ac5c-5cc4-a891-49042e75677e/5096b957-ac5c-5cc4-a891-49042e75677e_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 43216,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KR14OUW/696662290/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5096b957-ac5c-5cc4-a891-49042e75677e/5096b957-ac5c-5cc4-a891-49042e75677e_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 42472,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KR14OUW/696662294/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5096b957-ac5c-5cc4-a891-49042e75677e/5096b957-ac5c-5cc4-a891-49042e75677e_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 65379,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KR14OUW/696662301/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5096b957-ac5c-5cc4-a891-49042e75677e/5096b957-ac5c-5cc4-a891-49042e75677e_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 76148,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KR14OUW/696662307/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5096b957-ac5c-5cc4-a891-49042e75677e/5096b957-ac5c-5cc4-a891-49042e75677e_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 79484,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KR14OUW/696662309/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5096b957-ac5c-5cc4-a891-49042e75677e/5096b957-ac5c-5cc4-a891-49042e75677e_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 78309,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KR14OUW/696662314/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2014-01-01',
'seller_name': None,
'title': 'MERCEDES-BENZ E300 HYBRID 2.1 B/T SE TIP Saloon',
'transmission': 'manual',
'trim': 'B/T SE TIP',
'vin': 'WDD2120982B037336',
'year': 2014}
2026-03-28 14:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KR14%2520OUW%27 HTTP/1.1" 200 None
2026-03-28 14:02:46 [bca.uk] INFO: Saving data for KR14%20OUW: {'created_time': 1774706566.555043, 'last_price_update_time': 1774706566.555054, 'auction_closing_time': 1774778400.0}
2026-03-28 14:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='KR14%2520OUW') HTTP/1.1" 204 0
2026-03-28 14:02:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SM67VNV/698094155/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/SM67VNV/42810251?sv=2020-08-04&st=2026-03-28T14%3A02%3A21Z&se=2026-03-28T14%3A27%3A21Z&sr=b&sp=r&sig=zKf9cm3c2GLLDCKC9h0Kq9J3NSEBcqSIr7bWiyg1hwQ%3D)
2026-03-28 14:02:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:02:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c172710>
2026-03-28 14:02:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:02:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:02:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:02:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_299c12ca-ac8c-5489-8f0d-0d144c80340f/299c12ca-ac8c-5489-8f0d-0d144c80340f_image_1.jpg HTTP/1.1" 201 0
2026-03-28 14:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FCY68EOB%252F698765212%252F600') HTTP/1.1" 204 0
2026-03-28 14:02:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CY68EOB/698765212/600 saved to cache
2026-03-28 14:02:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 299c12ca-ac8c-5489-8f0d-0d144c80340f
2026-03-28 14:02:46 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 299c12ca-ac8c-5489-8f0d-0d144c80340f, skipping ID generation
2026-03-28 14:02:46 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 299c12ca-ac8c-5489-8f0d-0d144c80340f sending to next pipeline
2026-03-28 14:02:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 299c12ca-ac8c-5489-8f0d-0d144c80340f, identifier: CY68%20EOB
2026-03-28 14:02:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:02:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2d78e410>
2026-03-28 14:02:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:02:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:02:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:02:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_73dc1fed-646a-544c-b3e5-ff1b6aff4358/73dc1fed-646a-544c-b3e5-ff1b6aff4358_image_3.jpg HTTP/1.1" 201 0
2026-03-28 14:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FFA18OJS%252F698923326%252F600') HTTP/1.1" 204 0
2026-03-28 14:02:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FA18OJS/698923326/600 saved to cache
2026-03-28 14:02:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 73dc1fed-646a-544c-b3e5-ff1b6aff4358
2026-03-28 14:02:46 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:02:46 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:02:46 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:02:46 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:02:46 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:02:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:02:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c1700d0>
2026-03-28 14:02:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:02:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:02:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:02:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_017f335f-f1b9-5de8-8cb9-bc79c2d2f45f/017f335f-f1b9-5de8-8cb9-bc79c2d2f45f_image_7.jpg HTTP/1.1" 201 0
2026-03-28 14:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FWP62XCK%252F697615129%252F600') HTTP/1.1" 204 0
2026-03-28 14:02:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WP62XCK/697615129/600 saved to cache
2026-03-28 14:02:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 017f335f-f1b9-5de8-8cb9-bc79c2d2f45f
2026-03-28 14:02:46 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FA18OJS/698923268/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=FA18OJS-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-28 14:02:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 299c12ca-ac8c-5489-8f0d-0d144c80340f with identifier: CY68%20EOB
2026-03-28 14:02:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 299c12ca-ac8c-5489-8f0d-0d144c80340f with identifier: CY68%20EOB
2026-03-28 14:02:46 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 299c12ca-ac8c-5489-8f0d-0d144c80340f with identifier: CY68%20EOB to the API
2026-03-28 14:02:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:02:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:02:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CY68EOB/698765212/600>
{'auction_title': '',
'c_o_2_emission_value': 136,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_299c12ca-ac8c-5489-8f0d-0d144c80340f/299c12ca-ac8c-5489-8f0d-0d144c80340f_expert_report_file_3d68d73e-3882-4c6d-85f2-cb8ef0828b13.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=CY68%20EOB-GB',
'category': 'Car',
'color': 'blue',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.5L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol',
'id': '299c12ca-ac8c-5489-8f0d-0d144c80340f',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'CY68 EOB',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=CY68%20EOB&vehicleType=*',
'listing': 'auction',
'location': 'Nottingham',
'make': 'VAUXHALL',
'model': 'INSIGNIA GS',
'odometer': 75777,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 11,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_299c12ca-ac8c-5489-8f0d-0d144c80340f/299c12ca-ac8c-5489-8f0d-0d144c80340f_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 50831,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CY68EOB/698765188/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_299c12ca-ac8c-5489-8f0d-0d144c80340f/299c12ca-ac8c-5489-8f0d-0d144c80340f_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 49403,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CY68EOB/698765212/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_299c12ca-ac8c-5489-8f0d-0d144c80340f/299c12ca-ac8c-5489-8f0d-0d144c80340f_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 46752,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CY68EOB/698765230/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_299c12ca-ac8c-5489-8f0d-0d144c80340f/299c12ca-ac8c-5489-8f0d-0d144c80340f_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 48339,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CY68EOB/698765249/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_299c12ca-ac8c-5489-8f0d-0d144c80340f/299c12ca-ac8c-5489-8f0d-0d144c80340f_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 43385,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CY68EOB/698765281/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_299c12ca-ac8c-5489-8f0d-0d144c80340f/299c12ca-ac8c-5489-8f0d-0d144c80340f_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 41754,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CY68EOB/698765300/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_299c12ca-ac8c-5489-8f0d-0d144c80340f/299c12ca-ac8c-5489-8f0d-0d144c80340f_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 81638,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CY68EOB/698765328/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_299c12ca-ac8c-5489-8f0d-0d144c80340f/299c12ca-ac8c-5489-8f0d-0d144c80340f_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 59229,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CY68EOB/698765358/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_299c12ca-ac8c-5489-8f0d-0d144c80340f/299c12ca-ac8c-5489-8f0d-0d144c80340f_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 78839,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CY68EOB/698765391/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_299c12ca-ac8c-5489-8f0d-0d144c80340f/299c12ca-ac8c-5489-8f0d-0d144c80340f_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 77537,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CY68EOB/698765416/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-01-01',
'seller_name': None,
'title': 'VAUXHALL INSIGNIA GS 1.5 T 165 SRI Hatchback',
'transmission': 'manual',
'trim': 'T 165 SRI',
'vin': 'W0VZS6EB0J1147175',
'year': 2018}
2026-03-28 14:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27CY68%2520EOB%27 HTTP/1.1" 200 None
2026-03-28 14:02:47 [bca.uk] INFO: Saving data for CY68%20EOB: {'created_time': 1774706567.19564, 'last_price_update_time': 1774706567.19565, 'auction_closing_time': 1774864800.0}
2026-03-28 14:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='CY68%2520EOB') HTTP/1.1" 204 0
2026-03-28 14:02:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EP19XHA/698568387/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/EP19XHA/42803467?sv=2020-08-04&st=2026-03-28T14%3A02%3A25Z&se=2026-03-28T14%3A27%3A25Z&sr=b&sp=r&sig=3aXptHZNTY1xw5UUqyLl7yubHBPKRq5U01kDhdsbsYM%3D)
2026-03-28 14:02:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FA18OJS/698923302/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/FA18OJS/42809927?sv=2020-08-04&st=2026-03-28T14%3A02%3A25Z&se=2026-03-28T14%3A27%3A25Z&sr=b&sp=r&sig=wYbenAdSOJrfSZzoBonOEa6%2BD7yy%2FzPCYgKi2Sl75o8%3D)
2026-03-28 14:02:47 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WP62XCK/697615110/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=697615110>
2026-03-28 14:02:47 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SM67VNV/698094093/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698094093>
2026-03-28 14:02:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RF08TZP/698938753/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/RF08TZP/42781844?sv=2020-08-04&st=2026-03-28T14%3A02%3A20Z&se=2026-03-28T14%3A27%3A20Z&sr=b&sp=r&sig=6hLicjIfZGVTK7BLacvGBl2SaFBQyybl9CGTh8APRd8%3D)
2026-03-28 14:02:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WP62XCK/697615121/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/WP62XCK/42810245?sv=2020-08-04&st=2026-03-28T14%3A02%3A21Z&se=2026-03-28T14%3A27%3A21Z&sr=b&sp=r&sig=gyEdXM91VrVknbZjiLD2toi%2BgCj7hBqRBYqi3Ts%2BfeU%3D)
2026-03-28 14:02:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SM67VNV/698094131/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/SM67VNV/42810251?sv=2020-08-04&st=2026-03-28T14%3A02%3A21Z&se=2026-03-28T14%3A27%3A21Z&sr=b&sp=r&sig=zKf9cm3c2GLLDCKC9h0Kq9J3NSEBcqSIr7bWiyg1hwQ%3D)
2026-03-28 14:02:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:02:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c8d6d90>
2026-03-28 14:02:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:02:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:02:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:02:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0d8a0ea5-df55-5526-b46c-23b49b8e0dc3/0d8a0ea5-df55-5526-b46c-23b49b8e0dc3_image_1.jpg HTTP/1.1" 201 0
2026-03-28 14:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FRE03XJT%252F698933977%252F600') HTTP/1.1" 204 0
2026-03-28 14:02:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RE03XJT/698933977/600 saved to cache
2026-03-28 14:02:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 0d8a0ea5-df55-5526-b46c-23b49b8e0dc3
2026-03-28 14:02:47 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 0d8a0ea5-df55-5526-b46c-23b49b8e0dc3, skipping ID generation
2026-03-28 14:02:47 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 0d8a0ea5-df55-5526-b46c-23b49b8e0dc3 sending to next pipeline
2026-03-28 14:02:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 0d8a0ea5-df55-5526-b46c-23b49b8e0dc3, identifier: RE03%20XJT
2026-03-28 14:02:47 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:02:47 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:02:47 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:02:47 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:02:47 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:02:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:02:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a1fd7c510>
2026-03-28 14:02:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:02:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:02:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:02:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e4b35cfb-486e-55d8-b302-6ece660ab632/e4b35cfb-486e-55d8-b302-6ece660ab632_image_7.jpg HTTP/1.1" 201 0
2026-03-28 14:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FSM67VNV%252F698094155%252F600') HTTP/1.1" 204 0
2026-03-28 14:02:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SM67VNV/698094155/600 saved to cache
2026-03-28 14:02:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item e4b35cfb-486e-55d8-b302-6ece660ab632
2026-03-28 14:02:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 0d8a0ea5-df55-5526-b46c-23b49b8e0dc3 with identifier: RE03%20XJT
2026-03-28 14:02:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 0d8a0ea5-df55-5526-b46c-23b49b8e0dc3 with identifier: RE03%20XJT
2026-03-28 14:02:47 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 0d8a0ea5-df55-5526-b46c-23b49b8e0dc3 with identifier: RE03%20XJT to the API
2026-03-28 14:02:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:02:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:02:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RE03XJT/698933977/600>
{'auction_title': '',
'c_o_2_emission_value': 139,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0d8a0ea5-df55-5526-b46c-23b49b8e0dc3/0d8a0ea5-df55-5526-b46c-23b49b8e0dc3_expert_report_file_268f0faf-f594-4f3d-9c85-f7cb8e09ed0a.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=RE03%20XJT-GB',
'category': 'Car',
'color': 'blue',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.4L',
'expiration_date': '2026-03-29T10:00:00Z',
'fuel_type': 'Petrol',
'id': '0d8a0ea5-df55-5526-b46c-23b49b8e0dc3',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'RE03 XJT',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=RE03%20XJT&vehicleType=*',
'listing': 'auction',
'location': 'Enfield',
'make': 'HONDA',
'model': 'JAZZ',
'odometer': 167885,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 11,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0d8a0ea5-df55-5526-b46c-23b49b8e0dc3/0d8a0ea5-df55-5526-b46c-23b49b8e0dc3_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 47343,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RE03XJT/698933956/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0d8a0ea5-df55-5526-b46c-23b49b8e0dc3/0d8a0ea5-df55-5526-b46c-23b49b8e0dc3_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 46184,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RE03XJT/698933977/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0d8a0ea5-df55-5526-b46c-23b49b8e0dc3/0d8a0ea5-df55-5526-b46c-23b49b8e0dc3_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 45172,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RE03XJT/698933995/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0d8a0ea5-df55-5526-b46c-23b49b8e0dc3/0d8a0ea5-df55-5526-b46c-23b49b8e0dc3_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 44532,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RE03XJT/698934011/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0d8a0ea5-df55-5526-b46c-23b49b8e0dc3/0d8a0ea5-df55-5526-b46c-23b49b8e0dc3_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 46231,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RE03XJT/698934033/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0d8a0ea5-df55-5526-b46c-23b49b8e0dc3/0d8a0ea5-df55-5526-b46c-23b49b8e0dc3_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 45680,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RE03XJT/698934050/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0d8a0ea5-df55-5526-b46c-23b49b8e0dc3/0d8a0ea5-df55-5526-b46c-23b49b8e0dc3_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 86126,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RE03XJT/698934068/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0d8a0ea5-df55-5526-b46c-23b49b8e0dc3/0d8a0ea5-df55-5526-b46c-23b49b8e0dc3_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 72743,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RE03XJT/698934082/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0d8a0ea5-df55-5526-b46c-23b49b8e0dc3/0d8a0ea5-df55-5526-b46c-23b49b8e0dc3_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 84763,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RE03XJT/698934102/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0d8a0ea5-df55-5526-b46c-23b49b8e0dc3/0d8a0ea5-df55-5526-b46c-23b49b8e0dc3_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 69524,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RE03XJT/698934114/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2003-01-01',
'seller_name': None,
'title': 'HONDA JAZZ 1.4 I-DSI SE SPORT Hatchback',
'transmission': 'automatic',
'trim': 'I-DSI SE SPORT',
'vin': 'JHMGD18703S206031',
'year': 2003}
2026-03-28 14:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27RE03%2520XJT%27 HTTP/1.1" 200 None
2026-03-28 14:02:47 [bca.uk] INFO: Saving data for RE03%20XJT: {'created_time': 1774706567.83145, 'last_price_update_time': 1774706567.831462, 'auction_closing_time': 1774778400.0}
2026-03-28 14:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='RE03%2520XJT') HTTP/1.1" 204 0
2026-03-28 14:02:47 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YC72AVN/698691214/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698691214>
2026-03-28 14:02:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FA18OJS/698923281/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/FA18OJS/42809927?sv=2020-08-04&st=2026-03-28T14%3A02%3A25Z&se=2026-03-28T14%3A27%3A25Z&sr=b&sp=r&sig=wYbenAdSOJrfSZzoBonOEa6%2BD7yy%2FzPCYgKi2Sl75o8%3D)
2026-03-28 14:02:47 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RF08TZP/698938725/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698938725>
2026-03-28 14:02:47 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WP62XCK/697615106/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=697615106>
2026-03-28 14:02:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SM67VNV/698094106/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/SM67VNV/42810251?sv=2020-08-04&st=2026-03-28T14%3A02%3A21Z&se=2026-03-28T14%3A27%3A21Z&sr=b&sp=r&sig=zKf9cm3c2GLLDCKC9h0Kq9J3NSEBcqSIr7bWiyg1hwQ%3D)
2026-03-28 14:02:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WP62XCK/697615113/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/WP62XCK/42810245?sv=2020-08-04&st=2026-03-28T14%3A02%3A21Z&se=2026-03-28T14%3A27%3A21Z&sr=b&sp=r&sig=gyEdXM91VrVknbZjiLD2toi%2BgCj7hBqRBYqi3Ts%2BfeU%3D)
2026-03-28 14:02:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YC72AVN/698691238/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YC72AVN/42810244?sv=2020-08-04&st=2026-03-28T14%3A02%3A20Z&se=2026-03-28T14%3A27%3A20Z&sr=b&sp=r&sig=beG5fN%2BBH0Z%2FDIpkhCSt8zTlTgu277%2B2D8NvIf%2FKCVY%3D)
2026-03-28 14:02:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RF08TZP/698938739/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/RF08TZP/42781844?sv=2020-08-04&st=2026-03-28T14%3A02%3A20Z&se=2026-03-28T14%3A27%3A20Z&sr=b&sp=r&sig=6hLicjIfZGVTK7BLacvGBl2SaFBQyybl9CGTh8APRd8%3D)
2026-03-28 14:02:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:02:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2d643cd0>
2026-03-28 14:02:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:02:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:02:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:02:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_85df4e80-1e5a-5573-ad99-0445a298364d/85df4e80-1e5a-5573-ad99-0445a298364d_image_2.jpg HTTP/1.1" 201 0
2026-03-28 14:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FEP19XHA%252F698568387%252F600') HTTP/1.1" 204 0
2026-03-28 14:02:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EP19XHA/698568387/600 saved to cache
2026-03-28 14:02:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 85df4e80-1e5a-5573-ad99-0445a298364d
2026-03-28 14:02:47 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 85df4e80-1e5a-5573-ad99-0445a298364d, skipping ID generation
2026-03-28 14:02:47 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 85df4e80-1e5a-5573-ad99-0445a298364d sending to next pipeline
2026-03-28 14:02:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 85df4e80-1e5a-5573-ad99-0445a298364d, identifier: EP19%20XHA
2026-03-28 14:02:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:02:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a1ff53810>
2026-03-28 14:02:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:02:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:02:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:02:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_73dc1fed-646a-544c-b3e5-ff1b6aff4358/73dc1fed-646a-544c-b3e5-ff1b6aff4358_image_2.jpg HTTP/1.1" 201 0
2026-03-28 14:02:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FFA18OJS%252F698923302%252F600') HTTP/1.1" 204 0
2026-03-28 14:02:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FA18OJS/698923302/600 saved to cache
2026-03-28 14:02:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 73dc1fed-646a-544c-b3e5-ff1b6aff4358
2026-03-28 14:02:48 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:02:48 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:02:48 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:02:48 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:02:48 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:02:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:02:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c51d910>
2026-03-28 14:02:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:02:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:02:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:02:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0db89969-308f-54b4-910e-308fd1f55fa4/0db89969-308f-54b4-910e-308fd1f55fa4_image_8.jpg HTTP/1.1" 201 0
2026-03-28 14:02:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FRF08TZP%252F698938753%252F600') HTTP/1.1" 204 0
2026-03-28 14:02:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RF08TZP/698938753/600 saved to cache
2026-03-28 14:02:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 0db89969-308f-54b4-910e-308fd1f55fa4
2026-03-28 14:02:48 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:02:48 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:02:48 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:02:48 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:02:48 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:02:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:02:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2de0b610>
2026-03-28 14:02:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:02:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:02:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:02:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_017f335f-f1b9-5de8-8cb9-bc79c2d2f45f/017f335f-f1b9-5de8-8cb9-bc79c2d2f45f_image_6.jpg HTTP/1.1" 201 0
2026-03-28 14:02:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FWP62XCK%252F697615121%252F600') HTTP/1.1" 204 0
2026-03-28 14:02:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WP62XCK/697615121/600 saved to cache
2026-03-28 14:02:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 017f335f-f1b9-5de8-8cb9-bc79c2d2f45f
2026-03-28 14:02:48 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:02:48 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:02:48 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:02:48 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:02:48 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:02:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:02:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c52c2d0>
2026-03-28 14:02:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:02:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:02:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:02:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e4b35cfb-486e-55d8-b302-6ece660ab632/e4b35cfb-486e-55d8-b302-6ece660ab632_image_6.jpg HTTP/1.1" 201 0
2026-03-28 14:02:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FSM67VNV%252F698094131%252F600') HTTP/1.1" 204 0
2026-03-28 14:02:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SM67VNV/698094131/600 saved to cache
2026-03-28 14:02:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item e4b35cfb-486e-55d8-b302-6ece660ab632
2026-03-28 14:02:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 85df4e80-1e5a-5573-ad99-0445a298364d with identifier: EP19%20XHA
2026-03-28 14:02:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 85df4e80-1e5a-5573-ad99-0445a298364d with identifier: EP19%20XHA
2026-03-28 14:02:48 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 85df4e80-1e5a-5573-ad99-0445a298364d with identifier: EP19%20XHA to the API
2026-03-28 14:02:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:02:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:02:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EP19XHA/698568387/600>
{'auction_title': '',
'c_o_2_emission_value': 128,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_85df4e80-1e5a-5573-ad99-0445a298364d/85df4e80-1e5a-5573-ad99-0445a298364d_expert_report_file_5ac99e97-8224-4475-985d-505732e3d665.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=EP19%20XHA-GB',
'category': 'Car',
'color': 'white',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.2L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol',
'id': '85df4e80-1e5a-5573-ad99-0445a298364d',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'EP19 XHA',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=EP19%20XHA&vehicleType=*',
'listing': 'auction',
'location': 'Enfield',
'make': 'VAUXHALL',
'model': 'CROSSLAND X',
'odometer': 71246,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 11,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_85df4e80-1e5a-5573-ad99-0445a298364d/85df4e80-1e5a-5573-ad99-0445a298364d_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 45526,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EP19XHA/698568351/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_85df4e80-1e5a-5573-ad99-0445a298364d/85df4e80-1e5a-5573-ad99-0445a298364d_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 45228,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EP19XHA/698568369/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_85df4e80-1e5a-5573-ad99-0445a298364d/85df4e80-1e5a-5573-ad99-0445a298364d_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 42384,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EP19XHA/698568387/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_85df4e80-1e5a-5573-ad99-0445a298364d/85df4e80-1e5a-5573-ad99-0445a298364d_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 42626,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EP19XHA/698568411/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_85df4e80-1e5a-5573-ad99-0445a298364d/85df4e80-1e5a-5573-ad99-0445a298364d_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 44341,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EP19XHA/698568433/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_85df4e80-1e5a-5573-ad99-0445a298364d/85df4e80-1e5a-5573-ad99-0445a298364d_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 43463,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EP19XHA/698568458/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_85df4e80-1e5a-5573-ad99-0445a298364d/85df4e80-1e5a-5573-ad99-0445a298364d_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 83180,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EP19XHA/698568502/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_85df4e80-1e5a-5573-ad99-0445a298364d/85df4e80-1e5a-5573-ad99-0445a298364d_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 67474,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EP19XHA/698568540/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_85df4e80-1e5a-5573-ad99-0445a298364d/85df4e80-1e5a-5573-ad99-0445a298364d_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 82900,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EP19XHA/698568581/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_85df4e80-1e5a-5573-ad99-0445a298364d/85df4e80-1e5a-5573-ad99-0445a298364d_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 89215,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EP19XHA/698568618/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-01-01',
'seller_name': None,
'title': 'VAUXHALL CROSSLAND X 1.2 T 110 ELITE S/S Hatchback',
'transmission': 'automatic',
'trim': 'T 110 ELITE S/S',
'vin': 'W0V7H9EDXK4432328',
'year': 2019}
2026-03-28 14:02:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27EP19%2520XHA%27 HTTP/1.1" 200 None
2026-03-28 14:02:48 [bca.uk] INFO: Saving data for EP19%20XHA: {'created_time': 1774706568.631487, 'last_price_update_time': 1774706568.6315, 'auction_closing_time': 1774864800.0}
2026-03-28 14:02:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='EP19%2520XHA') HTTP/1.1" 204 0
2026-03-28 14:02:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FA18OJS/698923268/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/FA18OJS/42809927?sv=2020-08-04&st=2026-03-28T14%3A02%3A25Z&se=2026-03-28T14%3A27%3A25Z&sr=b&sp=r&sig=wYbenAdSOJrfSZzoBonOEa6%2BD7yy%2FzPCYgKi2Sl75o8%3D)
2026-03-28 14:02:48 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WP62XCK/697615101/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=697615101>
2026-03-28 14:02:48 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SM67VNV/698094070/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698094070>
2026-03-28 14:02:48 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RF08TZP/698938712/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698938712>
2026-03-28 14:02:48 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YC72AVN/698691179/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698691179>
2026-03-28 14:02:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WP62XCK/697615110/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/WP62XCK/42810245?sv=2020-08-04&st=2026-03-28T14%3A02%3A21Z&se=2026-03-28T14%3A27%3A21Z&sr=b&sp=r&sig=gyEdXM91VrVknbZjiLD2toi%2BgCj7hBqRBYqi3Ts%2BfeU%3D)
2026-03-28 14:02:48 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SM67VNV/698094083/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698094083>
2026-03-28 14:02:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SM67VNV/698094093/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/SM67VNV/42810251?sv=2020-08-04&st=2026-03-28T14%3A02%3A21Z&se=2026-03-28T14%3A27%3A21Z&sr=b&sp=r&sig=zKf9cm3c2GLLDCKC9h0Kq9J3NSEBcqSIr7bWiyg1hwQ%3D)
2026-03-28 14:02:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:02:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c52eb10>
2026-03-28 14:02:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:02:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:02:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:02:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_73dc1fed-646a-544c-b3e5-ff1b6aff4358/73dc1fed-646a-544c-b3e5-ff1b6aff4358_image_1.jpg HTTP/1.1" 201 0
2026-03-28 14:02:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FFA18OJS%252F698923281%252F600') HTTP/1.1" 204 0
2026-03-28 14:02:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FA18OJS/698923281/600 saved to cache
2026-03-28 14:02:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 73dc1fed-646a-544c-b3e5-ff1b6aff4358
2026-03-28 14:02:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:02:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a1fed0d50>
2026-03-28 14:02:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:02:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:02:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:02:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e4b35cfb-486e-55d8-b302-6ece660ab632/e4b35cfb-486e-55d8-b302-6ece660ab632_image_5.jpg HTTP/1.1" 201 0
2026-03-28 14:02:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FSM67VNV%252F698094106%252F600') HTTP/1.1" 204 0
2026-03-28 14:02:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SM67VNV/698094106/600 saved to cache
2026-03-28 14:02:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item e4b35cfb-486e-55d8-b302-6ece660ab632
2026-03-28 14:02:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:02:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c7053d0>
2026-03-28 14:02:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:02:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:02:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:02:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_017f335f-f1b9-5de8-8cb9-bc79c2d2f45f/017f335f-f1b9-5de8-8cb9-bc79c2d2f45f_image_5.jpg HTTP/1.1" 201 0
2026-03-28 14:02:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FWP62XCK%252F697615113%252F600') HTTP/1.1" 204 0
2026-03-28 14:02:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WP62XCK/697615113/600 saved to cache
2026-03-28 14:02:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 017f335f-f1b9-5de8-8cb9-bc79c2d2f45f
2026-03-28 14:02:48 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:02:48 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:02:48 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:02:48 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:02:48 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:02:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:02:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a1fed2d90>
2026-03-28 14:02:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:02:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:02:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:02:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_98f6010a-0356-55b3-9d9f-fbc61b9e1410/98f6010a-0356-55b3-9d9f-fbc61b9e1410_image_9.jpg HTTP/1.1" 201 0
2026-03-28 14:02:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FYC72AVN%252F698691238%252F600') HTTP/1.1" 204 0
2026-03-28 14:02:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YC72AVN/698691238/600 saved to cache
2026-03-28 14:02:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 98f6010a-0356-55b3-9d9f-fbc61b9e1410
2026-03-28 14:02:48 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:02:48 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:02:48 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:02:48 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:02:48 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:02:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:02:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a1fef3bd0>
2026-03-28 14:02:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:02:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:02:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:02:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0db89969-308f-54b4-910e-308fd1f55fa4/0db89969-308f-54b4-910e-308fd1f55fa4_image_7.jpg HTTP/1.1" 201 0
2026-03-28 14:02:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FRF08TZP%252F698938739%252F600') HTTP/1.1" 204 0
2026-03-28 14:02:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RF08TZP/698938739/600 saved to cache
2026-03-28 14:02:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 0db89969-308f-54b4-910e-308fd1f55fa4
2026-03-28 14:02:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:02:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a1fed0650>
2026-03-28 14:02:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:02:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:02:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:02:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_73dc1fed-646a-544c-b3e5-ff1b6aff4358/73dc1fed-646a-544c-b3e5-ff1b6aff4358_image_0.jpg HTTP/1.1" 201 0
2026-03-28 14:02:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FFA18OJS%252F698923268%252F600') HTTP/1.1" 204 0
2026-03-28 14:02:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FA18OJS/698923268/600 saved to cache
2026-03-28 14:02:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 73dc1fed-646a-544c-b3e5-ff1b6aff4358
2026-03-28 14:02:48 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 73dc1fed-646a-544c-b3e5-ff1b6aff4358, skipping ID generation
2026-03-28 14:02:48 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 73dc1fed-646a-544c-b3e5-ff1b6aff4358 sending to next pipeline
2026-03-28 14:02:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 73dc1fed-646a-544c-b3e5-ff1b6aff4358, identifier: FA18%20OJS
2026-03-28 14:02:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:02:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a1fed2250>
2026-03-28 14:02:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:02:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:02:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:02:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_017f335f-f1b9-5de8-8cb9-bc79c2d2f45f/017f335f-f1b9-5de8-8cb9-bc79c2d2f45f_image_4.jpg HTTP/1.1" 201 0
2026-03-28 14:02:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FWP62XCK%252F697615110%252F600') HTTP/1.1" 204 0
2026-03-28 14:02:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WP62XCK/697615110/600 saved to cache
2026-03-28 14:02:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 017f335f-f1b9-5de8-8cb9-bc79c2d2f45f
2026-03-28 14:02:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:02:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c99d250>
2026-03-28 14:02:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:02:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:02:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:02:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e4b35cfb-486e-55d8-b302-6ece660ab632/e4b35cfb-486e-55d8-b302-6ece660ab632_image_4.jpg HTTP/1.1" 201 0
2026-03-28 14:02:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FSM67VNV%252F698094093%252F600') HTTP/1.1" 204 0
2026-03-28 14:02:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SM67VNV/698094093/600 saved to cache
2026-03-28 14:02:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item e4b35cfb-486e-55d8-b302-6ece660ab632
2026-03-28 14:02:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 73dc1fed-646a-544c-b3e5-ff1b6aff4358 with identifier: FA18%20OJS
2026-03-28 14:02:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 73dc1fed-646a-544c-b3e5-ff1b6aff4358 with identifier: FA18%20OJS
2026-03-28 14:02:49 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 73dc1fed-646a-544c-b3e5-ff1b6aff4358 with identifier: FA18%20OJS to the API
2026-03-28 14:02:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:02:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:02:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FA18OJS/698923268/600>
{'auction_title': '',
'c_o_2_emission_value': 125,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_73dc1fed-646a-544c-b3e5-ff1b6aff4358/73dc1fed-646a-544c-b3e5-ff1b6aff4358_expert_report_file_4b344213-dc88-404a-86a4-f6cc33f55dc5.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=FA18%20OJS-GB',
'category': 'Car',
'color': 'blue',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.4L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol',
'id': '73dc1fed-646a-544c-b3e5-ff1b6aff4358',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'FA18 OJS',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=FA18%20OJS&vehicleType=*',
'listing': 'auction',
'location': 'Nottingham',
'make': 'SEAT',
'model': 'ATECA',
'odometer': 61997,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 11,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_73dc1fed-646a-544c-b3e5-ff1b6aff4358/73dc1fed-646a-544c-b3e5-ff1b6aff4358_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 50082,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FA18OJS/698923268/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_73dc1fed-646a-544c-b3e5-ff1b6aff4358/73dc1fed-646a-544c-b3e5-ff1b6aff4358_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 48961,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FA18OJS/698923281/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_73dc1fed-646a-544c-b3e5-ff1b6aff4358/73dc1fed-646a-544c-b3e5-ff1b6aff4358_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 47041,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FA18OJS/698923302/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_73dc1fed-646a-544c-b3e5-ff1b6aff4358/73dc1fed-646a-544c-b3e5-ff1b6aff4358_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 48162,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FA18OJS/698923326/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_73dc1fed-646a-544c-b3e5-ff1b6aff4358/73dc1fed-646a-544c-b3e5-ff1b6aff4358_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 46644,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FA18OJS/698923357/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_73dc1fed-646a-544c-b3e5-ff1b6aff4358/73dc1fed-646a-544c-b3e5-ff1b6aff4358_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 44617,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FA18OJS/698923380/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_73dc1fed-646a-544c-b3e5-ff1b6aff4358/73dc1fed-646a-544c-b3e5-ff1b6aff4358_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 78046,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FA18OJS/698923415/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_73dc1fed-646a-544c-b3e5-ff1b6aff4358/73dc1fed-646a-544c-b3e5-ff1b6aff4358_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 73525,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FA18OJS/698923447/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_73dc1fed-646a-544c-b3e5-ff1b6aff4358/73dc1fed-646a-544c-b3e5-ff1b6aff4358_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 83686,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FA18OJS/698923476/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_73dc1fed-646a-544c-b3e5-ff1b6aff4358/73dc1fed-646a-544c-b3e5-ff1b6aff4358_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 79708,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FA18OJS/698923504/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-01-01',
'seller_name': None,
'title': 'SEAT ATECA 1.4 ECO TSI 150 XCELLENCE DSG StationWagon',
'transmission': 'automatic',
'trim': 'ECO TSI 150 XCELLENCE DSG',
'vin': 'VSSZZZ5FZJ6575049',
'year': 2018}
2026-03-28 14:02:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FA18%2520OJS%27 HTTP/1.1" 200 None
2026-03-28 14:02:49 [bca.uk] INFO: Saving data for FA18%20OJS: {'created_time': 1774706569.495527, 'last_price_update_time': 1774706569.495537, 'auction_closing_time': 1774864800.0}
2026-03-28 14:02:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='FA18%2520OJS') HTTP/1.1" 204 0
2026-03-28 14:02:49 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RF08TZP/698938690/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698938690>
2026-03-28 14:02:49 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YC72AVN/698691152/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698691152>
2026-03-28 14:02:49 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SM67VNV/698094054/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698094054>
2026-03-28 14:02:49 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YC72AVN/698691055/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698691055>
2026-03-28 14:02:49 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YC72AVN/698691111/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698691111>
2026-03-28 14:02:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WP62XCK/697615106/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/WP62XCK/42810245?sv=2020-08-04&st=2026-03-28T14%3A02%3A21Z&se=2026-03-28T14%3A27%3A21Z&sr=b&sp=r&sig=gyEdXM91VrVknbZjiLD2toi%2BgCj7hBqRBYqi3Ts%2BfeU%3D)
2026-03-28 14:02:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YC72AVN/698691214/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YC72AVN/42810244?sv=2020-08-04&st=2026-03-28T14%3A02%3A20Z&se=2026-03-28T14%3A27%3A20Z&sr=b&sp=r&sig=beG5fN%2BBH0Z%2FDIpkhCSt8zTlTgu277%2B2D8NvIf%2FKCVY%3D)
2026-03-28 14:02:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RF08TZP/698938725/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/RF08TZP/42781844?sv=2020-08-04&st=2026-03-28T14%3A02%3A20Z&se=2026-03-28T14%3A27%3A20Z&sr=b&sp=r&sig=6hLicjIfZGVTK7BLacvGBl2SaFBQyybl9CGTh8APRd8%3D)
2026-03-28 14:02:49 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YC72AVN/698691035/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698691035>
2026-03-28 14:02:49 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RF08TZP/698938679/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698938679>
2026-03-28 14:02:49 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RF08TZP/698938672/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=RF08TZP-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-28 14:02:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YC72AVN/698691179/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YC72AVN/42810244?sv=2020-08-04&st=2026-03-28T14%3A02%3A20Z&se=2026-03-28T14%3A27%3A20Z&sr=b&sp=r&sig=beG5fN%2BBH0Z%2FDIpkhCSt8zTlTgu277%2B2D8NvIf%2FKCVY%3D)
2026-03-28 14:02:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WP62XCK/697615101/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/WP62XCK/42810245?sv=2020-08-04&st=2026-03-28T14%3A02%3A21Z&se=2026-03-28T14%3A27%3A21Z&sr=b&sp=r&sig=gyEdXM91VrVknbZjiLD2toi%2BgCj7hBqRBYqi3Ts%2BfeU%3D)
2026-03-28 14:02:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SM67VNV/698094070/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/SM67VNV/42810251?sv=2020-08-04&st=2026-03-28T14%3A02%3A21Z&se=2026-03-28T14%3A27%3A21Z&sr=b&sp=r&sig=zKf9cm3c2GLLDCKC9h0Kq9J3NSEBcqSIr7bWiyg1hwQ%3D)
2026-03-28 14:02:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RF08TZP/698938712/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/RF08TZP/42781844?sv=2020-08-04&st=2026-03-28T14%3A02%3A20Z&se=2026-03-28T14%3A27%3A20Z&sr=b&sp=r&sig=6hLicjIfZGVTK7BLacvGBl2SaFBQyybl9CGTh8APRd8%3D)
2026-03-28 14:02:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SM67VNV/698094083/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/SM67VNV/42810251?sv=2020-08-04&st=2026-03-28T14%3A02%3A21Z&se=2026-03-28T14%3A27%3A21Z&sr=b&sp=r&sig=zKf9cm3c2GLLDCKC9h0Kq9J3NSEBcqSIr7bWiyg1hwQ%3D)
2026-03-28 14:02:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:02:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a1fef03d0>
2026-03-28 14:02:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:02:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:02:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:02:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_017f335f-f1b9-5de8-8cb9-bc79c2d2f45f/017f335f-f1b9-5de8-8cb9-bc79c2d2f45f_image_3.jpg HTTP/1.1" 201 0
2026-03-28 14:02:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FWP62XCK%252F697615106%252F600') HTTP/1.1" 204 0
2026-03-28 14:02:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WP62XCK/697615106/600 saved to cache
2026-03-28 14:02:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 017f335f-f1b9-5de8-8cb9-bc79c2d2f45f
2026-03-28 14:02:49 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:02:49 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:02:49 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:02:49 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:02:49 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:02:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:02:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c82c2d0>
2026-03-28 14:02:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:02:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:02:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:02:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_98f6010a-0356-55b3-9d9f-fbc61b9e1410/98f6010a-0356-55b3-9d9f-fbc61b9e1410_image_8.jpg HTTP/1.1" 201 0
2026-03-28 14:02:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FYC72AVN%252F698691214%252F600') HTTP/1.1" 204 0
2026-03-28 14:02:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YC72AVN/698691214/600 saved to cache
2026-03-28 14:02:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 98f6010a-0356-55b3-9d9f-fbc61b9e1410
2026-03-28 14:02:49 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:02:49 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:02:49 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:02:49 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:02:49 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:02:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:02:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c3fde10>
2026-03-28 14:02:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:02:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:02:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:02:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0db89969-308f-54b4-910e-308fd1f55fa4/0db89969-308f-54b4-910e-308fd1f55fa4_image_6.jpg HTTP/1.1" 201 0
2026-03-28 14:02:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FRF08TZP%252F698938725%252F600') HTTP/1.1" 204 0
2026-03-28 14:02:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RF08TZP/698938725/600 saved to cache
2026-03-28 14:02:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 0db89969-308f-54b4-910e-308fd1f55fa4
2026-03-28 14:02:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YC72AVN/698691111/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YC72AVN/42810244?sv=2020-08-04&st=2026-03-28T14%3A02%3A20Z&se=2026-03-28T14%3A27%3A20Z&sr=b&sp=r&sig=beG5fN%2BBH0Z%2FDIpkhCSt8zTlTgu277%2B2D8NvIf%2FKCVY%3D)
2026-03-28 14:02:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YC72AVN/698691055/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YC72AVN/42810244?sv=2020-08-04&st=2026-03-28T14%3A02%3A20Z&se=2026-03-28T14%3A27%3A20Z&sr=b&sp=r&sig=beG5fN%2BBH0Z%2FDIpkhCSt8zTlTgu277%2B2D8NvIf%2FKCVY%3D)
2026-03-28 14:02:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RF08TZP/698938690/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/RF08TZP/42781844?sv=2020-08-04&st=2026-03-28T14%3A02%3A20Z&se=2026-03-28T14%3A27%3A20Z&sr=b&sp=r&sig=6hLicjIfZGVTK7BLacvGBl2SaFBQyybl9CGTh8APRd8%3D)
2026-03-28 14:02:49 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YC72AVN/698691021/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698691021>
2026-03-28 14:02:49 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EX10BXE/698923517/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698923517>
2026-03-28 14:02:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SM67VNV/698094054/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/SM67VNV/42810251?sv=2020-08-04&st=2026-03-28T14%3A02%3A21Z&se=2026-03-28T14%3A27%3A21Z&sr=b&sp=r&sig=zKf9cm3c2GLLDCKC9h0Kq9J3NSEBcqSIr7bWiyg1hwQ%3D)
2026-03-28 14:02:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YC72AVN/698691152/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YC72AVN/42810244?sv=2020-08-04&st=2026-03-28T14%3A02%3A20Z&se=2026-03-28T14%3A27%3A20Z&sr=b&sp=r&sig=beG5fN%2BBH0Z%2FDIpkhCSt8zTlTgu277%2B2D8NvIf%2FKCVY%3D)
2026-03-28 14:02:49 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:02:49 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:02:49 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:02:49 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:02:49 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:02:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:02:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c780590>
2026-03-28 14:02:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:02:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:02:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:02:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_98f6010a-0356-55b3-9d9f-fbc61b9e1410/98f6010a-0356-55b3-9d9f-fbc61b9e1410_image_7.jpg HTTP/1.1" 201 0
2026-03-28 14:02:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FYC72AVN%252F698691179%252F600') HTTP/1.1" 204 0
2026-03-28 14:02:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YC72AVN/698691179/600 saved to cache
2026-03-28 14:02:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 98f6010a-0356-55b3-9d9f-fbc61b9e1410
2026-03-28 14:02:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:02:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c6f3290>
2026-03-28 14:02:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:02:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:02:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:02:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_017f335f-f1b9-5de8-8cb9-bc79c2d2f45f/017f335f-f1b9-5de8-8cb9-bc79c2d2f45f_image_2.jpg HTTP/1.1" 201 0
2026-03-28 14:02:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FWP62XCK%252F697615101%252F600') HTTP/1.1" 204 0
2026-03-28 14:02:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WP62XCK/697615101/600 saved to cache
2026-03-28 14:02:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 017f335f-f1b9-5de8-8cb9-bc79c2d2f45f
2026-03-28 14:02:49 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 017f335f-f1b9-5de8-8cb9-bc79c2d2f45f, skipping ID generation
2026-03-28 14:02:49 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 017f335f-f1b9-5de8-8cb9-bc79c2d2f45f sending to next pipeline
2026-03-28 14:02:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 017f335f-f1b9-5de8-8cb9-bc79c2d2f45f, identifier: WP62%20XCK
2026-03-28 14:02:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:02:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2fdbca90>
2026-03-28 14:02:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:02:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:02:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:02:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e4b35cfb-486e-55d8-b302-6ece660ab632/e4b35cfb-486e-55d8-b302-6ece660ab632_image_2.jpg HTTP/1.1" 201 0
2026-03-28 14:02:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FSM67VNV%252F698094070%252F600') HTTP/1.1" 204 0
2026-03-28 14:02:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SM67VNV/698094070/600 saved to cache
2026-03-28 14:02:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item e4b35cfb-486e-55d8-b302-6ece660ab632
2026-03-28 14:02:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:02:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c8ce050>
2026-03-28 14:02:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:02:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:02:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:02:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0db89969-308f-54b4-910e-308fd1f55fa4/0db89969-308f-54b4-910e-308fd1f55fa4_image_5.jpg HTTP/1.1" 201 0
2026-03-28 14:02:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FRF08TZP%252F698938712%252F600') HTTP/1.1" 204 0
2026-03-28 14:02:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RF08TZP/698938712/600 saved to cache
2026-03-28 14:02:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 0db89969-308f-54b4-910e-308fd1f55fa4
2026-03-28 14:02:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:02:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c4ffe90>
2026-03-28 14:02:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:02:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:02:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:02:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e4b35cfb-486e-55d8-b302-6ece660ab632/e4b35cfb-486e-55d8-b302-6ece660ab632_image_3.jpg HTTP/1.1" 201 0
2026-03-28 14:02:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FSM67VNV%252F698094083%252F600') HTTP/1.1" 204 0
2026-03-28 14:02:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SM67VNV/698094083/600 saved to cache
2026-03-28 14:02:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item e4b35cfb-486e-55d8-b302-6ece660ab632
2026-03-28 14:02:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 017f335f-f1b9-5de8-8cb9-bc79c2d2f45f with identifier: WP62%20XCK
2026-03-28 14:02:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 017f335f-f1b9-5de8-8cb9-bc79c2d2f45f with identifier: WP62%20XCK
2026-03-28 14:02:50 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 017f335f-f1b9-5de8-8cb9-bc79c2d2f45f with identifier: WP62%20XCK to the API
2026-03-28 14:02:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:02:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:02:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WP62XCK/697615101/600>
{'auction_title': '',
'c_o_2_emission_value': 133,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_017f335f-f1b9-5de8-8cb9-bc79c2d2f45f/017f335f-f1b9-5de8-8cb9-bc79c2d2f45f_expert_report_file_545dedb5-2a1f-4334-9bdd-ef4425cbb169.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=WP62%20XCK-GB',
'category': 'Car',
'color': 'black',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.6L',
'expiration_date': '2026-03-29T10:00:00Z',
'fuel_type': 'Petrol',
'id': '017f335f-f1b9-5de8-8cb9-bc79c2d2f45f',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'WP62 XCK',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=WP62%20XCK&vehicleType=*',
'listing': 'auction',
'location': 'Newcastle-u-Tyne',
'make': 'MERCEDES-BENZ',
'model': 'A180',
'odometer': 88173,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 11,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_017f335f-f1b9-5de8-8cb9-bc79c2d2f45f/017f335f-f1b9-5de8-8cb9-bc79c2d2f45f_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 50008,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WP62XCK/697615090/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_017f335f-f1b9-5de8-8cb9-bc79c2d2f45f/017f335f-f1b9-5de8-8cb9-bc79c2d2f45f_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 46324,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WP62XCK/697615097/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_017f335f-f1b9-5de8-8cb9-bc79c2d2f45f/017f335f-f1b9-5de8-8cb9-bc79c2d2f45f_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 43457,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WP62XCK/697615101/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_017f335f-f1b9-5de8-8cb9-bc79c2d2f45f/017f335f-f1b9-5de8-8cb9-bc79c2d2f45f_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 44825,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WP62XCK/697615106/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_017f335f-f1b9-5de8-8cb9-bc79c2d2f45f/017f335f-f1b9-5de8-8cb9-bc79c2d2f45f_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 40985,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WP62XCK/697615110/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_017f335f-f1b9-5de8-8cb9-bc79c2d2f45f/017f335f-f1b9-5de8-8cb9-bc79c2d2f45f_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 40674,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WP62XCK/697615113/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_017f335f-f1b9-5de8-8cb9-bc79c2d2f45f/017f335f-f1b9-5de8-8cb9-bc79c2d2f45f_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 90298,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WP62XCK/697615121/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_017f335f-f1b9-5de8-8cb9-bc79c2d2f45f/017f335f-f1b9-5de8-8cb9-bc79c2d2f45f_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 88413,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WP62XCK/697615129/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_017f335f-f1b9-5de8-8cb9-bc79c2d2f45f/017f335f-f1b9-5de8-8cb9-bc79c2d2f45f_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 93403,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WP62XCK/697615135/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_017f335f-f1b9-5de8-8cb9-bc79c2d2f45f/017f335f-f1b9-5de8-8cb9-bc79c2d2f45f_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 78494,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WP62XCK/697615142/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2013-01-01',
'seller_name': None,
'title': 'MERCEDES-BENZ A180 1.6 B/E SPORT Hatchback',
'transmission': 'manual',
'trim': 'B/E SPORT',
'vin': 'WDD1760422J041251',
'year': 2013}
2026-03-28 14:02:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WP62%2520XCK%27 HTTP/1.1" 200 None
2026-03-28 14:02:51 [bca.uk] INFO: Saving data for WP62%20XCK: {'created_time': 1774706571.191359, 'last_price_update_time': 1774706571.191373, 'auction_closing_time': 1774778400.0}
2026-03-28 14:02:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='WP62%2520XCK') HTTP/1.1" 204 0
2026-03-28 14:02:51 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/ND17VGZ/698929349/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698929349>
2026-03-28 14:02:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RF08TZP/698938672/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/RF08TZP/42781844?sv=2020-08-04&st=2026-03-28T14%3A02%3A20Z&se=2026-03-28T14%3A27%3A20Z&sr=b&sp=r&sig=6hLicjIfZGVTK7BLacvGBl2SaFBQyybl9CGTh8APRd8%3D)
2026-03-28 14:02:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YC72AVN/698691035/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YC72AVN/42810244?sv=2020-08-04&st=2026-03-28T14%3A02%3A20Z&se=2026-03-28T14%3A27%3A20Z&sr=b&sp=r&sig=beG5fN%2BBH0Z%2FDIpkhCSt8zTlTgu277%2B2D8NvIf%2FKCVY%3D)
2026-03-28 14:02:51 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/DT16AWH/42810199?sv=2020-08-04&st=2026-03-28T14%3A02%3A49Z&se=2026-03-28T14%3A27%3A49Z&sr=b&sp=r&sig=Qm3Z9KBDI%2FgTQga6pc%2FqHN6txQQLz%2B%2FrlyC%2F4kkmDaA%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=DT16%20AWH-GB>
2026-03-28 14:02:51 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GF57MWW/698928920/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698928920>
2026-03-28 14:02:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RF08TZP/698938679/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/RF08TZP/42781844?sv=2020-08-04&st=2026-03-28T14%3A02%3A20Z&se=2026-03-28T14%3A27%3A20Z&sr=b&sp=r&sig=6hLicjIfZGVTK7BLacvGBl2SaFBQyybl9CGTh8APRd8%3D)
2026-03-28 14:02:51 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/GU14USS/42809794?sv=2020-08-04&st=2026-03-28T14%3A02%3A49Z&se=2026-03-28T14%3A27%3A49Z&sr=b&sp=r&sig=UCoZSxmlKy5d0BUzmMeFfalunCe3LCcB9XS6zEEjeiM%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=GU14%20USS-GB>
2026-03-28 14:02:51 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EX10BXE/698923494/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698923494>
2026-03-28 14:02:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:02:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c6f33d0>
2026-03-28 14:02:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:02:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:02:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:02:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_98f6010a-0356-55b3-9d9f-fbc61b9e1410/98f6010a-0356-55b3-9d9f-fbc61b9e1410_image_5.jpg HTTP/1.1" 201 0
2026-03-28 14:02:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FYC72AVN%252F698691111%252F600') HTTP/1.1" 204 0
2026-03-28 14:02:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YC72AVN/698691111/600 saved to cache
2026-03-28 14:02:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 98f6010a-0356-55b3-9d9f-fbc61b9e1410
2026-03-28 14:02:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:02:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a1fd39310>
2026-03-28 14:02:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:02:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:02:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:02:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_98f6010a-0356-55b3-9d9f-fbc61b9e1410/98f6010a-0356-55b3-9d9f-fbc61b9e1410_image_3.jpg HTTP/1.1" 201 0
2026-03-28 14:02:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FYC72AVN%252F698691055%252F600') HTTP/1.1" 204 0
2026-03-28 14:02:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YC72AVN/698691055/600 saved to cache
2026-03-28 14:02:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 98f6010a-0356-55b3-9d9f-fbc61b9e1410
2026-03-28 14:02:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:02:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c628290>
2026-03-28 14:02:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:02:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:02:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:02:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0db89969-308f-54b4-910e-308fd1f55fa4/0db89969-308f-54b4-910e-308fd1f55fa4_image_2.jpg HTTP/1.1" 201 0
2026-03-28 14:02:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FRF08TZP%252F698938690%252F600') HTTP/1.1" 204 0
2026-03-28 14:02:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RF08TZP/698938690/600 saved to cache
2026-03-28 14:02:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 0db89969-308f-54b4-910e-308fd1f55fa4
2026-03-28 14:02:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:02:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c3fe0d0>
2026-03-28 14:02:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:02:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:02:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:02:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e4b35cfb-486e-55d8-b302-6ece660ab632/e4b35cfb-486e-55d8-b302-6ece660ab632_image_1.jpg HTTP/1.1" 201 0
2026-03-28 14:02:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FSM67VNV%252F698094054%252F600') HTTP/1.1" 204 0
2026-03-28 14:02:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SM67VNV/698094054/600 saved to cache
2026-03-28 14:02:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item e4b35cfb-486e-55d8-b302-6ece660ab632
2026-03-28 14:02:51 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: e4b35cfb-486e-55d8-b302-6ece660ab632, skipping ID generation
2026-03-28 14:02:51 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item e4b35cfb-486e-55d8-b302-6ece660ab632 sending to next pipeline
2026-03-28 14:02:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: e4b35cfb-486e-55d8-b302-6ece660ab632, identifier: SM67%20VNV
2026-03-28 14:02:51 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:02:51 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:02:51 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:02:51 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:02:51 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:02:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:02:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c993250>
2026-03-28 14:02:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:02:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:02:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:02:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_98f6010a-0356-55b3-9d9f-fbc61b9e1410/98f6010a-0356-55b3-9d9f-fbc61b9e1410_image_6.jpg HTTP/1.1" 201 0
2026-03-28 14:02:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FYC72AVN%252F698691152%252F600') HTTP/1.1" 204 0
2026-03-28 14:02:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YC72AVN/698691152/600 saved to cache
2026-03-28 14:02:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 98f6010a-0356-55b3-9d9f-fbc61b9e1410
2026-03-28 14:02:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: e4b35cfb-486e-55d8-b302-6ece660ab632 with identifier: SM67%20VNV
2026-03-28 14:02:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: e4b35cfb-486e-55d8-b302-6ece660ab632 with identifier: SM67%20VNV
2026-03-28 14:02:51 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: e4b35cfb-486e-55d8-b302-6ece660ab632 with identifier: SM67%20VNV to the API
2026-03-28 14:02:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:02:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:02:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SM67VNV/698094054/600>
{'auction_title': '',
'c_o_2_emission_value': 101,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e4b35cfb-486e-55d8-b302-6ece660ab632/e4b35cfb-486e-55d8-b302-6ece660ab632_expert_report_file_6a5d717b-4c74-4a03-bdd2-dca9cc92c5d3.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=SM67%20VNV-GB',
'category': 'Car',
'color': 'silver',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.0L',
'expiration_date': '2026-03-29T10:00:00Z',
'fuel_type': 'Petrol',
'id': 'e4b35cfb-486e-55d8-b302-6ece660ab632',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'SM67 VNV',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=SM67%20VNV&vehicleType=*',
'listing': 'auction',
'location': 'Newcastle-u-Tyne',
'make': 'SKODA',
'model': 'FABIA',
'odometer': 61500,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 11,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e4b35cfb-486e-55d8-b302-6ece660ab632/e4b35cfb-486e-55d8-b302-6ece660ab632_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 45648,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SM67VNV/698094046/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e4b35cfb-486e-55d8-b302-6ece660ab632/e4b35cfb-486e-55d8-b302-6ece660ab632_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 44648,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SM67VNV/698094054/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e4b35cfb-486e-55d8-b302-6ece660ab632/e4b35cfb-486e-55d8-b302-6ece660ab632_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 43165,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SM67VNV/698094070/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e4b35cfb-486e-55d8-b302-6ece660ab632/e4b35cfb-486e-55d8-b302-6ece660ab632_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 44272,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SM67VNV/698094083/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e4b35cfb-486e-55d8-b302-6ece660ab632/e4b35cfb-486e-55d8-b302-6ece660ab632_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 42108,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SM67VNV/698094093/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e4b35cfb-486e-55d8-b302-6ece660ab632/e4b35cfb-486e-55d8-b302-6ece660ab632_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 41519,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SM67VNV/698094106/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e4b35cfb-486e-55d8-b302-6ece660ab632/e4b35cfb-486e-55d8-b302-6ece660ab632_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 101944,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SM67VNV/698094131/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e4b35cfb-486e-55d8-b302-6ece660ab632/e4b35cfb-486e-55d8-b302-6ece660ab632_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 71889,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SM67VNV/698094155/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e4b35cfb-486e-55d8-b302-6ece660ab632/e4b35cfb-486e-55d8-b302-6ece660ab632_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 84463,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SM67VNV/698094168/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e4b35cfb-486e-55d8-b302-6ece660ab632/e4b35cfb-486e-55d8-b302-6ece660ab632_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 88528,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SM67VNV/698094197/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-01-01',
'seller_name': None,
'title': 'SKODA FABIA 1.0 TSI 95 SE Hatchback',
'transmission': 'manual',
'trim': 'TSI 95 SE',
'vin': 'TMBFP6NJ1JZ044841',
'year': 2018}
2026-03-28 14:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SM67%2520VNV%27 HTTP/1.1" 200 None
2026-03-28 14:02:52 [bca.uk] INFO: Saving data for SM67%20VNV: {'created_time': 1774706572.176619, 'last_price_update_time': 1774706572.176635, 'auction_closing_time': 1774778400.0}
2026-03-28 14:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='SM67%2520VNV') HTTP/1.1" 204 0
2026-03-28 14:02:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YC72AVN/698691021/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YC72AVN/42810244?sv=2020-08-04&st=2026-03-28T14%3A02%3A20Z&se=2026-03-28T14%3A27%3A20Z&sr=b&sp=r&sig=beG5fN%2BBH0Z%2FDIpkhCSt8zTlTgu277%2B2D8NvIf%2FKCVY%3D)
2026-03-28 14:02:52 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WV13ZTH/698929371/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698929371>
2026-03-28 14:02:52 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/ND17VGZ/698929339/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698929339>
2026-03-28 14:02:52 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/EA67PUX/42810613?sv=2020-08-04&st=2026-03-28T14%3A02%3A51Z&se=2026-03-28T14%3A27%3A51Z&sr=b&sp=r&sig=FV2MJ3KNr66dhTGacY033E%2BqmCeGdrbYHllv8MYGBuI%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=EA67%20PUX-GB>
2026-03-28 14:02:52 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LM11RXV/42806050?sv=2020-08-04&st=2026-03-28T14%3A02%3A51Z&se=2026-03-28T14%3A27%3A51Z&sr=b&sp=r&sig=caEaKFXTUt%2BfRTREEriaB%2FaR7T%2BUUg3%2FKsPPCwG8otw%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=LM11%20RXV-GB>
2026-03-28 14:02:52 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GF57MWW/698928890/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698928890>
2026-03-28 14:02:52 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EX10BXE/698923471/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698923471>
2026-03-28 14:02:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EX10BXE/698923517/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/EX10BXE/42809799?sv=2020-08-04&st=2026-03-28T14%3A01%3A07Z&se=2026-03-28T14%3A26%3A07Z&sr=b&sp=r&sig=xoEQIFwTRaF8ZPdiio47BQcwaxFkt4KEonwRoN8KxQM%3D)
2026-03-28 14:02:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:02:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a1fee98d0>
2026-03-28 14:02:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:02:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:02:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:02:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0db89969-308f-54b4-910e-308fd1f55fa4/0db89969-308f-54b4-910e-308fd1f55fa4_image_0.jpg HTTP/1.1" 201 0
2026-03-28 14:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FRF08TZP%252F698938672%252F600') HTTP/1.1" 204 0
2026-03-28 14:02:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RF08TZP/698938672/600 saved to cache
2026-03-28 14:02:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 0db89969-308f-54b4-910e-308fd1f55fa4
2026-03-28 14:02:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:02:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a3063c3d0>
2026-03-28 14:02:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:02:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:02:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:02:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_98f6010a-0356-55b3-9d9f-fbc61b9e1410/98f6010a-0356-55b3-9d9f-fbc61b9e1410_image_2.jpg HTTP/1.1" 201 0
2026-03-28 14:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FYC72AVN%252F698691035%252F600') HTTP/1.1" 204 0
2026-03-28 14:02:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YC72AVN/698691035/600 saved to cache
2026-03-28 14:02:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 98f6010a-0356-55b3-9d9f-fbc61b9e1410
2026-03-28 14:02:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:02:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2d9f0a10>
2026-03-28 14:02:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:02:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:02:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:02:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0db89969-308f-54b4-910e-308fd1f55fa4/0db89969-308f-54b4-910e-308fd1f55fa4_image_1.jpg HTTP/1.1" 201 0
2026-03-28 14:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FRF08TZP%252F698938679%252F600') HTTP/1.1" 204 0
2026-03-28 14:02:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RF08TZP/698938679/600 saved to cache
2026-03-28 14:02:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 0db89969-308f-54b4-910e-308fd1f55fa4
2026-03-28 14:02:52 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 0db89969-308f-54b4-910e-308fd1f55fa4, skipping ID generation
2026-03-28 14:02:52 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 0db89969-308f-54b4-910e-308fd1f55fa4 sending to next pipeline
2026-03-28 14:02:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 0db89969-308f-54b4-910e-308fd1f55fa4, identifier: RF08%20TZP
2026-03-28 14:02:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 0db89969-308f-54b4-910e-308fd1f55fa4 with identifier: RF08%20TZP
2026-03-28 14:02:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 0db89969-308f-54b4-910e-308fd1f55fa4 with identifier: RF08%20TZP
2026-03-28 14:02:52 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 0db89969-308f-54b4-910e-308fd1f55fa4 with identifier: RF08%20TZP to the API
2026-03-28 14:02:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:02:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:02:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RF08TZP/698938679/600>
{'auction_title': '',
'c_o_2_emission_value': 137,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0db89969-308f-54b4-910e-308fd1f55fa4/0db89969-308f-54b4-910e-308fd1f55fa4_expert_report_file_fc161f00-5f9b-4342-a2a2-35d76566b5f2.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=RF08%20TZP-GB',
'category': 'Car',
'color': 'grey',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.4L',
'expiration_date': '2026-03-29T10:00:00Z',
'fuel_type': 'Petrol',
'id': '0db89969-308f-54b4-910e-308fd1f55fa4',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'RF08 TZP',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=RF08%20TZP&vehicleType=*',
'listing': 'auction',
'location': 'Measham',
'make': 'HONDA',
'model': 'JAZZ',
'odometer': 143571,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 11,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0db89969-308f-54b4-910e-308fd1f55fa4/0db89969-308f-54b4-910e-308fd1f55fa4_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 42557,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RF08TZP/698938672/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0db89969-308f-54b4-910e-308fd1f55fa4/0db89969-308f-54b4-910e-308fd1f55fa4_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 40202,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RF08TZP/698938679/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0db89969-308f-54b4-910e-308fd1f55fa4/0db89969-308f-54b4-910e-308fd1f55fa4_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 43535,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RF08TZP/698938690/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0db89969-308f-54b4-910e-308fd1f55fa4/0db89969-308f-54b4-910e-308fd1f55fa4_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 42228,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RF08TZP/698938695/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0db89969-308f-54b4-910e-308fd1f55fa4/0db89969-308f-54b4-910e-308fd1f55fa4_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 42050,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RF08TZP/698938702/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0db89969-308f-54b4-910e-308fd1f55fa4/0db89969-308f-54b4-910e-308fd1f55fa4_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 41008,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RF08TZP/698938712/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0db89969-308f-54b4-910e-308fd1f55fa4/0db89969-308f-54b4-910e-308fd1f55fa4_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 90682,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RF08TZP/698938725/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0db89969-308f-54b4-910e-308fd1f55fa4/0db89969-308f-54b4-910e-308fd1f55fa4_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 72267,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RF08TZP/698938739/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0db89969-308f-54b4-910e-308fd1f55fa4/0db89969-308f-54b4-910e-308fd1f55fa4_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 90281,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RF08TZP/698938753/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0db89969-308f-54b4-910e-308fd1f55fa4/0db89969-308f-54b4-910e-308fd1f55fa4_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 77295,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RF08TZP/698938767/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2008-01-01',
'seller_name': None,
'title': 'HONDA JAZZ 1.4 I-DSI SE CVT-7 Hatchback',
'transmission': 'manual',
'trim': 'I-DSI SE CVT-7',
'vin': 'LUCGE385083215592',
'year': 2008}
2026-03-28 14:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27RF08%2520TZP%27 HTTP/1.1" 200 None
2026-03-28 14:02:52 [bca.uk] INFO: Saving data for RF08%20TZP: {'created_time': 1774706572.944506, 'last_price_update_time': 1774706572.944519, 'auction_closing_time': 1774778400.0}
2026-03-28 14:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='RF08%2520TZP') HTTP/1.1" 204 0
2026-03-28 14:02:52 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/ND17VGZ/698929328/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698929328>
2026-03-28 14:02:52 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WV13ZTH/698929353/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698929353>
2026-03-28 14:02:52 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GF57MWW/698928862/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698928862>
2026-03-28 14:02:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EX10BXE/698923494/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/EX10BXE/42809799?sv=2020-08-04&st=2026-03-28T14%3A01%3A07Z&se=2026-03-28T14%3A26%3A07Z&sr=b&sp=r&sig=xoEQIFwTRaF8ZPdiio47BQcwaxFkt4KEonwRoN8KxQM%3D)
2026-03-28 14:02:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GF57MWW/698928920/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/GF57MWW/42810309?sv=2020-08-04&st=2026-03-28T14%3A01%3A09Z&se=2026-03-28T14%3A26%3A09Z&sr=b&sp=r&sig=hJTqt8SLdbJfAcgzLjUmqtORuHZL2E6pw%2FRYFmCkjK4%3D)
2026-03-28 14:02:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/ND17VGZ/698929349/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/ND17VGZ/42810273?sv=2020-08-04&st=2026-03-28T14%3A01%3A05Z&se=2026-03-28T14%3A26%3A05Z&sr=b&sp=r&sig=Ddznt5rliWG2eSFSeV1iYUxjjPUcheWJt3FgNXERnUs%3D)
2026-03-28 14:02:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/DT16AWH/42810199?sv=2020-08-04&st=2026-03-28T14%3A02%3A49Z&se=2026-03-28T14%3A27%3A49Z&sr=b&sp=r&sig=Qm3Z9KBDI%2FgTQga6pc%2FqHN6txQQLz%2B%2FrlyC%2F4kkmDaA%3D> (referer: https://www.bca.co.uk/)
2026-03-28 14:02:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:02:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2d9df390>
2026-03-28 14:02:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:02:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:02:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:02:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_98f6010a-0356-55b3-9d9f-fbc61b9e1410/98f6010a-0356-55b3-9d9f-fbc61b9e1410_image_1.jpg HTTP/1.1" 201 0
2026-03-28 14:02:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FYC72AVN%252F698691021%252F600') HTTP/1.1" 204 0
2026-03-28 14:02:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YC72AVN/698691021/600 saved to cache
2026-03-28 14:02:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 98f6010a-0356-55b3-9d9f-fbc61b9e1410
2026-03-28 14:02:53 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 98f6010a-0356-55b3-9d9f-fbc61b9e1410, skipping ID generation
2026-03-28 14:02:53 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 98f6010a-0356-55b3-9d9f-fbc61b9e1410 sending to next pipeline
2026-03-28 14:02:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 98f6010a-0356-55b3-9d9f-fbc61b9e1410, identifier: YC72%20AVN
2026-03-28 14:02:53 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:02:53 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:02:53 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:02:53 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:02:53 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:02:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:02:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a1ff14a10>
2026-03-28 14:02:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:02:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:02:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:02:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f5f9bed7-96bb-5ef8-8a52-e232dbf0b7d5/f5f9bed7-96bb-5ef8-8a52-e232dbf0b7d5_image_8.jpg HTTP/1.1" 201 0
2026-03-28 14:02:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FEX10BXE%252F698923517%252F600') HTTP/1.1" 204 0
2026-03-28 14:02:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EX10BXE/698923517/600 saved to cache
2026-03-28 14:02:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item f5f9bed7-96bb-5ef8-8a52-e232dbf0b7d5
2026-03-28 14:02:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/GU14USS/42809794?sv=2020-08-04&st=2026-03-28T14%3A02%3A49Z&se=2026-03-28T14%3A27%3A49Z&sr=b&sp=r&sig=UCoZSxmlKy5d0BUzmMeFfalunCe3LCcB9XS6zEEjeiM%3D> (referer: https://www.bca.co.uk/)
2026-03-28 14:02:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 98f6010a-0356-55b3-9d9f-fbc61b9e1410 with identifier: YC72%20AVN
2026-03-28 14:02:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 98f6010a-0356-55b3-9d9f-fbc61b9e1410 with identifier: YC72%20AVN
2026-03-28 14:02:53 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 98f6010a-0356-55b3-9d9f-fbc61b9e1410 with identifier: YC72%20AVN to the API
2026-03-28 14:02:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:02:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:02:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YC72AVN/698691021/600>
{'auction_title': '',
'c_o_2_emission_value': 137,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_98f6010a-0356-55b3-9d9f-fbc61b9e1410/98f6010a-0356-55b3-9d9f-fbc61b9e1410_expert_report_file_66bb59b5-9f28-4f15-90e7-915c2e1b8f19.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=YC72%20AVN-GB',
'category': 'Car',
'color': 'grey',
'currency': 'GBP',
'doors_number': 5,
'engine': '2.0L',
'expiration_date': '2026-03-31T10:00:00Z',
'fuel_type': 'Diesel',
'id': '98f6010a-0356-55b3-9d9f-fbc61b9e1410',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'YC72 AVN',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=YC72%20AVN&vehicleType=*',
'listing': 'auction',
'location': 'Measham',
'make': 'VOLKSWAGEN',
'model': 'GOLF',
'odometer': 30331,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 11,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_98f6010a-0356-55b3-9d9f-fbc61b9e1410/98f6010a-0356-55b3-9d9f-fbc61b9e1410_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 42318,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YC72AVN/698691008/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_98f6010a-0356-55b3-9d9f-fbc61b9e1410/98f6010a-0356-55b3-9d9f-fbc61b9e1410_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 41509,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YC72AVN/698691021/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_98f6010a-0356-55b3-9d9f-fbc61b9e1410/98f6010a-0356-55b3-9d9f-fbc61b9e1410_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 43771,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YC72AVN/698691035/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_98f6010a-0356-55b3-9d9f-fbc61b9e1410/98f6010a-0356-55b3-9d9f-fbc61b9e1410_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 42192,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YC72AVN/698691055/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_98f6010a-0356-55b3-9d9f-fbc61b9e1410/98f6010a-0356-55b3-9d9f-fbc61b9e1410_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 42799,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YC72AVN/698691080/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_98f6010a-0356-55b3-9d9f-fbc61b9e1410/98f6010a-0356-55b3-9d9f-fbc61b9e1410_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 41790,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YC72AVN/698691111/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_98f6010a-0356-55b3-9d9f-fbc61b9e1410/98f6010a-0356-55b3-9d9f-fbc61b9e1410_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 79760,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YC72AVN/698691152/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_98f6010a-0356-55b3-9d9f-fbc61b9e1410/98f6010a-0356-55b3-9d9f-fbc61b9e1410_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 73871,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YC72AVN/698691179/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_98f6010a-0356-55b3-9d9f-fbc61b9e1410/98f6010a-0356-55b3-9d9f-fbc61b9e1410_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 87466,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YC72AVN/698691214/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_98f6010a-0356-55b3-9d9f-fbc61b9e1410/98f6010a-0356-55b3-9d9f-fbc61b9e1410_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 100240,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YC72AVN/698691238/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-01-01',
'seller_name': None,
'title': 'VOLKSWAGEN GOLF 2.0 TDI 200 GTD DSG Hatchback',
'transmission': 'automatic',
'trim': 'TDI 200 GTD DSG',
'vin': 'WVWZZZCD4PW114543',
'year': 2022}
2026-03-28 14:02:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YC72%2520AVN%27 HTTP/1.1" 200 None
2026-03-28 14:02:53 [bca.uk] INFO: Saving data for YC72%20AVN: {'created_time': 1774706573.55075, 'last_price_update_time': 1774706573.550761, 'auction_closing_time': 1774951200.0}
2026-03-28 14:02:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='YC72%2520AVN') HTTP/1.1" 204 0
2026-03-28 14:02:53 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/X28AVE/698923832/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698923832>
2026-03-28 14:02:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GF57MWW/698928890/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/GF57MWW/42810309?sv=2020-08-04&st=2026-03-28T14%3A01%3A09Z&se=2026-03-28T14%3A26%3A09Z&sr=b&sp=r&sig=hJTqt8SLdbJfAcgzLjUmqtORuHZL2E6pw%2FRYFmCkjK4%3D)
2026-03-28 14:02:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EX10BXE/698923471/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/EX10BXE/42809799?sv=2020-08-04&st=2026-03-28T14%3A01%3A07Z&se=2026-03-28T14%3A26%3A07Z&sr=b&sp=r&sig=xoEQIFwTRaF8ZPdiio47BQcwaxFkt4KEonwRoN8KxQM%3D)
2026-03-28 14:02:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WV13ZTH/698929371/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/WV13ZTH/42810161?sv=2020-08-04&st=2026-03-28T14%3A01%3A04Z&se=2026-03-28T14%3A26%3A04Z&sr=b&sp=r&sig=hbqIghhD97wvMs5qjsvBMdrtSptsqnkIa342PcMgOiA%3D)
2026-03-28 14:02:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/ND17VGZ/698929339/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/ND17VGZ/42810273?sv=2020-08-04&st=2026-03-28T14%3A01%3A05Z&se=2026-03-28T14%3A26%3A05Z&sr=b&sp=r&sig=Ddznt5rliWG2eSFSeV1iYUxjjPUcheWJt3FgNXERnUs%3D)
2026-03-28 14:02:53 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:02:53 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:02:53 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:02:53 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:02:53 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:02:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:02:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c0cdb90>
2026-03-28 14:02:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:02:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:02:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:02:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f5f9bed7-96bb-5ef8-8a52-e232dbf0b7d5/f5f9bed7-96bb-5ef8-8a52-e232dbf0b7d5_image_7.jpg HTTP/1.1" 201 0
2026-03-28 14:02:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FEX10BXE%252F698923494%252F600') HTTP/1.1" 204 0
2026-03-28 14:02:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EX10BXE/698923494/600 saved to cache
2026-03-28 14:02:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item f5f9bed7-96bb-5ef8-8a52-e232dbf0b7d5
2026-03-28 14:02:53 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:02:53 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:02:53 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:02:53 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:02:53 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:02:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:02:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c86c5d0>
2026-03-28 14:02:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:02:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:02:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:02:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cdcc838c-10d3-5f36-90c6-59ef07eececc/cdcc838c-10d3-5f36-90c6-59ef07eececc_image_7.jpg HTTP/1.1" 201 0
2026-03-28 14:02:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FGF57MWW%252F698928920%252F600') HTTP/1.1" 204 0
2026-03-28 14:02:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GF57MWW/698928920/600 saved to cache
2026-03-28 14:02:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item cdcc838c-10d3-5f36-90c6-59ef07eececc
2026-03-28 14:02:53 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:02:53 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:02:53 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:02:53 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:02:53 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:02:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:02:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a1fd36510>
2026-03-28 14:02:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:02:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:02:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:02:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_03d2b309-0f29-57c0-bf73-2b86c16c227a/03d2b309-0f29-57c0-bf73-2b86c16c227a_image_9.jpg HTTP/1.1" 201 0
2026-03-28 14:02:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FND17VGZ%252F698929349%252F600') HTTP/1.1" 204 0
2026-03-28 14:02:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/ND17VGZ/698929349/600 saved to cache
2026-03-28 14:02:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 03d2b309-0f29-57c0-bf73-2b86c16c227a
2026-03-28 14:02:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:02:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c763b10>
2026-03-28 14:02:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:02:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:02:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:02:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_92f1052e-2c5b-500c-801d-40376c1b4f7c/92f1052e-2c5b-500c-801d-40376c1b4f7c_expert_report_file_ff799d04-be65-4129-a3a9-f11da8830661.pdf HTTP/1.1" 201 0
2026-03-28 14:02:53 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item 92f1052e-2c5b-500c-801d-40376c1b4f7c
2026-03-28 14:02:53 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 92f1052e-2c5b-500c-801d-40376c1b4f7c, skipping ID generation
2026-03-28 14:02:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 92f1052e-2c5b-500c-801d-40376c1b4f7c
2026-03-28 14:02:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DDT16AWH-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-28 14:02:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=DT16AWH-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-28 14:02:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:02:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c58d350>
2026-03-28 14:02:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:02:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:02:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:02:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_356c7b48-0ca4-5934-ba83-5b447228ae4f/356c7b48-0ca4-5934-ba83-5b447228ae4f_expert_report_file_528257ec-afcd-4c16-a527-fba5dcff507e.pdf HTTP/1.1" 201 0
2026-03-28 14:02:53 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item 356c7b48-0ca4-5934-ba83-5b447228ae4f
2026-03-28 14:02:53 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 356c7b48-0ca4-5934-ba83-5b447228ae4f, skipping ID generation
2026-03-28 14:02:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 356c7b48-0ca4-5934-ba83-5b447228ae4f
2026-03-28 14:02:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DGU14USS-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-28 14:02:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=GU14USS-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-28 14:02:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/EA67PUX/42810613?sv=2020-08-04&st=2026-03-28T14%3A02%3A51Z&se=2026-03-28T14%3A27%3A51Z&sr=b&sp=r&sig=FV2MJ3KNr66dhTGacY033E%2BqmCeGdrbYHllv8MYGBuI%3D> (referer: https://www.bca.co.uk/)
2026-03-28 14:02:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LM11RXV/42806050?sv=2020-08-04&st=2026-03-28T14%3A02%3A51Z&se=2026-03-28T14%3A27%3A51Z&sr=b&sp=r&sig=caEaKFXTUt%2BfRTREEriaB%2FaR7T%2BUUg3%2FKsPPCwG8otw%3D> (referer: https://www.bca.co.uk/)
2026-03-28 14:02:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GF57MWW/698928862/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/GF57MWW/42810309?sv=2020-08-04&st=2026-03-28T14%3A01%3A09Z&se=2026-03-28T14%3A26%3A09Z&sr=b&sp=r&sig=hJTqt8SLdbJfAcgzLjUmqtORuHZL2E6pw%2FRYFmCkjK4%3D)
2026-03-28 14:02:53 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YK67BOU/698928994/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698928994>
2026-03-28 14:02:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698767527%27 HTTP/1.1" 200 None
2026-03-28 14:02:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698767527 not downloaded yet
2026-03-28 14:02:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698923304%27 HTTP/1.1" 200 None
2026-03-28 14:02:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698923304 not downloaded yet
2026-03-28 14:02:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WV13ZTH/698929353/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/WV13ZTH/42810161?sv=2020-08-04&st=2026-03-28T14%3A01%3A04Z&se=2026-03-28T14%3A26%3A04Z&sr=b&sp=r&sig=hbqIghhD97wvMs5qjsvBMdrtSptsqnkIa342PcMgOiA%3D)
2026-03-28 14:02:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/ND17VGZ/698929328/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/ND17VGZ/42810273?sv=2020-08-04&st=2026-03-28T14%3A01%3A05Z&se=2026-03-28T14%3A26%3A05Z&sr=b&sp=r&sig=Ddznt5rliWG2eSFSeV1iYUxjjPUcheWJt3FgNXERnUs%3D)
2026-03-28 14:02:53 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/AV65GXF/42809712?sv=2020-08-04&st=2026-03-28T14%3A02%3A53Z&se=2026-03-28T14%3A27%3A53Z&sr=b&sp=r&sig=sDl3PHJQQenzzf0IaxC9YbOCWzunrZz%2F4azGtC537eM%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=AV65%20GXF-GB>
2026-03-28 14:02:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698767548%27 HTTP/1.1" 200 None
2026-03-28 14:02:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698767548 not downloaded yet
2026-03-28 14:02:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698923324%27 HTTP/1.1" 200 None
2026-03-28 14:02:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698923324 not downloaded yet
2026-03-28 14:02:53 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:02:53 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:02:53 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:02:53 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:02:53 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:02:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:02:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c116710>
2026-03-28 14:02:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:02:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:02:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:02:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cdcc838c-10d3-5f36-90c6-59ef07eececc/cdcc838c-10d3-5f36-90c6-59ef07eececc_image_6.jpg HTTP/1.1" 201 0
2026-03-28 14:02:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FGF57MWW%252F698928890%252F600') HTTP/1.1" 204 0
2026-03-28 14:02:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GF57MWW/698928890/600 saved to cache
2026-03-28 14:02:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item cdcc838c-10d3-5f36-90c6-59ef07eececc
2026-03-28 14:02:53 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:02:53 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:02:53 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:02:53 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:02:53 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:02:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:02:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c3b71d0>
2026-03-28 14:02:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:02:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:02:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:02:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f5f9bed7-96bb-5ef8-8a52-e232dbf0b7d5/f5f9bed7-96bb-5ef8-8a52-e232dbf0b7d5_image_6.jpg HTTP/1.1" 201 0
2026-03-28 14:02:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FEX10BXE%252F698923471%252F600') HTTP/1.1" 204 0
2026-03-28 14:02:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EX10BXE/698923471/600 saved to cache
2026-03-28 14:02:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item f5f9bed7-96bb-5ef8-8a52-e232dbf0b7d5
2026-03-28 14:02:53 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:02:53 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:02:53 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:02:53 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:02:53 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:02:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:02:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c3b5b50>
2026-03-28 14:02:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:02:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:02:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:02:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4766d63c-47f2-5b85-8b2c-c4d089a16b5c/4766d63c-47f2-5b85-8b2c-c4d089a16b5c_image_9.jpg HTTP/1.1" 201 0
2026-03-28 14:02:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FWV13ZTH%252F698929371%252F600') HTTP/1.1" 204 0
2026-03-28 14:02:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WV13ZTH/698929371/600 saved to cache
2026-03-28 14:02:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 4766d63c-47f2-5b85-8b2c-c4d089a16b5c
2026-03-28 14:02:54 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:02:54 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:02:54 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:02:54 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:02:54 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:02:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:02:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a1fd7fdd0>
2026-03-28 14:02:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:02:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:02:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:02:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_03d2b309-0f29-57c0-bf73-2b86c16c227a/03d2b309-0f29-57c0-bf73-2b86c16c227a_image_8.jpg HTTP/1.1" 201 0
2026-03-28 14:02:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FND17VGZ%252F698929339%252F600') HTTP/1.1" 204 0
2026-03-28 14:02:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/ND17VGZ/698929339/600 saved to cache
2026-03-28 14:02:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 03d2b309-0f29-57c0-bf73-2b86c16c227a
2026-03-28 14:02:54 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/AK12LBY/42807851?sv=2020-08-04&st=2026-03-28T14%3A02%3A53Z&se=2026-03-28T14%3A27%3A53Z&sr=b&sp=r&sig=rVL1iJzLJtr688%2BIoR0ly84el0HPI9ysth%2F2YIfbWys%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=AK12%20LBY-GB>
2026-03-28 14:02:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698767563%27 HTTP/1.1" 200 None
2026-03-28 14:02:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698767563 not downloaded yet
2026-03-28 14:02:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698923343%27 HTTP/1.1" 200 None
2026-03-28 14:02:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698923343 not downloaded yet
2026-03-28 14:02:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/X28AVE/698923832/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/X28AVE/42809896?sv=2020-08-04&st=2026-03-28T14%3A01%3A06Z&se=2026-03-28T14%3A26%3A06Z&sr=b&sp=r&sig=AYxkyrr3IbeLdESXjdd9QmNEg4ZiUeF%2B%2BO3v1nuSrfg%3D)
2026-03-28 14:02:54 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GF57MWW/698928844/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698928844>
2026-03-28 14:02:54 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WV13ZTH/698929340/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698929340>
2026-03-28 14:02:54 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/ND17VGZ/698929315/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698929315>
2026-03-28 14:02:54 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/X28AVE/698923819/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698923819>
2026-03-28 14:02:54 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EX10BXE/698923441/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698923441>
2026-03-28 14:02:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698767575%27 HTTP/1.1" 200 None
2026-03-28 14:02:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698767575 not downloaded yet
2026-03-28 14:02:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698923361%27 HTTP/1.1" 200 None
2026-03-28 14:02:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698923361 not downloaded yet
2026-03-28 14:02:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:02:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c3d3dd0>
2026-03-28 14:02:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:02:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:02:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:02:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_efe9536c-07f4-51cc-8c8c-b67b73b93c1d/efe9536c-07f4-51cc-8c8c-b67b73b93c1d_expert_report_file_59d2b004-65ff-4a15-81fd-23863fe63b97.pdf HTTP/1.1" 201 0
2026-03-28 14:02:54 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item efe9536c-07f4-51cc-8c8c-b67b73b93c1d
2026-03-28 14:02:54 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: efe9536c-07f4-51cc-8c8c-b67b73b93c1d, skipping ID generation
2026-03-28 14:02:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item efe9536c-07f4-51cc-8c8c-b67b73b93c1d
2026-03-28 14:02:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DEA67PUX-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-28 14:02:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=EA67PUX-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-28 14:02:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:02:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2de4c8d0>
2026-03-28 14:02:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:02:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:02:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:02:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8d240778-137c-5daf-bc26-32539d983300/8d240778-137c-5daf-bc26-32539d983300_expert_report_file_d41ad2f5-f935-4bc3-a457-c9687ee8880d.pdf HTTP/1.1" 201 0
2026-03-28 14:02:54 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item 8d240778-137c-5daf-bc26-32539d983300
2026-03-28 14:02:54 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 8d240778-137c-5daf-bc26-32539d983300, skipping ID generation
2026-03-28 14:02:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 8d240778-137c-5daf-bc26-32539d983300
2026-03-28 14:02:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DLM11RXV-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-28 14:02:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=LM11RXV-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-28 14:02:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:02:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2d9f1bd0>
2026-03-28 14:02:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:02:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:02:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:02:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cdcc838c-10d3-5f36-90c6-59ef07eececc/cdcc838c-10d3-5f36-90c6-59ef07eececc_image_5.jpg HTTP/1.1" 201 0
2026-03-28 14:02:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FGF57MWW%252F698928862%252F600') HTTP/1.1" 204 0
2026-03-28 14:02:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GF57MWW/698928862/600 saved to cache
2026-03-28 14:02:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item cdcc838c-10d3-5f36-90c6-59ef07eececc
2026-03-28 14:02:54 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:02:54 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:02:54 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:02:54 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:02:54 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:02:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:02:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2de4ec10>
2026-03-28 14:02:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:02:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:02:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:02:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4766d63c-47f2-5b85-8b2c-c4d089a16b5c/4766d63c-47f2-5b85-8b2c-c4d089a16b5c_image_8.jpg HTTP/1.1" 201 0
2026-03-28 14:02:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FWV13ZTH%252F698929353%252F600') HTTP/1.1" 204 0
2026-03-28 14:02:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WV13ZTH/698929353/600 saved to cache
2026-03-28 14:02:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 4766d63c-47f2-5b85-8b2c-c4d089a16b5c
2026-03-28 14:02:54 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:02:54 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:02:54 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:02:54 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:02:54 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:02:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:02:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2ca5fc90>
2026-03-28 14:02:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:02:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:02:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:02:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_03d2b309-0f29-57c0-bf73-2b86c16c227a/03d2b309-0f29-57c0-bf73-2b86c16c227a_image_7.jpg HTTP/1.1" 201 0
2026-03-28 14:02:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FND17VGZ%252F698929328%252F600') HTTP/1.1" 204 0
2026-03-28 14:02:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/ND17VGZ/698929328/600 saved to cache
2026-03-28 14:02:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 03d2b309-0f29-57c0-bf73-2b86c16c227a
2026-03-28 14:02:54 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YK67BOU/698928964/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698928964>
2026-03-28 14:02:54 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/KN15HKZ/42810176?sv=2020-08-04&st=2026-03-28T14%3A02%3A54Z&se=2026-03-28T14%3A27%3A54Z&sr=b&sp=r&sig=6ZOzhCNRXpxseDgu0vJzh7zeL7nkRl6lcUDHM3dN8f4%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=KN15%20HKZ-GB>
2026-03-28 14:02:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698767586%27 HTTP/1.1" 200 None
2026-03-28 14:02:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698767586 not downloaded yet
2026-03-28 14:02:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698923381%27 HTTP/1.1" 200 None
2026-03-28 14:02:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698923381 not downloaded yet
2026-03-28 14:02:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698970520%27 HTTP/1.1" 200 None
2026-03-28 14:02:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698970520 not downloaded yet
2026-03-28 14:02:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698709973%27 HTTP/1.1" 200 None
2026-03-28 14:02:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698709973 not downloaded yet
2026-03-28 14:02:54 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EX10BXE/698923423/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698923423>
2026-03-28 14:02:54 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/ND17VGZ/698929297/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698929297>
2026-03-28 14:02:54 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GU14USS/698923283/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=GU14USS-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-28 14:02:54 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DT16AWH/698767510/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=DT16AWH-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-28 14:02:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698767600%27 HTTP/1.1" 200 None
2026-03-28 14:02:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698767600 not downloaded yet
2026-03-28 14:02:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698923412%27 HTTP/1.1" 200 None
2026-03-28 14:02:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698923412 not downloaded yet
2026-03-28 14:02:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698953140%27 HTTP/1.1" 200 None
2026-03-28 14:02:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698953140 not downloaded yet
2026-03-28 14:02:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698709981%27 HTTP/1.1" 200 None
2026-03-28 14:02:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698709981 not downloaded yet
2026-03-28 14:02:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YK67BOU/698928994/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YK67BOU/42810138?sv=2020-08-04&st=2026-03-28T14%3A01%3A06Z&se=2026-03-28T14%3A26%3A06Z&sr=b&sp=r&sig=lMZ3QjflOWAYgjfCxBohfGqFaZWJDMyvtEvO8nKSM7s%3D)
2026-03-28 14:02:54 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:02:54 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:02:54 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:02:54 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:02:54 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:02:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:02:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a1fe67c50>
2026-03-28 14:02:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:02:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:02:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:02:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e788d11e-974b-5084-adb6-d49a23c42616/e788d11e-974b-5084-adb6-d49a23c42616_image_9.jpg HTTP/1.1" 201 0
2026-03-28 14:02:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FX28AVE%252F698923832%252F600') HTTP/1.1" 204 0
2026-03-28 14:02:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/X28AVE/698923832/600 saved to cache
2026-03-28 14:02:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item e788d11e-974b-5084-adb6-d49a23c42616
2026-03-28 14:02:54 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/PO15XUV/42809772?sv=2020-08-04&st=2026-03-28T14%3A02%3A54Z&se=2026-03-28T14%3A27%3A54Z&sr=b&sp=r&sig=1ksGRuGZMylD5KeVhMjhRx%2BfGxoL8DlmhQEw9kjsatI%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=PO15%20XUV-GB>
2026-03-28 14:02:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698767618%27 HTTP/1.1" 200 None
2026-03-28 14:02:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698767618 not downloaded yet
2026-03-28 14:02:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698923444%27 HTTP/1.1" 200 None
2026-03-28 14:02:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698923444 not downloaded yet
2026-03-28 14:02:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698970538%27 HTTP/1.1" 200 None
2026-03-28 14:02:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698970538 not downloaded yet
2026-03-28 14:02:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698709995%27 HTTP/1.1" 200 None
2026-03-28 14:02:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698709995 not downloaded yet
2026-03-28 14:02:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GF57MWW/698928844/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/GF57MWW/42810309?sv=2020-08-04&st=2026-03-28T14%3A01%3A09Z&se=2026-03-28T14%3A26%3A09Z&sr=b&sp=r&sig=hJTqt8SLdbJfAcgzLjUmqtORuHZL2E6pw%2FRYFmCkjK4%3D)
2026-03-28 14:02:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WV13ZTH/698929340/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/WV13ZTH/42810161?sv=2020-08-04&st=2026-03-28T14%3A01%3A04Z&se=2026-03-28T14%3A26%3A04Z&sr=b&sp=r&sig=hbqIghhD97wvMs5qjsvBMdrtSptsqnkIa342PcMgOiA%3D)
2026-03-28 14:02:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698767633%27 HTTP/1.1" 200 None
2026-03-28 14:02:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698767633 not downloaded yet
2026-03-28 14:02:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698923467%27 HTTP/1.1" 200 None
2026-03-28 14:02:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698923467 not downloaded yet
2026-03-28 14:02:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698953155%27 HTTP/1.1" 200 None
2026-03-28 14:02:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698953155 not downloaded yet
2026-03-28 14:02:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698710007%27 HTTP/1.1" 200 None
2026-03-28 14:02:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698710007 not downloaded yet
2026-03-28 14:02:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/X28AVE/698923819/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/X28AVE/42809896?sv=2020-08-04&st=2026-03-28T14%3A01%3A06Z&se=2026-03-28T14%3A26%3A06Z&sr=b&sp=r&sig=AYxkyrr3IbeLdESXjdd9QmNEg4ZiUeF%2B%2BO3v1nuSrfg%3D)
2026-03-28 14:02:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/AK12LBY/42807851?sv=2020-08-04&st=2026-03-28T14%3A02%3A53Z&se=2026-03-28T14%3A27%3A53Z&sr=b&sp=r&sig=rVL1iJzLJtr688%2BIoR0ly84el0HPI9ysth%2F2YIfbWys%3D> (referer: https://www.bca.co.uk/)
2026-03-28 14:02:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EX10BXE/698923441/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/EX10BXE/42809799?sv=2020-08-04&st=2026-03-28T14%3A01%3A07Z&se=2026-03-28T14%3A26%3A07Z&sr=b&sp=r&sig=xoEQIFwTRaF8ZPdiio47BQcwaxFkt4KEonwRoN8KxQM%3D)
2026-03-28 14:02:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/ND17VGZ/698929315/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/ND17VGZ/42810273?sv=2020-08-04&st=2026-03-28T14%3A01%3A05Z&se=2026-03-28T14%3A26%3A05Z&sr=b&sp=r&sig=Ddznt5rliWG2eSFSeV1iYUxjjPUcheWJt3FgNXERnUs%3D)
2026-03-28 14:02:54 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GU14USS/698923343/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698923343>
2026-03-28 14:02:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698767650%27 HTTP/1.1" 200 None
2026-03-28 14:02:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698767650 not downloaded yet
2026-03-28 14:02:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698923497%27 HTTP/1.1" 200 None
2026-03-28 14:02:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698923497 not downloaded yet
2026-03-28 14:02:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698970555%27 HTTP/1.1" 200 None
2026-03-28 14:02:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698970555 not downloaded yet
2026-03-28 14:02:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698710017%27 HTTP/1.1" 200 None
2026-03-28 14:02:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698710017 not downloaded yet
2026-03-28 14:02:54 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:02:54 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:02:54 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:02:54 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:02:54 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:02:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:02:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2fe31fd0>
2026-03-28 14:02:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:02:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:02:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:02:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_561c0b4f-3a2d-562b-bb16-d69244165df3/561c0b4f-3a2d-562b-bb16-d69244165df3_image_9.jpg HTTP/1.1" 201 0
2026-03-28 14:02:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FYK67BOU%252F698928994%252F600') HTTP/1.1" 204 0
2026-03-28 14:02:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YK67BOU/698928994/600 saved to cache
2026-03-28 14:02:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 561c0b4f-3a2d-562b-bb16-d69244165df3
2026-03-28 14:02:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/AV65GXF/42809712?sv=2020-08-04&st=2026-03-28T14%3A02%3A53Z&se=2026-03-28T14%3A27%3A53Z&sr=b&sp=r&sig=sDl3PHJQQenzzf0IaxC9YbOCWzunrZz%2F4azGtC537eM%3D> (referer: https://www.bca.co.uk/)
2026-03-28 14:02:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698953167%27 HTTP/1.1" 200 None
2026-03-28 14:02:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698953167 not downloaded yet
2026-03-28 14:02:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698710036%27 HTTP/1.1" 200 None
2026-03-28 14:02:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698710036 not downloaded yet
2026-03-28 14:02:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YK67BOU/698928964/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YK67BOU/42810138?sv=2020-08-04&st=2026-03-28T14%3A01%3A06Z&se=2026-03-28T14%3A26%3A06Z&sr=b&sp=r&sig=lMZ3QjflOWAYgjfCxBohfGqFaZWJDMyvtEvO8nKSM7s%3D)
2026-03-28 14:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698970565%27 HTTP/1.1" 200 None
2026-03-28 14:02:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698970565 not downloaded yet
2026-03-28 14:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698710056%27 HTTP/1.1" 200 None
2026-03-28 14:02:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698710056 not downloaded yet
2026-03-28 14:02:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/KN15HKZ/42810176?sv=2020-08-04&st=2026-03-28T14%3A02%3A54Z&se=2026-03-28T14%3A27%3A54Z&sr=b&sp=r&sig=6ZOzhCNRXpxseDgu0vJzh7zeL7nkRl6lcUDHM3dN8f4%3D> (referer: https://www.bca.co.uk/)
2026-03-28 14:02:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:02:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2de3de50>
2026-03-28 14:02:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:02:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:02:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:02:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cdcc838c-10d3-5f36-90c6-59ef07eececc/cdcc838c-10d3-5f36-90c6-59ef07eececc_image_4.jpg HTTP/1.1" 201 0
2026-03-28 14:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FGF57MWW%252F698928844%252F600') HTTP/1.1" 204 0
2026-03-28 14:02:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GF57MWW/698928844/600 saved to cache
2026-03-28 14:02:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item cdcc838c-10d3-5f36-90c6-59ef07eececc
2026-03-28 14:02:55 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:02:55 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:02:55 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:02:55 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:02:55 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:02:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:02:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c51fad0>
2026-03-28 14:02:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:02:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:02:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:02:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4766d63c-47f2-5b85-8b2c-c4d089a16b5c/4766d63c-47f2-5b85-8b2c-c4d089a16b5c_image_7.jpg HTTP/1.1" 201 0
2026-03-28 14:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FWV13ZTH%252F698929340%252F600') HTTP/1.1" 204 0
2026-03-28 14:02:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WV13ZTH/698929340/600 saved to cache
2026-03-28 14:02:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 4766d63c-47f2-5b85-8b2c-c4d089a16b5c
2026-03-28 14:02:55 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:02:55 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:02:55 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:02:55 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:02:55 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:02:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:02:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2ca0f2d0>
2026-03-28 14:02:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:02:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:02:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:02:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e788d11e-974b-5084-adb6-d49a23c42616/e788d11e-974b-5084-adb6-d49a23c42616_image_8.jpg HTTP/1.1" 201 0
2026-03-28 14:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FX28AVE%252F698923819%252F600') HTTP/1.1" 204 0
2026-03-28 14:02:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/X28AVE/698923819/600 saved to cache
2026-03-28 14:02:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item e788d11e-974b-5084-adb6-d49a23c42616
2026-03-28 14:02:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:02:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a1fea31d0>
2026-03-28 14:02:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:02:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:02:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:02:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ea08653a-82f6-5e2e-9b8f-caf8f656653f/ea08653a-82f6-5e2e-9b8f-caf8f656653f_expert_report_file_0a61dc25-b2b7-4ba6-a03b-7cf405f04c82.pdf HTTP/1.1" 201 0
2026-03-28 14:02:55 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item ea08653a-82f6-5e2e-9b8f-caf8f656653f
2026-03-28 14:02:55 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: ea08653a-82f6-5e2e-9b8f-caf8f656653f, skipping ID generation
2026-03-28 14:02:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item ea08653a-82f6-5e2e-9b8f-caf8f656653f
2026-03-28 14:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DAK12LBY-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-28 14:02:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=AK12LBY-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-28 14:02:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:02:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a1fed2490>
2026-03-28 14:02:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:02:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:02:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:02:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f5f9bed7-96bb-5ef8-8a52-e232dbf0b7d5/f5f9bed7-96bb-5ef8-8a52-e232dbf0b7d5_image_5.jpg HTTP/1.1" 201 0
2026-03-28 14:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FEX10BXE%252F698923441%252F600') HTTP/1.1" 204 0
2026-03-28 14:02:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EX10BXE/698923441/600 saved to cache
2026-03-28 14:02:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item f5f9bed7-96bb-5ef8-8a52-e232dbf0b7d5
2026-03-28 14:02:55 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:02:55 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:02:55 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:02:55 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:02:55 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:02:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:02:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a1feabb90>
2026-03-28 14:02:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:02:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:02:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:02:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_03d2b309-0f29-57c0-bf73-2b86c16c227a/03d2b309-0f29-57c0-bf73-2b86c16c227a_image_6.jpg HTTP/1.1" 201 0
2026-03-28 14:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FND17VGZ%252F698929315%252F600') HTTP/1.1" 204 0
2026-03-28 14:02:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/ND17VGZ/698929315/600 saved to cache
2026-03-28 14:02:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 03d2b309-0f29-57c0-bf73-2b86c16c227a
2026-03-28 14:02:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DT16AWH/698767510/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/DT16AWH/42810199?sv=2020-08-04&st=2026-03-28T14%3A02%3A49Z&se=2026-03-28T14%3A27%3A49Z&sr=b&sp=r&sig=Qm3Z9KBDI%2FgTQga6pc%2FqHN6txQQLz%2B%2FrlyC%2F4kkmDaA%3D)
2026-03-28 14:02:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GU14USS/698923283/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/GU14USS/42809794?sv=2020-08-04&st=2026-03-28T14%3A02%3A49Z&se=2026-03-28T14%3A27%3A49Z&sr=b&sp=r&sig=UCoZSxmlKy5d0BUzmMeFfalunCe3LCcB9XS6zEEjeiM%3D)
2026-03-28 14:02:55 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LM11RXV/698709973/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698709973>
2026-03-28 14:02:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EX10BXE/698923423/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/EX10BXE/42809799?sv=2020-08-04&st=2026-03-28T14%3A01%3A07Z&se=2026-03-28T14%3A26%3A07Z&sr=b&sp=r&sig=xoEQIFwTRaF8ZPdiio47BQcwaxFkt4KEonwRoN8KxQM%3D)
2026-03-28 14:02:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/ND17VGZ/698929297/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/ND17VGZ/42810273?sv=2020-08-04&st=2026-03-28T14%3A01%3A05Z&se=2026-03-28T14%3A26%3A05Z&sr=b&sp=r&sig=Ddznt5rliWG2eSFSeV1iYUxjjPUcheWJt3FgNXERnUs%3D)
2026-03-28 14:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698953184%27 HTTP/1.1" 200 None
2026-03-28 14:02:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698953184 not downloaded yet
2026-03-28 14:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698710072%27 HTTP/1.1" 200 None
2026-03-28 14:02:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698710072 not downloaded yet
2026-03-28 14:02:55 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LM11RXV/698709995/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698709995>
2026-03-28 14:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698787364%27 HTTP/1.1" 200 None
2026-03-28 14:02:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698787364 not downloaded yet
2026-03-28 14:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698970574%27 HTTP/1.1" 200 None
2026-03-28 14:02:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698970574 not downloaded yet
2026-03-28 14:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698710093%27 HTTP/1.1" 200 None
2026-03-28 14:02:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698710093 not downloaded yet
2026-03-28 14:02:55 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EA67PUX/698970538/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698970538>
2026-03-28 14:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698787376%27 HTTP/1.1" 200 None
2026-03-28 14:02:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698787376 not downloaded yet
2026-03-28 14:02:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GU14USS/698923343/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/GU14USS/42809794?sv=2020-08-04&st=2026-03-28T14%3A02%3A49Z&se=2026-03-28T14%3A27%3A49Z&sr=b&sp=r&sig=UCoZSxmlKy5d0BUzmMeFfalunCe3LCcB9XS6zEEjeiM%3D)
2026-03-28 14:02:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:02:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c587510>
2026-03-28 14:02:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:02:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:02:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:02:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3178ef9b-a5d4-5f26-baa7-4b0b7cfd9561/3178ef9b-a5d4-5f26-baa7-4b0b7cfd9561_expert_report_file_ad5bf725-e885-4715-91e4-a5c5d41d9c3b.pdf HTTP/1.1" 201 0
2026-03-28 14:02:55 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item 3178ef9b-a5d4-5f26-baa7-4b0b7cfd9561
2026-03-28 14:02:55 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 3178ef9b-a5d4-5f26-baa7-4b0b7cfd9561, skipping ID generation
2026-03-28 14:02:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 3178ef9b-a5d4-5f26-baa7-4b0b7cfd9561
2026-03-28 14:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DAV65GXF-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-28 14:02:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=AV65GXF-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-28 14:02:55 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:02:55 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:02:55 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:02:55 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:02:55 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:02:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:02:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c8e1a10>
2026-03-28 14:02:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:02:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:02:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:02:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_561c0b4f-3a2d-562b-bb16-d69244165df3/561c0b4f-3a2d-562b-bb16-d69244165df3_image_8.jpg HTTP/1.1" 201 0
2026-03-28 14:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FYK67BOU%252F698928964%252F600') HTTP/1.1" 204 0
2026-03-28 14:02:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YK67BOU/698928964/600 saved to cache
2026-03-28 14:02:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 561c0b4f-3a2d-562b-bb16-d69244165df3
2026-03-28 14:02:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:02:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c860290>
2026-03-28 14:02:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:02:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:02:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:02:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9708014f-5ed6-5f8a-955b-235d568bd501/9708014f-5ed6-5f8a-955b-235d568bd501_expert_report_file_095666f7-82fd-4fa1-86ee-8f085b25f2a4.pdf HTTP/1.1" 201 0
2026-03-28 14:02:55 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item 9708014f-5ed6-5f8a-955b-235d568bd501
2026-03-28 14:02:55 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 9708014f-5ed6-5f8a-955b-235d568bd501, skipping ID generation
2026-03-28 14:02:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 9708014f-5ed6-5f8a-955b-235d568bd501
2026-03-28 14:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DKN15HKZ-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-28 14:02:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=KN15HKZ-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-28 14:02:55 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LM11RXV/698710007/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698710007>
2026-03-28 14:02:55 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LM11RXV/698710017/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698710017>
2026-03-28 14:02:55 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DT16AWH/698767633/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698767633>
2026-03-28 14:02:55 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GU14USS/698923467/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698923467>
2026-03-28 14:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698787394%27 HTTP/1.1" 200 None
2026-03-28 14:02:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698787394 not downloaded yet
2026-03-28 14:02:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/PO15XUV/42809772?sv=2020-08-04&st=2026-03-28T14%3A02%3A54Z&se=2026-03-28T14%3A27%3A54Z&sr=b&sp=r&sig=1ksGRuGZMylD5KeVhMjhRx%2BfGxoL8DlmhQEw9kjsatI%3D> (referer: https://www.bca.co.uk/)
2026-03-28 14:02:55 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EA67PUX/698953155/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698953155>
2026-03-28 14:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698920136%27 HTTP/1.1" 200 None
2026-03-28 14:02:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698920136 not downloaded yet
2026-03-28 14:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698174235%27 HTTP/1.1" 200 None
2026-03-28 14:02:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698174235 not downloaded yet
2026-03-28 14:02:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:02:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c779710>
2026-03-28 14:02:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:02:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:02:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:02:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_92f1052e-2c5b-500c-801d-40376c1b4f7c/92f1052e-2c5b-500c-801d-40376c1b4f7c_image_0.jpg HTTP/1.1" 201 0
2026-03-28 14:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FDT16AWH%252F698767510%252F600') HTTP/1.1" 204 0
2026-03-28 14:02:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DT16AWH/698767510/600 saved to cache
2026-03-28 14:02:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 92f1052e-2c5b-500c-801d-40376c1b4f7c
2026-03-28 14:02:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:02:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a1fedfe10>
2026-03-28 14:02:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:02:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:02:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:02:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_356c7b48-0ca4-5934-ba83-5b447228ae4f/356c7b48-0ca4-5934-ba83-5b447228ae4f_image_0.jpg HTTP/1.1" 201 0
2026-03-28 14:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FGU14USS%252F698923283%252F600') HTTP/1.1" 204 0
2026-03-28 14:02:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GU14USS/698923283/600 saved to cache
2026-03-28 14:02:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 356c7b48-0ca4-5934-ba83-5b447228ae4f
2026-03-28 14:02:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:02:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c6b2250>
2026-03-28 14:02:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:02:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:02:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:02:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f5f9bed7-96bb-5ef8-8a52-e232dbf0b7d5/f5f9bed7-96bb-5ef8-8a52-e232dbf0b7d5_image_4.jpg HTTP/1.1" 201 0
2026-03-28 14:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FEX10BXE%252F698923423%252F600') HTTP/1.1" 204 0
2026-03-28 14:02:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EX10BXE/698923423/600 saved to cache
2026-03-28 14:02:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item f5f9bed7-96bb-5ef8-8a52-e232dbf0b7d5
2026-03-28 14:02:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:02:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c59a990>
2026-03-28 14:02:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:02:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:02:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:02:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_03d2b309-0f29-57c0-bf73-2b86c16c227a/03d2b309-0f29-57c0-bf73-2b86c16c227a_image_5.jpg HTTP/1.1" 201 0
2026-03-28 14:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FND17VGZ%252F698929297%252F600') HTTP/1.1" 204 0
2026-03-28 14:02:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/ND17VGZ/698929297/600 saved to cache
2026-03-28 14:02:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 03d2b309-0f29-57c0-bf73-2b86c16c227a
2026-03-28 14:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698787404%27 HTTP/1.1" 200 None
2026-03-28 14:02:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698787404 not downloaded yet
2026-03-28 14:02:55 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EA67PUX/698970555/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698970555>
2026-03-28 14:02:55 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LM11RXV/698710036/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698710036>
2026-03-28 14:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698920162%27 HTTP/1.1" 200 None
2026-03-28 14:02:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698920162 not downloaded yet
2026-03-28 14:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698174245%27 HTTP/1.1" 200 None
2026-03-28 14:02:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698174245 not downloaded yet
2026-03-28 14:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698787413%27 HTTP/1.1" 200 None
2026-03-28 14:02:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698787413 not downloaded yet
2026-03-28 14:02:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:02:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c5f13d0>
2026-03-28 14:02:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:02:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:02:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:02:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_356c7b48-0ca4-5934-ba83-5b447228ae4f/356c7b48-0ca4-5934-ba83-5b447228ae4f_image_3.jpg HTTP/1.1" 201 0
2026-03-28 14:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FGU14USS%252F698923343%252F600') HTTP/1.1" 204 0
2026-03-28 14:02:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GU14USS/698923343/600 saved to cache
2026-03-28 14:02:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 356c7b48-0ca4-5934-ba83-5b447228ae4f
2026-03-28 14:02:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:02:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c5e8450>
2026-03-28 14:02:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:02:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:02:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:02:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_325fe017-882a-52af-b1a0-8b2b107ef73e/325fe017-882a-52af-b1a0-8b2b107ef73e_expert_report_file_ec481218-4c34-446b-8ae5-481e1c20d540.pdf HTTP/1.1" 201 0
2026-03-28 14:02:56 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item 325fe017-882a-52af-b1a0-8b2b107ef73e
2026-03-28 14:02:56 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 325fe017-882a-52af-b1a0-8b2b107ef73e, skipping ID generation
2026-03-28 14:02:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 325fe017-882a-52af-b1a0-8b2b107ef73e
2026-03-28 14:02:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DPO15XUV-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-28 14:02:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=PO15XUV-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-28 14:02:56 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EA67PUX/698970565/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698970565>
2026-03-28 14:02:56 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LM11RXV/698710056/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698710056>
2026-03-28 14:02:56 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EA67PUX/698953167/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698953167>
2026-03-28 14:02:56 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AK12LBY/698787350/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=AK12LBY-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-28 14:02:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LM11RXV/698709995/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LM11RXV/42806050?sv=2020-08-04&st=2026-03-28T14%3A02%3A51Z&se=2026-03-28T14%3A27%3A51Z&sr=b&sp=r&sig=caEaKFXTUt%2BfRTREEriaB%2FaR7T%2BUUg3%2FKsPPCwG8otw%3D)
2026-03-28 14:02:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LM11RXV/698709973/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LM11RXV/42806050?sv=2020-08-04&st=2026-03-28T14%3A02%3A51Z&se=2026-03-28T14%3A27%3A51Z&sr=b&sp=r&sig=caEaKFXTUt%2BfRTREEriaB%2FaR7T%2BUUg3%2FKsPPCwG8otw%3D)
2026-03-28 14:02:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698920194%27 HTTP/1.1" 200 None
2026-03-28 14:02:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698920194 not downloaded yet
2026-03-28 14:02:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698174256%27 HTTP/1.1" 200 None
2026-03-28 14:02:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698174256 not downloaded yet
2026-03-28 14:02:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698787427%27 HTTP/1.1" 200 None
2026-03-28 14:02:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698787427 not downloaded yet
2026-03-28 14:02:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698923331%27 HTTP/1.1" 200 None
2026-03-28 14:02:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698923331 not downloaded yet
2026-03-28 14:02:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698920213%27 HTTP/1.1" 200 None
2026-03-28 14:02:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698920213 not downloaded yet
2026-03-28 14:02:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698174269%27 HTTP/1.1" 200 None
2026-03-28 14:02:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698174269 not downloaded yet
2026-03-28 14:02:56 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LM11RXV/698710093/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698710093>
2026-03-28 14:02:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EA67PUX/698970538/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/EA67PUX/42810613?sv=2020-08-04&st=2026-03-28T14%3A02%3A51Z&se=2026-03-28T14%3A27%3A51Z&sr=b&sp=r&sig=FV2MJ3KNr66dhTGacY033E%2BqmCeGdrbYHllv8MYGBuI%3D)
2026-03-28 14:02:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698787442%27 HTTP/1.1" 200 None
2026-03-28 14:02:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698787442 not downloaded yet
2026-03-28 14:02:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698923352%27 HTTP/1.1" 200 None
2026-03-28 14:02:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698923352 not downloaded yet
2026-03-28 14:02:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LM11RXV/698710007/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LM11RXV/42806050?sv=2020-08-04&st=2026-03-28T14%3A02%3A51Z&se=2026-03-28T14%3A27%3A51Z&sr=b&sp=r&sig=caEaKFXTUt%2BfRTREEriaB%2FaR7T%2BUUg3%2FKsPPCwG8otw%3D)
2026-03-28 14:02:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LM11RXV/698710017/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LM11RXV/42806050?sv=2020-08-04&st=2026-03-28T14%3A02%3A51Z&se=2026-03-28T14%3A27%3A51Z&sr=b&sp=r&sig=caEaKFXTUt%2BfRTREEriaB%2FaR7T%2BUUg3%2FKsPPCwG8otw%3D)
2026-03-28 14:02:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EA67PUX/698953155/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/EA67PUX/42810613?sv=2020-08-04&st=2026-03-28T14%3A02%3A51Z&se=2026-03-28T14%3A27%3A51Z&sr=b&sp=r&sig=FV2MJ3KNr66dhTGacY033E%2BqmCeGdrbYHllv8MYGBuI%3D)
2026-03-28 14:02:56 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KN15HKZ/698174221/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=KN15HKZ-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-28 14:02:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698920233%27 HTTP/1.1" 200 None
2026-03-28 14:02:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698920233 not downloaded yet
2026-03-28 14:02:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698174280%27 HTTP/1.1" 200 None
2026-03-28 14:02:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698174280 not downloaded yet
2026-03-28 14:02:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DT16AWH/698767633/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/DT16AWH/42810199?sv=2020-08-04&st=2026-03-28T14%3A02%3A49Z&se=2026-03-28T14%3A27%3A49Z&sr=b&sp=r&sig=Qm3Z9KBDI%2FgTQga6pc%2FqHN6txQQLz%2B%2FrlyC%2F4kkmDaA%3D)
2026-03-28 14:02:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GU14USS/698923467/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/GU14USS/42809794?sv=2020-08-04&st=2026-03-28T14%3A02%3A49Z&se=2026-03-28T14%3A27%3A49Z&sr=b&sp=r&sig=UCoZSxmlKy5d0BUzmMeFfalunCe3LCcB9XS6zEEjeiM%3D)
2026-03-28 14:02:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698787455%27 HTTP/1.1" 200 None
2026-03-28 14:02:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698787455 not downloaded yet
2026-03-28 14:02:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698923379%27 HTTP/1.1" 200 None
2026-03-28 14:02:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698923379 not downloaded yet
2026-03-28 14:02:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:02:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2d6421d0>
2026-03-28 14:02:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:02:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:02:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:02:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8d240778-137c-5daf-bc26-32539d983300/8d240778-137c-5daf-bc26-32539d983300_image_3.jpg HTTP/1.1" 201 0
2026-03-28 14:02:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLM11RXV%252F698709995%252F600') HTTP/1.1" 204 0
2026-03-28 14:02:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LM11RXV/698709995/600 saved to cache
2026-03-28 14:02:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 8d240778-137c-5daf-bc26-32539d983300
2026-03-28 14:02:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:02:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a1fe65150>
2026-03-28 14:02:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:02:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:02:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:02:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8d240778-137c-5daf-bc26-32539d983300/8d240778-137c-5daf-bc26-32539d983300_image_1.jpg HTTP/1.1" 201 0
2026-03-28 14:02:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLM11RXV%252F698709973%252F600') HTTP/1.1" 204 0
2026-03-28 14:02:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LM11RXV/698709973/600 saved to cache
2026-03-28 14:02:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 8d240778-137c-5daf-bc26-32539d983300
2026-03-28 14:02:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698920255%27 HTTP/1.1" 200 None
2026-03-28 14:02:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698920255 not downloaded yet
2026-03-28 14:02:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698174294%27 HTTP/1.1" 200 None
2026-03-28 14:02:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698174294 not downloaded yet
2026-03-28 14:02:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EA67PUX/698970555/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/EA67PUX/42810613?sv=2020-08-04&st=2026-03-28T14%3A02%3A51Z&se=2026-03-28T14%3A27%3A51Z&sr=b&sp=r&sig=FV2MJ3KNr66dhTGacY033E%2BqmCeGdrbYHllv8MYGBuI%3D)
2026-03-28 14:02:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698787472%27 HTTP/1.1" 200 None
2026-03-28 14:02:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698787472 not downloaded yet
2026-03-28 14:02:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698923394%27 HTTP/1.1" 200 None
2026-03-28 14:02:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698923394 not downloaded yet
2026-03-28 14:02:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LM11RXV/698710036/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LM11RXV/42806050?sv=2020-08-04&st=2026-03-28T14%3A02%3A51Z&se=2026-03-28T14%3A27%3A51Z&sr=b&sp=r&sig=caEaKFXTUt%2BfRTREEriaB%2FaR7T%2BUUg3%2FKsPPCwG8otw%3D)
2026-03-28 14:02:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698920276%27 HTTP/1.1" 200 None
2026-03-28 14:02:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698920276 not downloaded yet
2026-03-28 14:02:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698174314%27 HTTP/1.1" 200 None
2026-03-28 14:02:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698174314 not downloaded yet
2026-03-28 14:02:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AK12LBY/698787350/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/AK12LBY/42807851?sv=2020-08-04&st=2026-03-28T14%3A02%3A53Z&se=2026-03-28T14%3A27%3A53Z&sr=b&sp=r&sig=rVL1iJzLJtr688%2BIoR0ly84el0HPI9ysth%2F2YIfbWys%3D)
2026-03-28 14:02:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EA67PUX/698970565/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/EA67PUX/42810613?sv=2020-08-04&st=2026-03-28T14%3A02%3A51Z&se=2026-03-28T14%3A27%3A51Z&sr=b&sp=r&sig=FV2MJ3KNr66dhTGacY033E%2BqmCeGdrbYHllv8MYGBuI%3D)
2026-03-28 14:02:56 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KN15HKZ/698174245/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698174245>
2026-03-28 14:02:56 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AV65GXF/698920162/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698920162>
2026-03-28 14:02:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698923413%27 HTTP/1.1" 200 None
2026-03-28 14:02:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698923413 not downloaded yet
2026-03-28 14:02:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EA67PUX/698953167/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/EA67PUX/42810613?sv=2020-08-04&st=2026-03-28T14%3A02%3A51Z&se=2026-03-28T14%3A27%3A51Z&sr=b&sp=r&sig=FV2MJ3KNr66dhTGacY033E%2BqmCeGdrbYHllv8MYGBuI%3D)
2026-03-28 14:02:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698920305%27 HTTP/1.1" 200 None
2026-03-28 14:02:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698920305 not downloaded yet
2026-03-28 14:02:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698174333%27 HTTP/1.1" 200 None
2026-03-28 14:02:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698174333 not downloaded yet
2026-03-28 14:02:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:02:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2d9b1490>
2026-03-28 14:02:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:02:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:02:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:02:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_efe9536c-07f4-51cc-8c8c-b67b73b93c1d/efe9536c-07f4-51cc-8c8c-b67b73b93c1d_image_3.jpg HTTP/1.1" 201 0
2026-03-28 14:02:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FEA67PUX%252F698970538%252F600') HTTP/1.1" 204 0
2026-03-28 14:02:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EA67PUX/698970538/600 saved to cache
2026-03-28 14:02:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item efe9536c-07f4-51cc-8c8c-b67b73b93c1d
2026-03-28 14:02:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:02:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c8cf3d0>
2026-03-28 14:02:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:02:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:02:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:02:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8d240778-137c-5daf-bc26-32539d983300/8d240778-137c-5daf-bc26-32539d983300_image_4.jpg HTTP/1.1" 201 0
2026-03-28 14:02:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLM11RXV%252F698710007%252F600') HTTP/1.1" 204 0
2026-03-28 14:02:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LM11RXV/698710007/600 saved to cache
2026-03-28 14:02:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 8d240778-137c-5daf-bc26-32539d983300
2026-03-28 14:02:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:02:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a1fd171d0>
2026-03-28 14:02:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:02:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:02:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:02:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8d240778-137c-5daf-bc26-32539d983300/8d240778-137c-5daf-bc26-32539d983300_image_5.jpg HTTP/1.1" 201 0
2026-03-28 14:02:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLM11RXV%252F698710017%252F600') HTTP/1.1" 204 0
2026-03-28 14:02:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LM11RXV/698710017/600 saved to cache
2026-03-28 14:02:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 8d240778-137c-5daf-bc26-32539d983300
2026-03-28 14:02:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:02:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2ca82650>
2026-03-28 14:02:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:02:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:02:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:02:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_efe9536c-07f4-51cc-8c8c-b67b73b93c1d/efe9536c-07f4-51cc-8c8c-b67b73b93c1d_image_4.jpg HTTP/1.1" 201 0
2026-03-28 14:02:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FEA67PUX%252F698953155%252F600') HTTP/1.1" 204 0
2026-03-28 14:02:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EA67PUX/698953155/600 saved to cache
2026-03-28 14:02:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item efe9536c-07f4-51cc-8c8c-b67b73b93c1d
2026-03-28 14:02:56 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:02:56 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:02:56 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:02:56 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:02:56 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:02:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:02:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c104790>
2026-03-28 14:02:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:02:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:02:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:02:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_92f1052e-2c5b-500c-801d-40376c1b4f7c/92f1052e-2c5b-500c-801d-40376c1b4f7c_image_8.jpg HTTP/1.1" 201 0
2026-03-28 14:02:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FDT16AWH%252F698767633%252F600') HTTP/1.1" 204 0
2026-03-28 14:02:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DT16AWH/698767633/600 saved to cache
2026-03-28 14:02:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 92f1052e-2c5b-500c-801d-40376c1b4f7c
2026-03-28 14:02:56 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:02:56 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:02:56 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:02:56 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:02:56 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:02:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:02:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2d692b50>
2026-03-28 14:02:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:02:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:02:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:02:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_356c7b48-0ca4-5934-ba83-5b447228ae4f/356c7b48-0ca4-5934-ba83-5b447228ae4f_image_8.jpg HTTP/1.1" 201 0
2026-03-28 14:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FGU14USS%252F698923467%252F600') HTTP/1.1" 204 0
2026-03-28 14:02:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GU14USS/698923467/600 saved to cache
2026-03-28 14:02:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 356c7b48-0ca4-5934-ba83-5b447228ae4f
2026-03-28 14:02:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LM11RXV/698710056/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LM11RXV/42806050?sv=2020-08-04&st=2026-03-28T14%3A02%3A51Z&se=2026-03-28T14%3A27%3A51Z&sr=b&sp=r&sig=caEaKFXTUt%2BfRTREEriaB%2FaR7T%2BUUg3%2FKsPPCwG8otw%3D)
2026-03-28 14:02:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LM11RXV/698710093/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LM11RXV/42806050?sv=2020-08-04&st=2026-03-28T14%3A02%3A51Z&se=2026-03-28T14%3A27%3A51Z&sr=b&sp=r&sig=caEaKFXTUt%2BfRTREEriaB%2FaR7T%2BUUg3%2FKsPPCwG8otw%3D)
2026-03-28 14:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698923438%27 HTTP/1.1" 200 None
2026-03-28 14:02:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698923438 not downloaded yet
2026-03-28 14:02:57 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PO15XUV/698923331/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698923331>
2026-03-28 14:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698920332%27 HTTP/1.1" 200 None
2026-03-28 14:02:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698920332 not downloaded yet
2026-03-28 14:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698174356%27 HTTP/1.1" 200 None
2026-03-28 14:02:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698174356 not downloaded yet
2026-03-28 14:02:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:02:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a1fd144d0>
2026-03-28 14:02:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:02:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:02:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:02:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_efe9536c-07f4-51cc-8c8c-b67b73b93c1d/efe9536c-07f4-51cc-8c8c-b67b73b93c1d_image_5.jpg HTTP/1.1" 201 0
2026-03-28 14:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FEA67PUX%252F698970555%252F600') HTTP/1.1" 204 0
2026-03-28 14:02:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EA67PUX/698970555/600 saved to cache
2026-03-28 14:02:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item efe9536c-07f4-51cc-8c8c-b67b73b93c1d
2026-03-28 14:02:57 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:02:57 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:02:57 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:02:57 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:02:57 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:02:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:02:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c82fed0>
2026-03-28 14:02:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:02:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:02:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:02:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8d240778-137c-5daf-bc26-32539d983300/8d240778-137c-5daf-bc26-32539d983300_image_6.jpg HTTP/1.1" 201 0
2026-03-28 14:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLM11RXV%252F698710036%252F600') HTTP/1.1" 204 0
2026-03-28 14:02:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LM11RXV/698710036/600 saved to cache
2026-03-28 14:02:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 8d240778-137c-5daf-bc26-32539d983300
2026-03-28 14:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698923457%27 HTTP/1.1" 200 None
2026-03-28 14:02:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698923457 not downloaded yet
2026-03-28 14:02:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KN15HKZ/698174221/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/KN15HKZ/42810176?sv=2020-08-04&st=2026-03-28T14%3A02%3A54Z&se=2026-03-28T14%3A27%3A54Z&sr=b&sp=r&sig=6ZOzhCNRXpxseDgu0vJzh7zeL7nkRl6lcUDHM3dN8f4%3D)
2026-03-28 14:02:57 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KN15HKZ/698174269/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698174269>
2026-03-28 14:02:57 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AK12LBY/698787442/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698787442>
2026-03-28 14:02:57 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AV65GXF/698920213/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698920213>
2026-03-28 14:02:57 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PO15XUV/698923352/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698923352>
2026-03-28 14:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698923491%27 HTTP/1.1" 200 None
2026-03-28 14:02:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698923491 not downloaded yet
2026-03-28 14:02:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:02:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c3d3910>
2026-03-28 14:02:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:02:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:02:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:02:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ea08653a-82f6-5e2e-9b8f-caf8f656653f/ea08653a-82f6-5e2e-9b8f-caf8f656653f_image_0.jpg HTTP/1.1" 201 0
2026-03-28 14:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FAK12LBY%252F698787350%252F600') HTTP/1.1" 204 0
2026-03-28 14:02:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AK12LBY/698787350/600 saved to cache
2026-03-28 14:02:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item ea08653a-82f6-5e2e-9b8f-caf8f656653f
2026-03-28 14:02:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:02:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2de4f7d0>
2026-03-28 14:02:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:02:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:02:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:02:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_efe9536c-07f4-51cc-8c8c-b67b73b93c1d/efe9536c-07f4-51cc-8c8c-b67b73b93c1d_image_7.jpg HTTP/1.1" 201 0
2026-03-28 14:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FEA67PUX%252F698970565%252F600') HTTP/1.1" 204 0
2026-03-28 14:02:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EA67PUX/698970565/600 saved to cache
2026-03-28 14:02:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item efe9536c-07f4-51cc-8c8c-b67b73b93c1d
2026-03-28 14:02:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:02:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a3011cbd0>
2026-03-28 14:02:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:02:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:02:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:02:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_efe9536c-07f4-51cc-8c8c-b67b73b93c1d/efe9536c-07f4-51cc-8c8c-b67b73b93c1d_image_6.jpg HTTP/1.1" 201 0
2026-03-28 14:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FEA67PUX%252F698953167%252F600') HTTP/1.1" 204 0
2026-03-28 14:02:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EA67PUX/698953167/600 saved to cache
2026-03-28 14:02:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item efe9536c-07f4-51cc-8c8c-b67b73b93c1d
2026-03-28 14:02:57 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:02:57 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:02:57 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:02:57 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:02:57 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:02:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:02:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a3011ba50>
2026-03-28 14:02:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:02:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:02:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:02:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8d240778-137c-5daf-bc26-32539d983300/8d240778-137c-5daf-bc26-32539d983300_image_7.jpg HTTP/1.1" 201 0
2026-03-28 14:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLM11RXV%252F698710056%252F600') HTTP/1.1" 204 0
2026-03-28 14:02:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LM11RXV/698710056/600 saved to cache
2026-03-28 14:02:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 8d240778-137c-5daf-bc26-32539d983300
2026-03-28 14:02:57 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:02:57 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:02:57 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:02:57 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:02:57 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:02:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:02:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2d780a90>
2026-03-28 14:02:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:02:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:02:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:02:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8d240778-137c-5daf-bc26-32539d983300/8d240778-137c-5daf-bc26-32539d983300_image_9.jpg HTTP/1.1" 201 0
2026-03-28 14:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLM11RXV%252F698710093%252F600') HTTP/1.1" 204 0
2026-03-28 14:02:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LM11RXV/698710093/600 saved to cache
2026-03-28 14:02:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 8d240778-137c-5daf-bc26-32539d983300
2026-03-28 14:02:57 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PO15XUV/698923379/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698923379>
2026-03-28 14:02:57 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KN15HKZ/698174294/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698174294>
2026-03-28 14:02:57 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AK12LBY/698787427/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698787427>
2026-03-28 14:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698923510%27 HTTP/1.1" 200 None
2026-03-28 14:02:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698923510 not downloaded yet
2026-03-28 14:02:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:02:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2de20a10>
2026-03-28 14:02:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:02:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:02:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:02:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9708014f-5ed6-5f8a-955b-235d568bd501/9708014f-5ed6-5f8a-955b-235d568bd501_image_0.jpg HTTP/1.1" 201 0
2026-03-28 14:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FKN15HKZ%252F698174221%252F600') HTTP/1.1" 204 0
2026-03-28 14:02:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KN15HKZ/698174221/600 saved to cache
2026-03-28 14:02:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 9708014f-5ed6-5f8a-955b-235d568bd501
2026-03-28 14:02:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KN15HKZ/698174245/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/KN15HKZ/42810176?sv=2020-08-04&st=2026-03-28T14%3A02%3A54Z&se=2026-03-28T14%3A27%3A54Z&sr=b&sp=r&sig=6ZOzhCNRXpxseDgu0vJzh7zeL7nkRl6lcUDHM3dN8f4%3D)
2026-03-28 14:02:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AV65GXF/698920162/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/AV65GXF/42809712?sv=2020-08-04&st=2026-03-28T14%3A02%3A53Z&se=2026-03-28T14%3A27%3A53Z&sr=b&sp=r&sig=sDl3PHJQQenzzf0IaxC9YbOCWzunrZz%2F4azGtC537eM%3D)
2026-03-28 14:02:57 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AV65GXF/698920276/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698920276>
2026-03-28 14:02:57 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KN15HKZ/698174314/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698174314>
2026-03-28 14:02:57 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PO15XUV/698923394/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698923394>
2026-03-28 14:02:57 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KN15HKZ/698174333/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698174333>
2026-03-28 14:02:57 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AV65GXF/698920305/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698920305>
2026-03-28 14:02:57 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PO15XUV/698923457/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698923457>
2026-03-28 14:02:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PO15XUV/698923352/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/PO15XUV/42809772?sv=2020-08-04&st=2026-03-28T14%3A02%3A54Z&se=2026-03-28T14%3A27%3A54Z&sr=b&sp=r&sig=1ksGRuGZMylD5KeVhMjhRx%2BfGxoL8DlmhQEw9kjsatI%3D)
2026-03-28 14:02:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PO15XUV/698923331/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/PO15XUV/42809772?sv=2020-08-04&st=2026-03-28T14%3A02%3A54Z&se=2026-03-28T14%3A27%3A54Z&sr=b&sp=r&sig=1ksGRuGZMylD5KeVhMjhRx%2BfGxoL8DlmhQEw9kjsatI%3D)
2026-03-28 14:02:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AK12LBY/698787442/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/AK12LBY/42807851?sv=2020-08-04&st=2026-03-28T14%3A02%3A53Z&se=2026-03-28T14%3A27%3A53Z&sr=b&sp=r&sig=rVL1iJzLJtr688%2BIoR0ly84el0HPI9ysth%2F2YIfbWys%3D)
2026-03-28 14:02:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:02:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a1fea9a50>
2026-03-28 14:02:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:02:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:02:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:02:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9708014f-5ed6-5f8a-955b-235d568bd501/9708014f-5ed6-5f8a-955b-235d568bd501_image_2.jpg HTTP/1.1" 201 0
2026-03-28 14:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FKN15HKZ%252F698174245%252F600') HTTP/1.1" 204 0
2026-03-28 14:02:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KN15HKZ/698174245/600 saved to cache
2026-03-28 14:02:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 9708014f-5ed6-5f8a-955b-235d568bd501
2026-03-28 14:02:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AV65GXF/698920213/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/AV65GXF/42809712?sv=2020-08-04&st=2026-03-28T14%3A02%3A53Z&se=2026-03-28T14%3A27%3A53Z&sr=b&sp=r&sig=sDl3PHJQQenzzf0IaxC9YbOCWzunrZz%2F4azGtC537eM%3D)
2026-03-28 14:02:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AK12LBY/698787427/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/AK12LBY/42807851?sv=2020-08-04&st=2026-03-28T14%3A02%3A53Z&se=2026-03-28T14%3A27%3A53Z&sr=b&sp=r&sig=rVL1iJzLJtr688%2BIoR0ly84el0HPI9ysth%2F2YIfbWys%3D)
2026-03-28 14:02:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KN15HKZ/698174269/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/KN15HKZ/42810176?sv=2020-08-04&st=2026-03-28T14%3A02%3A54Z&se=2026-03-28T14%3A27%3A54Z&sr=b&sp=r&sig=6ZOzhCNRXpxseDgu0vJzh7zeL7nkRl6lcUDHM3dN8f4%3D)
2026-03-28 14:02:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PO15XUV/698923394/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/PO15XUV/42809772?sv=2020-08-04&st=2026-03-28T14%3A02%3A54Z&se=2026-03-28T14%3A27%3A54Z&sr=b&sp=r&sig=1ksGRuGZMylD5KeVhMjhRx%2BfGxoL8DlmhQEw9kjsatI%3D)
2026-03-28 14:02:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:02:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2d676a10>
2026-03-28 14:02:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:02:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:02:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:02:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3178ef9b-a5d4-5f26-baa7-4b0b7cfd9561/3178ef9b-a5d4-5f26-baa7-4b0b7cfd9561_image_2.jpg HTTP/1.1" 201 0
2026-03-28 14:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FAV65GXF%252F698920162%252F600') HTTP/1.1" 204 0
2026-03-28 14:02:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AV65GXF/698920162/600 saved to cache
2026-03-28 14:02:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 3178ef9b-a5d4-5f26-baa7-4b0b7cfd9561
2026-03-28 14:02:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PO15XUV/698923379/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/PO15XUV/42809772?sv=2020-08-04&st=2026-03-28T14%3A02%3A54Z&se=2026-03-28T14%3A27%3A54Z&sr=b&sp=r&sig=1ksGRuGZMylD5KeVhMjhRx%2BfGxoL8DlmhQEw9kjsatI%3D)
2026-03-28 14:02:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KN15HKZ/698174314/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/KN15HKZ/42810176?sv=2020-08-04&st=2026-03-28T14%3A02%3A54Z&se=2026-03-28T14%3A27%3A54Z&sr=b&sp=r&sig=6ZOzhCNRXpxseDgu0vJzh7zeL7nkRl6lcUDHM3dN8f4%3D)
2026-03-28 14:02:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KN15HKZ/698174294/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/KN15HKZ/42810176?sv=2020-08-04&st=2026-03-28T14%3A02%3A54Z&se=2026-03-28T14%3A27%3A54Z&sr=b&sp=r&sig=6ZOzhCNRXpxseDgu0vJzh7zeL7nkRl6lcUDHM3dN8f4%3D)
2026-03-28 14:02:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AV65GXF/698920276/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/AV65GXF/42809712?sv=2020-08-04&st=2026-03-28T14%3A02%3A53Z&se=2026-03-28T14%3A27%3A53Z&sr=b&sp=r&sig=sDl3PHJQQenzzf0IaxC9YbOCWzunrZz%2F4azGtC537eM%3D)
2026-03-28 14:02:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:02:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c9d6c10>
2026-03-28 14:02:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:02:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:02:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:02:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_325fe017-882a-52af-b1a0-8b2b107ef73e/325fe017-882a-52af-b1a0-8b2b107ef73e_image_2.jpg HTTP/1.1" 201 0
2026-03-28 14:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FPO15XUV%252F698923352%252F600') HTTP/1.1" 204 0
2026-03-28 14:02:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PO15XUV/698923352/600 saved to cache
2026-03-28 14:02:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 325fe017-882a-52af-b1a0-8b2b107ef73e
2026-03-28 14:02:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:02:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a1fd34bd0>
2026-03-28 14:02:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:02:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:02:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:02:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_325fe017-882a-52af-b1a0-8b2b107ef73e/325fe017-882a-52af-b1a0-8b2b107ef73e_image_1.jpg HTTP/1.1" 201 0
2026-03-28 14:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FPO15XUV%252F698923331%252F600') HTTP/1.1" 204 0
2026-03-28 14:02:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PO15XUV/698923331/600 saved to cache
2026-03-28 14:02:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 325fe017-882a-52af-b1a0-8b2b107ef73e
2026-03-28 14:02:57 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PO15XUV/698923510/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698923510>
2026-03-28 14:02:57 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KN15HKZ/698174356/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698174356>
2026-03-28 14:02:57 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PO15XUV/698923438/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698923438>
2026-03-28 14:02:57 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PO15XUV/698923491/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698923491>
2026-03-28 14:02:57 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AV65GXF/698920332/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698920332>
2026-03-28 14:02:57 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:02:57 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:02:57 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:02:57 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:02:57 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:02:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:02:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c8903d0>
2026-03-28 14:02:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:02:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:02:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:02:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ea08653a-82f6-5e2e-9b8f-caf8f656653f/ea08653a-82f6-5e2e-9b8f-caf8f656653f_image_7.jpg HTTP/1.1" 201 0
2026-03-28 14:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FAK12LBY%252F698787442%252F600') HTTP/1.1" 204 0
2026-03-28 14:02:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AK12LBY/698787442/600 saved to cache
2026-03-28 14:02:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item ea08653a-82f6-5e2e-9b8f-caf8f656653f
2026-03-28 14:02:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AV65GXF/698920305/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/AV65GXF/42809712?sv=2020-08-04&st=2026-03-28T14%3A02%3A53Z&se=2026-03-28T14%3A27%3A53Z&sr=b&sp=r&sig=sDl3PHJQQenzzf0IaxC9YbOCWzunrZz%2F4azGtC537eM%3D)
2026-03-28 14:02:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KN15HKZ/698174333/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/KN15HKZ/42810176?sv=2020-08-04&st=2026-03-28T14%3A02%3A54Z&se=2026-03-28T14%3A27%3A54Z&sr=b&sp=r&sig=6ZOzhCNRXpxseDgu0vJzh7zeL7nkRl6lcUDHM3dN8f4%3D)
2026-03-28 14:02:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:02:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c659c90>
2026-03-28 14:02:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:02:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:02:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:02:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3178ef9b-a5d4-5f26-baa7-4b0b7cfd9561/3178ef9b-a5d4-5f26-baa7-4b0b7cfd9561_image_4.jpg HTTP/1.1" 201 0
2026-03-28 14:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FAV65GXF%252F698920213%252F600') HTTP/1.1" 204 0
2026-03-28 14:02:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AV65GXF/698920213/600 saved to cache
2026-03-28 14:02:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 3178ef9b-a5d4-5f26-baa7-4b0b7cfd9561
2026-03-28 14:02:58 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:02:58 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:02:58 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:02:58 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:02:58 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:02:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:02:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c403f90>
2026-03-28 14:02:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:02:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:02:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:02:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ea08653a-82f6-5e2e-9b8f-caf8f656653f/ea08653a-82f6-5e2e-9b8f-caf8f656653f_image_6.jpg HTTP/1.1" 201 0
2026-03-28 14:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FAK12LBY%252F698787427%252F600') HTTP/1.1" 204 0
2026-03-28 14:02:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AK12LBY/698787427/600 saved to cache
2026-03-28 14:02:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item ea08653a-82f6-5e2e-9b8f-caf8f656653f
2026-03-28 14:02:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:02:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2d6424d0>
2026-03-28 14:02:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:02:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:02:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:02:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9708014f-5ed6-5f8a-955b-235d568bd501/9708014f-5ed6-5f8a-955b-235d568bd501_image_4.jpg HTTP/1.1" 201 0
2026-03-28 14:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FKN15HKZ%252F698174269%252F600') HTTP/1.1" 204 0
2026-03-28 14:02:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KN15HKZ/698174269/600 saved to cache
2026-03-28 14:02:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 9708014f-5ed6-5f8a-955b-235d568bd501
2026-03-28 14:02:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:02:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c52aa50>
2026-03-28 14:02:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:02:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:02:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:02:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_325fe017-882a-52af-b1a0-8b2b107ef73e/325fe017-882a-52af-b1a0-8b2b107ef73e_image_4.jpg HTTP/1.1" 201 0
2026-03-28 14:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FPO15XUV%252F698923394%252F600') HTTP/1.1" 204 0
2026-03-28 14:02:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PO15XUV/698923394/600 saved to cache
2026-03-28 14:02:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 325fe017-882a-52af-b1a0-8b2b107ef73e
2026-03-28 14:02:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:02:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2d643510>
2026-03-28 14:02:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:02:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:02:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:02:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_325fe017-882a-52af-b1a0-8b2b107ef73e/325fe017-882a-52af-b1a0-8b2b107ef73e_image_3.jpg HTTP/1.1" 201 0
2026-03-28 14:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FPO15XUV%252F698923379%252F600') HTTP/1.1" 204 0
2026-03-28 14:02:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PO15XUV/698923379/600 saved to cache
2026-03-28 14:02:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 325fe017-882a-52af-b1a0-8b2b107ef73e
2026-03-28 14:02:58 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:02:58 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:02:58 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:02:58 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:02:58 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:02:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:02:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2d987810>
2026-03-28 14:02:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:02:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:02:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:02:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9708014f-5ed6-5f8a-955b-235d568bd501/9708014f-5ed6-5f8a-955b-235d568bd501_image_7.jpg HTTP/1.1" 201 0
2026-03-28 14:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FKN15HKZ%252F698174314%252F600') HTTP/1.1" 204 0
2026-03-28 14:02:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KN15HKZ/698174314/600 saved to cache
2026-03-28 14:02:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 9708014f-5ed6-5f8a-955b-235d568bd501
2026-03-28 14:02:58 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:02:58 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:02:58 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:02:58 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:02:58 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:02:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:02:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2d641d50>
2026-03-28 14:02:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:02:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:02:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:02:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9708014f-5ed6-5f8a-955b-235d568bd501/9708014f-5ed6-5f8a-955b-235d568bd501_image_6.jpg HTTP/1.1" 201 0
2026-03-28 14:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FKN15HKZ%252F698174294%252F600') HTTP/1.1" 204 0
2026-03-28 14:02:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KN15HKZ/698174294/600 saved to cache
2026-03-28 14:02:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 9708014f-5ed6-5f8a-955b-235d568bd501
2026-03-28 14:02:58 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:02:58 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:02:58 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:02:58 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:02:58 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:02:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:02:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2d959ed0>
2026-03-28 14:02:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:02:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:02:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:02:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3178ef9b-a5d4-5f26-baa7-4b0b7cfd9561/3178ef9b-a5d4-5f26-baa7-4b0b7cfd9561_image_7.jpg HTTP/1.1" 201 0
2026-03-28 14:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FAV65GXF%252F698920276%252F600') HTTP/1.1" 204 0
2026-03-28 14:02:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AV65GXF/698920276/600 saved to cache
2026-03-28 14:02:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 3178ef9b-a5d4-5f26-baa7-4b0b7cfd9561
2026-03-28 14:02:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PO15XUV/698923457/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/PO15XUV/42809772?sv=2020-08-04&st=2026-03-28T14%3A02%3A54Z&se=2026-03-28T14%3A27%3A54Z&sr=b&sp=r&sig=1ksGRuGZMylD5KeVhMjhRx%2BfGxoL8DlmhQEw9kjsatI%3D)
2026-03-28 14:02:58 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KN15HKZ/698174280/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698174280>
2026-03-28 14:02:58 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PO15XUV/698923413/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698923413>
2026-03-28 14:02:58 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AV65GXF/698920255/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698920255>
2026-03-28 14:02:58 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AK12LBY/698787455/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698787455>
2026-03-28 14:02:58 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AK12LBY/698787472/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698787472>
2026-03-28 14:02:58 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KN15HKZ/698174256/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698174256>
2026-03-28 14:02:58 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AV65GXF/698920233/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698920233>
2026-03-28 14:02:58 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:02:58 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:02:58 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:02:58 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:02:58 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:02:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:02:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a1ff52210>
2026-03-28 14:02:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:02:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:02:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:02:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3178ef9b-a5d4-5f26-baa7-4b0b7cfd9561/3178ef9b-a5d4-5f26-baa7-4b0b7cfd9561_image_8.jpg HTTP/1.1" 201 0
2026-03-28 14:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FAV65GXF%252F698920305%252F600') HTTP/1.1" 204 0
2026-03-28 14:02:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AV65GXF/698920305/600 saved to cache
2026-03-28 14:02:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 3178ef9b-a5d4-5f26-baa7-4b0b7cfd9561
2026-03-28 14:02:58 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:02:58 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:02:58 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:02:58 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:02:58 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:02:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:02:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a1fdb3590>
2026-03-28 14:02:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:02:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:02:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:02:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9708014f-5ed6-5f8a-955b-235d568bd501/9708014f-5ed6-5f8a-955b-235d568bd501_image_8.jpg HTTP/1.1" 201 0
2026-03-28 14:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FKN15HKZ%252F698174333%252F600') HTTP/1.1" 204 0
2026-03-28 14:02:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KN15HKZ/698174333/600 saved to cache
2026-03-28 14:02:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 9708014f-5ed6-5f8a-955b-235d568bd501
2026-03-28 14:02:58 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:02:58 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:02:58 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:02:58 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:02:58 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:02:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:02:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a1fed0a50>
2026-03-28 14:02:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:02:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:02:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:02:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_325fe017-882a-52af-b1a0-8b2b107ef73e/325fe017-882a-52af-b1a0-8b2b107ef73e_image_7.jpg HTTP/1.1" 201 0
2026-03-28 14:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FPO15XUV%252F698923457%252F600') HTTP/1.1" 204 0
2026-03-28 14:02:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PO15XUV/698923457/600 saved to cache
2026-03-28 14:02:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 325fe017-882a-52af-b1a0-8b2b107ef73e
2026-03-28 14:02:58 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AK12LBY/698787413/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698787413>
2026-03-28 14:02:58 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AV65GXF/698920194/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698920194>
2026-03-28 14:02:58 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PO15XUV/698923295/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=PO15XUV-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-28 14:02:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PO15XUV/698923491/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/PO15XUV/42809772?sv=2020-08-04&st=2026-03-28T14%3A02%3A54Z&se=2026-03-28T14%3A27%3A54Z&sr=b&sp=r&sig=1ksGRuGZMylD5KeVhMjhRx%2BfGxoL8DlmhQEw9kjsatI%3D)
2026-03-28 14:02:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AV65GXF/698920332/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/AV65GXF/42809712?sv=2020-08-04&st=2026-03-28T14%3A02%3A53Z&se=2026-03-28T14%3A27%3A53Z&sr=b&sp=r&sig=sDl3PHJQQenzzf0IaxC9YbOCWzunrZz%2F4azGtC537eM%3D)
2026-03-28 14:02:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PO15XUV/698923438/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/PO15XUV/42809772?sv=2020-08-04&st=2026-03-28T14%3A02%3A54Z&se=2026-03-28T14%3A27%3A54Z&sr=b&sp=r&sig=1ksGRuGZMylD5KeVhMjhRx%2BfGxoL8DlmhQEw9kjsatI%3D)
2026-03-28 14:02:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PO15XUV/698923510/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/PO15XUV/42809772?sv=2020-08-04&st=2026-03-28T14%3A02%3A54Z&se=2026-03-28T14%3A27%3A54Z&sr=b&sp=r&sig=1ksGRuGZMylD5KeVhMjhRx%2BfGxoL8DlmhQEw9kjsatI%3D)
2026-03-28 14:02:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KN15HKZ/698174356/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/KN15HKZ/42810176?sv=2020-08-04&st=2026-03-28T14%3A02%3A54Z&se=2026-03-28T14%3A27%3A54Z&sr=b&sp=r&sig=6ZOzhCNRXpxseDgu0vJzh7zeL7nkRl6lcUDHM3dN8f4%3D)
2026-03-28 14:02:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AK12LBY/698787455/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/AK12LBY/42807851?sv=2020-08-04&st=2026-03-28T14%3A02%3A53Z&se=2026-03-28T14%3A27%3A53Z&sr=b&sp=r&sig=rVL1iJzLJtr688%2BIoR0ly84el0HPI9ysth%2F2YIfbWys%3D)
2026-03-28 14:02:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KN15HKZ/698174256/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/KN15HKZ/42810176?sv=2020-08-04&st=2026-03-28T14%3A02%3A54Z&se=2026-03-28T14%3A27%3A54Z&sr=b&sp=r&sig=6ZOzhCNRXpxseDgu0vJzh7zeL7nkRl6lcUDHM3dN8f4%3D)
2026-03-28 14:02:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AV65GXF/698920233/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/AV65GXF/42809712?sv=2020-08-04&st=2026-03-28T14%3A02%3A53Z&se=2026-03-28T14%3A27%3A53Z&sr=b&sp=r&sig=sDl3PHJQQenzzf0IaxC9YbOCWzunrZz%2F4azGtC537eM%3D)
2026-03-28 14:02:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AV65GXF/698920255/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/AV65GXF/42809712?sv=2020-08-04&st=2026-03-28T14%3A02%3A53Z&se=2026-03-28T14%3A27%3A53Z&sr=b&sp=r&sig=sDl3PHJQQenzzf0IaxC9YbOCWzunrZz%2F4azGtC537eM%3D)
2026-03-28 14:02:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PO15XUV/698923413/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/PO15XUV/42809772?sv=2020-08-04&st=2026-03-28T14%3A02%3A54Z&se=2026-03-28T14%3A27%3A54Z&sr=b&sp=r&sig=1ksGRuGZMylD5KeVhMjhRx%2BfGxoL8DlmhQEw9kjsatI%3D)
2026-03-28 14:02:58 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AK12LBY/698787404/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698787404>
2026-03-28 14:02:58 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:02:58 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:02:58 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:02:58 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:02:58 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:02:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:02:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c5294d0>
2026-03-28 14:02:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:02:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:02:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:02:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_325fe017-882a-52af-b1a0-8b2b107ef73e/325fe017-882a-52af-b1a0-8b2b107ef73e_image_8.jpg HTTP/1.1" 201 0
2026-03-28 14:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FPO15XUV%252F698923491%252F600') HTTP/1.1" 204 0
2026-03-28 14:02:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PO15XUV/698923491/600 saved to cache
2026-03-28 14:02:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 325fe017-882a-52af-b1a0-8b2b107ef73e
2026-03-28 14:02:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AK12LBY/698787472/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/AK12LBY/42807851?sv=2020-08-04&st=2026-03-28T14%3A02%3A53Z&se=2026-03-28T14%3A27%3A53Z&sr=b&sp=r&sig=rVL1iJzLJtr688%2BIoR0ly84el0HPI9ysth%2F2YIfbWys%3D)
2026-03-28 14:02:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KN15HKZ/698174280/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/KN15HKZ/42810176?sv=2020-08-04&st=2026-03-28T14%3A02%3A54Z&se=2026-03-28T14%3A27%3A54Z&sr=b&sp=r&sig=6ZOzhCNRXpxseDgu0vJzh7zeL7nkRl6lcUDHM3dN8f4%3D)
2026-03-28 14:02:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PO15XUV/698923295/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/PO15XUV/42809772?sv=2020-08-04&st=2026-03-28T14%3A02%3A54Z&se=2026-03-28T14%3A27%3A54Z&sr=b&sp=r&sig=1ksGRuGZMylD5KeVhMjhRx%2BfGxoL8DlmhQEw9kjsatI%3D)
2026-03-28 14:02:58 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:02:58 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:02:58 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:02:58 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:02:58 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:02:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:02:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c8cc2d0>
2026-03-28 14:02:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:02:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:02:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:02:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3178ef9b-a5d4-5f26-baa7-4b0b7cfd9561/3178ef9b-a5d4-5f26-baa7-4b0b7cfd9561_image_9.jpg HTTP/1.1" 201 0
2026-03-28 14:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FAV65GXF%252F698920332%252F600') HTTP/1.1" 204 0
2026-03-28 14:02:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AV65GXF/698920332/600 saved to cache
2026-03-28 14:02:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 3178ef9b-a5d4-5f26-baa7-4b0b7cfd9561
2026-03-28 14:02:58 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KN15HKZ/698174235/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698174235>
2026-03-28 14:02:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AK12LBY/698787413/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/AK12LBY/42807851?sv=2020-08-04&st=2026-03-28T14%3A02%3A53Z&se=2026-03-28T14%3A27%3A53Z&sr=b&sp=r&sig=rVL1iJzLJtr688%2BIoR0ly84el0HPI9ysth%2F2YIfbWys%3D)
2026-03-28 14:02:58 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AV65GXF/698920136/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698920136>
2026-03-28 14:02:58 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AK12LBY/698787394/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698787394>
2026-03-28 14:02:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AV65GXF/698920194/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/AV65GXF/42809712?sv=2020-08-04&st=2026-03-28T14%3A02%3A53Z&se=2026-03-28T14%3A27%3A53Z&sr=b&sp=r&sig=sDl3PHJQQenzzf0IaxC9YbOCWzunrZz%2F4azGtC537eM%3D)
2026-03-28 14:02:58 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:02:58 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:02:58 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:02:58 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:02:58 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:02:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:02:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c4d39d0>
2026-03-28 14:02:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:02:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:02:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:02:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_325fe017-882a-52af-b1a0-8b2b107ef73e/325fe017-882a-52af-b1a0-8b2b107ef73e_image_6.jpg HTTP/1.1" 201 0
2026-03-28 14:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FPO15XUV%252F698923438%252F600') HTTP/1.1" 204 0
2026-03-28 14:02:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PO15XUV/698923438/600 saved to cache
2026-03-28 14:02:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 325fe017-882a-52af-b1a0-8b2b107ef73e
2026-03-28 14:02:58 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:02:58 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:02:58 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:02:58 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:02:58 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:02:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:02:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2d9fff10>
2026-03-28 14:02:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:02:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:02:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:02:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_325fe017-882a-52af-b1a0-8b2b107ef73e/325fe017-882a-52af-b1a0-8b2b107ef73e_image_9.jpg HTTP/1.1" 201 0
2026-03-28 14:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FPO15XUV%252F698923510%252F600') HTTP/1.1" 204 0
2026-03-28 14:02:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PO15XUV/698923510/600 saved to cache
2026-03-28 14:02:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 325fe017-882a-52af-b1a0-8b2b107ef73e
2026-03-28 14:02:58 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:02:58 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:02:58 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:02:58 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:02:58 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:02:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:02:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c59bd90>
2026-03-28 14:02:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:02:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:02:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:02:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9708014f-5ed6-5f8a-955b-235d568bd501/9708014f-5ed6-5f8a-955b-235d568bd501_image_9.jpg HTTP/1.1" 201 0
2026-03-28 14:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FKN15HKZ%252F698174356%252F600') HTTP/1.1" 204 0
2026-03-28 14:02:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KN15HKZ/698174356/600 saved to cache
2026-03-28 14:02:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 9708014f-5ed6-5f8a-955b-235d568bd501
2026-03-28 14:02:58 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AK12LBY/698787376/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698787376>
2026-03-28 14:02:58 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AV65GXF/698920094/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=AV65GXF-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-28 14:02:58 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EA67PUX/698970574/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698970574>
2026-03-28 14:02:58 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:02:58 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:02:58 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:02:58 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:02:58 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:02:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:02:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c107c10>
2026-03-28 14:02:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:02:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:02:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:02:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ea08653a-82f6-5e2e-9b8f-caf8f656653f/ea08653a-82f6-5e2e-9b8f-caf8f656653f_image_8.jpg HTTP/1.1" 201 0
2026-03-28 14:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FAK12LBY%252F698787455%252F600') HTTP/1.1" 204 0
2026-03-28 14:02:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AK12LBY/698787455/600 saved to cache
2026-03-28 14:02:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item ea08653a-82f6-5e2e-9b8f-caf8f656653f
2026-03-28 14:02:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:02:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a1ff2dfd0>
2026-03-28 14:02:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:02:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:02:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:02:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9708014f-5ed6-5f8a-955b-235d568bd501/9708014f-5ed6-5f8a-955b-235d568bd501_image_3.jpg HTTP/1.1" 201 0
2026-03-28 14:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FKN15HKZ%252F698174256%252F600') HTTP/1.1" 204 0
2026-03-28 14:02:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KN15HKZ/698174256/600 saved to cache
2026-03-28 14:02:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 9708014f-5ed6-5f8a-955b-235d568bd501
2026-03-28 14:02:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:02:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c57cb50>
2026-03-28 14:02:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:02:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:02:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:02:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3178ef9b-a5d4-5f26-baa7-4b0b7cfd9561/3178ef9b-a5d4-5f26-baa7-4b0b7cfd9561_image_5.jpg HTTP/1.1" 201 0
2026-03-28 14:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FAV65GXF%252F698920233%252F600') HTTP/1.1" 204 0
2026-03-28 14:02:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AV65GXF/698920233/600 saved to cache
2026-03-28 14:02:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 3178ef9b-a5d4-5f26-baa7-4b0b7cfd9561
2026-03-28 14:02:59 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:02:59 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:02:59 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:02:59 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:02:59 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:02:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:02:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2d9bc090>
2026-03-28 14:02:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:02:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:02:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:02:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3178ef9b-a5d4-5f26-baa7-4b0b7cfd9561/3178ef9b-a5d4-5f26-baa7-4b0b7cfd9561_image_6.jpg HTTP/1.1" 201 0
2026-03-28 14:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FAV65GXF%252F698920255%252F600') HTTP/1.1" 204 0
2026-03-28 14:02:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AV65GXF/698920255/600 saved to cache
2026-03-28 14:02:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 3178ef9b-a5d4-5f26-baa7-4b0b7cfd9561
2026-03-28 14:02:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:02:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a1fef27d0>
2026-03-28 14:02:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:02:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:02:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:02:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_325fe017-882a-52af-b1a0-8b2b107ef73e/325fe017-882a-52af-b1a0-8b2b107ef73e_image_5.jpg HTTP/1.1" 201 0
2026-03-28 14:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FPO15XUV%252F698923413%252F600') HTTP/1.1" 204 0
2026-03-28 14:02:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PO15XUV/698923413/600 saved to cache
2026-03-28 14:02:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 325fe017-882a-52af-b1a0-8b2b107ef73e
2026-03-28 14:02:59 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:02:59 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:02:59 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:02:59 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:02:59 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:02:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:02:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a1feab050>
2026-03-28 14:02:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:02:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:02:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:02:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ea08653a-82f6-5e2e-9b8f-caf8f656653f/ea08653a-82f6-5e2e-9b8f-caf8f656653f_image_9.jpg HTTP/1.1" 201 0
2026-03-28 14:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FAK12LBY%252F698787472%252F600') HTTP/1.1" 204 0
2026-03-28 14:02:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AK12LBY/698787472/600 saved to cache
2026-03-28 14:02:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item ea08653a-82f6-5e2e-9b8f-caf8f656653f
2026-03-28 14:02:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:02:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2fe31bd0>
2026-03-28 14:02:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:02:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:02:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:02:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9708014f-5ed6-5f8a-955b-235d568bd501/9708014f-5ed6-5f8a-955b-235d568bd501_image_5.jpg HTTP/1.1" 201 0
2026-03-28 14:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FKN15HKZ%252F698174280%252F600') HTTP/1.1" 204 0
2026-03-28 14:02:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KN15HKZ/698174280/600 saved to cache
2026-03-28 14:02:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 9708014f-5ed6-5f8a-955b-235d568bd501
2026-03-28 14:02:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:02:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c3a07d0>
2026-03-28 14:02:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:02:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:02:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:02:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_325fe017-882a-52af-b1a0-8b2b107ef73e/325fe017-882a-52af-b1a0-8b2b107ef73e_image_0.jpg HTTP/1.1" 201 0
2026-03-28 14:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FPO15XUV%252F698923295%252F600') HTTP/1.1" 204 0
2026-03-28 14:02:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PO15XUV/698923295/600 saved to cache
2026-03-28 14:02:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 325fe017-882a-52af-b1a0-8b2b107ef73e
2026-03-28 14:02:59 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 325fe017-882a-52af-b1a0-8b2b107ef73e, skipping ID generation
2026-03-28 14:02:59 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 325fe017-882a-52af-b1a0-8b2b107ef73e sending to next pipeline
2026-03-28 14:03:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 325fe017-882a-52af-b1a0-8b2b107ef73e, identifier: PO15%20XUV
2026-03-28 14:03:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:03:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c680b90>
2026-03-28 14:03:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:03:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:03:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:03:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ea08653a-82f6-5e2e-9b8f-caf8f656653f/ea08653a-82f6-5e2e-9b8f-caf8f656653f_image_5.jpg HTTP/1.1" 201 0
2026-03-28 14:03:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FAK12LBY%252F698787413%252F600') HTTP/1.1" 204 0
2026-03-28 14:03:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AK12LBY/698787413/600 saved to cache
2026-03-28 14:03:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item ea08653a-82f6-5e2e-9b8f-caf8f656653f
2026-03-28 14:03:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:03:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c429c90>
2026-03-28 14:03:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:03:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:03:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:03:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3178ef9b-a5d4-5f26-baa7-4b0b7cfd9561/3178ef9b-a5d4-5f26-baa7-4b0b7cfd9561_image_3.jpg HTTP/1.1" 201 0
2026-03-28 14:03:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FAV65GXF%252F698920194%252F600') HTTP/1.1" 204 0
2026-03-28 14:03:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AV65GXF/698920194/600 saved to cache
2026-03-28 14:03:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 3178ef9b-a5d4-5f26-baa7-4b0b7cfd9561
2026-03-28 14:03:00 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LM11RXV/698710072/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698710072>
2026-03-28 14:03:00 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EA67PUX/698953184/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698953184>
2026-03-28 14:03:00 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GU14USS/698923497/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698923497>
2026-03-28 14:03:00 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AK12LBY/698787364/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698787364>
2026-03-28 14:03:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AK12LBY/698787404/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/AK12LBY/42807851?sv=2020-08-04&st=2026-03-28T14%3A02%3A53Z&se=2026-03-28T14%3A27%3A53Z&sr=b&sp=r&sig=rVL1iJzLJtr688%2BIoR0ly84el0HPI9ysth%2F2YIfbWys%3D)
2026-03-28 14:03:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 325fe017-882a-52af-b1a0-8b2b107ef73e with identifier: PO15%20XUV
2026-03-28 14:03:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 325fe017-882a-52af-b1a0-8b2b107ef73e with identifier: PO15%20XUV
2026-03-28 14:03:00 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 325fe017-882a-52af-b1a0-8b2b107ef73e with identifier: PO15%20XUV to the API
2026-03-28 14:03:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:03:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:03:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PO15XUV/698923295/600>
{'auction_title': '',
'c_o_2_emission_value': 158,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_325fe017-882a-52af-b1a0-8b2b107ef73e/325fe017-882a-52af-b1a0-8b2b107ef73e_expert_report_file_ec481218-4c34-446b-8ae5-481e1c20d540.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=PO15%20XUV-GB',
'category': 'Car',
'color': 'blue',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.4L',
'expiration_date': '2026-03-29T10:00:00Z',
'fuel_type': 'Petrol',
'id': '325fe017-882a-52af-b1a0-8b2b107ef73e',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'PO15 XUV',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=PO15%20XUV&vehicleType=*',
'listing': 'auction',
'location': 'Paddock Wood',
'make': 'VAUXHALL',
'model': 'ZAFIRA TOURER',
'odometer': 78111,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 11,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_325fe017-882a-52af-b1a0-8b2b107ef73e/325fe017-882a-52af-b1a0-8b2b107ef73e_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 52972,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PO15XUV/698923295/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_325fe017-882a-52af-b1a0-8b2b107ef73e/325fe017-882a-52af-b1a0-8b2b107ef73e_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 50809,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PO15XUV/698923331/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_325fe017-882a-52af-b1a0-8b2b107ef73e/325fe017-882a-52af-b1a0-8b2b107ef73e_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 49899,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PO15XUV/698923352/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_325fe017-882a-52af-b1a0-8b2b107ef73e/325fe017-882a-52af-b1a0-8b2b107ef73e_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 48153,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PO15XUV/698923379/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_325fe017-882a-52af-b1a0-8b2b107ef73e/325fe017-882a-52af-b1a0-8b2b107ef73e_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 46030,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PO15XUV/698923394/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_325fe017-882a-52af-b1a0-8b2b107ef73e/325fe017-882a-52af-b1a0-8b2b107ef73e_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 44037,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PO15XUV/698923413/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_325fe017-882a-52af-b1a0-8b2b107ef73e/325fe017-882a-52af-b1a0-8b2b107ef73e_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 99875,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PO15XUV/698923438/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_325fe017-882a-52af-b1a0-8b2b107ef73e/325fe017-882a-52af-b1a0-8b2b107ef73e_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 83232,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PO15XUV/698923457/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_325fe017-882a-52af-b1a0-8b2b107ef73e/325fe017-882a-52af-b1a0-8b2b107ef73e_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 84614,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PO15XUV/698923491/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_325fe017-882a-52af-b1a0-8b2b107ef73e/325fe017-882a-52af-b1a0-8b2b107ef73e_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 82259,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PO15XUV/698923510/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-01-01',
'seller_name': None,
'title': 'VAUXHALL ZAFIRA TOURER 1.4 T 140 EXCLUSIV MPV',
'transmission': 'manual',
'trim': 'T 140 EXCLUSIV',
'vin': 'W0LPD9EC4F1031943',
'year': 2015}
2026-03-28 14:03:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27PO15%2520XUV%27 HTTP/1.1" 200 None
2026-03-28 14:03:00 [bca.uk] INFO: Saving data for PO15%20XUV: {'created_time': 1774706580.612616, 'last_price_update_time': 1774706580.612628, 'auction_closing_time': 1774778400.0}
2026-03-28 14:03:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='PO15%2520XUV') HTTP/1.1" 204 0
2026-03-28 14:03:00 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GU14USS/698923444/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698923444>
2026-03-28 14:03:00 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DT16AWH/698767650/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698767650>
2026-03-28 14:03:00 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DT16AWH/698767618/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698767618>
2026-03-28 14:03:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:03:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a3185aed0>
2026-03-28 14:03:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:03:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:03:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:03:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ea08653a-82f6-5e2e-9b8f-caf8f656653f/ea08653a-82f6-5e2e-9b8f-caf8f656653f_image_4.jpg HTTP/1.1" 201 0
2026-03-28 14:03:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FAK12LBY%252F698787404%252F600') HTTP/1.1" 204 0
2026-03-28 14:03:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AK12LBY/698787404/600 saved to cache
2026-03-28 14:03:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item ea08653a-82f6-5e2e-9b8f-caf8f656653f
2026-03-28 14:03:00 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EA67PUX/698953140/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698953140>
2026-03-28 14:03:00 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LM11RXV/698709981/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698709981>
2026-03-28 14:03:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AK12LBY/698787376/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/AK12LBY/42807851?sv=2020-08-04&st=2026-03-28T14%3A02%3A53Z&se=2026-03-28T14%3A27%3A53Z&sr=b&sp=r&sig=rVL1iJzLJtr688%2BIoR0ly84el0HPI9ysth%2F2YIfbWys%3D)
2026-03-28 14:03:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AV65GXF/698920094/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/AV65GXF/42809712?sv=2020-08-04&st=2026-03-28T14%3A02%3A53Z&se=2026-03-28T14%3A27%3A53Z&sr=b&sp=r&sig=sDl3PHJQQenzzf0IaxC9YbOCWzunrZz%2F4azGtC537eM%3D)
2026-03-28 14:03:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KN15HKZ/698174235/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/KN15HKZ/42810176?sv=2020-08-04&st=2026-03-28T14%3A02%3A54Z&se=2026-03-28T14%3A27%3A54Z&sr=b&sp=r&sig=6ZOzhCNRXpxseDgu0vJzh7zeL7nkRl6lcUDHM3dN8f4%3D)
2026-03-28 14:03:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AK12LBY/698787394/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/AK12LBY/42807851?sv=2020-08-04&st=2026-03-28T14%3A02%3A53Z&se=2026-03-28T14%3A27%3A53Z&sr=b&sp=r&sig=rVL1iJzLJtr688%2BIoR0ly84el0HPI9ysth%2F2YIfbWys%3D)
2026-03-28 14:03:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EA67PUX/698970574/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/EA67PUX/42810613?sv=2020-08-04&st=2026-03-28T14%3A02%3A51Z&se=2026-03-28T14%3A27%3A51Z&sr=b&sp=r&sig=FV2MJ3KNr66dhTGacY033E%2BqmCeGdrbYHllv8MYGBuI%3D)
2026-03-28 14:03:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EA67PUX/698953184/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/EA67PUX/42810613?sv=2020-08-04&st=2026-03-28T14%3A02%3A51Z&se=2026-03-28T14%3A27%3A51Z&sr=b&sp=r&sig=FV2MJ3KNr66dhTGacY033E%2BqmCeGdrbYHllv8MYGBuI%3D)
2026-03-28 14:03:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AK12LBY/698787364/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/AK12LBY/42807851?sv=2020-08-04&st=2026-03-28T14%3A02%3A53Z&se=2026-03-28T14%3A27%3A53Z&sr=b&sp=r&sig=rVL1iJzLJtr688%2BIoR0ly84el0HPI9ysth%2F2YIfbWys%3D)
2026-03-28 14:03:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LM11RXV/698710072/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LM11RXV/42806050?sv=2020-08-04&st=2026-03-28T14%3A02%3A51Z&se=2026-03-28T14%3A27%3A51Z&sr=b&sp=r&sig=caEaKFXTUt%2BfRTREEriaB%2FaR7T%2BUUg3%2FKsPPCwG8otw%3D)
2026-03-28 14:03:00 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GU14USS/698923412/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698923412>
2026-03-28 14:03:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GU14USS/698923497/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/GU14USS/42809794?sv=2020-08-04&st=2026-03-28T14%3A02%3A49Z&se=2026-03-28T14%3A27%3A49Z&sr=b&sp=r&sig=UCoZSxmlKy5d0BUzmMeFfalunCe3LCcB9XS6zEEjeiM%3D)
2026-03-28 14:03:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AV65GXF/698920136/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/AV65GXF/42809712?sv=2020-08-04&st=2026-03-28T14%3A02%3A53Z&se=2026-03-28T14%3A27%3A53Z&sr=b&sp=r&sig=sDl3PHJQQenzzf0IaxC9YbOCWzunrZz%2F4azGtC537eM%3D)
2026-03-28 14:03:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:03:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c45c350>
2026-03-28 14:03:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:03:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:03:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:03:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ea08653a-82f6-5e2e-9b8f-caf8f656653f/ea08653a-82f6-5e2e-9b8f-caf8f656653f_image_2.jpg HTTP/1.1" 201 0
2026-03-28 14:03:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FAK12LBY%252F698787376%252F600') HTTP/1.1" 204 0
2026-03-28 14:03:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AK12LBY/698787376/600 saved to cache
2026-03-28 14:03:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item ea08653a-82f6-5e2e-9b8f-caf8f656653f
2026-03-28 14:03:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DT16AWH/698767650/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/DT16AWH/42810199?sv=2020-08-04&st=2026-03-28T14%3A02%3A49Z&se=2026-03-28T14%3A27%3A49Z&sr=b&sp=r&sig=Qm3Z9KBDI%2FgTQga6pc%2FqHN6txQQLz%2B%2FrlyC%2F4kkmDaA%3D)
2026-03-28 14:03:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LM11RXV/698709981/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LM11RXV/42806050?sv=2020-08-04&st=2026-03-28T14%3A02%3A51Z&se=2026-03-28T14%3A27%3A51Z&sr=b&sp=r&sig=caEaKFXTUt%2BfRTREEriaB%2FaR7T%2BUUg3%2FKsPPCwG8otw%3D)
2026-03-28 14:03:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EA67PUX/698953140/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/EA67PUX/42810613?sv=2020-08-04&st=2026-03-28T14%3A02%3A51Z&se=2026-03-28T14%3A27%3A51Z&sr=b&sp=r&sig=FV2MJ3KNr66dhTGacY033E%2BqmCeGdrbYHllv8MYGBuI%3D)
2026-03-28 14:03:00 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DT16AWH/698767600/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698767600>
2026-03-28 14:03:00 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EA67PUX/698970520/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698970520>
2026-03-28 14:03:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:03:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2fde6350>
2026-03-28 14:03:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:03:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:03:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:03:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3178ef9b-a5d4-5f26-baa7-4b0b7cfd9561/3178ef9b-a5d4-5f26-baa7-4b0b7cfd9561_image_0.jpg HTTP/1.1" 201 0
2026-03-28 14:03:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FAV65GXF%252F698920094%252F600') HTTP/1.1" 204 0
2026-03-28 14:03:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AV65GXF/698920094/600 saved to cache
2026-03-28 14:03:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 3178ef9b-a5d4-5f26-baa7-4b0b7cfd9561
2026-03-28 14:03:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:03:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a1fdb6250>
2026-03-28 14:03:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:03:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:03:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:03:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9708014f-5ed6-5f8a-955b-235d568bd501/9708014f-5ed6-5f8a-955b-235d568bd501_image_1.jpg HTTP/1.1" 201 0
2026-03-28 14:03:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FKN15HKZ%252F698174235%252F600') HTTP/1.1" 204 0
2026-03-28 14:03:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KN15HKZ/698174235/600 saved to cache
2026-03-28 14:03:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 9708014f-5ed6-5f8a-955b-235d568bd501
2026-03-28 14:03:00 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 9708014f-5ed6-5f8a-955b-235d568bd501, skipping ID generation
2026-03-28 14:03:00 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 9708014f-5ed6-5f8a-955b-235d568bd501 sending to next pipeline
2026-03-28 14:03:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 9708014f-5ed6-5f8a-955b-235d568bd501, identifier: KN15%20HKZ
2026-03-28 14:03:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:03:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c402d10>
2026-03-28 14:03:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:03:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:03:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:03:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ea08653a-82f6-5e2e-9b8f-caf8f656653f/ea08653a-82f6-5e2e-9b8f-caf8f656653f_image_3.jpg HTTP/1.1" 201 0
2026-03-28 14:03:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FAK12LBY%252F698787394%252F600') HTTP/1.1" 204 0
2026-03-28 14:03:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AK12LBY/698787394/600 saved to cache
2026-03-28 14:03:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item ea08653a-82f6-5e2e-9b8f-caf8f656653f
2026-03-28 14:03:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:03:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2ecc3b50>
2026-03-28 14:03:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:03:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:03:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:03:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_efe9536c-07f4-51cc-8c8c-b67b73b93c1d/efe9536c-07f4-51cc-8c8c-b67b73b93c1d_image_9.jpg HTTP/1.1" 201 0
2026-03-28 14:03:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FEA67PUX%252F698970574%252F600') HTTP/1.1" 204 0
2026-03-28 14:03:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EA67PUX/698970574/600 saved to cache
2026-03-28 14:03:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item efe9536c-07f4-51cc-8c8c-b67b73b93c1d
2026-03-28 14:03:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:03:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a1fd11dd0>
2026-03-28 14:03:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:03:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:03:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:03:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_efe9536c-07f4-51cc-8c8c-b67b73b93c1d/efe9536c-07f4-51cc-8c8c-b67b73b93c1d_image_8.jpg HTTP/1.1" 201 0
2026-03-28 14:03:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FEA67PUX%252F698953184%252F600') HTTP/1.1" 204 0
2026-03-28 14:03:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EA67PUX/698953184/600 saved to cache
2026-03-28 14:03:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item efe9536c-07f4-51cc-8c8c-b67b73b93c1d
2026-03-28 14:03:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 9708014f-5ed6-5f8a-955b-235d568bd501 with identifier: KN15%20HKZ
2026-03-28 14:03:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 9708014f-5ed6-5f8a-955b-235d568bd501 with identifier: KN15%20HKZ
2026-03-28 14:03:01 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 9708014f-5ed6-5f8a-955b-235d568bd501 with identifier: KN15%20HKZ to the API
2026-03-28 14:03:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:03:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:03:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KN15HKZ/698174235/600>
{'auction_title': '',
'c_o_2_emission_value': 105,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9708014f-5ed6-5f8a-955b-235d568bd501/9708014f-5ed6-5f8a-955b-235d568bd501_expert_report_file_095666f7-82fd-4fa1-86ee-8f085b25f2a4.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=KN15%20HKZ-GB',
'category': 'Car',
'color': 'blue',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.6L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Diesel',
'id': '9708014f-5ed6-5f8a-955b-235d568bd501',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'KN15 HKZ',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=KN15%20HKZ&vehicleType=*',
'listing': 'auction',
'location': 'Leeds',
'make': 'CITROEN',
'model': 'C4 PICASSO',
'odometer': 73918,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 11,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9708014f-5ed6-5f8a-955b-235d568bd501/9708014f-5ed6-5f8a-955b-235d568bd501_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 42175,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KN15HKZ/698174221/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9708014f-5ed6-5f8a-955b-235d568bd501/9708014f-5ed6-5f8a-955b-235d568bd501_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 43222,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KN15HKZ/698174235/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9708014f-5ed6-5f8a-955b-235d568bd501/9708014f-5ed6-5f8a-955b-235d568bd501_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 40578,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KN15HKZ/698174245/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9708014f-5ed6-5f8a-955b-235d568bd501/9708014f-5ed6-5f8a-955b-235d568bd501_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 40321,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KN15HKZ/698174256/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9708014f-5ed6-5f8a-955b-235d568bd501/9708014f-5ed6-5f8a-955b-235d568bd501_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 43003,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KN15HKZ/698174269/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9708014f-5ed6-5f8a-955b-235d568bd501/9708014f-5ed6-5f8a-955b-235d568bd501_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 40300,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KN15HKZ/698174280/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9708014f-5ed6-5f8a-955b-235d568bd501/9708014f-5ed6-5f8a-955b-235d568bd501_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 82396,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KN15HKZ/698174294/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9708014f-5ed6-5f8a-955b-235d568bd501/9708014f-5ed6-5f8a-955b-235d568bd501_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 73651,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KN15HKZ/698174314/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9708014f-5ed6-5f8a-955b-235d568bd501/9708014f-5ed6-5f8a-955b-235d568bd501_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 84046,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KN15HKZ/698174333/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9708014f-5ed6-5f8a-955b-235d568bd501/9708014f-5ed6-5f8a-955b-235d568bd501_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 85183,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KN15HKZ/698174356/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-01-01',
'seller_name': None,
'title': 'CITROEN C4 PICASSO 1.6 E-HDI 115 EXCLUSIVE ETG6 MPV',
'transmission': 'automatic',
'trim': 'E-HDI 115 EXCLUSIVE ETG6',
'vin': 'VF73D9HC8FJ586467',
'year': 2015}
2026-03-28 14:03:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KN15%2520HKZ%27 HTTP/1.1" 200 None
2026-03-28 14:03:01 [bca.uk] INFO: Saving data for KN15%20HKZ: {'created_time': 1774706581.593804, 'last_price_update_time': 1774706581.593814, 'auction_closing_time': 1774864800.0}
2026-03-28 14:03:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='KN15%2520HKZ') HTTP/1.1" 204 0
2026-03-28 14:03:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DT16AWH/698767618/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/DT16AWH/42810199?sv=2020-08-04&st=2026-03-28T14%3A02%3A49Z&se=2026-03-28T14%3A27%3A49Z&sr=b&sp=r&sig=Qm3Z9KBDI%2FgTQga6pc%2FqHN6txQQLz%2B%2FrlyC%2F4kkmDaA%3D)
2026-03-28 14:03:01 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GU14USS/698923381/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698923381>
2026-03-28 14:03:01 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DT16AWH/698767586/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698767586>
2026-03-28 14:03:01 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LM11RXV/698709956/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=LM11RXV-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-28 14:03:01 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GU14USS/698923361/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698923361>
2026-03-28 14:03:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GU14USS/698923444/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/GU14USS/42809794?sv=2020-08-04&st=2026-03-28T14%3A02%3A49Z&se=2026-03-28T14%3A27%3A49Z&sr=b&sp=r&sig=UCoZSxmlKy5d0BUzmMeFfalunCe3LCcB9XS6zEEjeiM%3D)
2026-03-28 14:03:01 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EA67PUX/698970518/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=EA67PUX-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-28 14:03:01 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DT16AWH/698767575/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698767575>
2026-03-28 14:03:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:03:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c504ed0>
2026-03-28 14:03:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:03:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:03:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:03:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ea08653a-82f6-5e2e-9b8f-caf8f656653f/ea08653a-82f6-5e2e-9b8f-caf8f656653f_image_1.jpg HTTP/1.1" 201 0
2026-03-28 14:03:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FAK12LBY%252F698787364%252F600') HTTP/1.1" 204 0
2026-03-28 14:03:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AK12LBY/698787364/600 saved to cache
2026-03-28 14:03:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item ea08653a-82f6-5e2e-9b8f-caf8f656653f
2026-03-28 14:03:01 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: ea08653a-82f6-5e2e-9b8f-caf8f656653f, skipping ID generation
2026-03-28 14:03:01 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item ea08653a-82f6-5e2e-9b8f-caf8f656653f sending to next pipeline
2026-03-28 14:03:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: ea08653a-82f6-5e2e-9b8f-caf8f656653f, identifier: AK12%20LBY
2026-03-28 14:03:01 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:03:01 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:03:01 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:03:01 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:03:01 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:03:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:03:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c5f97d0>
2026-03-28 14:03:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:03:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:03:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:03:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8d240778-137c-5daf-bc26-32539d983300/8d240778-137c-5daf-bc26-32539d983300_image_8.jpg HTTP/1.1" 201 0
2026-03-28 14:03:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLM11RXV%252F698710072%252F600') HTTP/1.1" 204 0
2026-03-28 14:03:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LM11RXV/698710072/600 saved to cache
2026-03-28 14:03:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 8d240778-137c-5daf-bc26-32539d983300
2026-03-28 14:03:01 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:03:01 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:03:01 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:03:01 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:03:01 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:03:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:03:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c5f8710>
2026-03-28 14:03:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:03:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:03:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:03:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_356c7b48-0ca4-5934-ba83-5b447228ae4f/356c7b48-0ca4-5934-ba83-5b447228ae4f_image_9.jpg HTTP/1.1" 201 0
2026-03-28 14:03:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FGU14USS%252F698923497%252F600') HTTP/1.1" 204 0
2026-03-28 14:03:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GU14USS/698923497/600 saved to cache
2026-03-28 14:03:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 356c7b48-0ca4-5934-ba83-5b447228ae4f
2026-03-28 14:03:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:03:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2d99ed90>
2026-03-28 14:03:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:03:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:03:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:03:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3178ef9b-a5d4-5f26-baa7-4b0b7cfd9561/3178ef9b-a5d4-5f26-baa7-4b0b7cfd9561_image_1.jpg HTTP/1.1" 201 0
2026-03-28 14:03:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FAV65GXF%252F698920136%252F600') HTTP/1.1" 204 0
2026-03-28 14:03:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AV65GXF/698920136/600 saved to cache
2026-03-28 14:03:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 3178ef9b-a5d4-5f26-baa7-4b0b7cfd9561
2026-03-28 14:03:01 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 3178ef9b-a5d4-5f26-baa7-4b0b7cfd9561, skipping ID generation
2026-03-28 14:03:01 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 3178ef9b-a5d4-5f26-baa7-4b0b7cfd9561 sending to next pipeline
2026-03-28 14:03:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 3178ef9b-a5d4-5f26-baa7-4b0b7cfd9561, identifier: AV65%20GXF
2026-03-28 14:03:01 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:03:01 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:03:01 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:03:01 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:03:01 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:03:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:03:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a1fdb7750>
2026-03-28 14:03:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:03:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:03:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:03:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_92f1052e-2c5b-500c-801d-40376c1b4f7c/92f1052e-2c5b-500c-801d-40376c1b4f7c_image_9.jpg HTTP/1.1" 201 0
2026-03-28 14:03:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FDT16AWH%252F698767650%252F600') HTTP/1.1" 204 0
2026-03-28 14:03:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DT16AWH/698767650/600 saved to cache
2026-03-28 14:03:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 92f1052e-2c5b-500c-801d-40376c1b4f7c
2026-03-28 14:03:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:03:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a1ffb05d0>
2026-03-28 14:03:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:03:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:03:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:03:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8d240778-137c-5daf-bc26-32539d983300/8d240778-137c-5daf-bc26-32539d983300_image_2.jpg HTTP/1.1" 201 0
2026-03-28 14:03:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLM11RXV%252F698709981%252F600') HTTP/1.1" 204 0
2026-03-28 14:03:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LM11RXV/698709981/600 saved to cache
2026-03-28 14:03:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 8d240778-137c-5daf-bc26-32539d983300
2026-03-28 14:03:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:03:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c5fb5d0>
2026-03-28 14:03:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:03:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:03:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:03:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_efe9536c-07f4-51cc-8c8c-b67b73b93c1d/efe9536c-07f4-51cc-8c8c-b67b73b93c1d_image_2.jpg HTTP/1.1" 201 0
2026-03-28 14:03:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FEA67PUX%252F698953140%252F600') HTTP/1.1" 204 0
2026-03-28 14:03:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EA67PUX/698953140/600 saved to cache
2026-03-28 14:03:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item efe9536c-07f4-51cc-8c8c-b67b73b93c1d
2026-03-28 14:03:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: ea08653a-82f6-5e2e-9b8f-caf8f656653f with identifier: AK12%20LBY
2026-03-28 14:03:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: ea08653a-82f6-5e2e-9b8f-caf8f656653f with identifier: AK12%20LBY
2026-03-28 14:03:02 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: ea08653a-82f6-5e2e-9b8f-caf8f656653f with identifier: AK12%20LBY to the API
2026-03-28 14:03:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:03:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:03:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AK12LBY/698787364/600>
{'auction_title': '',
'c_o_2_emission_value': 179,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ea08653a-82f6-5e2e-9b8f-caf8f656653f/ea08653a-82f6-5e2e-9b8f-caf8f656653f_expert_report_file_0a61dc25-b2b7-4ba6-a03b-7cf405f04c82.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=AK12%20LBY-GB',
'category': 'Car',
'color': 'white',
'currency': 'GBP',
'doors_number': 5,
'engine': '2.4L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Diesel',
'id': 'ea08653a-82f6-5e2e-9b8f-caf8f656653f',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'AK12 LBY',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=AK12%20LBY&vehicleType=*',
'listing': 'auction',
'location': 'Leeds',
'make': 'VOLVO',
'model': 'XC60',
'odometer': 119070,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 11,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ea08653a-82f6-5e2e-9b8f-caf8f656653f/ea08653a-82f6-5e2e-9b8f-caf8f656653f_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 42001,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AK12LBY/698787350/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ea08653a-82f6-5e2e-9b8f-caf8f656653f/ea08653a-82f6-5e2e-9b8f-caf8f656653f_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 41752,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AK12LBY/698787364/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ea08653a-82f6-5e2e-9b8f-caf8f656653f/ea08653a-82f6-5e2e-9b8f-caf8f656653f_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 41657,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AK12LBY/698787376/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ea08653a-82f6-5e2e-9b8f-caf8f656653f/ea08653a-82f6-5e2e-9b8f-caf8f656653f_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 40979,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AK12LBY/698787394/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ea08653a-82f6-5e2e-9b8f-caf8f656653f/ea08653a-82f6-5e2e-9b8f-caf8f656653f_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 41018,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AK12LBY/698787404/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ea08653a-82f6-5e2e-9b8f-caf8f656653f/ea08653a-82f6-5e2e-9b8f-caf8f656653f_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 39203,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AK12LBY/698787413/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ea08653a-82f6-5e2e-9b8f-caf8f656653f/ea08653a-82f6-5e2e-9b8f-caf8f656653f_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 73790,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AK12LBY/698787427/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ea08653a-82f6-5e2e-9b8f-caf8f656653f/ea08653a-82f6-5e2e-9b8f-caf8f656653f_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 73813,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AK12LBY/698787442/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ea08653a-82f6-5e2e-9b8f-caf8f656653f/ea08653a-82f6-5e2e-9b8f-caf8f656653f_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 79104,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AK12LBY/698787455/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ea08653a-82f6-5e2e-9b8f-caf8f656653f/ea08653a-82f6-5e2e-9b8f-caf8f656653f_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 86318,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AK12LBY/698787472/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2012-01-01',
'seller_name': None,
'title': 'VOLVO XC60 2.4 D5 215 R DESIGN G/T Estate',
'transmission': 'manual',
'trim': 'D5 215 R DESIGN G/T',
'vin': 'YV1DZ8256C2327788',
'year': 2012}
2026-03-28 14:03:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27AK12%2520LBY%27 HTTP/1.1" 200 None
2026-03-28 14:03:02 [bca.uk] INFO: Saving data for AK12%20LBY: {'created_time': 1774706582.495767, 'last_price_update_time': 1774706582.495779, 'auction_closing_time': 1774864800.0}
2026-03-28 14:03:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='AK12%2520LBY') HTTP/1.1" 204 0
2026-03-28 14:03:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 3178ef9b-a5d4-5f26-baa7-4b0b7cfd9561 with identifier: AV65%20GXF
2026-03-28 14:03:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 3178ef9b-a5d4-5f26-baa7-4b0b7cfd9561 with identifier: AV65%20GXF
2026-03-28 14:03:02 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 3178ef9b-a5d4-5f26-baa7-4b0b7cfd9561 with identifier: AV65%20GXF to the API
2026-03-28 14:03:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:03:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:03:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AV65GXF/698920136/600>
{'auction_title': '',
'c_o_2_emission_value': 102,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3178ef9b-a5d4-5f26-baa7-4b0b7cfd9561/3178ef9b-a5d4-5f26-baa7-4b0b7cfd9561_expert_report_file_ad5bf725-e885-4715-91e4-a5c5d41d9c3b.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=AV65%20GXF-GB',
'category': 'Car',
'color': 'black',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.0L',
'expiration_date': '2026-03-29T10:00:00Z',
'fuel_type': 'Petrol',
'id': '3178ef9b-a5d4-5f26-baa7-4b0b7cfd9561',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'AV65 GXF',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=AV65%20GXF&vehicleType=*',
'listing': 'auction',
'location': 'Paddock Wood',
'make': 'PEUGEOT',
'model': '208',
'odometer': 72079,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 11,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3178ef9b-a5d4-5f26-baa7-4b0b7cfd9561/3178ef9b-a5d4-5f26-baa7-4b0b7cfd9561_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 51327,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AV65GXF/698920094/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3178ef9b-a5d4-5f26-baa7-4b0b7cfd9561/3178ef9b-a5d4-5f26-baa7-4b0b7cfd9561_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 50798,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AV65GXF/698920136/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3178ef9b-a5d4-5f26-baa7-4b0b7cfd9561/3178ef9b-a5d4-5f26-baa7-4b0b7cfd9561_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 49631,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AV65GXF/698920162/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3178ef9b-a5d4-5f26-baa7-4b0b7cfd9561/3178ef9b-a5d4-5f26-baa7-4b0b7cfd9561_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 46180,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AV65GXF/698920194/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3178ef9b-a5d4-5f26-baa7-4b0b7cfd9561/3178ef9b-a5d4-5f26-baa7-4b0b7cfd9561_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 45461,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AV65GXF/698920213/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3178ef9b-a5d4-5f26-baa7-4b0b7cfd9561/3178ef9b-a5d4-5f26-baa7-4b0b7cfd9561_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 42865,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AV65GXF/698920233/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3178ef9b-a5d4-5f26-baa7-4b0b7cfd9561/3178ef9b-a5d4-5f26-baa7-4b0b7cfd9561_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 101497,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AV65GXF/698920255/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3178ef9b-a5d4-5f26-baa7-4b0b7cfd9561/3178ef9b-a5d4-5f26-baa7-4b0b7cfd9561_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 69895,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AV65GXF/698920276/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3178ef9b-a5d4-5f26-baa7-4b0b7cfd9561/3178ef9b-a5d4-5f26-baa7-4b0b7cfd9561_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 87241,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AV65GXF/698920305/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3178ef9b-a5d4-5f26-baa7-4b0b7cfd9561/3178ef9b-a5d4-5f26-baa7-4b0b7cfd9561_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 74881,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AV65GXF/698920332/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-01-01',
'seller_name': None,
'title': 'PEUGEOT 208 1.0 P/T 68 ACTIVE Hatchback',
'transmission': 'manual',
'trim': 'P/T 68 ACTIVE',
'vin': 'VF3CCZMZ6FT166574',
'year': 2015}
2026-03-28 14:03:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27AV65%2520GXF%27 HTTP/1.1" 200 None
2026-03-28 14:03:02 [bca.uk] INFO: Saving data for AV65%20GXF: {'created_time': 1774706582.897417, 'last_price_update_time': 1774706582.897427, 'auction_closing_time': 1774778400.0}
2026-03-28 14:03:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='AV65%2520GXF') HTTP/1.1" 204 0
2026-03-28 14:03:02 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DT16AWH/698767548/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698767548>
2026-03-28 14:03:02 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DT16AWH/698767563/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698767563>
2026-03-28 14:03:02 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DT16AWH/698767527/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698767527>
2026-03-28 14:03:02 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GU14USS/698923324/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698923324>
2026-03-28 14:03:02 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GU14USS/698923304/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698923304>
2026-03-28 14:03:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EA67PUX/698970520/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/EA67PUX/42810613?sv=2020-08-04&st=2026-03-28T14%3A02%3A51Z&se=2026-03-28T14%3A27%3A51Z&sr=b&sp=r&sig=FV2MJ3KNr66dhTGacY033E%2BqmCeGdrbYHllv8MYGBuI%3D)
2026-03-28 14:03:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GU14USS/698923412/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/GU14USS/42809794?sv=2020-08-04&st=2026-03-28T14%3A02%3A49Z&se=2026-03-28T14%3A27%3A49Z&sr=b&sp=r&sig=UCoZSxmlKy5d0BUzmMeFfalunCe3LCcB9XS6zEEjeiM%3D)
2026-03-28 14:03:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DT16AWH/698767600/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/DT16AWH/42810199?sv=2020-08-04&st=2026-03-28T14%3A02%3A49Z&se=2026-03-28T14%3A27%3A49Z&sr=b&sp=r&sig=Qm3Z9KBDI%2FgTQga6pc%2FqHN6txQQLz%2B%2FrlyC%2F4kkmDaA%3D)
2026-03-28 14:03:02 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:03:02 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:03:02 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:03:02 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:03:02 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:03:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:03:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2d7d83d0>
2026-03-28 14:03:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:03:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:03:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:03:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_92f1052e-2c5b-500c-801d-40376c1b4f7c/92f1052e-2c5b-500c-801d-40376c1b4f7c_image_7.jpg HTTP/1.1" 201 0
2026-03-28 14:03:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FDT16AWH%252F698767618%252F600') HTTP/1.1" 204 0
2026-03-28 14:03:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DT16AWH/698767618/600 saved to cache
2026-03-28 14:03:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 92f1052e-2c5b-500c-801d-40376c1b4f7c
2026-03-28 14:03:02 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:03:02 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:03:02 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:03:02 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:03:02 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:03:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:03:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a1fd7ea10>
2026-03-28 14:03:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:03:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:03:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:03:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_356c7b48-0ca4-5934-ba83-5b447228ae4f/356c7b48-0ca4-5934-ba83-5b447228ae4f_image_7.jpg HTTP/1.1" 201 0
2026-03-28 14:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FGU14USS%252F698923444%252F600') HTTP/1.1" 204 0
2026-03-28 14:03:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GU14USS/698923444/600 saved to cache
2026-03-28 14:03:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 356c7b48-0ca4-5934-ba83-5b447228ae4f
2026-03-28 14:03:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:03:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a1fd70f50>
2026-03-28 14:03:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:03:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:03:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:03:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_efe9536c-07f4-51cc-8c8c-b67b73b93c1d/efe9536c-07f4-51cc-8c8c-b67b73b93c1d_image_1.jpg HTTP/1.1" 201 0
2026-03-28 14:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FEA67PUX%252F698970520%252F600') HTTP/1.1" 204 0
2026-03-28 14:03:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EA67PUX/698970520/600 saved to cache
2026-03-28 14:03:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item efe9536c-07f4-51cc-8c8c-b67b73b93c1d
2026-03-28 14:03:03 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:03:03 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:03:03 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:03:03 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:03:03 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:03:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:03:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2de4ced0>
2026-03-28 14:03:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:03:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:03:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:03:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_356c7b48-0ca4-5934-ba83-5b447228ae4f/356c7b48-0ca4-5934-ba83-5b447228ae4f_image_6.jpg HTTP/1.1" 201 0
2026-03-28 14:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FGU14USS%252F698923412%252F600') HTTP/1.1" 204 0
2026-03-28 14:03:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GU14USS/698923412/600 saved to cache
2026-03-28 14:03:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 356c7b48-0ca4-5934-ba83-5b447228ae4f
2026-03-28 14:03:03 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:03:03 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:03:03 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:03:03 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:03:03 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:03:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:03:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c402f50>
2026-03-28 14:03:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:03:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:03:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:03:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_92f1052e-2c5b-500c-801d-40376c1b4f7c/92f1052e-2c5b-500c-801d-40376c1b4f7c_image_6.jpg HTTP/1.1" 201 0
2026-03-28 14:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FDT16AWH%252F698767600%252F600') HTTP/1.1" 204 0
2026-03-28 14:03:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DT16AWH/698767600/600 saved to cache
2026-03-28 14:03:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 92f1052e-2c5b-500c-801d-40376c1b4f7c
2026-03-28 14:03:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EA67PUX/698970518/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/EA67PUX/42810613?sv=2020-08-04&st=2026-03-28T14%3A02%3A51Z&se=2026-03-28T14%3A27%3A51Z&sr=b&sp=r&sig=FV2MJ3KNr66dhTGacY033E%2BqmCeGdrbYHllv8MYGBuI%3D)
2026-03-28 14:03:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LM11RXV/698709956/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LM11RXV/42806050?sv=2020-08-04&st=2026-03-28T14%3A02%3A51Z&se=2026-03-28T14%3A27%3A51Z&sr=b&sp=r&sig=caEaKFXTUt%2BfRTREEriaB%2FaR7T%2BUUg3%2FKsPPCwG8otw%3D)
2026-03-28 14:03:03 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GF57MWW/698928823/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698928823>
2026-03-28 14:03:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DT16AWH/698767575/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/DT16AWH/42810199?sv=2020-08-04&st=2026-03-28T14%3A02%3A49Z&se=2026-03-28T14%3A27%3A49Z&sr=b&sp=r&sig=Qm3Z9KBDI%2FgTQga6pc%2FqHN6txQQLz%2B%2FrlyC%2F4kkmDaA%3D)
2026-03-28 14:03:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DT16AWH/698767586/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/DT16AWH/42810199?sv=2020-08-04&st=2026-03-28T14%3A02%3A49Z&se=2026-03-28T14%3A27%3A49Z&sr=b&sp=r&sig=Qm3Z9KBDI%2FgTQga6pc%2FqHN6txQQLz%2B%2FrlyC%2F4kkmDaA%3D)
2026-03-28 14:03:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GU14USS/698923381/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/GU14USS/42809794?sv=2020-08-04&st=2026-03-28T14%3A02%3A49Z&se=2026-03-28T14%3A27%3A49Z&sr=b&sp=r&sig=UCoZSxmlKy5d0BUzmMeFfalunCe3LCcB9XS6zEEjeiM%3D)
2026-03-28 14:03:03 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/MJ62HDO/42810342?sv=2020-08-04&st=2026-03-28T14%3A03%3A03Z&se=2026-03-28T14%3A28%3A03Z&sr=b&sp=r&sig=4HxRLcY572xInqDRczi5%2F9rPsO%2Fy115VX0mOcX57FiI%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=MJ62%20HDO-GB>
2026-03-28 14:03:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GU14USS/698923361/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/GU14USS/42809794?sv=2020-08-04&st=2026-03-28T14%3A02%3A49Z&se=2026-03-28T14%3A27%3A49Z&sr=b&sp=r&sig=UCoZSxmlKy5d0BUzmMeFfalunCe3LCcB9XS6zEEjeiM%3D)
2026-03-28 14:03:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DT16AWH/698767548/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/DT16AWH/42810199?sv=2020-08-04&st=2026-03-28T14%3A02%3A49Z&se=2026-03-28T14%3A27%3A49Z&sr=b&sp=r&sig=Qm3Z9KBDI%2FgTQga6pc%2FqHN6txQQLz%2B%2FrlyC%2F4kkmDaA%3D)
2026-03-28 14:03:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DT16AWH/698767527/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/DT16AWH/42810199?sv=2020-08-04&st=2026-03-28T14%3A02%3A49Z&se=2026-03-28T14%3A27%3A49Z&sr=b&sp=r&sig=Qm3Z9KBDI%2FgTQga6pc%2FqHN6txQQLz%2B%2FrlyC%2F4kkmDaA%3D)
2026-03-28 14:03:03 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/X28AVE/698923798/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698923798>
2026-03-28 14:03:03 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WV13ZTH/698929332/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698929332>
2026-03-28 14:03:03 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YK67BOU/698928934/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698928934>
2026-03-28 14:03:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GU14USS/698923324/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/GU14USS/42809794?sv=2020-08-04&st=2026-03-28T14%3A02%3A49Z&se=2026-03-28T14%3A27%3A49Z&sr=b&sp=r&sig=UCoZSxmlKy5d0BUzmMeFfalunCe3LCcB9XS6zEEjeiM%3D)
2026-03-28 14:03:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DT16AWH/698767563/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/DT16AWH/42810199?sv=2020-08-04&st=2026-03-28T14%3A02%3A49Z&se=2026-03-28T14%3A27%3A49Z&sr=b&sp=r&sig=Qm3Z9KBDI%2FgTQga6pc%2FqHN6txQQLz%2B%2FrlyC%2F4kkmDaA%3D)
2026-03-28 14:03:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:03:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a1fd15050>
2026-03-28 14:03:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:03:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:03:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:03:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_efe9536c-07f4-51cc-8c8c-b67b73b93c1d/efe9536c-07f4-51cc-8c8c-b67b73b93c1d_image_0.jpg HTTP/1.1" 201 0
2026-03-28 14:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FEA67PUX%252F698970518%252F600') HTTP/1.1" 204 0
2026-03-28 14:03:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EA67PUX/698970518/600 saved to cache
2026-03-28 14:03:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item efe9536c-07f4-51cc-8c8c-b67b73b93c1d
2026-03-28 14:03:03 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: efe9536c-07f4-51cc-8c8c-b67b73b93c1d, skipping ID generation
2026-03-28 14:03:03 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item efe9536c-07f4-51cc-8c8c-b67b73b93c1d sending to next pipeline
2026-03-28 14:03:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: efe9536c-07f4-51cc-8c8c-b67b73b93c1d, identifier: EA67%20PUX
2026-03-28 14:03:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: efe9536c-07f4-51cc-8c8c-b67b73b93c1d with identifier: EA67%20PUX
2026-03-28 14:03:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: efe9536c-07f4-51cc-8c8c-b67b73b93c1d with identifier: EA67%20PUX
2026-03-28 14:03:03 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: efe9536c-07f4-51cc-8c8c-b67b73b93c1d with identifier: EA67%20PUX to the API
2026-03-28 14:03:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:03:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:03:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EA67PUX/698970518/600>
{'auction_title': '',
'c_o_2_emission_value': 117,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_efe9536c-07f4-51cc-8c8c-b67b73b93c1d/efe9536c-07f4-51cc-8c8c-b67b73b93c1d_expert_report_file_59d2b004-65ff-4a15-81fd-23863fe63b97.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=EA67%20PUX-GB',
'category': 'Car',
'color': 'grey',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.0L',
'expiration_date': '2026-03-29T10:00:00Z',
'fuel_type': 'Petrol',
'id': 'efe9536c-07f4-51cc-8c8c-b67b73b93c1d',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'EA67 PUX',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=EA67%20PUX&vehicleType=*',
'listing': 'auction',
'location': 'Paddock Wood',
'make': 'DACIA',
'model': 'SANDERO',
'odometer': 63227,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 16,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_efe9536c-07f4-51cc-8c8c-b67b73b93c1d/efe9536c-07f4-51cc-8c8c-b67b73b93c1d_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 45316,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EA67PUX/698970518/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_efe9536c-07f4-51cc-8c8c-b67b73b93c1d/efe9536c-07f4-51cc-8c8c-b67b73b93c1d_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 44441,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EA67PUX/698970520/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_efe9536c-07f4-51cc-8c8c-b67b73b93c1d/efe9536c-07f4-51cc-8c8c-b67b73b93c1d_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 50169,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EA67PUX/698953140/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_efe9536c-07f4-51cc-8c8c-b67b73b93c1d/efe9536c-07f4-51cc-8c8c-b67b73b93c1d_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 43221,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EA67PUX/698970538/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_efe9536c-07f4-51cc-8c8c-b67b73b93c1d/efe9536c-07f4-51cc-8c8c-b67b73b93c1d_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 48628,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EA67PUX/698953155/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_efe9536c-07f4-51cc-8c8c-b67b73b93c1d/efe9536c-07f4-51cc-8c8c-b67b73b93c1d_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 40605,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EA67PUX/698970555/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_efe9536c-07f4-51cc-8c8c-b67b73b93c1d/efe9536c-07f4-51cc-8c8c-b67b73b93c1d_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 46058,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EA67PUX/698953167/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_efe9536c-07f4-51cc-8c8c-b67b73b93c1d/efe9536c-07f4-51cc-8c8c-b67b73b93c1d_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 37263,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EA67PUX/698970565/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_efe9536c-07f4-51cc-8c8c-b67b73b93c1d/efe9536c-07f4-51cc-8c8c-b67b73b93c1d_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 44304,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EA67PUX/698953184/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_efe9536c-07f4-51cc-8c8c-b67b73b93c1d/efe9536c-07f4-51cc-8c8c-b67b73b93c1d_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 38140,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EA67PUX/698970574/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-01-01',
'seller_name': None,
'title': 'DACIA SANDERO 1.0 SCE AMBIANCE Hatchback',
'transmission': 'manual',
'trim': 'SCE AMBIANCE',
'vin': 'UU15SDMC559039894',
'year': 2017}
2026-03-28 14:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27EA67%2520PUX%27 HTTP/1.1" 200 None
2026-03-28 14:03:03 [bca.uk] INFO: Saving data for EA67%20PUX: {'created_time': 1774706583.764609, 'last_price_update_time': 1774706583.76462, 'auction_closing_time': 1774778400.0}
2026-03-28 14:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='EA67%2520PUX') HTTP/1.1" 204 0
2026-03-28 14:03:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GU14USS/698923304/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/GU14USS/42809794?sv=2020-08-04&st=2026-03-28T14%3A02%3A49Z&se=2026-03-28T14%3A27%3A49Z&sr=b&sp=r&sig=UCoZSxmlKy5d0BUzmMeFfalunCe3LCcB9XS6zEEjeiM%3D)
2026-03-28 14:03:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GF57MWW/698928823/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/GF57MWW/42810309?sv=2020-08-04&st=2026-03-28T14%3A01%3A09Z&se=2026-03-28T14%3A26%3A09Z&sr=b&sp=r&sig=hJTqt8SLdbJfAcgzLjUmqtORuHZL2E6pw%2FRYFmCkjK4%3D)
2026-03-28 14:03:03 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YK67BOU/698928908/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698928908>
2026-03-28 14:03:03 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/GV16HBD/42810313?sv=2020-08-04&st=2026-03-28T14%3A03%3A03Z&se=2026-03-28T14%3A28%3A03Z&sr=b&sp=r&sig=SZmUcBFQV93Ysin5HYH9TjRzwnjRVw7MvOMG44PxqsY%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=GV16%20HBD-GB>
2026-03-28 14:03:03 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/FY18CYT/42807957?sv=2020-08-04&st=2026-03-28T14%3A03%3A03Z&se=2026-03-28T14%3A28%3A03Z&sr=b&sp=r&sig=0X%2BGj0JbBf9U6KFOnmd0j0L8zgSNFs5MvLcdVjVSGWA%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=FY18%20CYT-GB>
2026-03-28 14:03:03 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/GF64UPV/42810175?sv=2020-08-04&st=2026-03-28T14%3A03%3A03Z&se=2026-03-28T14%3A28%3A03Z&sr=b&sp=r&sig=V6hyON%2BJA3aCP72Z85NeT3V3LO92YkUY%2FTF4afm%2Fwq0%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=GF64%20UPV-GB>
2026-03-28 14:03:03 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/GJ69TMO/42810317?sv=2020-08-04&st=2026-03-28T14%3A03%3A03Z&se=2026-03-28T14%3A28%3A03Z&sr=b&sp=r&sig=fxrA47lDZk3kHA1qwB8WBSU128g%2FFzPfbU3cJO1Sguw%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=GJ69%20TMO-GB>
2026-03-28 14:03:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:03:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c7628d0>
2026-03-28 14:03:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:03:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:03:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:03:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8d240778-137c-5daf-bc26-32539d983300/8d240778-137c-5daf-bc26-32539d983300_image_0.jpg HTTP/1.1" 201 0
2026-03-28 14:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLM11RXV%252F698709956%252F600') HTTP/1.1" 204 0
2026-03-28 14:03:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LM11RXV/698709956/600 saved to cache
2026-03-28 14:03:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 8d240778-137c-5daf-bc26-32539d983300
2026-03-28 14:03:03 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 8d240778-137c-5daf-bc26-32539d983300, skipping ID generation
2026-03-28 14:03:03 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 8d240778-137c-5daf-bc26-32539d983300 sending to next pipeline
2026-03-28 14:03:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 8d240778-137c-5daf-bc26-32539d983300, identifier: LM11%20RXV
2026-03-28 14:03:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 8d240778-137c-5daf-bc26-32539d983300 with identifier: LM11%20RXV
2026-03-28 14:03:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 8d240778-137c-5daf-bc26-32539d983300 with identifier: LM11%20RXV
2026-03-28 14:03:04 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 8d240778-137c-5daf-bc26-32539d983300 with identifier: LM11%20RXV to the API
2026-03-28 14:03:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:03:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:03:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LM11RXV/698709956/600>
{'auction_title': '',
'c_o_2_emission_value': 187,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8d240778-137c-5daf-bc26-32539d983300/8d240778-137c-5daf-bc26-32539d983300_expert_report_file_d41ad2f5-f935-4bc3-a457-c9687ee8880d.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=LM11%20RXV-GB',
'category': 'Car',
'color': 'blue',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.6L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol',
'id': '8d240778-137c-5daf-bc26-32539d983300',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'LM11 RXV',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=LM11%20RXV&vehicleType=*',
'listing': 'auction',
'location': 'Leeds',
'make': 'CHEVROLET',
'model': 'LACETTI',
'odometer': 65700,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 11,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8d240778-137c-5daf-bc26-32539d983300/8d240778-137c-5daf-bc26-32539d983300_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 42244,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LM11RXV/698709956/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8d240778-137c-5daf-bc26-32539d983300/8d240778-137c-5daf-bc26-32539d983300_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 40754,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LM11RXV/698709973/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8d240778-137c-5daf-bc26-32539d983300/8d240778-137c-5daf-bc26-32539d983300_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 40852,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LM11RXV/698709981/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8d240778-137c-5daf-bc26-32539d983300/8d240778-137c-5daf-bc26-32539d983300_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 41093,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LM11RXV/698709995/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8d240778-137c-5daf-bc26-32539d983300/8d240778-137c-5daf-bc26-32539d983300_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 42604,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LM11RXV/698710007/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8d240778-137c-5daf-bc26-32539d983300/8d240778-137c-5daf-bc26-32539d983300_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 39909,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LM11RXV/698710017/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8d240778-137c-5daf-bc26-32539d983300/8d240778-137c-5daf-bc26-32539d983300_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 76862,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LM11RXV/698710036/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8d240778-137c-5daf-bc26-32539d983300/8d240778-137c-5daf-bc26-32539d983300_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 70046,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LM11RXV/698710056/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8d240778-137c-5daf-bc26-32539d983300/8d240778-137c-5daf-bc26-32539d983300_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 89447,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LM11RXV/698710072/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8d240778-137c-5daf-bc26-32539d983300/8d240778-137c-5daf-bc26-32539d983300_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 70757,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LM11RXV/698710093/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2011-01-01',
'seller_name': None,
'title': 'CHEVROLET LACETTI 1.6 SX Hatchback',
'transmission': 'automatic',
'trim': 'SX',
'vin': 'KL1NA486JAK647895',
'year': 2011}
2026-03-28 14:03:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LM11%2520RXV%27 HTTP/1.1" 200 None
2026-03-28 14:03:04 [bca.uk] INFO: Saving data for LM11%20RXV: {'created_time': 1774706584.31934, 'last_price_update_time': 1774706584.319353, 'auction_closing_time': 1774864800.0}
2026-03-28 14:03:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='LM11%2520RXV') HTTP/1.1" 204 0
2026-03-28 14:03:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/MJ62HDO/42810342?sv=2020-08-04&st=2026-03-28T14%3A03%3A03Z&se=2026-03-28T14%3A28%3A03Z&sr=b&sp=r&sig=4HxRLcY572xInqDRczi5%2F9rPsO%2Fy115VX0mOcX57FiI%3D> (referer: https://www.bca.co.uk/)
2026-03-28 14:03:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:03:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c730d90>
2026-03-28 14:03:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:03:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:03:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:03:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_92f1052e-2c5b-500c-801d-40376c1b4f7c/92f1052e-2c5b-500c-801d-40376c1b4f7c_image_4.jpg HTTP/1.1" 201 0
2026-03-28 14:03:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FDT16AWH%252F698767575%252F600') HTTP/1.1" 204 0
2026-03-28 14:03:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DT16AWH/698767575/600 saved to cache
2026-03-28 14:03:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 92f1052e-2c5b-500c-801d-40376c1b4f7c
2026-03-28 14:03:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:03:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c172dd0>
2026-03-28 14:03:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:03:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:03:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:03:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_92f1052e-2c5b-500c-801d-40376c1b4f7c/92f1052e-2c5b-500c-801d-40376c1b4f7c_image_5.jpg HTTP/1.1" 201 0
2026-03-28 14:03:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FDT16AWH%252F698767586%252F600') HTTP/1.1" 204 0
2026-03-28 14:03:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DT16AWH/698767586/600 saved to cache
2026-03-28 14:03:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 92f1052e-2c5b-500c-801d-40376c1b4f7c
2026-03-28 14:03:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:03:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c8181d0>
2026-03-28 14:03:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:03:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:03:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:03:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_356c7b48-0ca4-5934-ba83-5b447228ae4f/356c7b48-0ca4-5934-ba83-5b447228ae4f_image_5.jpg HTTP/1.1" 201 0
2026-03-28 14:03:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FGU14USS%252F698923381%252F600') HTTP/1.1" 204 0
2026-03-28 14:03:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GU14USS/698923381/600 saved to cache
2026-03-28 14:03:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 356c7b48-0ca4-5934-ba83-5b447228ae4f
2026-03-28 14:03:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:03:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2d9b0450>
2026-03-28 14:03:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:03:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:03:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:03:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_356c7b48-0ca4-5934-ba83-5b447228ae4f/356c7b48-0ca4-5934-ba83-5b447228ae4f_image_4.jpg HTTP/1.1" 201 0
2026-03-28 14:03:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FGU14USS%252F698923361%252F600') HTTP/1.1" 204 0
2026-03-28 14:03:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GU14USS/698923361/600 saved to cache
2026-03-28 14:03:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 356c7b48-0ca4-5934-ba83-5b447228ae4f
2026-03-28 14:03:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:03:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2deb0110>
2026-03-28 14:03:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:03:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:03:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:03:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_92f1052e-2c5b-500c-801d-40376c1b4f7c/92f1052e-2c5b-500c-801d-40376c1b4f7c_image_2.jpg HTTP/1.1" 201 0
2026-03-28 14:03:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FDT16AWH%252F698767548%252F600') HTTP/1.1" 204 0
2026-03-28 14:03:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DT16AWH/698767548/600 saved to cache
2026-03-28 14:03:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 92f1052e-2c5b-500c-801d-40376c1b4f7c
2026-03-28 14:03:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:03:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c761d90>
2026-03-28 14:03:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:03:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:03:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:03:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_92f1052e-2c5b-500c-801d-40376c1b4f7c/92f1052e-2c5b-500c-801d-40376c1b4f7c_image_1.jpg HTTP/1.1" 201 0
2026-03-28 14:03:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FDT16AWH%252F698767527%252F600') HTTP/1.1" 204 0
2026-03-28 14:03:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DT16AWH/698767527/600 saved to cache
2026-03-28 14:03:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 92f1052e-2c5b-500c-801d-40376c1b4f7c
2026-03-28 14:03:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:03:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c730190>
2026-03-28 14:03:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:03:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:03:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:03:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_356c7b48-0ca4-5934-ba83-5b447228ae4f/356c7b48-0ca4-5934-ba83-5b447228ae4f_image_2.jpg HTTP/1.1" 201 0
2026-03-28 14:03:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FGU14USS%252F698923324%252F600') HTTP/1.1" 204 0
2026-03-28 14:03:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GU14USS/698923324/600 saved to cache
2026-03-28 14:03:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 356c7b48-0ca4-5934-ba83-5b447228ae4f
2026-03-28 14:03:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:03:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c8344d0>
2026-03-28 14:03:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:03:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:03:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:03:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_92f1052e-2c5b-500c-801d-40376c1b4f7c/92f1052e-2c5b-500c-801d-40376c1b4f7c_image_3.jpg HTTP/1.1" 201 0
2026-03-28 14:03:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FDT16AWH%252F698767563%252F600') HTTP/1.1" 204 0
2026-03-28 14:03:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DT16AWH/698767563/600 saved to cache
2026-03-28 14:03:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 92f1052e-2c5b-500c-801d-40376c1b4f7c
2026-03-28 14:03:04 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 92f1052e-2c5b-500c-801d-40376c1b4f7c, skipping ID generation
2026-03-28 14:03:04 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 92f1052e-2c5b-500c-801d-40376c1b4f7c sending to next pipeline
2026-03-28 14:03:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 92f1052e-2c5b-500c-801d-40376c1b4f7c, identifier: DT16%20AWH
2026-03-28 14:03:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WV13ZTH/698929332/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/WV13ZTH/42810161?sv=2020-08-04&st=2026-03-28T14%3A01%3A04Z&se=2026-03-28T14%3A26%3A04Z&sr=b&sp=r&sig=hbqIghhD97wvMs5qjsvBMdrtSptsqnkIa342PcMgOiA%3D)
2026-03-28 14:03:04 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LR11XWM/697880714/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=697880714>
2026-03-28 14:03:04 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/ND17VGZ/698929269/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698929269>
2026-03-28 14:03:04 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EX10BXE/698923388/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698923388>
2026-03-28 14:03:04 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EA24TKX/698296274/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698296274>
2026-03-28 14:03:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 92f1052e-2c5b-500c-801d-40376c1b4f7c with identifier: DT16%20AWH
2026-03-28 14:03:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 92f1052e-2c5b-500c-801d-40376c1b4f7c with identifier: DT16%20AWH
2026-03-28 14:03:04 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 92f1052e-2c5b-500c-801d-40376c1b4f7c with identifier: DT16%20AWH to the API
2026-03-28 14:03:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:03:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:03:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DT16AWH/698767563/600>
{'auction_title': '',
'c_o_2_emission_value': 113,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_92f1052e-2c5b-500c-801d-40376c1b4f7c/92f1052e-2c5b-500c-801d-40376c1b4f7c_expert_report_file_ff799d04-be65-4129-a3a9-f11da8830661.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=DT16%20AWH-GB',
'category': 'Car',
'color': 'white',
'currency': 'GBP',
'doors_number': 6,
'engine': '2.0L',
'expiration_date': '2026-03-29T10:00:00Z',
'fuel_type': 'Diesel',
'id': '92f1052e-2c5b-500c-801d-40376c1b4f7c',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'DT16 AWH',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=DT16%20AWH&vehicleType=*',
'listing': 'auction',
'location': 'Leeds',
'make': 'MINI',
'model': 'CLUBMAN',
'odometer': 153775,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 11,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_92f1052e-2c5b-500c-801d-40376c1b4f7c/92f1052e-2c5b-500c-801d-40376c1b4f7c_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 42056,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DT16AWH/698767510/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_92f1052e-2c5b-500c-801d-40376c1b4f7c/92f1052e-2c5b-500c-801d-40376c1b4f7c_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 40058,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DT16AWH/698767527/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_92f1052e-2c5b-500c-801d-40376c1b4f7c/92f1052e-2c5b-500c-801d-40376c1b4f7c_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 39144,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DT16AWH/698767548/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_92f1052e-2c5b-500c-801d-40376c1b4f7c/92f1052e-2c5b-500c-801d-40376c1b4f7c_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 39306,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DT16AWH/698767563/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_92f1052e-2c5b-500c-801d-40376c1b4f7c/92f1052e-2c5b-500c-801d-40376c1b4f7c_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 37131,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DT16AWH/698767575/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_92f1052e-2c5b-500c-801d-40376c1b4f7c/92f1052e-2c5b-500c-801d-40376c1b4f7c_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 35735,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DT16AWH/698767586/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_92f1052e-2c5b-500c-801d-40376c1b4f7c/92f1052e-2c5b-500c-801d-40376c1b4f7c_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 75669,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DT16AWH/698767600/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_92f1052e-2c5b-500c-801d-40376c1b4f7c/92f1052e-2c5b-500c-801d-40376c1b4f7c_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 72593,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DT16AWH/698767618/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_92f1052e-2c5b-500c-801d-40376c1b4f7c/92f1052e-2c5b-500c-801d-40376c1b4f7c_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 76152,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DT16AWH/698767633/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_92f1052e-2c5b-500c-801d-40376c1b4f7c/92f1052e-2c5b-500c-801d-40376c1b4f7c_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 94633,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DT16AWH/698767650/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-01-01',
'seller_name': None,
'title': 'MINI CLUBMAN 2.0 COOPER D Estate',
'transmission': 'manual',
'trim': 'COOPER D',
'vin': 'WMWLR920902E23524',
'year': 2016}
2026-03-28 14:03:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DT16%2520AWH%27 HTTP/1.1" 200 None
2026-03-28 14:03:05 [bca.uk] INFO: Saving data for DT16%20AWH: {'created_time': 1774706585.220788, 'last_price_update_time': 1774706585.2208, 'auction_closing_time': 1774778400.0}
2026-03-28 14:03:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='DT16%2520AWH') HTTP/1.1" 204 0
2026-03-28 14:03:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YK67BOU/698928934/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YK67BOU/42810138?sv=2020-08-04&st=2026-03-28T14%3A01%3A06Z&se=2026-03-28T14%3A26%3A06Z&sr=b&sp=r&sig=lMZ3QjflOWAYgjfCxBohfGqFaZWJDMyvtEvO8nKSM7s%3D)
2026-03-28 14:03:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/X28AVE/698923798/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/X28AVE/42809896?sv=2020-08-04&st=2026-03-28T14%3A01%3A06Z&se=2026-03-28T14%3A26%3A06Z&sr=b&sp=r&sig=AYxkyrr3IbeLdESXjdd9QmNEg4ZiUeF%2B%2BO3v1nuSrfg%3D)
2026-03-28 14:03:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:03:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c6dee10>
2026-03-28 14:03:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:03:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:03:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:03:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_356c7b48-0ca4-5934-ba83-5b447228ae4f/356c7b48-0ca4-5934-ba83-5b447228ae4f_image_1.jpg HTTP/1.1" 201 0
2026-03-28 14:03:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FGU14USS%252F698923304%252F600') HTTP/1.1" 204 0
2026-03-28 14:03:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GU14USS/698923304/600 saved to cache
2026-03-28 14:03:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 356c7b48-0ca4-5934-ba83-5b447228ae4f
2026-03-28 14:03:05 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 356c7b48-0ca4-5934-ba83-5b447228ae4f, skipping ID generation
2026-03-28 14:03:05 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 356c7b48-0ca4-5934-ba83-5b447228ae4f sending to next pipeline
2026-03-28 14:03:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 356c7b48-0ca4-5934-ba83-5b447228ae4f, identifier: GU14%20USS
2026-03-28 14:03:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:03:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c743e50>
2026-03-28 14:03:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:03:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:03:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:03:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cdcc838c-10d3-5f36-90c6-59ef07eececc/cdcc838c-10d3-5f36-90c6-59ef07eececc_image_3.jpg HTTP/1.1" 201 0
2026-03-28 14:03:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FGF57MWW%252F698928823%252F600') HTTP/1.1" 204 0
2026-03-28 14:03:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GF57MWW/698928823/600 saved to cache
2026-03-28 14:03:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item cdcc838c-10d3-5f36-90c6-59ef07eececc
2026-03-28 14:03:05 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MJ03HOW/698444440/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698444440>
2026-03-28 14:03:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 356c7b48-0ca4-5934-ba83-5b447228ae4f with identifier: GU14%20USS
2026-03-28 14:03:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 356c7b48-0ca4-5934-ba83-5b447228ae4f with identifier: GU14%20USS
2026-03-28 14:03:05 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 356c7b48-0ca4-5934-ba83-5b447228ae4f with identifier: GU14%20USS to the API
2026-03-28 14:03:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:03:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:03:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GU14USS/698923304/600>
{'auction_title': '',
'c_o_2_emission_value': 146,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_356c7b48-0ca4-5934-ba83-5b447228ae4f/356c7b48-0ca4-5934-ba83-5b447228ae4f_expert_report_file_528257ec-afcd-4c16-a527-fba5dcff507e.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=GU14%20USS-GB',
'category': 'Car',
'color': 'white',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.6L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol',
'id': '356c7b48-0ca4-5934-ba83-5b447228ae4f',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'GU14 USS',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=GU14%20USS&vehicleType=*',
'listing': 'auction',
'location': 'Paddock Wood',
'make': 'FORD',
'model': 'FOCUS',
'odometer': 105648,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 11,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_356c7b48-0ca4-5934-ba83-5b447228ae4f/356c7b48-0ca4-5934-ba83-5b447228ae4f_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 47132,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GU14USS/698923283/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_356c7b48-0ca4-5934-ba83-5b447228ae4f/356c7b48-0ca4-5934-ba83-5b447228ae4f_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 45910,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GU14USS/698923304/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_356c7b48-0ca4-5934-ba83-5b447228ae4f/356c7b48-0ca4-5934-ba83-5b447228ae4f_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 45852,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GU14USS/698923324/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_356c7b48-0ca4-5934-ba83-5b447228ae4f/356c7b48-0ca4-5934-ba83-5b447228ae4f_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 43503,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GU14USS/698923343/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_356c7b48-0ca4-5934-ba83-5b447228ae4f/356c7b48-0ca4-5934-ba83-5b447228ae4f_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 44108,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GU14USS/698923361/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_356c7b48-0ca4-5934-ba83-5b447228ae4f/356c7b48-0ca4-5934-ba83-5b447228ae4f_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 44113,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GU14USS/698923381/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_356c7b48-0ca4-5934-ba83-5b447228ae4f/356c7b48-0ca4-5934-ba83-5b447228ae4f_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 90598,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GU14USS/698923412/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_356c7b48-0ca4-5934-ba83-5b447228ae4f/356c7b48-0ca4-5934-ba83-5b447228ae4f_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 52625,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GU14USS/698923444/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_356c7b48-0ca4-5934-ba83-5b447228ae4f/356c7b48-0ca4-5934-ba83-5b447228ae4f_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 73029,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GU14USS/698923467/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_356c7b48-0ca4-5934-ba83-5b447228ae4f/356c7b48-0ca4-5934-ba83-5b447228ae4f_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 78861,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GU14USS/698923497/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2014-01-01',
'seller_name': None,
'title': 'FORD FOCUS 1.6 TI-VCT 125 ZETEC NAVIGATOR P/S Hatchback',
'transmission': 'automatic',
'trim': 'TI-VCT 125 ZETEC NAVIGATOR P/S',
'vin': 'WF0KXXGCBKET47257',
'year': 2014}
2026-03-28 14:03:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GU14%2520USS%27 HTTP/1.1" 200 None
2026-03-28 14:03:05 [bca.uk] INFO: Saving data for GU14%20USS: {'created_time': 1774706585.791133, 'last_price_update_time': 1774706585.791144, 'auction_closing_time': 1774864800.0}
2026-03-28 14:03:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='GU14%2520USS') HTTP/1.1" 204 0
2026-03-28 14:03:05 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GF57MWW/698928776/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698928776>
2026-03-28 14:03:05 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/PJ59WXK/42810349?sv=2020-08-04&st=2026-03-28T14%3A03%3A05Z&se=2026-03-28T14%3A28%3A05Z&sr=b&sp=r&sig=0pccUvvw8%2BiwcPxhRDvXDf%2FNBfxQSCx3DA%2F5VSxsghU%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=PJ59%20WXK-GB>
2026-03-28 14:03:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:03:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2d980410>
2026-03-28 14:03:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:03:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:03:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:03:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c697e335-b937-5194-8aed-71297a871cbe/c697e335-b937-5194-8aed-71297a871cbe_expert_report_file_3d7fad5e-5030-421e-9f2f-8d75a3d85b56.pdf HTTP/1.1" 201 0
2026-03-28 14:03:05 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item c697e335-b937-5194-8aed-71297a871cbe
2026-03-28 14:03:05 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: c697e335-b937-5194-8aed-71297a871cbe, skipping ID generation
2026-03-28 14:03:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item c697e335-b937-5194-8aed-71297a871cbe
2026-03-28 14:03:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DMJ62HDO-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-28 14:03:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=MJ62HDO-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-28 14:03:05 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:03:05 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:03:05 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:03:05 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:03:05 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:03:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:03:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2d95a7d0>
2026-03-28 14:03:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:03:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:03:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:03:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4766d63c-47f2-5b85-8b2c-c4d089a16b5c/4766d63c-47f2-5b85-8b2c-c4d089a16b5c_image_6.jpg HTTP/1.1" 201 0
2026-03-28 14:03:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FWV13ZTH%252F698929332%252F600') HTTP/1.1" 204 0
2026-03-28 14:03:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WV13ZTH/698929332/600 saved to cache
2026-03-28 14:03:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 4766d63c-47f2-5b85-8b2c-c4d089a16b5c
2026-03-28 14:03:06 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:03:06 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:03:06 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:03:06 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:03:06 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:03:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:03:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2d9d1b10>
2026-03-28 14:03:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:03:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:03:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:03:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_561c0b4f-3a2d-562b-bb16-d69244165df3/561c0b4f-3a2d-562b-bb16-d69244165df3_image_7.jpg HTTP/1.1" 201 0
2026-03-28 14:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FYK67BOU%252F698928934%252F600') HTTP/1.1" 204 0
2026-03-28 14:03:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YK67BOU/698928934/600 saved to cache
2026-03-28 14:03:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 561c0b4f-3a2d-562b-bb16-d69244165df3
2026-03-28 14:03:06 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:03:06 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:03:06 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:03:06 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:03:06 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:03:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:03:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2d829b10>
2026-03-28 14:03:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:03:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:03:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:03:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e788d11e-974b-5084-adb6-d49a23c42616/e788d11e-974b-5084-adb6-d49a23c42616_image_7.jpg HTTP/1.1" 201 0
2026-03-28 14:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FX28AVE%252F698923798%252F600') HTTP/1.1" 204 0
2026-03-28 14:03:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/X28AVE/698923798/600 saved to cache
2026-03-28 14:03:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item e788d11e-974b-5084-adb6-d49a23c42616
2026-03-28 14:03:06 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WV13ZTH/698929313/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698929313>
2026-03-28 14:03:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YK67BOU/698928908/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YK67BOU/42810138?sv=2020-08-04&st=2026-03-28T14%3A01%3A06Z&se=2026-03-28T14%3A26%3A06Z&sr=b&sp=r&sig=lMZ3QjflOWAYgjfCxBohfGqFaZWJDMyvtEvO8nKSM7s%3D)
2026-03-28 14:03:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/GV16HBD/42810313?sv=2020-08-04&st=2026-03-28T14%3A03%3A03Z&se=2026-03-28T14%3A28%3A03Z&sr=b&sp=r&sig=SZmUcBFQV93Ysin5HYH9TjRzwnjRVw7MvOMG44PxqsY%3D> (referer: https://www.bca.co.uk/)
2026-03-28 14:03:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/FY18CYT/42807957?sv=2020-08-04&st=2026-03-28T14%3A03%3A03Z&se=2026-03-28T14%3A28%3A03Z&sr=b&sp=r&sig=0X%2BGj0JbBf9U6KFOnmd0j0L8zgSNFs5MvLcdVjVSGWA%3D> (referer: https://www.bca.co.uk/)
2026-03-28 14:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D697888257%27 HTTP/1.1" 200 None
2026-03-28 14:03:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=697888257 not downloaded yet
2026-03-28 14:03:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/GJ69TMO/42810317?sv=2020-08-04&st=2026-03-28T14%3A03%3A03Z&se=2026-03-28T14%3A28%3A03Z&sr=b&sp=r&sig=fxrA47lDZk3kHA1qwB8WBSU128g%2FFzPfbU3cJO1Sguw%3D> (referer: https://www.bca.co.uk/)
2026-03-28 14:03:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/GF64UPV/42810175?sv=2020-08-04&st=2026-03-28T14%3A03%3A03Z&se=2026-03-28T14%3A28%3A03Z&sr=b&sp=r&sig=V6hyON%2BJA3aCP72Z85NeT3V3LO92YkUY%2FTF4afm%2Fwq0%3D> (referer: https://www.bca.co.uk/)
2026-03-28 14:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D697888265%27 HTTP/1.1" 200 None
2026-03-28 14:03:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=697888265 not downloaded yet
2026-03-28 14:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D697888270%27 HTTP/1.1" 200 None
2026-03-28 14:03:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=697888270 not downloaded yet
2026-03-28 14:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D697888273%27 HTTP/1.1" 200 None
2026-03-28 14:03:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=697888273 not downloaded yet
2026-03-28 14:03:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EA24TKX/698296274/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/EA24TKX/42810378?sv=2020-08-04&st=2026-03-28T14%3A01%3A05Z&se=2026-03-28T14%3A26%3A05Z&sr=b&sp=r&sig=Ajk9rVQfTHJs3R0cJnmP5VnSS5rSnHfV6UlI7D3mmDQ%3D)
2026-03-28 14:03:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EX10BXE/698923388/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/EX10BXE/42809799?sv=2020-08-04&st=2026-03-28T14%3A01%3A07Z&se=2026-03-28T14%3A26%3A07Z&sr=b&sp=r&sig=xoEQIFwTRaF8ZPdiio47BQcwaxFkt4KEonwRoN8KxQM%3D)
2026-03-28 14:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D697888277%27 HTTP/1.1" 200 None
2026-03-28 14:03:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=697888277 not downloaded yet
2026-03-28 14:03:06 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/X28AVE/698923758/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698923758>
2026-03-28 14:03:06 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YK67BOU/698928881/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698928881>
2026-03-28 14:03:06 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/RA16HNC/42810198?sv=2020-08-04&st=2026-03-28T14%3A03%3A06Z&se=2026-03-28T14%3A28%3A06Z&sr=b&sp=r&sig=LyYhM1EeBZuNgXZHNNjYE6jfdnZISItgtYhC%2Fw8yiFg%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=RA16%20HNC-GB>
2026-03-28 14:03:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/ND17VGZ/698929269/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/ND17VGZ/42810273?sv=2020-08-04&st=2026-03-28T14%3A01%3A05Z&se=2026-03-28T14%3A26%3A05Z&sr=b&sp=r&sig=Ddznt5rliWG2eSFSeV1iYUxjjPUcheWJt3FgNXERnUs%3D)
2026-03-28 14:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D697888285%27 HTTP/1.1" 200 None
2026-03-28 14:03:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=697888285 not downloaded yet
2026-03-28 14:03:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LR11XWM/697880714/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LR11XWM/42810294?sv=2020-08-04&st=2026-03-28T14%3A01%3A05Z&se=2026-03-28T14%3A26%3A05Z&sr=b&sp=r&sig=zHl%2Fkz2fSAoGVBY8ukVZULGVCGKqbTVidyooaEEBPNc%3D)
2026-03-28 14:03:06 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:03:06 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:03:06 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:03:06 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:03:06 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:03:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:03:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c3fc810>
2026-03-28 14:03:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:03:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:03:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:03:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_561c0b4f-3a2d-562b-bb16-d69244165df3/561c0b4f-3a2d-562b-bb16-d69244165df3_image_6.jpg HTTP/1.1" 201 0
2026-03-28 14:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FYK67BOU%252F698928908%252F600') HTTP/1.1" 204 0
2026-03-28 14:03:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YK67BOU/698928908/600 saved to cache
2026-03-28 14:03:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 561c0b4f-3a2d-562b-bb16-d69244165df3
2026-03-28 14:03:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:03:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2ca5d490>
2026-03-28 14:03:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:03:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:03:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:03:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0c77c9a7-bec0-528f-95be-edf653516a09/0c77c9a7-bec0-528f-95be-edf653516a09_expert_report_file_0a24782d-dd5a-4a16-a23c-f1c716782560.pdf HTTP/1.1" 201 0
2026-03-28 14:03:06 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item 0c77c9a7-bec0-528f-95be-edf653516a09
2026-03-28 14:03:06 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 0c77c9a7-bec0-528f-95be-edf653516a09, skipping ID generation
2026-03-28 14:03:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 0c77c9a7-bec0-528f-95be-edf653516a09
2026-03-28 14:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DGV16HBD-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-28 14:03:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=GV16HBD-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-28 14:03:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:03:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a1ffb0650>
2026-03-28 14:03:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:03:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:03:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:03:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_567b324e-2678-5f7b-ae48-9d6f040ce03b/567b324e-2678-5f7b-ae48-9d6f040ce03b_expert_report_file_e5c0a702-5f8a-445c-aebe-bbb3e817cca7.pdf HTTP/1.1" 201 0
2026-03-28 14:03:06 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item 567b324e-2678-5f7b-ae48-9d6f040ce03b
2026-03-28 14:03:06 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 567b324e-2678-5f7b-ae48-9d6f040ce03b, skipping ID generation
2026-03-28 14:03:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 567b324e-2678-5f7b-ae48-9d6f040ce03b
2026-03-28 14:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DFY18CYT-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-28 14:03:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=FY18CYT-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-28 14:03:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MJ03HOW/698444440/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/MJ03HOW/42810316?sv=2020-08-04&st=2026-03-28T14%3A01%3A04Z&se=2026-03-28T14%3A26%3A04Z&sr=b&sp=r&sig=72R4f35YDQDGGwN55srQJ3YRSQrnD%2FGMmCWnMvmfOLc%3D)
2026-03-28 14:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D697888292%27 HTTP/1.1" 200 None
2026-03-28 14:03:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=697888292 not downloaded yet
2026-03-28 14:03:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GF57MWW/698928776/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/GF57MWW/42810309?sv=2020-08-04&st=2026-03-28T14%3A01%3A09Z&se=2026-03-28T14%3A26%3A09Z&sr=b&sp=r&sig=hJTqt8SLdbJfAcgzLjUmqtORuHZL2E6pw%2FRYFmCkjK4%3D)
2026-03-28 14:03:06 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/GF23LJX/42810323?sv=2020-08-04&st=2026-03-28T14%3A03%3A06Z&se=2026-03-28T14%3A28%3A06Z&sr=b&sp=r&sig=%2Bdy17hHkwj66nlfWTlsIK4h%2BkQbwO199F4yfh3pb5Uc%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=GF23%20LJX-GB>
2026-03-28 14:03:06 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MJ62HDO/697888251/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=MJ62HDO-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-28 14:03:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WV13ZTH/698929313/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/WV13ZTH/42810161?sv=2020-08-04&st=2026-03-28T14%3A01%3A04Z&se=2026-03-28T14%3A26%3A04Z&sr=b&sp=r&sig=hbqIghhD97wvMs5qjsvBMdrtSptsqnkIa342PcMgOiA%3D)
2026-03-28 14:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698104815%27 HTTP/1.1" 200 None
2026-03-28 14:03:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698104815 not downloaded yet
2026-03-28 14:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698798448%27 HTTP/1.1" 200 None
2026-03-28 14:03:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698798448 not downloaded yet
2026-03-28 14:03:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:03:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c476890>
2026-03-28 14:03:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:03:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:03:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:03:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bf5f6c66-7fca-54d7-9dbf-87d60cf357d5/bf5f6c66-7fca-54d7-9dbf-87d60cf357d5_expert_report_file_11c3ec59-0761-4874-997c-430af7577d27.pdf HTTP/1.1" 201 0
2026-03-28 14:03:06 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item bf5f6c66-7fca-54d7-9dbf-87d60cf357d5
2026-03-28 14:03:06 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: bf5f6c66-7fca-54d7-9dbf-87d60cf357d5, skipping ID generation
2026-03-28 14:03:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item bf5f6c66-7fca-54d7-9dbf-87d60cf357d5
2026-03-28 14:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DGJ69TMO-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-28 14:03:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=GJ69TMO-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-28 14:03:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:03:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a1fd114d0>
2026-03-28 14:03:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:03:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:03:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:03:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_68af04a9-eec4-52ae-b536-68c72f8fddc4/68af04a9-eec4-52ae-b536-68c72f8fddc4_expert_report_file_4bbceb15-abdf-4eb2-8b26-880f39caa820.pdf HTTP/1.1" 201 0
2026-03-28 14:03:06 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item 68af04a9-eec4-52ae-b536-68c72f8fddc4
2026-03-28 14:03:06 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 68af04a9-eec4-52ae-b536-68c72f8fddc4, skipping ID generation
2026-03-28 14:03:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 68af04a9-eec4-52ae-b536-68c72f8fddc4
2026-03-28 14:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DGF64UPV-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-28 14:03:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=GF64UPV-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-28 14:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D697888302%27 HTTP/1.1" 200 None
2026-03-28 14:03:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=697888302 not downloaded yet
2026-03-28 14:03:06 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/ND17VGZ/698929257/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698929257>
2026-03-28 14:03:06 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EX10BXE/698923368/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698923368>
2026-03-28 14:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698104822%27 HTTP/1.1" 200 None
2026-03-28 14:03:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698104822 not downloaded yet
2026-03-28 14:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698798451%27 HTTP/1.1" 200 None
2026-03-28 14:03:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698798451 not downloaded yet
2026-03-28 14:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698438530%27 HTTP/1.1" 200 None
2026-03-28 14:03:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698438530 not downloaded yet
2026-03-28 14:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698015321%27 HTTP/1.1" 200 None
2026-03-28 14:03:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698015321 not downloaded yet
2026-03-28 14:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D697888310%27 HTTP/1.1" 200 None
2026-03-28 14:03:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=697888310 not downloaded yet
2026-03-28 14:03:06 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:03:06 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:03:06 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:03:06 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:03:06 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:03:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:03:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2fde7150>
2026-03-28 14:03:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:03:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:03:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:03:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a936dd22-4905-520e-8ef4-c3c73c56eba4/a936dd22-4905-520e-8ef4-c3c73c56eba4_image_8.jpg HTTP/1.1" 201 0
2026-03-28 14:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FEA24TKX%252F698296274%252F600') HTTP/1.1" 204 0
2026-03-28 14:03:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EA24TKX/698296274/600 saved to cache
2026-03-28 14:03:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item a936dd22-4905-520e-8ef4-c3c73c56eba4
2026-03-28 14:03:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:03:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c86f650>
2026-03-28 14:03:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:03:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:03:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:03:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f5f9bed7-96bb-5ef8-8a52-e232dbf0b7d5/f5f9bed7-96bb-5ef8-8a52-e232dbf0b7d5_image_2.jpg HTTP/1.1" 201 0
2026-03-28 14:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FEX10BXE%252F698923388%252F600') HTTP/1.1" 204 0
2026-03-28 14:03:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EX10BXE/698923388/600 saved to cache
2026-03-28 14:03:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item f5f9bed7-96bb-5ef8-8a52-e232dbf0b7d5
2026-03-28 14:03:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:03:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c8e0ed0>
2026-03-28 14:03:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:03:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:03:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:03:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_03d2b309-0f29-57c0-bf73-2b86c16c227a/03d2b309-0f29-57c0-bf73-2b86c16c227a_image_3.jpg HTTP/1.1" 201 0
2026-03-28 14:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FND17VGZ%252F698929269%252F600') HTTP/1.1" 204 0
2026-03-28 14:03:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/ND17VGZ/698929269/600 saved to cache
2026-03-28 14:03:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 03d2b309-0f29-57c0-bf73-2b86c16c227a
2026-03-28 14:03:06 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:03:06 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:03:06 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:03:06 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:03:06 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:03:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:03:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c86d0d0>
2026-03-28 14:03:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:03:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:03:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:03:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0b12c0fe-3ab8-5445-ad6b-256ccebc3b9e/0b12c0fe-3ab8-5445-ad6b-256ccebc3b9e_image_8.jpg HTTP/1.1" 201 0
2026-03-28 14:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLR11XWM%252F697880714%252F600') HTTP/1.1" 204 0
2026-03-28 14:03:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LR11XWM/697880714/600 saved to cache
2026-03-28 14:03:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 0b12c0fe-3ab8-5445-ad6b-256ccebc3b9e
2026-03-28 14:03:06 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:03:06 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:03:06 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:03:06 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:03:06 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:03:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:03:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2de03cd0>
2026-03-28 14:03:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:03:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:03:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:03:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b75153fa-8bbc-5e83-87eb-81edd908fcda/b75153fa-8bbc-5e83-87eb-81edd908fcda_image_9.jpg HTTP/1.1" 201 0
2026-03-28 14:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FMJ03HOW%252F698444440%252F600') HTTP/1.1" 204 0
2026-03-28 14:03:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MJ03HOW/698444440/600 saved to cache
2026-03-28 14:03:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item b75153fa-8bbc-5e83-87eb-81edd908fcda
2026-03-28 14:03:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:03:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2de875d0>
2026-03-28 14:03:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:03:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:03:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:03:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cdcc838c-10d3-5f36-90c6-59ef07eececc/cdcc838c-10d3-5f36-90c6-59ef07eececc_image_1.jpg HTTP/1.1" 201 0
2026-03-28 14:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FGF57MWW%252F698928776%252F600') HTTP/1.1" 204 0
2026-03-28 14:03:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GF57MWW/698928776/600 saved to cache
2026-03-28 14:03:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item cdcc838c-10d3-5f36-90c6-59ef07eececc
2026-03-28 14:03:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:03:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c6c7350>
2026-03-28 14:03:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:03:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:03:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:03:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4766d63c-47f2-5b85-8b2c-c4d089a16b5c/4766d63c-47f2-5b85-8b2c-c4d089a16b5c_image_4.jpg HTTP/1.1" 201 0
2026-03-28 14:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FWV13ZTH%252F698929313%252F600') HTTP/1.1" 204 0
2026-03-28 14:03:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WV13ZTH/698929313/600 saved to cache
2026-03-28 14:03:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 4766d63c-47f2-5b85-8b2c-c4d089a16b5c
2026-03-28 14:03:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/PJ59WXK/42810349?sv=2020-08-04&st=2026-03-28T14%3A03%3A05Z&se=2026-03-28T14%3A28%3A05Z&sr=b&sp=r&sig=0pccUvvw8%2BiwcPxhRDvXDf%2FNBfxQSCx3DA%2F5VSxsghU%3D> (referer: https://www.bca.co.uk/)
2026-03-28 14:03:06 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LR11XWM/697880683/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=697880683>
2026-03-28 14:03:06 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MJ62HDO/697888273/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=697888273>
2026-03-28 14:03:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/X28AVE/698923758/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/X28AVE/42809896?sv=2020-08-04&st=2026-03-28T14%3A01%3A06Z&se=2026-03-28T14%3A26%3A06Z&sr=b&sp=r&sig=AYxkyrr3IbeLdESXjdd9QmNEg4ZiUeF%2B%2BO3v1nuSrfg%3D)
2026-03-28 14:03:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YK67BOU/698928881/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YK67BOU/42810138?sv=2020-08-04&st=2026-03-28T14%3A01%3A06Z&se=2026-03-28T14%3A26%3A06Z&sr=b&sp=r&sig=lMZ3QjflOWAYgjfCxBohfGqFaZWJDMyvtEvO8nKSM7s%3D)
2026-03-28 14:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698104830%27 HTTP/1.1" 200 None
2026-03-28 14:03:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698104830 not downloaded yet
2026-03-28 14:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698798455%27 HTTP/1.1" 200 None
2026-03-28 14:03:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698798455 not downloaded yet
2026-03-28 14:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698438535%27 HTTP/1.1" 200 None
2026-03-28 14:03:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698438535 not downloaded yet
2026-03-28 14:03:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698015329%27 HTTP/1.1" 200 None
2026-03-28 14:03:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698015329 not downloaded yet
2026-03-28 14:03:07 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MJ62HDO/697888277/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=697888277>
2026-03-28 14:03:07 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MJ62HDO/697888270/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=697888270>
2026-03-28 14:03:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698104842%27 HTTP/1.1" 200 None
2026-03-28 14:03:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698104842 not downloaded yet
2026-03-28 14:03:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698798460%27 HTTP/1.1" 200 None
2026-03-28 14:03:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698798460 not downloaded yet
2026-03-28 14:03:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698438539%27 HTTP/1.1" 200 None
2026-03-28 14:03:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698438539 not downloaded yet
2026-03-28 14:03:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698015333%27 HTTP/1.1" 200 None
2026-03-28 14:03:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698015333 not downloaded yet
2026-03-28 14:03:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/RA16HNC/42810198?sv=2020-08-04&st=2026-03-28T14%3A03%3A06Z&se=2026-03-28T14%3A28%3A06Z&sr=b&sp=r&sig=LyYhM1EeBZuNgXZHNNjYE6jfdnZISItgtYhC%2Fw8yiFg%3D> (referer: https://www.bca.co.uk/)
2026-03-28 14:03:07 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MJ62HDO/697888265/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=697888265>
2026-03-28 14:03:07 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FY18CYT/698798445/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=FY18CYT-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-28 14:03:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698104850%27 HTTP/1.1" 200 None
2026-03-28 14:03:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698104850 not downloaded yet
2026-03-28 14:03:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698798471%27 HTTP/1.1" 200 None
2026-03-28 14:03:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698798471 not downloaded yet
2026-03-28 14:03:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698438545%27 HTTP/1.1" 200 None
2026-03-28 14:03:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698438545 not downloaded yet
2026-03-28 14:03:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698015337%27 HTTP/1.1" 200 None
2026-03-28 14:03:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698015337 not downloaded yet
2026-03-28 14:03:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MJ62HDO/697888251/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/MJ62HDO/42810342?sv=2020-08-04&st=2026-03-28T14%3A03%3A03Z&se=2026-03-28T14%3A28%3A03Z&sr=b&sp=r&sig=4HxRLcY572xInqDRczi5%2F9rPsO%2Fy115VX0mOcX57FiI%3D)
2026-03-28 14:03:07 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GV16HBD/698104806/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=GV16HBD-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-28 14:03:07 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MJ62HDO/697888285/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=697888285>
2026-03-28 14:03:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698104870%27 HTTP/1.1" 200 None
2026-03-28 14:03:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698104870 not downloaded yet
2026-03-28 14:03:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698798493%27 HTTP/1.1" 200 None
2026-03-28 14:03:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698798493 not downloaded yet
2026-03-28 14:03:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698438550%27 HTTP/1.1" 200 None
2026-03-28 14:03:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698438550 not downloaded yet
2026-03-28 14:03:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698015341%27 HTTP/1.1" 200 None
2026-03-28 14:03:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698015341 not downloaded yet
2026-03-28 14:03:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:03:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c891cd0>
2026-03-28 14:03:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:03:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:03:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:03:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b90da0a6-3ad2-591a-8a5c-936884592342/b90da0a6-3ad2-591a-8a5c-936884592342_expert_report_file_f5189d09-def5-4aa8-9470-421e79f892be.pdf HTTP/1.1" 201 0
2026-03-28 14:03:07 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item b90da0a6-3ad2-591a-8a5c-936884592342
2026-03-28 14:03:07 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: b90da0a6-3ad2-591a-8a5c-936884592342, skipping ID generation
2026-03-28 14:03:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item b90da0a6-3ad2-591a-8a5c-936884592342
2026-03-28 14:03:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DPJ59WXK-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-28 14:03:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=PJ59WXK-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-28 14:03:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:03:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a1fd7dfd0>
2026-03-28 14:03:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:03:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:03:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:03:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e788d11e-974b-5084-adb6-d49a23c42616/e788d11e-974b-5084-adb6-d49a23c42616_image_5.jpg HTTP/1.1" 201 0
2026-03-28 14:03:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FX28AVE%252F698923758%252F600') HTTP/1.1" 204 0
2026-03-28 14:03:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/X28AVE/698923758/600 saved to cache
2026-03-28 14:03:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item e788d11e-974b-5084-adb6-d49a23c42616
2026-03-28 14:03:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:03:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c3d36d0>
2026-03-28 14:03:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:03:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:03:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:03:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_561c0b4f-3a2d-562b-bb16-d69244165df3/561c0b4f-3a2d-562b-bb16-d69244165df3_image_5.jpg HTTP/1.1" 201 0
2026-03-28 14:03:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FYK67BOU%252F698928881%252F600') HTTP/1.1" 204 0
2026-03-28 14:03:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YK67BOU/698928881/600 saved to cache
2026-03-28 14:03:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 561c0b4f-3a2d-562b-bb16-d69244165df3
2026-03-28 14:03:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/GF23LJX/42810323?sv=2020-08-04&st=2026-03-28T14%3A03%3A06Z&se=2026-03-28T14%3A28%3A06Z&sr=b&sp=r&sig=%2Bdy17hHkwj66nlfWTlsIK4h%2BkQbwO199F4yfh3pb5Uc%3D> (referer: https://www.bca.co.uk/)
2026-03-28 14:03:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EX10BXE/698923368/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/EX10BXE/42809799?sv=2020-08-04&st=2026-03-28T14%3A01%3A07Z&se=2026-03-28T14%3A26%3A07Z&sr=b&sp=r&sig=xoEQIFwTRaF8ZPdiio47BQcwaxFkt4KEonwRoN8KxQM%3D)
2026-03-28 14:03:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/ND17VGZ/698929257/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/ND17VGZ/42810273?sv=2020-08-04&st=2026-03-28T14%3A01%3A05Z&se=2026-03-28T14%3A26%3A05Z&sr=b&sp=r&sig=Ddznt5rliWG2eSFSeV1iYUxjjPUcheWJt3FgNXERnUs%3D)
2026-03-28 14:03:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MJ62HDO/697888273/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/MJ62HDO/42810342?sv=2020-08-04&st=2026-03-28T14%3A03%3A03Z&se=2026-03-28T14%3A28%3A03Z&sr=b&sp=r&sig=4HxRLcY572xInqDRczi5%2F9rPsO%2Fy115VX0mOcX57FiI%3D)
2026-03-28 14:03:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698104885%27 HTTP/1.1" 200 None
2026-03-28 14:03:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698104885 not downloaded yet
2026-03-28 14:03:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698798512%27 HTTP/1.1" 200 None
2026-03-28 14:03:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698798512 not downloaded yet
2026-03-28 14:03:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698438559%27 HTTP/1.1" 200 None
2026-03-28 14:03:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698438559 not downloaded yet
2026-03-28 14:03:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698015348%27 HTTP/1.1" 200 None
2026-03-28 14:03:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698015348 not downloaded yet
2026-03-28 14:03:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698424526%27 HTTP/1.1" 200 None
2026-03-28 14:03:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698424526 not downloaded yet
2026-03-28 14:03:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LR11XWM/697880683/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LR11XWM/42810294?sv=2020-08-04&st=2026-03-28T14%3A01%3A05Z&se=2026-03-28T14%3A26%3A05Z&sr=b&sp=r&sig=zHl%2Fkz2fSAoGVBY8ukVZULGVCGKqbTVidyooaEEBPNc%3D)
2026-03-28 14:03:07 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GJ69TMO/698438530/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698438530>
2026-03-28 14:03:07 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MJ62HDO/697888310/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=697888310>
2026-03-28 14:03:07 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GF64UPV/698015321/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698015321>
2026-03-28 14:03:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698104900%27 HTTP/1.1" 200 None
2026-03-28 14:03:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698104900 not downloaded yet
2026-03-28 14:03:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698798528%27 HTTP/1.1" 200 None
2026-03-28 14:03:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698798528 not downloaded yet
2026-03-28 14:03:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698438561%27 HTTP/1.1" 200 None
2026-03-28 14:03:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698438561 not downloaded yet
2026-03-28 14:03:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698015357%27 HTTP/1.1" 200 None
2026-03-28 14:03:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698015357 not downloaded yet
2026-03-28 14:03:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698424528%27 HTTP/1.1" 200 None
2026-03-28 14:03:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698424528 not downloaded yet
2026-03-28 14:03:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:03:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c4b8110>
2026-03-28 14:03:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:03:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:03:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:03:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a241d4e5-9ba8-591a-8b8d-858d5e5adfe4/a241d4e5-9ba8-591a-8b8d-858d5e5adfe4_expert_report_file_1e1c689c-efff-4588-b468-3ffed66a2a30.pdf HTTP/1.1" 201 0
2026-03-28 14:03:07 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item a241d4e5-9ba8-591a-8b8d-858d5e5adfe4
2026-03-28 14:03:07 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: a241d4e5-9ba8-591a-8b8d-858d5e5adfe4, skipping ID generation
2026-03-28 14:03:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item a241d4e5-9ba8-591a-8b8d-858d5e5adfe4
2026-03-28 14:03:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DRA16HNC-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-28 14:03:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=RA16HNC-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-28 14:03:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:03:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a3008f4d0>
2026-03-28 14:03:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:03:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:03:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:03:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c697e335-b937-5194-8aed-71297a871cbe/c697e335-b937-5194-8aed-71297a871cbe_image_0.jpg HTTP/1.1" 201 0
2026-03-28 14:03:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FMJ62HDO%252F697888251%252F600') HTTP/1.1" 204 0
2026-03-28 14:03:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MJ62HDO/697888251/600 saved to cache
2026-03-28 14:03:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item c697e335-b937-5194-8aed-71297a871cbe
2026-03-28 14:03:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:03:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c3fdbd0>
2026-03-28 14:03:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:03:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:03:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:03:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e2169724-1950-5652-92b2-0f3da8b4bfbb/e2169724-1950-5652-92b2-0f3da8b4bfbb_expert_report_file_1670fa3c-f4d4-41d7-a63f-bee121998e69.pdf HTTP/1.1" 201 0
2026-03-28 14:03:07 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item e2169724-1950-5652-92b2-0f3da8b4bfbb
2026-03-28 14:03:07 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: e2169724-1950-5652-92b2-0f3da8b4bfbb, skipping ID generation
2026-03-28 14:03:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item e2169724-1950-5652-92b2-0f3da8b4bfbb
2026-03-28 14:03:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DGF23LJX-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-28 14:03:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=GF23LJX-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-28 14:03:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:03:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c9b62d0>
2026-03-28 14:03:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:03:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:03:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:03:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f5f9bed7-96bb-5ef8-8a52-e232dbf0b7d5/f5f9bed7-96bb-5ef8-8a52-e232dbf0b7d5_image_1.jpg HTTP/1.1" 201 0
2026-03-28 14:03:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FEX10BXE%252F698923368%252F600') HTTP/1.1" 204 0
2026-03-28 14:03:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EX10BXE/698923368/600 saved to cache
2026-03-28 14:03:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item f5f9bed7-96bb-5ef8-8a52-e232dbf0b7d5
2026-03-28 14:03:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:03:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a1feab4d0>
2026-03-28 14:03:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:03:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:03:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:03:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_03d2b309-0f29-57c0-bf73-2b86c16c227a/03d2b309-0f29-57c0-bf73-2b86c16c227a_image_2.jpg HTTP/1.1" 201 0
2026-03-28 14:03:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FND17VGZ%252F698929257%252F600') HTTP/1.1" 204 0
2026-03-28 14:03:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/ND17VGZ/698929257/600 saved to cache
2026-03-28 14:03:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 03d2b309-0f29-57c0-bf73-2b86c16c227a
2026-03-28 14:03:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:03:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c3b7590>
2026-03-28 14:03:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:03:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:03:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:03:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c697e335-b937-5194-8aed-71297a871cbe/c697e335-b937-5194-8aed-71297a871cbe_image_4.jpg HTTP/1.1" 201 0
2026-03-28 14:03:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FMJ62HDO%252F697888273%252F600') HTTP/1.1" 204 0
2026-03-28 14:03:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MJ62HDO/697888273/600 saved to cache
2026-03-28 14:03:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item c697e335-b937-5194-8aed-71297a871cbe
2026-03-28 14:03:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FY18CYT/698798445/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/FY18CYT/42807957?sv=2020-08-04&st=2026-03-28T14%3A03%3A03Z&se=2026-03-28T14%3A28%3A03Z&sr=b&sp=r&sig=0X%2BGj0JbBf9U6KFOnmd0j0L8zgSNFs5MvLcdVjVSGWA%3D)
2026-03-28 14:03:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MJ62HDO/697888265/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/MJ62HDO/42810342?sv=2020-08-04&st=2026-03-28T14%3A03%3A03Z&se=2026-03-28T14%3A28%3A03Z&sr=b&sp=r&sig=4HxRLcY572xInqDRczi5%2F9rPsO%2Fy115VX0mOcX57FiI%3D)
2026-03-28 14:03:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MJ62HDO/697888270/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/MJ62HDO/42810342?sv=2020-08-04&st=2026-03-28T14%3A03%3A03Z&se=2026-03-28T14%3A28%3A03Z&sr=b&sp=r&sig=4HxRLcY572xInqDRczi5%2F9rPsO%2Fy115VX0mOcX57FiI%3D)
2026-03-28 14:03:07 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GF64UPV/698015333/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698015333>
2026-03-28 14:03:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698104923%27 HTTP/1.1" 200 None
2026-03-28 14:03:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698104923 not downloaded yet
2026-03-28 14:03:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698798541%27 HTTP/1.1" 200 None
2026-03-28 14:03:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698798541 not downloaded yet
2026-03-28 14:03:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698438565%27 HTTP/1.1" 200 None
2026-03-28 14:03:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698438565 not downloaded yet
2026-03-28 14:03:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698015369%27 HTTP/1.1" 200 None
2026-03-28 14:03:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698015369 not downloaded yet
2026-03-28 14:03:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698424530%27 HTTP/1.1" 200 None
2026-03-28 14:03:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698424530 not downloaded yet
2026-03-28 14:03:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MJ62HDO/697888277/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/MJ62HDO/42810342?sv=2020-08-04&st=2026-03-28T14%3A03%3A03Z&se=2026-03-28T14%3A28%3A03Z&sr=b&sp=r&sig=4HxRLcY572xInqDRczi5%2F9rPsO%2Fy115VX0mOcX57FiI%3D)
2026-03-28 14:03:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698672300%27 HTTP/1.1" 200 None
2026-03-28 14:03:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698672300 not downloaded yet
2026-03-28 14:03:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698568375%27 HTTP/1.1" 200 None
2026-03-28 14:03:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698568375 not downloaded yet
2026-03-28 14:03:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GV16HBD/698104806/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/GV16HBD/42810313?sv=2020-08-04&st=2026-03-28T14%3A03%3A03Z&se=2026-03-28T14%3A28%3A03Z&sr=b&sp=r&sig=SZmUcBFQV93Ysin5HYH9TjRzwnjRVw7MvOMG44PxqsY%3D)
2026-03-28 14:03:07 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GF64UPV/698015337/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698015337>
2026-03-28 14:03:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698438567%27 HTTP/1.1" 200 None
2026-03-28 14:03:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698438567 not downloaded yet
2026-03-28 14:03:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698015380%27 HTTP/1.1" 200 None
2026-03-28 14:03:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698015380 not downloaded yet
2026-03-28 14:03:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698424531%27 HTTP/1.1" 200 None
2026-03-28 14:03:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698424531 not downloaded yet
2026-03-28 14:03:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MJ62HDO/697888285/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/MJ62HDO/42810342?sv=2020-08-04&st=2026-03-28T14%3A03%3A03Z&se=2026-03-28T14%3A28%3A03Z&sr=b&sp=r&sig=4HxRLcY572xInqDRczi5%2F9rPsO%2Fy115VX0mOcX57FiI%3D)
2026-03-28 14:03:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698672313%27 HTTP/1.1" 200 None
2026-03-28 14:03:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698672313 not downloaded yet
2026-03-28 14:03:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698568403%27 HTTP/1.1" 200 None
2026-03-28 14:03:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698568403 not downloaded yet
2026-03-28 14:03:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698424533%27 HTTP/1.1" 200 None
2026-03-28 14:03:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698424533 not downloaded yet
2026-03-28 14:03:08 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:03:08 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:03:08 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:03:08 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:03:08 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:03:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:03:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c40c850>
2026-03-28 14:03:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:03:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:03:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:03:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0b12c0fe-3ab8-5445-ad6b-256ccebc3b9e/0b12c0fe-3ab8-5445-ad6b-256ccebc3b9e_image_7.jpg HTTP/1.1" 201 0
2026-03-28 14:03:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLR11XWM%252F697880683%252F600') HTTP/1.1" 204 0
2026-03-28 14:03:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LR11XWM/697880683/600 saved to cache
2026-03-28 14:03:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 0b12c0fe-3ab8-5445-ad6b-256ccebc3b9e
2026-03-28 14:03:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:03:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a1fd735d0>
2026-03-28 14:03:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:03:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:03:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:03:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_567b324e-2678-5f7b-ae48-9d6f040ce03b/567b324e-2678-5f7b-ae48-9d6f040ce03b_image_0.jpg HTTP/1.1" 201 0
2026-03-28 14:03:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FFY18CYT%252F698798445%252F600') HTTP/1.1" 204 0
2026-03-28 14:03:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FY18CYT/698798445/600 saved to cache
2026-03-28 14:03:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 567b324e-2678-5f7b-ae48-9d6f040ce03b
2026-03-28 14:03:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:03:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c3a9d90>
2026-03-28 14:03:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:03:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:03:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:03:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c697e335-b937-5194-8aed-71297a871cbe/c697e335-b937-5194-8aed-71297a871cbe_image_2.jpg HTTP/1.1" 201 0
2026-03-28 14:03:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FMJ62HDO%252F697888265%252F600') HTTP/1.1" 204 0
2026-03-28 14:03:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MJ62HDO/697888265/600 saved to cache
2026-03-28 14:03:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item c697e335-b937-5194-8aed-71297a871cbe
2026-03-28 14:03:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:03:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c5349d0>
2026-03-28 14:03:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:03:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:03:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:03:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c697e335-b937-5194-8aed-71297a871cbe/c697e335-b937-5194-8aed-71297a871cbe_image_3.jpg HTTP/1.1" 201 0
2026-03-28 14:03:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FMJ62HDO%252F697888270%252F600') HTTP/1.1" 204 0
2026-03-28 14:03:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MJ62HDO/697888270/600 saved to cache
2026-03-28 14:03:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item c697e335-b937-5194-8aed-71297a871cbe
2026-03-28 14:03:08 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FY18CYT/698798493/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698798493>
2026-03-28 14:03:08 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GJ69TMO/698438550/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698438550>
2026-03-28 14:03:08 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GF64UPV/698015341/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698015341>
2026-03-28 14:03:08 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GV16HBD/698104870/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698104870>
2026-03-28 14:03:08 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PJ59WXK/698424523/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=PJ59WXK-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-28 14:03:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698672325%27 HTTP/1.1" 200 None
2026-03-28 14:03:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698672325 not downloaded yet
2026-03-28 14:03:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698568428%27 HTTP/1.1" 200 None
2026-03-28 14:03:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698568428 not downloaded yet
2026-03-28 14:03:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GF64UPV/698015321/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/GF64UPV/42810175?sv=2020-08-04&st=2026-03-28T14%3A03%3A03Z&se=2026-03-28T14%3A28%3A03Z&sr=b&sp=r&sig=V6hyON%2BJA3aCP72Z85NeT3V3LO92YkUY%2FTF4afm%2Fwq0%3D)
2026-03-28 14:03:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698424537%27 HTTP/1.1" 200 None
2026-03-28 14:03:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698424537 not downloaded yet
2026-03-28 14:03:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MJ62HDO/697888310/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/MJ62HDO/42810342?sv=2020-08-04&st=2026-03-28T14%3A03%3A03Z&se=2026-03-28T14%3A28%3A03Z&sr=b&sp=r&sig=4HxRLcY572xInqDRczi5%2F9rPsO%2Fy115VX0mOcX57FiI%3D)
2026-03-28 14:03:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698672337%27 HTTP/1.1" 200 None
2026-03-28 14:03:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698672337 not downloaded yet
2026-03-28 14:03:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698568447%27 HTTP/1.1" 200 None
2026-03-28 14:03:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698568447 not downloaded yet
2026-03-28 14:03:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:03:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a1fd17250>
2026-03-28 14:03:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:03:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:03:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:03:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c697e335-b937-5194-8aed-71297a871cbe/c697e335-b937-5194-8aed-71297a871cbe_image_5.jpg HTTP/1.1" 201 0
2026-03-28 14:03:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FMJ62HDO%252F697888277%252F600') HTTP/1.1" 204 0
2026-03-28 14:03:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MJ62HDO/697888277/600 saved to cache
2026-03-28 14:03:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item c697e335-b937-5194-8aed-71297a871cbe
2026-03-28 14:03:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:03:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a1fedf590>
2026-03-28 14:03:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:03:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:03:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:03:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0c77c9a7-bec0-528f-95be-edf653516a09/0c77c9a7-bec0-528f-95be-edf653516a09_image_0.jpg HTTP/1.1" 201 0
2026-03-28 14:03:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FGV16HBD%252F698104806%252F600') HTTP/1.1" 204 0
2026-03-28 14:03:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GV16HBD/698104806/600 saved to cache
2026-03-28 14:03:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 0c77c9a7-bec0-528f-95be-edf653516a09
2026-03-28 14:03:08 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:03:08 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:03:08 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:03:08 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:03:08 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:03:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:03:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c3d1d50>
2026-03-28 14:03:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:03:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:03:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:03:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c697e335-b937-5194-8aed-71297a871cbe/c697e335-b937-5194-8aed-71297a871cbe_image_6.jpg HTTP/1.1" 201 0
2026-03-28 14:03:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FMJ62HDO%252F697888285%252F600') HTTP/1.1" 204 0
2026-03-28 14:03:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MJ62HDO/697888285/600 saved to cache
2026-03-28 14:03:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item c697e335-b937-5194-8aed-71297a871cbe
2026-03-28 14:03:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GJ69TMO/698438530/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/GJ69TMO/42810317?sv=2020-08-04&st=2026-03-28T14%3A03%3A03Z&se=2026-03-28T14%3A28%3A03Z&sr=b&sp=r&sig=fxrA47lDZk3kHA1qwB8WBSU128g%2FFzPfbU3cJO1Sguw%3D)
2026-03-28 14:03:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698424539%27 HTTP/1.1" 200 None
2026-03-28 14:03:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698424539 not downloaded yet
2026-03-28 14:03:08 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PJ59WXK/698424528/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698424528>
2026-03-28 14:03:08 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RA16HNC/698672283/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=RA16HNC-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-28 14:03:08 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GF64UPV/698015357/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698015357>
2026-03-28 14:03:08 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GF23LJX/698568359/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=GF23LJX-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-28 14:03:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GF64UPV/698015333/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/GF64UPV/42810175?sv=2020-08-04&st=2026-03-28T14%3A03%3A03Z&se=2026-03-28T14%3A28%3A03Z&sr=b&sp=r&sig=V6hyON%2BJA3aCP72Z85NeT3V3LO92YkUY%2FTF4afm%2Fwq0%3D)
2026-03-28 14:03:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698672344%27 HTTP/1.1" 200 None
2026-03-28 14:03:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698672344 not downloaded yet
2026-03-28 14:03:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698568475%27 HTTP/1.1" 200 None
2026-03-28 14:03:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698568475 not downloaded yet
2026-03-28 14:03:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698424542%27 HTTP/1.1" 200 None
2026-03-28 14:03:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698424542 not downloaded yet
2026-03-28 14:03:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:03:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2d674d90>
2026-03-28 14:03:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:03:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:03:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:03:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_68af04a9-eec4-52ae-b536-68c72f8fddc4/68af04a9-eec4-52ae-b536-68c72f8fddc4_image_1.jpg HTTP/1.1" 201 0
2026-03-28 14:03:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FGF64UPV%252F698015321%252F600') HTTP/1.1" 204 0
2026-03-28 14:03:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GF64UPV/698015321/600 saved to cache
2026-03-28 14:03:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 68af04a9-eec4-52ae-b536-68c72f8fddc4
2026-03-28 14:03:08 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:03:08 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:03:08 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:03:08 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:03:08 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:03:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:03:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2da1c690>
2026-03-28 14:03:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:03:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:03:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:03:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c697e335-b937-5194-8aed-71297a871cbe/c697e335-b937-5194-8aed-71297a871cbe_image_9.jpg HTTP/1.1" 201 0
2026-03-28 14:03:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FMJ62HDO%252F697888310%252F600') HTTP/1.1" 204 0
2026-03-28 14:03:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MJ62HDO/697888310/600 saved to cache
2026-03-28 14:03:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item c697e335-b937-5194-8aed-71297a871cbe
2026-03-28 14:03:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GF64UPV/698015337/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/GF64UPV/42810175?sv=2020-08-04&st=2026-03-28T14%3A03%3A03Z&se=2026-03-28T14%3A28%3A03Z&sr=b&sp=r&sig=V6hyON%2BJA3aCP72Z85NeT3V3LO92YkUY%2FTF4afm%2Fwq0%3D)
2026-03-28 14:03:08 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PJ59WXK/698424530/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698424530>
2026-03-28 14:03:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698672357%27 HTTP/1.1" 200 None
2026-03-28 14:03:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698672357 not downloaded yet
2026-03-28 14:03:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698568523%27 HTTP/1.1" 200 None
2026-03-28 14:03:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698568523 not downloaded yet
2026-03-28 14:03:08 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PJ59WXK/698424531/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698424531>
2026-03-28 14:03:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698424545%27 HTTP/1.1" 200 None
2026-03-28 14:03:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698424545 not downloaded yet
2026-03-28 14:03:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698672371%27 HTTP/1.1" 200 None
2026-03-28 14:03:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698672371 not downloaded yet
2026-03-28 14:03:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698568566%27 HTTP/1.1" 200 None
2026-03-28 14:03:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698568566 not downloaded yet
2026-03-28 14:03:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:03:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2d677090>
2026-03-28 14:03:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:03:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:03:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:03:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bf5f6c66-7fca-54d7-9dbf-87d60cf357d5/bf5f6c66-7fca-54d7-9dbf-87d60cf357d5_image_1.jpg HTTP/1.1" 201 0
2026-03-28 14:03:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FGJ69TMO%252F698438530%252F600') HTTP/1.1" 204 0
2026-03-28 14:03:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GJ69TMO/698438530/600 saved to cache
2026-03-28 14:03:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item bf5f6c66-7fca-54d7-9dbf-87d60cf357d5
2026-03-28 14:03:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:03:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2d687850>
2026-03-28 14:03:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:03:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:03:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:03:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_68af04a9-eec4-52ae-b536-68c72f8fddc4/68af04a9-eec4-52ae-b536-68c72f8fddc4_image_3.jpg HTTP/1.1" 201 0
2026-03-28 14:03:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FGF64UPV%252F698015333%252F600') HTTP/1.1" 204 0
2026-03-28 14:03:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GF64UPV/698015333/600 saved to cache
2026-03-28 14:03:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 68af04a9-eec4-52ae-b536-68c72f8fddc4
2026-03-28 14:03:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PJ59WXK/698424523/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/PJ59WXK/42810349?sv=2020-08-04&st=2026-03-28T14%3A03%3A05Z&se=2026-03-28T14%3A28%3A05Z&sr=b&sp=r&sig=0pccUvvw8%2BiwcPxhRDvXDf%2FNBfxQSCx3DA%2F5VSxsghU%3D)
2026-03-28 14:03:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GF64UPV/698015341/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/GF64UPV/42810175?sv=2020-08-04&st=2026-03-28T14%3A03%3A03Z&se=2026-03-28T14%3A28%3A03Z&sr=b&sp=r&sig=V6hyON%2BJA3aCP72Z85NeT3V3LO92YkUY%2FTF4afm%2Fwq0%3D)
2026-03-28 14:03:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GJ69TMO/698438550/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/GJ69TMO/42810317?sv=2020-08-04&st=2026-03-28T14%3A03%3A03Z&se=2026-03-28T14%3A28%3A03Z&sr=b&sp=r&sig=fxrA47lDZk3kHA1qwB8WBSU128g%2FFzPfbU3cJO1Sguw%3D)
2026-03-28 14:03:08 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RA16HNC/698672325/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698672325>
2026-03-28 14:03:08 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GF23LJX/698568428/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698568428>
2026-03-28 14:03:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GV16HBD/698104870/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/GV16HBD/42810313?sv=2020-08-04&st=2026-03-28T14%3A03%3A03Z&se=2026-03-28T14%3A28%3A03Z&sr=b&sp=r&sig=SZmUcBFQV93Ysin5HYH9TjRzwnjRVw7MvOMG44PxqsY%3D)
2026-03-28 14:03:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698672384%27 HTTP/1.1" 200 None
2026-03-28 14:03:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698672384 not downloaded yet
2026-03-28 14:03:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698568599%27 HTTP/1.1" 200 None
2026-03-28 14:03:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698568599 not downloaded yet
2026-03-28 14:03:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FY18CYT/698798493/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/FY18CYT/42807957?sv=2020-08-04&st=2026-03-28T14%3A03%3A03Z&se=2026-03-28T14%3A28%3A03Z&sr=b&sp=r&sig=0X%2BGj0JbBf9U6KFOnmd0j0L8zgSNFs5MvLcdVjVSGWA%3D)
2026-03-28 14:03:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:03:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2ec93ed0>
2026-03-28 14:03:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:03:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:03:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:03:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_68af04a9-eec4-52ae-b536-68c72f8fddc4/68af04a9-eec4-52ae-b536-68c72f8fddc4_image_4.jpg HTTP/1.1" 201 0
2026-03-28 14:03:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FGF64UPV%252F698015337%252F600') HTTP/1.1" 204 0
2026-03-28 14:03:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GF64UPV/698015337/600 saved to cache
2026-03-28 14:03:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 68af04a9-eec4-52ae-b536-68c72f8fddc4
2026-03-28 14:03:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GF23LJX/698568359/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/GF23LJX/42810323?sv=2020-08-04&st=2026-03-28T14%3A03%3A06Z&se=2026-03-28T14%3A28%3A06Z&sr=b&sp=r&sig=%2Bdy17hHkwj66nlfWTlsIK4h%2BkQbwO199F4yfh3pb5Uc%3D)
2026-03-28 14:03:08 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PJ59WXK/698424537/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698424537>
2026-03-28 14:03:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698672410%27 HTTP/1.1" 200 None
2026-03-28 14:03:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698672410 not downloaded yet
2026-03-28 14:03:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698568631%27 HTTP/1.1" 200 None
2026-03-28 14:03:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698568631 not downloaded yet
2026-03-28 14:03:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GF64UPV/698015357/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/GF64UPV/42810175?sv=2020-08-04&st=2026-03-28T14%3A03%3A03Z&se=2026-03-28T14%3A28%3A03Z&sr=b&sp=r&sig=V6hyON%2BJA3aCP72Z85NeT3V3LO92YkUY%2FTF4afm%2Fwq0%3D)
2026-03-28 14:03:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:03:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c38ed50>
2026-03-28 14:03:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:03:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:03:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:03:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b90da0a6-3ad2-591a-8a5c-936884592342/b90da0a6-3ad2-591a-8a5c-936884592342_image_0.jpg HTTP/1.1" 201 0
2026-03-28 14:03:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FPJ59WXK%252F698424523%252F600') HTTP/1.1" 204 0
2026-03-28 14:03:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PJ59WXK/698424523/600 saved to cache
2026-03-28 14:03:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item b90da0a6-3ad2-591a-8a5c-936884592342
2026-03-28 14:03:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:03:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c504dd0>
2026-03-28 14:03:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:03:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:03:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:03:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_68af04a9-eec4-52ae-b536-68c72f8fddc4/68af04a9-eec4-52ae-b536-68c72f8fddc4_image_5.jpg HTTP/1.1" 201 0
2026-03-28 14:03:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FGF64UPV%252F698015341%252F600') HTTP/1.1" 204 0
2026-03-28 14:03:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GF64UPV/698015341/600 saved to cache
2026-03-28 14:03:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 68af04a9-eec4-52ae-b536-68c72f8fddc4
2026-03-28 14:03:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:03:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a1fec6a50>
2026-03-28 14:03:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:03:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:03:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:03:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bf5f6c66-7fca-54d7-9dbf-87d60cf357d5/bf5f6c66-7fca-54d7-9dbf-87d60cf357d5_image_5.jpg HTTP/1.1" 201 0
2026-03-28 14:03:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FGJ69TMO%252F698438550%252F600') HTTP/1.1" 204 0
2026-03-28 14:03:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GJ69TMO/698438550/600 saved to cache
2026-03-28 14:03:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item bf5f6c66-7fca-54d7-9dbf-87d60cf357d5
2026-03-28 14:03:09 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:03:09 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:03:09 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:03:09 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:03:09 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:03:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:03:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c5061d0>
2026-03-28 14:03:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:03:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:03:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:03:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0c77c9a7-bec0-528f-95be-edf653516a09/0c77c9a7-bec0-528f-95be-edf653516a09_image_6.jpg HTTP/1.1" 201 0
2026-03-28 14:03:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FGV16HBD%252F698104870%252F600') HTTP/1.1" 204 0
2026-03-28 14:03:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GV16HBD/698104870/600 saved to cache
2026-03-28 14:03:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 0c77c9a7-bec0-528f-95be-edf653516a09
2026-03-28 14:03:09 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:03:09 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:03:09 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:03:09 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:03:09 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:03:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:03:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c505a50>
2026-03-28 14:03:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:03:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:03:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:03:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_567b324e-2678-5f7b-ae48-9d6f040ce03b/567b324e-2678-5f7b-ae48-9d6f040ce03b_image_6.jpg HTTP/1.1" 201 0
2026-03-28 14:03:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FFY18CYT%252F698798493%252F600') HTTP/1.1" 204 0
2026-03-28 14:03:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FY18CYT/698798493/600 saved to cache
2026-03-28 14:03:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 567b324e-2678-5f7b-ae48-9d6f040ce03b
2026-03-28 14:03:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RA16HNC/698672283/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/RA16HNC/42810198?sv=2020-08-04&st=2026-03-28T14%3A03%3A06Z&se=2026-03-28T14%3A28%3A06Z&sr=b&sp=r&sig=LyYhM1EeBZuNgXZHNNjYE6jfdnZISItgtYhC%2Fw8yiFg%3D)
2026-03-28 14:03:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PJ59WXK/698424528/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/PJ59WXK/42810349?sv=2020-08-04&st=2026-03-28T14%3A03%3A05Z&se=2026-03-28T14%3A28%3A05Z&sr=b&sp=r&sig=0pccUvvw8%2BiwcPxhRDvXDf%2FNBfxQSCx3DA%2F5VSxsghU%3D)
2026-03-28 14:03:09 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PJ59WXK/698424539/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698424539>
2026-03-28 14:03:09 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GF23LJX/698568475/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698568475>
2026-03-28 14:03:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PJ59WXK/698424530/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/PJ59WXK/42810349?sv=2020-08-04&st=2026-03-28T14%3A03%3A05Z&se=2026-03-28T14%3A28%3A05Z&sr=b&sp=r&sig=0pccUvvw8%2BiwcPxhRDvXDf%2FNBfxQSCx3DA%2F5VSxsghU%3D)
2026-03-28 14:03:09 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PJ59WXK/698424545/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698424545>
2026-03-28 14:03:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PJ59WXK/698424531/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/PJ59WXK/42810349?sv=2020-08-04&st=2026-03-28T14%3A03%3A05Z&se=2026-03-28T14%3A28%3A05Z&sr=b&sp=r&sig=0pccUvvw8%2BiwcPxhRDvXDf%2FNBfxQSCx3DA%2F5VSxsghU%3D)
2026-03-28 14:03:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:03:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c505010>
2026-03-28 14:03:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:03:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:03:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:03:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e2169724-1950-5652-92b2-0f3da8b4bfbb/e2169724-1950-5652-92b2-0f3da8b4bfbb_image_0.jpg HTTP/1.1" 201 0
2026-03-28 14:03:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FGF23LJX%252F698568359%252F600') HTTP/1.1" 204 0
2026-03-28 14:03:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GF23LJX/698568359/600 saved to cache
2026-03-28 14:03:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item e2169724-1950-5652-92b2-0f3da8b4bfbb
2026-03-28 14:03:09 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:03:09 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:03:09 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:03:09 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:03:09 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:03:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:03:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c3a1e50>
2026-03-28 14:03:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:03:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:03:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:03:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_68af04a9-eec4-52ae-b536-68c72f8fddc4/68af04a9-eec4-52ae-b536-68c72f8fddc4_image_7.jpg HTTP/1.1" 201 0
2026-03-28 14:03:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FGF64UPV%252F698015357%252F600') HTTP/1.1" 204 0
2026-03-28 14:03:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GF64UPV/698015357/600 saved to cache
2026-03-28 14:03:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 68af04a9-eec4-52ae-b536-68c72f8fddc4
2026-03-28 14:03:09 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GF23LJX/698568523/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698568523>
2026-03-28 14:03:09 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GF23LJX/698568599/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698568599>
2026-03-28 14:03:09 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RA16HNC/698672371/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698672371>
2026-03-28 14:03:09 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GF23LJX/698568566/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698568566>
2026-03-28 14:03:09 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RA16HNC/698672357/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698672357>
2026-03-28 14:03:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PJ59WXK/698424537/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/PJ59WXK/42810349?sv=2020-08-04&st=2026-03-28T14%3A03%3A05Z&se=2026-03-28T14%3A28%3A05Z&sr=b&sp=r&sig=0pccUvvw8%2BiwcPxhRDvXDf%2FNBfxQSCx3DA%2F5VSxsghU%3D)
2026-03-28 14:03:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RA16HNC/698672325/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/RA16HNC/42810198?sv=2020-08-04&st=2026-03-28T14%3A03%3A06Z&se=2026-03-28T14%3A28%3A06Z&sr=b&sp=r&sig=LyYhM1EeBZuNgXZHNNjYE6jfdnZISItgtYhC%2Fw8yiFg%3D)
2026-03-28 14:03:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:03:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2d6ac210>
2026-03-28 14:03:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:03:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:03:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:03:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a241d4e5-9ba8-591a-8b8d-858d5e5adfe4/a241d4e5-9ba8-591a-8b8d-858d5e5adfe4_image_0.jpg HTTP/1.1" 201 0
2026-03-28 14:03:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FRA16HNC%252F698672283%252F600') HTTP/1.1" 204 0
2026-03-28 14:03:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RA16HNC/698672283/600 saved to cache
2026-03-28 14:03:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item a241d4e5-9ba8-591a-8b8d-858d5e5adfe4
2026-03-28 14:03:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:03:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2d97b390>
2026-03-28 14:03:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:03:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:03:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:03:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b90da0a6-3ad2-591a-8a5c-936884592342/b90da0a6-3ad2-591a-8a5c-936884592342_image_2.jpg HTTP/1.1" 201 0
2026-03-28 14:03:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FPJ59WXK%252F698424528%252F600') HTTP/1.1" 204 0
2026-03-28 14:03:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PJ59WXK/698424528/600 saved to cache
2026-03-28 14:03:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item b90da0a6-3ad2-591a-8a5c-936884592342
2026-03-28 14:03:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GF23LJX/698568428/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/GF23LJX/42810323?sv=2020-08-04&st=2026-03-28T14%3A03%3A06Z&se=2026-03-28T14%3A28%3A06Z&sr=b&sp=r&sig=%2Bdy17hHkwj66nlfWTlsIK4h%2BkQbwO199F4yfh3pb5Uc%3D)
2026-03-28 14:03:09 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GF23LJX/698568631/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698568631>
2026-03-28 14:03:09 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RA16HNC/698672410/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698672410>
2026-03-28 14:03:09 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RA16HNC/698672384/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698672384>
2026-03-28 14:03:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GF23LJX/698568475/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/GF23LJX/42810323?sv=2020-08-04&st=2026-03-28T14%3A03%3A06Z&se=2026-03-28T14%3A28%3A06Z&sr=b&sp=r&sig=%2Bdy17hHkwj66nlfWTlsIK4h%2BkQbwO199F4yfh3pb5Uc%3D)
2026-03-28 14:03:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:03:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c586090>
2026-03-28 14:03:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:03:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:03:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:03:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b90da0a6-3ad2-591a-8a5c-936884592342/b90da0a6-3ad2-591a-8a5c-936884592342_image_3.jpg HTTP/1.1" 201 0
2026-03-28 14:03:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FPJ59WXK%252F698424530%252F600') HTTP/1.1" 204 0
2026-03-28 14:03:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PJ59WXK/698424530/600 saved to cache
2026-03-28 14:03:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item b90da0a6-3ad2-591a-8a5c-936884592342
2026-03-28 14:03:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PJ59WXK/698424539/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/PJ59WXK/42810349?sv=2020-08-04&st=2026-03-28T14%3A03%3A05Z&se=2026-03-28T14%3A28%3A05Z&sr=b&sp=r&sig=0pccUvvw8%2BiwcPxhRDvXDf%2FNBfxQSCx3DA%2F5VSxsghU%3D)
2026-03-28 14:03:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PJ59WXK/698424545/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/PJ59WXK/42810349?sv=2020-08-04&st=2026-03-28T14%3A03%3A05Z&se=2026-03-28T14%3A28%3A05Z&sr=b&sp=r&sig=0pccUvvw8%2BiwcPxhRDvXDf%2FNBfxQSCx3DA%2F5VSxsghU%3D)
2026-03-28 14:03:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:03:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c172150>
2026-03-28 14:03:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:03:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:03:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:03:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b90da0a6-3ad2-591a-8a5c-936884592342/b90da0a6-3ad2-591a-8a5c-936884592342_image_4.jpg HTTP/1.1" 201 0
2026-03-28 14:03:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FPJ59WXK%252F698424531%252F600') HTTP/1.1" 204 0
2026-03-28 14:03:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PJ59WXK/698424531/600 saved to cache
2026-03-28 14:03:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item b90da0a6-3ad2-591a-8a5c-936884592342
2026-03-28 14:03:09 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PJ59WXK/698424542/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698424542>
2026-03-28 14:03:09 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:03:09 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:03:09 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:03:09 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:03:09 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:03:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:03:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a305dc190>
2026-03-28 14:03:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:03:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:03:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:03:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b90da0a6-3ad2-591a-8a5c-936884592342/b90da0a6-3ad2-591a-8a5c-936884592342_image_6.jpg HTTP/1.1" 201 0
2026-03-28 14:03:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FPJ59WXK%252F698424537%252F600') HTTP/1.1" 204 0
2026-03-28 14:03:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PJ59WXK/698424537/600 saved to cache
2026-03-28 14:03:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item b90da0a6-3ad2-591a-8a5c-936884592342
2026-03-28 14:03:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:03:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2d6ae9d0>
2026-03-28 14:03:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:03:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:03:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:03:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a241d4e5-9ba8-591a-8b8d-858d5e5adfe4/a241d4e5-9ba8-591a-8b8d-858d5e5adfe4_image_3.jpg HTTP/1.1" 201 0
2026-03-28 14:03:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FRA16HNC%252F698672325%252F600') HTTP/1.1" 204 0
2026-03-28 14:03:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RA16HNC/698672325/600 saved to cache
2026-03-28 14:03:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item a241d4e5-9ba8-591a-8b8d-858d5e5adfe4
2026-03-28 14:03:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RA16HNC/698672371/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/RA16HNC/42810198?sv=2020-08-04&st=2026-03-28T14%3A03%3A06Z&se=2026-03-28T14%3A28%3A06Z&sr=b&sp=r&sig=LyYhM1EeBZuNgXZHNNjYE6jfdnZISItgtYhC%2Fw8yiFg%3D)
2026-03-28 14:03:09 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RA16HNC/698672344/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698672344>
2026-03-28 14:03:09 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GF23LJX/698568447/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698568447>
2026-03-28 14:03:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GF23LJX/698568599/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/GF23LJX/42810323?sv=2020-08-04&st=2026-03-28T14%3A03%3A06Z&se=2026-03-28T14%3A28%3A06Z&sr=b&sp=r&sig=%2Bdy17hHkwj66nlfWTlsIK4h%2BkQbwO199F4yfh3pb5Uc%3D)
2026-03-28 14:03:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RA16HNC/698672357/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/RA16HNC/42810198?sv=2020-08-04&st=2026-03-28T14%3A03%3A06Z&se=2026-03-28T14%3A28%3A06Z&sr=b&sp=r&sig=LyYhM1EeBZuNgXZHNNjYE6jfdnZISItgtYhC%2Fw8yiFg%3D)
2026-03-28 14:03:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:03:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c585590>
2026-03-28 14:03:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:03:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:03:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:03:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e2169724-1950-5652-92b2-0f3da8b4bfbb/e2169724-1950-5652-92b2-0f3da8b4bfbb_image_3.jpg HTTP/1.1" 201 0
2026-03-28 14:03:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FGF23LJX%252F698568428%252F600') HTTP/1.1" 204 0
2026-03-28 14:03:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GF23LJX/698568428/600 saved to cache
2026-03-28 14:03:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item e2169724-1950-5652-92b2-0f3da8b4bfbb
2026-03-28 14:03:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:03:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c6c5e90>
2026-03-28 14:03:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:03:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:03:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:03:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e2169724-1950-5652-92b2-0f3da8b4bfbb/e2169724-1950-5652-92b2-0f3da8b4bfbb_image_5.jpg HTTP/1.1" 201 0
2026-03-28 14:03:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FGF23LJX%252F698568475%252F600') HTTP/1.1" 204 0
2026-03-28 14:03:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GF23LJX/698568475/600 saved to cache
2026-03-28 14:03:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item e2169724-1950-5652-92b2-0f3da8b4bfbb
2026-03-28 14:03:10 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:03:10 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:03:10 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:03:10 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:03:10 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:03:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:03:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c64d710>
2026-03-28 14:03:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:03:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:03:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:03:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b90da0a6-3ad2-591a-8a5c-936884592342/b90da0a6-3ad2-591a-8a5c-936884592342_image_7.jpg HTTP/1.1" 201 0
2026-03-28 14:03:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FPJ59WXK%252F698424539%252F600') HTTP/1.1" 204 0
2026-03-28 14:03:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PJ59WXK/698424539/600 saved to cache
2026-03-28 14:03:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item b90da0a6-3ad2-591a-8a5c-936884592342
2026-03-28 14:03:10 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:03:10 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:03:10 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:03:10 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:03:10 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:03:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:03:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2d9f02d0>
2026-03-28 14:03:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:03:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:03:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:03:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b90da0a6-3ad2-591a-8a5c-936884592342/b90da0a6-3ad2-591a-8a5c-936884592342_image_9.jpg HTTP/1.1" 201 0
2026-03-28 14:03:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FPJ59WXK%252F698424545%252F600') HTTP/1.1" 204 0
2026-03-28 14:03:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PJ59WXK/698424545/600 saved to cache
2026-03-28 14:03:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item b90da0a6-3ad2-591a-8a5c-936884592342
2026-03-28 14:03:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GF23LJX/698568566/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/GF23LJX/42810323?sv=2020-08-04&st=2026-03-28T14%3A03%3A06Z&se=2026-03-28T14%3A28%3A06Z&sr=b&sp=r&sig=%2Bdy17hHkwj66nlfWTlsIK4h%2BkQbwO199F4yfh3pb5Uc%3D)
2026-03-28 14:03:10 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RA16HNC/698672337/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698672337>
2026-03-28 14:03:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GF23LJX/698568523/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/GF23LJX/42810323?sv=2020-08-04&st=2026-03-28T14%3A03%3A06Z&se=2026-03-28T14%3A28%3A06Z&sr=b&sp=r&sig=%2Bdy17hHkwj66nlfWTlsIK4h%2BkQbwO199F4yfh3pb5Uc%3D)
2026-03-28 14:03:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RA16HNC/698672384/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/RA16HNC/42810198?sv=2020-08-04&st=2026-03-28T14%3A03%3A06Z&se=2026-03-28T14%3A28%3A06Z&sr=b&sp=r&sig=LyYhM1EeBZuNgXZHNNjYE6jfdnZISItgtYhC%2Fw8yiFg%3D)
2026-03-28 14:03:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GF23LJX/698568631/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/GF23LJX/42810323?sv=2020-08-04&st=2026-03-28T14%3A03%3A06Z&se=2026-03-28T14%3A28%3A06Z&sr=b&sp=r&sig=%2Bdy17hHkwj66nlfWTlsIK4h%2BkQbwO199F4yfh3pb5Uc%3D)
2026-03-28 14:03:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RA16HNC/698672410/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/RA16HNC/42810198?sv=2020-08-04&st=2026-03-28T14%3A03%3A06Z&se=2026-03-28T14%3A28%3A06Z&sr=b&sp=r&sig=LyYhM1EeBZuNgXZHNNjYE6jfdnZISItgtYhC%2Fw8yiFg%3D)
2026-03-28 14:03:10 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:03:10 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:03:10 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:03:10 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:03:10 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:03:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:03:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2d9f0c90>
2026-03-28 14:03:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:03:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:03:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:03:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a241d4e5-9ba8-591a-8b8d-858d5e5adfe4/a241d4e5-9ba8-591a-8b8d-858d5e5adfe4_image_7.jpg HTTP/1.1" 201 0
2026-03-28 14:03:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FRA16HNC%252F698672371%252F600') HTTP/1.1" 204 0
2026-03-28 14:03:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RA16HNC/698672371/600 saved to cache
2026-03-28 14:03:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item a241d4e5-9ba8-591a-8b8d-858d5e5adfe4
2026-03-28 14:03:10 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:03:10 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:03:10 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:03:10 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:03:10 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:03:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:03:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a1ff15310>
2026-03-28 14:03:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:03:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:03:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:03:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e2169724-1950-5652-92b2-0f3da8b4bfbb/e2169724-1950-5652-92b2-0f3da8b4bfbb_image_8.jpg HTTP/1.1" 201 0
2026-03-28 14:03:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FGF23LJX%252F698568599%252F600') HTTP/1.1" 204 0
2026-03-28 14:03:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GF23LJX/698568599/600 saved to cache
2026-03-28 14:03:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item e2169724-1950-5652-92b2-0f3da8b4bfbb
2026-03-28 14:03:10 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:03:10 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:03:10 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:03:10 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:03:10 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:03:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:03:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c659f10>
2026-03-28 14:03:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:03:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:03:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:03:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a241d4e5-9ba8-591a-8b8d-858d5e5adfe4/a241d4e5-9ba8-591a-8b8d-858d5e5adfe4_image_6.jpg HTTP/1.1" 201 0
2026-03-28 14:03:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FRA16HNC%252F698672357%252F600') HTTP/1.1" 204 0
2026-03-28 14:03:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RA16HNC/698672357/600 saved to cache
2026-03-28 14:03:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item a241d4e5-9ba8-591a-8b8d-858d5e5adfe4
2026-03-28 14:03:10 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PJ59WXK/698424533/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698424533>
2026-03-28 14:03:10 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GF23LJX/698568403/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698568403>
2026-03-28 14:03:10 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RA16HNC/698672313/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698672313>
2026-03-28 14:03:10 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GF64UPV/698015380/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698015380>
2026-03-28 14:03:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PJ59WXK/698424542/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/PJ59WXK/42810349?sv=2020-08-04&st=2026-03-28T14%3A03%3A05Z&se=2026-03-28T14%3A28%3A05Z&sr=b&sp=r&sig=0pccUvvw8%2BiwcPxhRDvXDf%2FNBfxQSCx3DA%2F5VSxsghU%3D)
2026-03-28 14:03:10 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:03:10 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:03:10 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:03:10 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:03:10 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:03:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:03:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c993d90>
2026-03-28 14:03:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:03:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:03:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:03:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e2169724-1950-5652-92b2-0f3da8b4bfbb/e2169724-1950-5652-92b2-0f3da8b4bfbb_image_7.jpg HTTP/1.1" 201 0
2026-03-28 14:03:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FGF23LJX%252F698568566%252F600') HTTP/1.1" 204 0
2026-03-28 14:03:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GF23LJX/698568566/600 saved to cache
2026-03-28 14:03:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item e2169724-1950-5652-92b2-0f3da8b4bfbb
2026-03-28 14:03:10 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:03:10 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:03:10 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:03:10 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:03:10 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:03:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:03:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2de54c50>
2026-03-28 14:03:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:03:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:03:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:03:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e2169724-1950-5652-92b2-0f3da8b4bfbb/e2169724-1950-5652-92b2-0f3da8b4bfbb_image_6.jpg HTTP/1.1" 201 0
2026-03-28 14:03:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FGF23LJX%252F698568523%252F600') HTTP/1.1" 204 0
2026-03-28 14:03:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GF23LJX/698568523/600 saved to cache
2026-03-28 14:03:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item e2169724-1950-5652-92b2-0f3da8b4bfbb
2026-03-28 14:03:10 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:03:10 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:03:10 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:03:10 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:03:10 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:03:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:03:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a1ff2e050>
2026-03-28 14:03:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:03:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:03:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:03:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a241d4e5-9ba8-591a-8b8d-858d5e5adfe4/a241d4e5-9ba8-591a-8b8d-858d5e5adfe4_image_8.jpg HTTP/1.1" 201 0
2026-03-28 14:03:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FRA16HNC%252F698672384%252F600') HTTP/1.1" 204 0
2026-03-28 14:03:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RA16HNC/698672384/600 saved to cache
2026-03-28 14:03:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item a241d4e5-9ba8-591a-8b8d-858d5e5adfe4
2026-03-28 14:03:10 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:03:10 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:03:10 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:03:10 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:03:10 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:03:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:03:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2d692410>
2026-03-28 14:03:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:03:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:03:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:03:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e2169724-1950-5652-92b2-0f3da8b4bfbb/e2169724-1950-5652-92b2-0f3da8b4bfbb_image_9.jpg HTTP/1.1" 201 0
2026-03-28 14:03:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FGF23LJX%252F698568631%252F600') HTTP/1.1" 204 0
2026-03-28 14:03:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GF23LJX/698568631/600 saved to cache
2026-03-28 14:03:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item e2169724-1950-5652-92b2-0f3da8b4bfbb
2026-03-28 14:03:10 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:03:10 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:03:10 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:03:10 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:03:10 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:03:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:03:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a1ff2d0d0>
2026-03-28 14:03:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:03:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:03:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:03:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a241d4e5-9ba8-591a-8b8d-858d5e5adfe4/a241d4e5-9ba8-591a-8b8d-858d5e5adfe4_image_9.jpg HTTP/1.1" 201 0
2026-03-28 14:03:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FRA16HNC%252F698672410%252F600') HTTP/1.1" 204 0
2026-03-28 14:03:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RA16HNC/698672410/600 saved to cache
2026-03-28 14:03:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item a241d4e5-9ba8-591a-8b8d-858d5e5adfe4
2026-03-28 14:03:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GF23LJX/698568447/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/GF23LJX/42810323?sv=2020-08-04&st=2026-03-28T14%3A03%3A06Z&se=2026-03-28T14%3A28%3A06Z&sr=b&sp=r&sig=%2Bdy17hHkwj66nlfWTlsIK4h%2BkQbwO199F4yfh3pb5Uc%3D)
2026-03-28 14:03:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RA16HNC/698672344/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/RA16HNC/42810198?sv=2020-08-04&st=2026-03-28T14%3A03%3A06Z&se=2026-03-28T14%3A28%3A06Z&sr=b&sp=r&sig=LyYhM1EeBZuNgXZHNNjYE6jfdnZISItgtYhC%2Fw8yiFg%3D)
2026-03-28 14:03:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RA16HNC/698672337/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/RA16HNC/42810198?sv=2020-08-04&st=2026-03-28T14%3A03%3A06Z&se=2026-03-28T14%3A28%3A06Z&sr=b&sp=r&sig=LyYhM1EeBZuNgXZHNNjYE6jfdnZISItgtYhC%2Fw8yiFg%3D)
2026-03-28 14:03:10 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GJ69TMO/698438567/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698438567>
2026-03-28 14:03:10 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GF23LJX/698568375/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698568375>
2026-03-28 14:03:10 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GF64UPV/698015369/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698015369>
2026-03-28 14:03:10 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RA16HNC/698672300/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698672300>
2026-03-28 14:03:10 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:03:10 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:03:10 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:03:10 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:03:10 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:03:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:03:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2da1ed10>
2026-03-28 14:03:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:03:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:03:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:03:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b90da0a6-3ad2-591a-8a5c-936884592342/b90da0a6-3ad2-591a-8a5c-936884592342_image_8.jpg HTTP/1.1" 201 0
2026-03-28 14:03:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FPJ59WXK%252F698424542%252F600') HTTP/1.1" 204 0
2026-03-28 14:03:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PJ59WXK/698424542/600 saved to cache
2026-03-28 14:03:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item b90da0a6-3ad2-591a-8a5c-936884592342
2026-03-28 14:03:10 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GJ69TMO/698438565/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698438565>
2026-03-28 14:03:10 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GJ69TMO/698438561/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698438561>
2026-03-28 14:03:10 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FY18CYT/698798541/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698798541>
2026-03-28 14:03:10 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GV16HBD/698104923/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698104923>
2026-03-28 14:03:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RA16HNC/698672313/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/RA16HNC/42810198?sv=2020-08-04&st=2026-03-28T14%3A03%3A06Z&se=2026-03-28T14%3A28%3A06Z&sr=b&sp=r&sig=LyYhM1EeBZuNgXZHNNjYE6jfdnZISItgtYhC%2Fw8yiFg%3D)
2026-03-28 14:03:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PJ59WXK/698424533/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/PJ59WXK/42810349?sv=2020-08-04&st=2026-03-28T14%3A03%3A05Z&se=2026-03-28T14%3A28%3A05Z&sr=b&sp=r&sig=0pccUvvw8%2BiwcPxhRDvXDf%2FNBfxQSCx3DA%2F5VSxsghU%3D)
2026-03-28 14:03:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GF23LJX/698568403/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/GF23LJX/42810323?sv=2020-08-04&st=2026-03-28T14%3A03%3A06Z&se=2026-03-28T14%3A28%3A06Z&sr=b&sp=r&sig=%2Bdy17hHkwj66nlfWTlsIK4h%2BkQbwO199F4yfh3pb5Uc%3D)
2026-03-28 14:03:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:03:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2d78d110>
2026-03-28 14:03:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:03:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:03:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:03:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e2169724-1950-5652-92b2-0f3da8b4bfbb/e2169724-1950-5652-92b2-0f3da8b4bfbb_image_4.jpg HTTP/1.1" 201 0
2026-03-28 14:03:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FGF23LJX%252F698568447%252F600') HTTP/1.1" 204 0
2026-03-28 14:03:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GF23LJX/698568447/600 saved to cache
2026-03-28 14:03:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item e2169724-1950-5652-92b2-0f3da8b4bfbb
2026-03-28 14:03:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RA16HNC/698672300/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/RA16HNC/42810198?sv=2020-08-04&st=2026-03-28T14%3A03%3A06Z&se=2026-03-28T14%3A28%3A06Z&sr=b&sp=r&sig=LyYhM1EeBZuNgXZHNNjYE6jfdnZISItgtYhC%2Fw8yiFg%3D)
2026-03-28 14:03:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GF64UPV/698015380/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/GF64UPV/42810175?sv=2020-08-04&st=2026-03-28T14%3A03%3A03Z&se=2026-03-28T14%3A28%3A03Z&sr=b&sp=r&sig=V6hyON%2BJA3aCP72Z85NeT3V3LO92YkUY%2FTF4afm%2Fwq0%3D)
2026-03-28 14:03:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:03:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2eaea550>
2026-03-28 14:03:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:03:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:03:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:03:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a241d4e5-9ba8-591a-8b8d-858d5e5adfe4/a241d4e5-9ba8-591a-8b8d-858d5e5adfe4_image_5.jpg HTTP/1.1" 201 0
2026-03-28 14:03:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FRA16HNC%252F698672344%252F600') HTTP/1.1" 204 0
2026-03-28 14:03:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RA16HNC/698672344/600 saved to cache
2026-03-28 14:03:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item a241d4e5-9ba8-591a-8b8d-858d5e5adfe4
2026-03-28 14:03:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:03:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c554d10>
2026-03-28 14:03:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:03:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:03:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:03:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a241d4e5-9ba8-591a-8b8d-858d5e5adfe4/a241d4e5-9ba8-591a-8b8d-858d5e5adfe4_image_4.jpg HTTP/1.1" 201 0
2026-03-28 14:03:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FRA16HNC%252F698672337%252F600') HTTP/1.1" 204 0
2026-03-28 14:03:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RA16HNC/698672337/600 saved to cache
2026-03-28 14:03:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item a241d4e5-9ba8-591a-8b8d-858d5e5adfe4
2026-03-28 14:03:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GF64UPV/698015369/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/GF64UPV/42810175?sv=2020-08-04&st=2026-03-28T14%3A03%3A03Z&se=2026-03-28T14%3A28%3A03Z&sr=b&sp=r&sig=V6hyON%2BJA3aCP72Z85NeT3V3LO92YkUY%2FTF4afm%2Fwq0%3D)
2026-03-28 14:03:10 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FY18CYT/698798528/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698798528>
2026-03-28 14:03:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GF23LJX/698568375/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/GF23LJX/42810323?sv=2020-08-04&st=2026-03-28T14%3A03%3A06Z&se=2026-03-28T14%3A28%3A06Z&sr=b&sp=r&sig=%2Bdy17hHkwj66nlfWTlsIK4h%2BkQbwO199F4yfh3pb5Uc%3D)
2026-03-28 14:03:10 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GV16HBD/698104900/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698104900>
2026-03-28 14:03:10 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PJ59WXK/698424526/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698424526>
2026-03-28 14:03:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:03:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2d6ade90>
2026-03-28 14:03:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:03:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:03:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:03:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a241d4e5-9ba8-591a-8b8d-858d5e5adfe4/a241d4e5-9ba8-591a-8b8d-858d5e5adfe4_image_2.jpg HTTP/1.1" 201 0
2026-03-28 14:03:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FRA16HNC%252F698672313%252F600') HTTP/1.1" 204 0
2026-03-28 14:03:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RA16HNC/698672313/600 saved to cache
2026-03-28 14:03:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item a241d4e5-9ba8-591a-8b8d-858d5e5adfe4
2026-03-28 14:03:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:03:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c782710>
2026-03-28 14:03:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:03:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:03:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:03:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b90da0a6-3ad2-591a-8a5c-936884592342/b90da0a6-3ad2-591a-8a5c-936884592342_image_5.jpg HTTP/1.1" 201 0
2026-03-28 14:03:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FPJ59WXK%252F698424533%252F600') HTTP/1.1" 204 0
2026-03-28 14:03:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PJ59WXK/698424533/600 saved to cache
2026-03-28 14:03:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item b90da0a6-3ad2-591a-8a5c-936884592342
2026-03-28 14:03:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:03:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c862e90>
2026-03-28 14:03:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:03:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:03:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:03:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e2169724-1950-5652-92b2-0f3da8b4bfbb/e2169724-1950-5652-92b2-0f3da8b4bfbb_image_2.jpg HTTP/1.1" 201 0
2026-03-28 14:03:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FGF23LJX%252F698568403%252F600') HTTP/1.1" 204 0
2026-03-28 14:03:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GF23LJX/698568403/600 saved to cache
2026-03-28 14:03:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item e2169724-1950-5652-92b2-0f3da8b4bfbb
2026-03-28 14:03:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GJ69TMO/698438567/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/GJ69TMO/42810317?sv=2020-08-04&st=2026-03-28T14%3A03%3A03Z&se=2026-03-28T14%3A28%3A03Z&sr=b&sp=r&sig=fxrA47lDZk3kHA1qwB8WBSU128g%2FFzPfbU3cJO1Sguw%3D)
2026-03-28 14:03:10 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GF64UPV/698015348/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698015348>
2026-03-28 14:03:10 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GJ69TMO/698438559/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698438559>
2026-03-28 14:03:10 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FY18CYT/698798512/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698798512>
2026-03-28 14:03:10 [scrapy.extensions.logstats] INFO: Crawled 97 pages (at 41 pages/min), scraped 101 items (at 42 items/min)
2026-03-28 14:03:10 [scrapy.extensions.memusage] INFO: Peak memory usage is 191MiB
2026-03-28 14:03:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GJ69TMO/698438565/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/GJ69TMO/42810317?sv=2020-08-04&st=2026-03-28T14%3A03%3A03Z&se=2026-03-28T14%3A28%3A03Z&sr=b&sp=r&sig=fxrA47lDZk3kHA1qwB8WBSU128g%2FFzPfbU3cJO1Sguw%3D)
2026-03-28 14:03:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GJ69TMO/698438561/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/GJ69TMO/42810317?sv=2020-08-04&st=2026-03-28T14%3A03%3A03Z&se=2026-03-28T14%3A28%3A03Z&sr=b&sp=r&sig=fxrA47lDZk3kHA1qwB8WBSU128g%2FFzPfbU3cJO1Sguw%3D)
2026-03-28 14:03:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FY18CYT/698798541/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/FY18CYT/42807957?sv=2020-08-04&st=2026-03-28T14%3A03%3A03Z&se=2026-03-28T14%3A28%3A03Z&sr=b&sp=r&sig=0X%2BGj0JbBf9U6KFOnmd0j0L8zgSNFs5MvLcdVjVSGWA%3D)
2026-03-28 14:03:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GV16HBD/698104923/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/GV16HBD/42810313?sv=2020-08-04&st=2026-03-28T14%3A03%3A03Z&se=2026-03-28T14%3A28%3A03Z&sr=b&sp=r&sig=SZmUcBFQV93Ysin5HYH9TjRzwnjRVw7MvOMG44PxqsY%3D)
2026-03-28 14:03:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:03:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c3a03d0>
2026-03-28 14:03:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:03:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:03:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:03:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a241d4e5-9ba8-591a-8b8d-858d5e5adfe4/a241d4e5-9ba8-591a-8b8d-858d5e5adfe4_image_1.jpg HTTP/1.1" 201 0
2026-03-28 14:03:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FRA16HNC%252F698672300%252F600') HTTP/1.1" 204 0
2026-03-28 14:03:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RA16HNC/698672300/600 saved to cache
2026-03-28 14:03:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item a241d4e5-9ba8-591a-8b8d-858d5e5adfe4
2026-03-28 14:03:11 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: a241d4e5-9ba8-591a-8b8d-858d5e5adfe4, skipping ID generation
2026-03-28 14:03:11 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item a241d4e5-9ba8-591a-8b8d-858d5e5adfe4 sending to next pipeline
2026-03-28 14:03:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: a241d4e5-9ba8-591a-8b8d-858d5e5adfe4, identifier: RA16%20HNC
2026-03-28 14:03:11 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:03:11 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:03:11 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:03:11 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:03:11 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:03:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:03:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2d9f01d0>
2026-03-28 14:03:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:03:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:03:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:03:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_68af04a9-eec4-52ae-b536-68c72f8fddc4/68af04a9-eec4-52ae-b536-68c72f8fddc4_image_9.jpg HTTP/1.1" 201 0
2026-03-28 14:03:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FGF64UPV%252F698015380%252F600') HTTP/1.1" 204 0
2026-03-28 14:03:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GF64UPV/698015380/600 saved to cache
2026-03-28 14:03:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 68af04a9-eec4-52ae-b536-68c72f8fddc4
2026-03-28 14:03:11 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:03:11 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:03:11 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:03:11 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:03:11 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:03:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:03:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a1fea1210>
2026-03-28 14:03:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:03:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:03:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:03:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_68af04a9-eec4-52ae-b536-68c72f8fddc4/68af04a9-eec4-52ae-b536-68c72f8fddc4_image_8.jpg HTTP/1.1" 201 0
2026-03-28 14:03:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FGF64UPV%252F698015369%252F600') HTTP/1.1" 204 0
2026-03-28 14:03:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GF64UPV/698015369/600 saved to cache
2026-03-28 14:03:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 68af04a9-eec4-52ae-b536-68c72f8fddc4
2026-03-28 14:03:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:03:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2d78cd10>
2026-03-28 14:03:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:03:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:03:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:03:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e2169724-1950-5652-92b2-0f3da8b4bfbb/e2169724-1950-5652-92b2-0f3da8b4bfbb_image_1.jpg HTTP/1.1" 201 0
2026-03-28 14:03:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FGF23LJX%252F698568375%252F600') HTTP/1.1" 204 0
2026-03-28 14:03:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GF23LJX/698568375/600 saved to cache
2026-03-28 14:03:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item e2169724-1950-5652-92b2-0f3da8b4bfbb
2026-03-28 14:03:11 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: e2169724-1950-5652-92b2-0f3da8b4bfbb, skipping ID generation
2026-03-28 14:03:11 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item e2169724-1950-5652-92b2-0f3da8b4bfbb sending to next pipeline
2026-03-28 14:03:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: e2169724-1950-5652-92b2-0f3da8b4bfbb, identifier: GF23%20LJX
2026-03-28 14:03:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: a241d4e5-9ba8-591a-8b8d-858d5e5adfe4 with identifier: RA16%20HNC
2026-03-28 14:03:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: a241d4e5-9ba8-591a-8b8d-858d5e5adfe4 with identifier: RA16%20HNC
2026-03-28 14:03:11 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: a241d4e5-9ba8-591a-8b8d-858d5e5adfe4 with identifier: RA16%20HNC to the API
2026-03-28 14:03:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:03:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:03:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RA16HNC/698672300/600>
{'auction_title': '',
'c_o_2_emission_value': 101,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a241d4e5-9ba8-591a-8b8d-858d5e5adfe4/a241d4e5-9ba8-591a-8b8d-858d5e5adfe4_expert_report_file_1e1c689c-efff-4588-b468-3ffed66a2a30.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=RA16%20HNC-GB',
'category': 'Car',
'color': 'grey',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.6L',
'expiration_date': '2026-03-29T10:00:00Z',
'fuel_type': 'Diesel',
'id': 'a241d4e5-9ba8-591a-8b8d-858d5e5adfe4',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'RA16 HNC',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=RA16%20HNC&vehicleType=*',
'listing': 'auction',
'location': 'Leeds',
'make': 'VOLKSWAGEN',
'model': 'GOLF',
'odometer': 106618,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 11,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a241d4e5-9ba8-591a-8b8d-858d5e5adfe4/a241d4e5-9ba8-591a-8b8d-858d5e5adfe4_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 42259,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RA16HNC/698672283/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a241d4e5-9ba8-591a-8b8d-858d5e5adfe4/a241d4e5-9ba8-591a-8b8d-858d5e5adfe4_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 40896,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RA16HNC/698672300/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a241d4e5-9ba8-591a-8b8d-858d5e5adfe4/a241d4e5-9ba8-591a-8b8d-858d5e5adfe4_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 39183,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RA16HNC/698672313/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a241d4e5-9ba8-591a-8b8d-858d5e5adfe4/a241d4e5-9ba8-591a-8b8d-858d5e5adfe4_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 39902,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RA16HNC/698672325/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a241d4e5-9ba8-591a-8b8d-858d5e5adfe4/a241d4e5-9ba8-591a-8b8d-858d5e5adfe4_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 41963,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RA16HNC/698672337/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a241d4e5-9ba8-591a-8b8d-858d5e5adfe4/a241d4e5-9ba8-591a-8b8d-858d5e5adfe4_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 39467,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RA16HNC/698672344/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a241d4e5-9ba8-591a-8b8d-858d5e5adfe4/a241d4e5-9ba8-591a-8b8d-858d5e5adfe4_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 69715,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RA16HNC/698672357/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a241d4e5-9ba8-591a-8b8d-858d5e5adfe4/a241d4e5-9ba8-591a-8b8d-858d5e5adfe4_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 62668,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RA16HNC/698672371/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a241d4e5-9ba8-591a-8b8d-858d5e5adfe4/a241d4e5-9ba8-591a-8b8d-858d5e5adfe4_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 69088,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RA16HNC/698672384/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a241d4e5-9ba8-591a-8b8d-858d5e5adfe4/a241d4e5-9ba8-591a-8b8d-858d5e5adfe4_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 80122,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RA16HNC/698672410/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-01-01',
'seller_name': None,
'title': 'VOLKSWAGEN GOLF 1.6 TDI 110 GT EDITION Hatchback',
'transmission': 'manual',
'trim': 'TDI 110 GT EDITION',
'vin': 'WVWZZZAUZHW031645',
'year': 2016}
2026-03-28 14:03:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27RA16%2520HNC%27 HTTP/1.1" 200 None
2026-03-28 14:03:12 [bca.uk] INFO: Saving data for RA16%20HNC: {'created_time': 1774706592.167557, 'last_price_update_time': 1774706592.16757, 'auction_closing_time': 1774778400.0}
2026-03-28 14:03:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='RA16%2520HNC') HTTP/1.1" 204 0
2026-03-28 14:03:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: e2169724-1950-5652-92b2-0f3da8b4bfbb with identifier: GF23%20LJX
2026-03-28 14:03:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: e2169724-1950-5652-92b2-0f3da8b4bfbb with identifier: GF23%20LJX
2026-03-28 14:03:12 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: e2169724-1950-5652-92b2-0f3da8b4bfbb with identifier: GF23%20LJX to the API
2026-03-28 14:03:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:03:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:03:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GF23LJX/698568375/600>
{'auction_title': '',
'c_o_2_emission_value': 141,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e2169724-1950-5652-92b2-0f3da8b4bfbb/e2169724-1950-5652-92b2-0f3da8b4bfbb_expert_report_file_1670fa3c-f4d4-41d7-a63f-bee121998e69.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=GF23%20LJX-GB',
'category': 'Car',
'color': 'blue',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.5L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol',
'id': 'e2169724-1950-5652-92b2-0f3da8b4bfbb',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'GF23 LJX',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=GF23%20LJX&vehicleType=*',
'listing': 'auction',
'location': 'Paddock Wood',
'make': 'AUDI',
'model': 'Q2',
'odometer': 37125,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 11,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e2169724-1950-5652-92b2-0f3da8b4bfbb/e2169724-1950-5652-92b2-0f3da8b4bfbb_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 55774,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GF23LJX/698568359/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e2169724-1950-5652-92b2-0f3da8b4bfbb/e2169724-1950-5652-92b2-0f3da8b4bfbb_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 54541,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GF23LJX/698568375/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e2169724-1950-5652-92b2-0f3da8b4bfbb/e2169724-1950-5652-92b2-0f3da8b4bfbb_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 53530,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GF23LJX/698568403/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e2169724-1950-5652-92b2-0f3da8b4bfbb/e2169724-1950-5652-92b2-0f3da8b4bfbb_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 50606,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GF23LJX/698568428/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e2169724-1950-5652-92b2-0f3da8b4bfbb/e2169724-1950-5652-92b2-0f3da8b4bfbb_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 48670,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GF23LJX/698568447/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e2169724-1950-5652-92b2-0f3da8b4bfbb/e2169724-1950-5652-92b2-0f3da8b4bfbb_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 47789,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GF23LJX/698568475/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e2169724-1950-5652-92b2-0f3da8b4bfbb/e2169724-1950-5652-92b2-0f3da8b4bfbb_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 105246,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GF23LJX/698568523/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e2169724-1950-5652-92b2-0f3da8b4bfbb/e2169724-1950-5652-92b2-0f3da8b4bfbb_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 93278,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GF23LJX/698568566/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e2169724-1950-5652-92b2-0f3da8b4bfbb/e2169724-1950-5652-92b2-0f3da8b4bfbb_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 91874,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GF23LJX/698568599/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e2169724-1950-5652-92b2-0f3da8b4bfbb/e2169724-1950-5652-92b2-0f3da8b4bfbb_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 86329,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GF23LJX/698568631/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2023-01-01',
'seller_name': None,
'title': 'AUDI Q2 1.5 35 TFSI S LINE S-T Hatchback',
'transmission': 'automatic',
'trim': '35 TFSI S LINE S-T',
'vin': 'WAUZZZGA4PA037375',
'year': 2023}
2026-03-28 14:03:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GF23%2520LJX%27 HTTP/1.1" 200 None
2026-03-28 14:03:12 [bca.uk] INFO: Saving data for GF23%20LJX: {'created_time': 1774706592.602109, 'last_price_update_time': 1774706592.60212, 'auction_closing_time': 1774864800.0}
2026-03-28 14:03:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='GF23%2520LJX') HTTP/1.1" 204 0
2026-03-28 14:03:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PJ59WXK/698424526/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/PJ59WXK/42810349?sv=2020-08-04&st=2026-03-28T14%3A03%3A05Z&se=2026-03-28T14%3A28%3A05Z&sr=b&sp=r&sig=0pccUvvw8%2BiwcPxhRDvXDf%2FNBfxQSCx3DA%2F5VSxsghU%3D)
2026-03-28 14:03:12 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GJ69TMO/698438545/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698438545>
2026-03-28 14:03:12 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GV16HBD/698104885/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698104885>
2026-03-28 14:03:12 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GJ69TMO/698438539/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698438539>
2026-03-28 14:03:12 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FY18CYT/698798471/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698798471>
2026-03-28 14:03:12 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GV16HBD/698104850/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698104850>
2026-03-28 14:03:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FY18CYT/698798528/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/FY18CYT/42807957?sv=2020-08-04&st=2026-03-28T14%3A03%3A03Z&se=2026-03-28T14%3A28%3A03Z&sr=b&sp=r&sig=0X%2BGj0JbBf9U6KFOnmd0j0L8zgSNFs5MvLcdVjVSGWA%3D)
2026-03-28 14:03:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GV16HBD/698104900/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/GV16HBD/42810313?sv=2020-08-04&st=2026-03-28T14%3A03%3A03Z&se=2026-03-28T14%3A28%3A03Z&sr=b&sp=r&sig=SZmUcBFQV93Ysin5HYH9TjRzwnjRVw7MvOMG44PxqsY%3D)
2026-03-28 14:03:12 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:03:12 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:03:12 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:03:12 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:03:12 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:03:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:03:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c0cea50>
2026-03-28 14:03:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:03:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:03:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:03:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bf5f6c66-7fca-54d7-9dbf-87d60cf357d5/bf5f6c66-7fca-54d7-9dbf-87d60cf357d5_image_9.jpg HTTP/1.1" 201 0
2026-03-28 14:03:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FGJ69TMO%252F698438567%252F600') HTTP/1.1" 204 0
2026-03-28 14:03:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GJ69TMO/698438567/600 saved to cache
2026-03-28 14:03:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item bf5f6c66-7fca-54d7-9dbf-87d60cf357d5
2026-03-28 14:03:12 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:03:12 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:03:12 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:03:12 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:03:12 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:03:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:03:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c5f1a10>
2026-03-28 14:03:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:03:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:03:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:03:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bf5f6c66-7fca-54d7-9dbf-87d60cf357d5/bf5f6c66-7fca-54d7-9dbf-87d60cf357d5_image_8.jpg HTTP/1.1" 201 0
2026-03-28 14:03:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FGJ69TMO%252F698438565%252F600') HTTP/1.1" 204 0
2026-03-28 14:03:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GJ69TMO/698438565/600 saved to cache
2026-03-28 14:03:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item bf5f6c66-7fca-54d7-9dbf-87d60cf357d5
2026-03-28 14:03:12 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:03:12 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:03:12 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:03:12 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:03:12 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:03:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:03:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c52d0d0>
2026-03-28 14:03:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:03:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:03:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:03:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bf5f6c66-7fca-54d7-9dbf-87d60cf357d5/bf5f6c66-7fca-54d7-9dbf-87d60cf357d5_image_7.jpg HTTP/1.1" 201 0
2026-03-28 14:03:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FGJ69TMO%252F698438561%252F600') HTTP/1.1" 204 0
2026-03-28 14:03:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GJ69TMO/698438561/600 saved to cache
2026-03-28 14:03:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item bf5f6c66-7fca-54d7-9dbf-87d60cf357d5
2026-03-28 14:03:12 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:03:12 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:03:12 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:03:12 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:03:12 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:03:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:03:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2d695f50>
2026-03-28 14:03:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:03:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:03:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:03:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_567b324e-2678-5f7b-ae48-9d6f040ce03b/567b324e-2678-5f7b-ae48-9d6f040ce03b_image_9.jpg HTTP/1.1" 201 0
2026-03-28 14:03:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FFY18CYT%252F698798541%252F600') HTTP/1.1" 204 0
2026-03-28 14:03:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FY18CYT/698798541/600 saved to cache
2026-03-28 14:03:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 567b324e-2678-5f7b-ae48-9d6f040ce03b
2026-03-28 14:03:12 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:03:12 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:03:12 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:03:12 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:03:12 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:03:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:03:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c117010>
2026-03-28 14:03:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:03:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:03:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:03:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0c77c9a7-bec0-528f-95be-edf653516a09/0c77c9a7-bec0-528f-95be-edf653516a09_image_9.jpg HTTP/1.1" 201 0
2026-03-28 14:03:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FGV16HBD%252F698104923%252F600') HTTP/1.1" 204 0
2026-03-28 14:03:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GV16HBD/698104923/600 saved to cache
2026-03-28 14:03:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 0c77c9a7-bec0-528f-95be-edf653516a09
2026-03-28 14:03:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FY18CYT/698798512/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/FY18CYT/42807957?sv=2020-08-04&st=2026-03-28T14%3A03%3A03Z&se=2026-03-28T14%3A28%3A03Z&sr=b&sp=r&sig=0X%2BGj0JbBf9U6KFOnmd0j0L8zgSNFs5MvLcdVjVSGWA%3D)
2026-03-28 14:03:12 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FY18CYT/698798460/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698798460>
2026-03-28 14:03:12 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GF64UPV/698015329/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698015329>
2026-03-28 14:03:12 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GV16HBD/698104842/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698104842>
2026-03-28 14:03:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GF64UPV/698015348/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/GF64UPV/42810175?sv=2020-08-04&st=2026-03-28T14%3A03%3A03Z&se=2026-03-28T14%3A28%3A03Z&sr=b&sp=r&sig=V6hyON%2BJA3aCP72Z85NeT3V3LO92YkUY%2FTF4afm%2Fwq0%3D)
2026-03-28 14:03:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GJ69TMO/698438559/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/GJ69TMO/42810317?sv=2020-08-04&st=2026-03-28T14%3A03%3A03Z&se=2026-03-28T14%3A28%3A03Z&sr=b&sp=r&sig=fxrA47lDZk3kHA1qwB8WBSU128g%2FFzPfbU3cJO1Sguw%3D)
2026-03-28 14:03:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:03:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c4afc10>
2026-03-28 14:03:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:03:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:03:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:03:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b90da0a6-3ad2-591a-8a5c-936884592342/b90da0a6-3ad2-591a-8a5c-936884592342_image_1.jpg HTTP/1.1" 201 0
2026-03-28 14:03:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FPJ59WXK%252F698424526%252F600') HTTP/1.1" 204 0
2026-03-28 14:03:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PJ59WXK/698424526/600 saved to cache
2026-03-28 14:03:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item b90da0a6-3ad2-591a-8a5c-936884592342
2026-03-28 14:03:12 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: b90da0a6-3ad2-591a-8a5c-936884592342, skipping ID generation
2026-03-28 14:03:12 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item b90da0a6-3ad2-591a-8a5c-936884592342 sending to next pipeline
2026-03-28 14:03:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: b90da0a6-3ad2-591a-8a5c-936884592342, identifier: PJ59%20WXK
2026-03-28 14:03:13 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:03:13 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:03:13 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:03:13 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:03:13 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:03:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:03:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c9d4ed0>
2026-03-28 14:03:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:03:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:03:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:03:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_567b324e-2678-5f7b-ae48-9d6f040ce03b/567b324e-2678-5f7b-ae48-9d6f040ce03b_image_8.jpg HTTP/1.1" 201 0
2026-03-28 14:03:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FFY18CYT%252F698798528%252F600') HTTP/1.1" 204 0
2026-03-28 14:03:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FY18CYT/698798528/600 saved to cache
2026-03-28 14:03:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 567b324e-2678-5f7b-ae48-9d6f040ce03b
2026-03-28 14:03:13 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:03:13 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:03:13 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:03:13 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:03:13 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:03:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:03:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c8ce690>
2026-03-28 14:03:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:03:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:03:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:03:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0c77c9a7-bec0-528f-95be-edf653516a09/0c77c9a7-bec0-528f-95be-edf653516a09_image_8.jpg HTTP/1.1" 201 0
2026-03-28 14:03:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FGV16HBD%252F698104900%252F600') HTTP/1.1" 204 0
2026-03-28 14:03:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GV16HBD/698104900/600 saved to cache
2026-03-28 14:03:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 0c77c9a7-bec0-528f-95be-edf653516a09
2026-03-28 14:03:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: b90da0a6-3ad2-591a-8a5c-936884592342 with identifier: PJ59%20WXK
2026-03-28 14:03:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: b90da0a6-3ad2-591a-8a5c-936884592342 with identifier: PJ59%20WXK
2026-03-28 14:03:13 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: b90da0a6-3ad2-591a-8a5c-936884592342 with identifier: PJ59%20WXK to the API
2026-03-28 14:03:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:03:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:03:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PJ59WXK/698424526/600>
{'auction_title': '',
'c_o_2_emission_value': 128,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b90da0a6-3ad2-591a-8a5c-936884592342/b90da0a6-3ad2-591a-8a5c-936884592342_expert_report_file_f5189d09-def5-4aa8-9470-421e79f892be.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=PJ59%20WXK-GB',
'category': 'Car',
'color': 'silver',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.4L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol',
'id': 'b90da0a6-3ad2-591a-8a5c-936884592342',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'PJ59 WXK',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=PJ59%20WXK&vehicleType=*',
'listing': 'auction',
'location': 'Preston',
'make': 'HONDA',
'model': 'JAZZ',
'odometer': 70711,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 11,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b90da0a6-3ad2-591a-8a5c-936884592342/b90da0a6-3ad2-591a-8a5c-936884592342_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 43101,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PJ59WXK/698424523/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b90da0a6-3ad2-591a-8a5c-936884592342/b90da0a6-3ad2-591a-8a5c-936884592342_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 44246,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PJ59WXK/698424526/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b90da0a6-3ad2-591a-8a5c-936884592342/b90da0a6-3ad2-591a-8a5c-936884592342_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 42144,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PJ59WXK/698424528/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b90da0a6-3ad2-591a-8a5c-936884592342/b90da0a6-3ad2-591a-8a5c-936884592342_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 40807,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PJ59WXK/698424530/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b90da0a6-3ad2-591a-8a5c-936884592342/b90da0a6-3ad2-591a-8a5c-936884592342_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 41271,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PJ59WXK/698424531/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b90da0a6-3ad2-591a-8a5c-936884592342/b90da0a6-3ad2-591a-8a5c-936884592342_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 41119,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PJ59WXK/698424533/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b90da0a6-3ad2-591a-8a5c-936884592342/b90da0a6-3ad2-591a-8a5c-936884592342_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 82929,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PJ59WXK/698424537/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b90da0a6-3ad2-591a-8a5c-936884592342/b90da0a6-3ad2-591a-8a5c-936884592342_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 68563,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PJ59WXK/698424539/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b90da0a6-3ad2-591a-8a5c-936884592342/b90da0a6-3ad2-591a-8a5c-936884592342_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 82486,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PJ59WXK/698424542/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b90da0a6-3ad2-591a-8a5c-936884592342/b90da0a6-3ad2-591a-8a5c-936884592342_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 88034,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PJ59WXK/698424545/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2009-01-01',
'seller_name': None,
'title': 'HONDA JAZZ 1.4 I-VTEC EX I-SHIFT Hatchback',
'transmission': 'automatic',
'trim': 'I-VTEC EX I-SHIFT',
'vin': 'SHHGG6880AU001458',
'year': 2009}
2026-03-28 14:03:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27PJ59%2520WXK%27 HTTP/1.1" 200 None
2026-03-28 14:03:13 [bca.uk] INFO: Saving data for PJ59%20WXK: {'created_time': 1774706593.506626, 'last_price_update_time': 1774706593.506637, 'auction_closing_time': 1774864800.0}
2026-03-28 14:03:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='PJ59%2520WXK') HTTP/1.1" 204 0
2026-03-28 14:03:13 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FY18CYT/698798455/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698798455>
2026-03-28 14:03:13 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GJ69TMO/698438535/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698438535>
2026-03-28 14:03:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GV16HBD/698104850/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/GV16HBD/42810313?sv=2020-08-04&st=2026-03-28T14%3A03%3A03Z&se=2026-03-28T14%3A28%3A03Z&sr=b&sp=r&sig=SZmUcBFQV93Ysin5HYH9TjRzwnjRVw7MvOMG44PxqsY%3D)
2026-03-28 14:03:13 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GV16HBD/698104830/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698104830>
2026-03-28 14:03:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GJ69TMO/698438539/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/GJ69TMO/42810317?sv=2020-08-04&st=2026-03-28T14%3A03%3A03Z&se=2026-03-28T14%3A28%3A03Z&sr=b&sp=r&sig=fxrA47lDZk3kHA1qwB8WBSU128g%2FFzPfbU3cJO1Sguw%3D)
2026-03-28 14:03:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FY18CYT/698798471/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/FY18CYT/42807957?sv=2020-08-04&st=2026-03-28T14%3A03%3A03Z&se=2026-03-28T14%3A28%3A03Z&sr=b&sp=r&sig=0X%2BGj0JbBf9U6KFOnmd0j0L8zgSNFs5MvLcdVjVSGWA%3D)
2026-03-28 14:03:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GJ69TMO/698438545/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/GJ69TMO/42810317?sv=2020-08-04&st=2026-03-28T14%3A03%3A03Z&se=2026-03-28T14%3A28%3A03Z&sr=b&sp=r&sig=fxrA47lDZk3kHA1qwB8WBSU128g%2FFzPfbU3cJO1Sguw%3D)
2026-03-28 14:03:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GV16HBD/698104885/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/GV16HBD/42810313?sv=2020-08-04&st=2026-03-28T14%3A03%3A03Z&se=2026-03-28T14%3A28%3A03Z&sr=b&sp=r&sig=SZmUcBFQV93Ysin5HYH9TjRzwnjRVw7MvOMG44PxqsY%3D)
2026-03-28 14:03:13 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:03:13 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:03:13 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:03:13 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:03:13 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:03:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:03:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c65a0d0>
2026-03-28 14:03:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:03:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:03:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:03:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_567b324e-2678-5f7b-ae48-9d6f040ce03b/567b324e-2678-5f7b-ae48-9d6f040ce03b_image_7.jpg HTTP/1.1" 201 0
2026-03-28 14:03:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FFY18CYT%252F698798512%252F600') HTTP/1.1" 204 0
2026-03-28 14:03:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FY18CYT/698798512/600 saved to cache
2026-03-28 14:03:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 567b324e-2678-5f7b-ae48-9d6f040ce03b
2026-03-28 14:03:13 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:03:13 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:03:13 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:03:13 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:03:13 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:03:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:03:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c4b9790>
2026-03-28 14:03:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:03:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:03:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:03:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_68af04a9-eec4-52ae-b536-68c72f8fddc4/68af04a9-eec4-52ae-b536-68c72f8fddc4_image_6.jpg HTTP/1.1" 201 0
2026-03-28 14:03:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FGF64UPV%252F698015348%252F600') HTTP/1.1" 204 0
2026-03-28 14:03:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GF64UPV/698015348/600 saved to cache
2026-03-28 14:03:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 68af04a9-eec4-52ae-b536-68c72f8fddc4
2026-03-28 14:03:13 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:03:13 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:03:13 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:03:13 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:03:13 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:03:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:03:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c65b910>
2026-03-28 14:03:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:03:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:03:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:03:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bf5f6c66-7fca-54d7-9dbf-87d60cf357d5/bf5f6c66-7fca-54d7-9dbf-87d60cf357d5_image_6.jpg HTTP/1.1" 201 0
2026-03-28 14:03:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FGJ69TMO%252F698438559%252F600') HTTP/1.1" 204 0
2026-03-28 14:03:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GJ69TMO/698438559/600 saved to cache
2026-03-28 14:03:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item bf5f6c66-7fca-54d7-9dbf-87d60cf357d5
2026-03-28 14:03:13 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FY18CYT/698798451/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698798451>
2026-03-28 14:03:13 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GV16HBD/698104822/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698104822>
2026-03-28 14:03:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:03:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c8be4d0>
2026-03-28 14:03:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:03:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:03:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:03:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0c77c9a7-bec0-528f-95be-edf653516a09/0c77c9a7-bec0-528f-95be-edf653516a09_image_5.jpg HTTP/1.1" 201 0
2026-03-28 14:03:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FGV16HBD%252F698104850%252F600') HTTP/1.1" 204 0
2026-03-28 14:03:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GV16HBD/698104850/600 saved to cache
2026-03-28 14:03:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 0c77c9a7-bec0-528f-95be-edf653516a09
2026-03-28 14:03:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:03:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2d687fd0>
2026-03-28 14:03:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:03:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:03:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:03:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bf5f6c66-7fca-54d7-9dbf-87d60cf357d5/bf5f6c66-7fca-54d7-9dbf-87d60cf357d5_image_3.jpg HTTP/1.1" 201 0
2026-03-28 14:03:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FGJ69TMO%252F698438539%252F600') HTTP/1.1" 204 0
2026-03-28 14:03:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GJ69TMO/698438539/600 saved to cache
2026-03-28 14:03:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item bf5f6c66-7fca-54d7-9dbf-87d60cf357d5
2026-03-28 14:03:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:03:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a1fedf610>
2026-03-28 14:03:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:03:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:03:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:03:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_567b324e-2678-5f7b-ae48-9d6f040ce03b/567b324e-2678-5f7b-ae48-9d6f040ce03b_image_5.jpg HTTP/1.1" 201 0
2026-03-28 14:03:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FFY18CYT%252F698798471%252F600') HTTP/1.1" 204 0
2026-03-28 14:03:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FY18CYT/698798471/600 saved to cache
2026-03-28 14:03:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 567b324e-2678-5f7b-ae48-9d6f040ce03b
2026-03-28 14:03:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:03:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2ffb3fd0>
2026-03-28 14:03:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:03:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:03:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:03:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bf5f6c66-7fca-54d7-9dbf-87d60cf357d5/bf5f6c66-7fca-54d7-9dbf-87d60cf357d5_image_4.jpg HTTP/1.1" 201 0
2026-03-28 14:03:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FGJ69TMO%252F698438545%252F600') HTTP/1.1" 204 0
2026-03-28 14:03:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GJ69TMO/698438545/600 saved to cache
2026-03-28 14:03:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item bf5f6c66-7fca-54d7-9dbf-87d60cf357d5
2026-03-28 14:03:13 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:03:13 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:03:13 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:03:13 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:03:13 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:03:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:03:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c7320d0>
2026-03-28 14:03:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:03:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:03:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:03:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0c77c9a7-bec0-528f-95be-edf653516a09/0c77c9a7-bec0-528f-95be-edf653516a09_image_7.jpg HTTP/1.1" 201 0
2026-03-28 14:03:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FGV16HBD%252F698104885%252F600') HTTP/1.1" 204 0
2026-03-28 14:03:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GV16HBD/698104885/600 saved to cache
2026-03-28 14:03:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 0c77c9a7-bec0-528f-95be-edf653516a09
2026-03-28 14:03:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GV16HBD/698104842/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/GV16HBD/42810313?sv=2020-08-04&st=2026-03-28T14%3A03%3A03Z&se=2026-03-28T14%3A28%3A03Z&sr=b&sp=r&sig=SZmUcBFQV93Ysin5HYH9TjRzwnjRVw7MvOMG44PxqsY%3D)
2026-03-28 14:03:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GF64UPV/698015329/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/GF64UPV/42810175?sv=2020-08-04&st=2026-03-28T14%3A03%3A03Z&se=2026-03-28T14%3A28%3A03Z&sr=b&sp=r&sig=V6hyON%2BJA3aCP72Z85NeT3V3LO92YkUY%2FTF4afm%2Fwq0%3D)
2026-03-28 14:03:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FY18CYT/698798460/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/FY18CYT/42807957?sv=2020-08-04&st=2026-03-28T14%3A03%3A03Z&se=2026-03-28T14%3A28%3A03Z&sr=b&sp=r&sig=0X%2BGj0JbBf9U6KFOnmd0j0L8zgSNFs5MvLcdVjVSGWA%3D)
2026-03-28 14:03:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FY18CYT/698798455/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/FY18CYT/42807957?sv=2020-08-04&st=2026-03-28T14%3A03%3A03Z&se=2026-03-28T14%3A28%3A03Z&sr=b&sp=r&sig=0X%2BGj0JbBf9U6KFOnmd0j0L8zgSNFs5MvLcdVjVSGWA%3D)
2026-03-28 14:03:13 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MJ62HDO/697888302/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=697888302>
2026-03-28 14:03:13 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GJ69TMO/698438524/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=GJ69TMO-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-28 14:03:13 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GF64UPV/698015312/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=GF64UPV-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-28 14:03:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GJ69TMO/698438535/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/GJ69TMO/42810317?sv=2020-08-04&st=2026-03-28T14%3A03%3A03Z&se=2026-03-28T14%3A28%3A03Z&sr=b&sp=r&sig=fxrA47lDZk3kHA1qwB8WBSU128g%2FFzPfbU3cJO1Sguw%3D)
2026-03-28 14:03:13 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MJ62HDO/697888292/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=697888292>
2026-03-28 14:03:13 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GV16HBD/698104815/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698104815>
2026-03-28 14:03:13 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EA24TKX/698296270/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698296270>
2026-03-28 14:03:14 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MJ62HDO/697888257/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=697888257>
2026-03-28 14:03:14 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FY18CYT/698798448/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698798448>
2026-03-28 14:03:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GV16HBD/698104822/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/GV16HBD/42810313?sv=2020-08-04&st=2026-03-28T14%3A03%3A03Z&se=2026-03-28T14%3A28%3A03Z&sr=b&sp=r&sig=SZmUcBFQV93Ysin5HYH9TjRzwnjRVw7MvOMG44PxqsY%3D)
2026-03-28 14:03:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FY18CYT/698798451/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/FY18CYT/42807957?sv=2020-08-04&st=2026-03-28T14%3A03%3A03Z&se=2026-03-28T14%3A28%3A03Z&sr=b&sp=r&sig=0X%2BGj0JbBf9U6KFOnmd0j0L8zgSNFs5MvLcdVjVSGWA%3D)
2026-03-28 14:03:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GV16HBD/698104830/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/GV16HBD/42810313?sv=2020-08-04&st=2026-03-28T14%3A03%3A03Z&se=2026-03-28T14%3A28%3A03Z&sr=b&sp=r&sig=SZmUcBFQV93Ysin5HYH9TjRzwnjRVw7MvOMG44PxqsY%3D)
2026-03-28 14:03:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:03:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2d65e810>
2026-03-28 14:03:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:03:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:03:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:03:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0c77c9a7-bec0-528f-95be-edf653516a09/0c77c9a7-bec0-528f-95be-edf653516a09_image_4.jpg HTTP/1.1" 201 0
2026-03-28 14:03:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FGV16HBD%252F698104842%252F600') HTTP/1.1" 204 0
2026-03-28 14:03:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GV16HBD/698104842/600 saved to cache
2026-03-28 14:03:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 0c77c9a7-bec0-528f-95be-edf653516a09
2026-03-28 14:03:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:03:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c9936d0>
2026-03-28 14:03:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:03:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:03:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:03:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_68af04a9-eec4-52ae-b536-68c72f8fddc4/68af04a9-eec4-52ae-b536-68c72f8fddc4_image_2.jpg HTTP/1.1" 201 0
2026-03-28 14:03:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FGF64UPV%252F698015329%252F600') HTTP/1.1" 204 0
2026-03-28 14:03:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GF64UPV/698015329/600 saved to cache
2026-03-28 14:03:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 68af04a9-eec4-52ae-b536-68c72f8fddc4
2026-03-28 14:03:14 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MJ03HOW/698444427/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698444427>
2026-03-28 14:03:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GF64UPV/698015312/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/GF64UPV/42810175?sv=2020-08-04&st=2026-03-28T14%3A03%3A03Z&se=2026-03-28T14%3A28%3A03Z&sr=b&sp=r&sig=V6hyON%2BJA3aCP72Z85NeT3V3LO92YkUY%2FTF4afm%2Fwq0%3D)
2026-03-28 14:03:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GJ69TMO/698438524/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/GJ69TMO/42810317?sv=2020-08-04&st=2026-03-28T14%3A03%3A03Z&se=2026-03-28T14%3A28%3A03Z&sr=b&sp=r&sig=fxrA47lDZk3kHA1qwB8WBSU128g%2FFzPfbU3cJO1Sguw%3D)
2026-03-28 14:03:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MJ62HDO/697888302/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/MJ62HDO/42810342?sv=2020-08-04&st=2026-03-28T14%3A03%3A03Z&se=2026-03-28T14%3A28%3A03Z&sr=b&sp=r&sig=4HxRLcY572xInqDRczi5%2F9rPsO%2Fy115VX0mOcX57FiI%3D)
2026-03-28 14:03:14 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DP19FWW/698227127/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698227127>
2026-03-28 14:03:14 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GF57MWW/698928757/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=GF57MWW-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-28 14:03:14 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/SD18YWW/42810346?sv=2020-08-04&st=2026-03-28T14%3A03%3A14Z&se=2026-03-28T14%3A28%3A14Z&sr=b&sp=r&sig=7AasTz5GkcbVg3mZlAj5bXm4eRmFaqXEvgRF5S45ypY%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=SD18%20YWW-GB>
2026-03-28 14:03:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:03:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2ca81a90>
2026-03-28 14:03:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:03:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:03:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:03:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_567b324e-2678-5f7b-ae48-9d6f040ce03b/567b324e-2678-5f7b-ae48-9d6f040ce03b_image_4.jpg HTTP/1.1" 201 0
2026-03-28 14:03:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FFY18CYT%252F698798460%252F600') HTTP/1.1" 204 0
2026-03-28 14:03:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FY18CYT/698798460/600 saved to cache
2026-03-28 14:03:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 567b324e-2678-5f7b-ae48-9d6f040ce03b
2026-03-28 14:03:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:03:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2d9a4ad0>
2026-03-28 14:03:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:03:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:03:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:03:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_567b324e-2678-5f7b-ae48-9d6f040ce03b/567b324e-2678-5f7b-ae48-9d6f040ce03b_image_3.jpg HTTP/1.1" 201 0
2026-03-28 14:03:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FFY18CYT%252F698798455%252F600') HTTP/1.1" 204 0
2026-03-28 14:03:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FY18CYT/698798455/600 saved to cache
2026-03-28 14:03:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 567b324e-2678-5f7b-ae48-9d6f040ce03b
2026-03-28 14:03:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:03:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2d640b10>
2026-03-28 14:03:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:03:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:03:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:03:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bf5f6c66-7fca-54d7-9dbf-87d60cf357d5/bf5f6c66-7fca-54d7-9dbf-87d60cf357d5_image_2.jpg HTTP/1.1" 201 0
2026-03-28 14:03:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FGJ69TMO%252F698438535%252F600') HTTP/1.1" 204 0
2026-03-28 14:03:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GJ69TMO/698438535/600 saved to cache
2026-03-28 14:03:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item bf5f6c66-7fca-54d7-9dbf-87d60cf357d5
2026-03-28 14:03:14 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WV13ZTH/698929305/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698929305>
2026-03-28 14:03:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MJ62HDO/697888292/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/MJ62HDO/42810342?sv=2020-08-04&st=2026-03-28T14%3A03%3A03Z&se=2026-03-28T14%3A28%3A03Z&sr=b&sp=r&sig=4HxRLcY572xInqDRczi5%2F9rPsO%2Fy115VX0mOcX57FiI%3D)
2026-03-28 14:03:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:03:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c990e50>
2026-03-28 14:03:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:03:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:03:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:03:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0c77c9a7-bec0-528f-95be-edf653516a09/0c77c9a7-bec0-528f-95be-edf653516a09_image_2.jpg HTTP/1.1" 201 0
2026-03-28 14:03:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FGV16HBD%252F698104822%252F600') HTTP/1.1" 204 0
2026-03-28 14:03:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GV16HBD/698104822/600 saved to cache
2026-03-28 14:03:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 0c77c9a7-bec0-528f-95be-edf653516a09
2026-03-28 14:03:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:03:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c5858d0>
2026-03-28 14:03:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:03:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:03:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:03:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_567b324e-2678-5f7b-ae48-9d6f040ce03b/567b324e-2678-5f7b-ae48-9d6f040ce03b_image_2.jpg HTTP/1.1" 201 0
2026-03-28 14:03:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FFY18CYT%252F698798451%252F600') HTTP/1.1" 204 0
2026-03-28 14:03:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FY18CYT/698798451/600 saved to cache
2026-03-28 14:03:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 567b324e-2678-5f7b-ae48-9d6f040ce03b
2026-03-28 14:03:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:03:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c990e50>
2026-03-28 14:03:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:03:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:03:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:03:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0c77c9a7-bec0-528f-95be-edf653516a09/0c77c9a7-bec0-528f-95be-edf653516a09_image_3.jpg HTTP/1.1" 201 0
2026-03-28 14:03:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FGV16HBD%252F698104830%252F600') HTTP/1.1" 204 0
2026-03-28 14:03:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GV16HBD/698104830/600 saved to cache
2026-03-28 14:03:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 0c77c9a7-bec0-528f-95be-edf653516a09
2026-03-28 14:03:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:03:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c9dc250>
2026-03-28 14:03:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:03:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:03:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:03:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_68af04a9-eec4-52ae-b536-68c72f8fddc4/68af04a9-eec4-52ae-b536-68c72f8fddc4_image_0.jpg HTTP/1.1" 201 0
2026-03-28 14:03:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FGF64UPV%252F698015312%252F600') HTTP/1.1" 204 0
2026-03-28 14:03:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GF64UPV/698015312/600 saved to cache
2026-03-28 14:03:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 68af04a9-eec4-52ae-b536-68c72f8fddc4
2026-03-28 14:03:14 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 68af04a9-eec4-52ae-b536-68c72f8fddc4, skipping ID generation
2026-03-28 14:03:14 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 68af04a9-eec4-52ae-b536-68c72f8fddc4 sending to next pipeline
2026-03-28 14:03:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 68af04a9-eec4-52ae-b536-68c72f8fddc4, identifier: GF64%20UPV
2026-03-28 14:03:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:03:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c4bb6d0>
2026-03-28 14:03:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:03:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:03:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:03:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bf5f6c66-7fca-54d7-9dbf-87d60cf357d5/bf5f6c66-7fca-54d7-9dbf-87d60cf357d5_image_0.jpg HTTP/1.1" 201 0
2026-03-28 14:03:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FGJ69TMO%252F698438524%252F600') HTTP/1.1" 204 0
2026-03-28 14:03:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GJ69TMO/698438524/600 saved to cache
2026-03-28 14:03:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item bf5f6c66-7fca-54d7-9dbf-87d60cf357d5
2026-03-28 14:03:14 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: bf5f6c66-7fca-54d7-9dbf-87d60cf357d5, skipping ID generation
2026-03-28 14:03:14 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item bf5f6c66-7fca-54d7-9dbf-87d60cf357d5 sending to next pipeline
2026-03-28 14:03:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: bf5f6c66-7fca-54d7-9dbf-87d60cf357d5, identifier: GJ69%20TMO
2026-03-28 14:03:14 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:03:14 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:03:14 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:03:14 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:03:14 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:03:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:03:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2d65fe10>
2026-03-28 14:03:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:03:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:03:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:03:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c697e335-b937-5194-8aed-71297a871cbe/c697e335-b937-5194-8aed-71297a871cbe_image_8.jpg HTTP/1.1" 201 0
2026-03-28 14:03:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FMJ62HDO%252F697888302%252F600') HTTP/1.1" 204 0
2026-03-28 14:03:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MJ62HDO/697888302/600 saved to cache
2026-03-28 14:03:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item c697e335-b937-5194-8aed-71297a871cbe
2026-03-28 14:03:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 68af04a9-eec4-52ae-b536-68c72f8fddc4 with identifier: GF64%20UPV
2026-03-28 14:03:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 68af04a9-eec4-52ae-b536-68c72f8fddc4 with identifier: GF64%20UPV
2026-03-28 14:03:14 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 68af04a9-eec4-52ae-b536-68c72f8fddc4 with identifier: GF64%20UPV to the API
2026-03-28 14:03:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:03:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:03:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GF64UPV/698015312/600>
{'auction_title': '',
'c_o_2_emission_value': 125,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_68af04a9-eec4-52ae-b536-68c72f8fddc4/68af04a9-eec4-52ae-b536-68c72f8fddc4_expert_report_file_4bbceb15-abdf-4eb2-8b26-880f39caa820.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=GF64%20UPV-GB',
'category': 'Car',
'color': 'black',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.4L',
'expiration_date': '2026-03-29T10:00:00Z',
'fuel_type': 'Petrol',
'id': '68af04a9-eec4-52ae-b536-68c72f8fddc4',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'GF64 UPV',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=GF64%20UPV&vehicleType=*',
'listing': 'auction',
'location': 'Leeds',
'make': 'VOLKSWAGEN',
'model': 'GOLF SV',
'odometer': 92355,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 11,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_68af04a9-eec4-52ae-b536-68c72f8fddc4/68af04a9-eec4-52ae-b536-68c72f8fddc4_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 42117,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GF64UPV/698015312/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_68af04a9-eec4-52ae-b536-68c72f8fddc4/68af04a9-eec4-52ae-b536-68c72f8fddc4_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 40216,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GF64UPV/698015321/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_68af04a9-eec4-52ae-b536-68c72f8fddc4/68af04a9-eec4-52ae-b536-68c72f8fddc4_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 39979,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GF64UPV/698015329/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_68af04a9-eec4-52ae-b536-68c72f8fddc4/68af04a9-eec4-52ae-b536-68c72f8fddc4_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 40343,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GF64UPV/698015333/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_68af04a9-eec4-52ae-b536-68c72f8fddc4/68af04a9-eec4-52ae-b536-68c72f8fddc4_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 39592,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GF64UPV/698015337/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_68af04a9-eec4-52ae-b536-68c72f8fddc4/68af04a9-eec4-52ae-b536-68c72f8fddc4_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 37885,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GF64UPV/698015341/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_68af04a9-eec4-52ae-b536-68c72f8fddc4/68af04a9-eec4-52ae-b536-68c72f8fddc4_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 73584,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GF64UPV/698015348/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_68af04a9-eec4-52ae-b536-68c72f8fddc4/68af04a9-eec4-52ae-b536-68c72f8fddc4_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 66004,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GF64UPV/698015357/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_68af04a9-eec4-52ae-b536-68c72f8fddc4/68af04a9-eec4-52ae-b536-68c72f8fddc4_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 79039,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GF64UPV/698015369/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_68af04a9-eec4-52ae-b536-68c72f8fddc4/68af04a9-eec4-52ae-b536-68c72f8fddc4_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 71276,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GF64UPV/698015380/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2014-01-01',
'seller_name': None,
'title': 'VOLKSWAGEN GOLF SV 1.4 TSI 125 S MPV',
'transmission': 'manual',
'trim': 'TSI 125 S',
'vin': 'WVWZZZAUZFW537937',
'year': 2014}
2026-03-28 14:03:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GF64%2520UPV%27 HTTP/1.1" 200 None
2026-03-28 14:03:15 [bca.uk] INFO: Saving data for GF64%20UPV: {'created_time': 1774706595.177537, 'last_price_update_time': 1774706595.17755, 'auction_closing_time': 1774778400.0}
2026-03-28 14:03:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='GF64%2520UPV') HTTP/1.1" 204 0
2026-03-28 14:03:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: bf5f6c66-7fca-54d7-9dbf-87d60cf357d5 with identifier: GJ69%20TMO
2026-03-28 14:03:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: bf5f6c66-7fca-54d7-9dbf-87d60cf357d5 with identifier: GJ69%20TMO
2026-03-28 14:03:15 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: bf5f6c66-7fca-54d7-9dbf-87d60cf357d5 with identifier: GJ69%20TMO to the API
2026-03-28 14:03:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:03:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:03:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GJ69TMO/698438524/600>
{'auction_title': '',
'c_o_2_emission_value': 110,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bf5f6c66-7fca-54d7-9dbf-87d60cf357d5/bf5f6c66-7fca-54d7-9dbf-87d60cf357d5_expert_report_file_11c3ec59-0761-4874-997c-430af7577d27.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=GJ69%20TMO-GB',
'category': 'Car',
'color': 'black',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.0L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol',
'id': 'bf5f6c66-7fca-54d7-9dbf-87d60cf357d5',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'GJ69 TMO',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=GJ69%20TMO&vehicleType=*',
'listing': 'auction',
'location': 'Paddock Wood',
'make': 'VOLKSWAGEN',
'model': 'POLO',
'odometer': 43072,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 11,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bf5f6c66-7fca-54d7-9dbf-87d60cf357d5/bf5f6c66-7fca-54d7-9dbf-87d60cf357d5_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 54928,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GJ69TMO/698438524/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bf5f6c66-7fca-54d7-9dbf-87d60cf357d5/bf5f6c66-7fca-54d7-9dbf-87d60cf357d5_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 52281,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GJ69TMO/698438530/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bf5f6c66-7fca-54d7-9dbf-87d60cf357d5/bf5f6c66-7fca-54d7-9dbf-87d60cf357d5_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 49922,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GJ69TMO/698438535/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bf5f6c66-7fca-54d7-9dbf-87d60cf357d5/bf5f6c66-7fca-54d7-9dbf-87d60cf357d5_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 46958,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GJ69TMO/698438539/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bf5f6c66-7fca-54d7-9dbf-87d60cf357d5/bf5f6c66-7fca-54d7-9dbf-87d60cf357d5_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 46646,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GJ69TMO/698438545/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bf5f6c66-7fca-54d7-9dbf-87d60cf357d5/bf5f6c66-7fca-54d7-9dbf-87d60cf357d5_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 46042,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GJ69TMO/698438550/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bf5f6c66-7fca-54d7-9dbf-87d60cf357d5/bf5f6c66-7fca-54d7-9dbf-87d60cf357d5_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 108797,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GJ69TMO/698438559/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bf5f6c66-7fca-54d7-9dbf-87d60cf357d5/bf5f6c66-7fca-54d7-9dbf-87d60cf357d5_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 83566,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GJ69TMO/698438561/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bf5f6c66-7fca-54d7-9dbf-87d60cf357d5/bf5f6c66-7fca-54d7-9dbf-87d60cf357d5_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 89866,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GJ69TMO/698438565/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bf5f6c66-7fca-54d7-9dbf-87d60cf357d5/bf5f6c66-7fca-54d7-9dbf-87d60cf357d5_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 66047,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GJ69TMO/698438567/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-01-01',
'seller_name': None,
'title': 'VOLKSWAGEN POLO 1.0 EVO 80 BEATS Hatchback',
'transmission': 'manual',
'trim': 'EVO 80 BEATS',
'vin': 'WVWZZZAWZKU046699',
'year': 2019}
2026-03-28 14:03:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GJ69%2520TMO%27 HTTP/1.1" 200 None
2026-03-28 14:03:15 [bca.uk] INFO: Saving data for GJ69%20TMO: {'created_time': 1774706595.6478, 'last_price_update_time': 1774706595.647817, 'auction_closing_time': 1774864800.0}
2026-03-28 14:03:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='GJ69%2520TMO') HTTP/1.1" 204 0
2026-03-28 14:03:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GV16HBD/698104815/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/GV16HBD/42810313?sv=2020-08-04&st=2026-03-28T14%3A03%3A03Z&se=2026-03-28T14%3A28%3A03Z&sr=b&sp=r&sig=SZmUcBFQV93Ysin5HYH9TjRzwnjRVw7MvOMG44PxqsY%3D)
2026-03-28 14:03:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FY18CYT/698798448/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/FY18CYT/42807957?sv=2020-08-04&st=2026-03-28T14%3A03%3A03Z&se=2026-03-28T14%3A28%3A03Z&sr=b&sp=r&sig=0X%2BGj0JbBf9U6KFOnmd0j0L8zgSNFs5MvLcdVjVSGWA%3D)
2026-03-28 14:03:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EA24TKX/698296270/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/EA24TKX/42810378?sv=2020-08-04&st=2026-03-28T14%3A01%3A05Z&se=2026-03-28T14%3A26%3A05Z&sr=b&sp=r&sig=Ajk9rVQfTHJs3R0cJnmP5VnSS5rSnHfV6UlI7D3mmDQ%3D)
2026-03-28 14:03:15 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/X28AVE/698923746/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698923746>
2026-03-28 14:03:15 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YK67BOU/698928864/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698928864>
2026-03-28 14:03:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MJ62HDO/697888257/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/MJ62HDO/42810342?sv=2020-08-04&st=2026-03-28T14%3A03%3A03Z&se=2026-03-28T14%3A28%3A03Z&sr=b&sp=r&sig=4HxRLcY572xInqDRczi5%2F9rPsO%2Fy115VX0mOcX57FiI%3D)
2026-03-28 14:03:15 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/RF21EBD/42809773?sv=2020-08-04&st=2026-03-28T14%3A03%3A14Z&se=2026-03-28T14%3A28%3A14Z&sr=b&sp=r&sig=fw1hk%2FxP20iV0pBAL7NeH7NwSGkh4C74QjCjIGW34mQ%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=RF21%20EBD-GB>
2026-03-28 14:03:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MJ03HOW/698444427/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/MJ03HOW/42810316?sv=2020-08-04&st=2026-03-28T14%3A01%3A04Z&se=2026-03-28T14%3A26%3A04Z&sr=b&sp=r&sig=72R4f35YDQDGGwN55srQJ3YRSQrnD%2FGMmCWnMvmfOLc%3D)
2026-03-28 14:03:15 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:03:15 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:03:15 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:03:15 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:03:15 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:03:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:03:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c6f2c10>
2026-03-28 14:03:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:03:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:03:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:03:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c697e335-b937-5194-8aed-71297a871cbe/c697e335-b937-5194-8aed-71297a871cbe_image_7.jpg HTTP/1.1" 201 0
2026-03-28 14:03:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FMJ62HDO%252F697888292%252F600') HTTP/1.1" 204 0
2026-03-28 14:03:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MJ62HDO/697888292/600 saved to cache
2026-03-28 14:03:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item c697e335-b937-5194-8aed-71297a871cbe
2026-03-28 14:03:15 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/ND17VGZ/698929237/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698929237>
2026-03-28 14:03:15 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/DU19WRR/42810292?sv=2020-08-04&st=2026-03-28T14%3A03%3A15Z&se=2026-03-28T14%3A28%3A15Z&sr=b&sp=r&sig=MtD%2F8L7XEKrXW%2B2op3%2BPdiCG6LVJvVg4cKAzJgc4HxE%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=DU19%20WRR-GB>
2026-03-28 14:03:15 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EX10BXE/698923350/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=EX10BXE-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-28 14:03:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WV13ZTH/698929305/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/WV13ZTH/42810161?sv=2020-08-04&st=2026-03-28T14%3A01%3A04Z&se=2026-03-28T14%3A26%3A04Z&sr=b&sp=r&sig=hbqIghhD97wvMs5qjsvBMdrtSptsqnkIa342PcMgOiA%3D)
2026-03-28 14:03:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GF57MWW/698928757/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/GF57MWW/42810309?sv=2020-08-04&st=2026-03-28T14%3A01%3A09Z&se=2026-03-28T14%3A26%3A09Z&sr=b&sp=r&sig=hJTqt8SLdbJfAcgzLjUmqtORuHZL2E6pw%2FRYFmCkjK4%3D)
2026-03-28 14:03:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:03:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c555890>
2026-03-28 14:03:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:03:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:03:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:03:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0c77c9a7-bec0-528f-95be-edf653516a09/0c77c9a7-bec0-528f-95be-edf653516a09_image_1.jpg HTTP/1.1" 201 0
2026-03-28 14:03:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FGV16HBD%252F698104815%252F600') HTTP/1.1" 204 0
2026-03-28 14:03:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GV16HBD/698104815/600 saved to cache
2026-03-28 14:03:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 0c77c9a7-bec0-528f-95be-edf653516a09
2026-03-28 14:03:15 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 0c77c9a7-bec0-528f-95be-edf653516a09, skipping ID generation
2026-03-28 14:03:15 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 0c77c9a7-bec0-528f-95be-edf653516a09 sending to next pipeline
2026-03-28 14:03:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 0c77c9a7-bec0-528f-95be-edf653516a09, identifier: GV16%20HBD
2026-03-28 14:03:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 0c77c9a7-bec0-528f-95be-edf653516a09 with identifier: GV16%20HBD
2026-03-28 14:03:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 0c77c9a7-bec0-528f-95be-edf653516a09 with identifier: GV16%20HBD
2026-03-28 14:03:16 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 0c77c9a7-bec0-528f-95be-edf653516a09 with identifier: GV16%20HBD to the API
2026-03-28 14:03:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:03:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:03:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GV16HBD/698104815/600>
{'auction_title': '',
'c_o_2_emission_value': 119,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0c77c9a7-bec0-528f-95be-edf653516a09/0c77c9a7-bec0-528f-95be-edf653516a09_expert_report_file_0a24782d-dd5a-4a16-a23c-f1c716782560.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=GV16%20HBD-GB',
'category': 'Car',
'color': 'red',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.2L',
'expiration_date': '2026-03-29T10:00:00Z',
'fuel_type': 'Petrol',
'id': '0c77c9a7-bec0-528f-95be-edf653516a09',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'GV16 HBD',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=GV16%20HBD&vehicleType=*',
'listing': 'auction',
'location': 'Paddock Wood',
'make': 'NISSAN',
'model': 'NOTE',
'odometer': 59435,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 11,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0c77c9a7-bec0-528f-95be-edf653516a09/0c77c9a7-bec0-528f-95be-edf653516a09_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 53851,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GV16HBD/698104806/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0c77c9a7-bec0-528f-95be-edf653516a09/0c77c9a7-bec0-528f-95be-edf653516a09_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 52861,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GV16HBD/698104815/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0c77c9a7-bec0-528f-95be-edf653516a09/0c77c9a7-bec0-528f-95be-edf653516a09_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 50033,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GV16HBD/698104822/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0c77c9a7-bec0-528f-95be-edf653516a09/0c77c9a7-bec0-528f-95be-edf653516a09_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 48069,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GV16HBD/698104830/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0c77c9a7-bec0-528f-95be-edf653516a09/0c77c9a7-bec0-528f-95be-edf653516a09_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 47930,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GV16HBD/698104842/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0c77c9a7-bec0-528f-95be-edf653516a09/0c77c9a7-bec0-528f-95be-edf653516a09_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 46874,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GV16HBD/698104850/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0c77c9a7-bec0-528f-95be-edf653516a09/0c77c9a7-bec0-528f-95be-edf653516a09_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 99899,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GV16HBD/698104870/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0c77c9a7-bec0-528f-95be-edf653516a09/0c77c9a7-bec0-528f-95be-edf653516a09_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 81397,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GV16HBD/698104885/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0c77c9a7-bec0-528f-95be-edf653516a09/0c77c9a7-bec0-528f-95be-edf653516a09_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 87850,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GV16HBD/698104900/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0c77c9a7-bec0-528f-95be-edf653516a09/0c77c9a7-bec0-528f-95be-edf653516a09_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 74508,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GV16HBD/698104923/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-01-01',
'seller_name': None,
'title': 'NISSAN NOTE 1.2 DIG-S TEKNA Hatchback',
'transmission': 'automatic',
'trim': 'DIG-S TEKNA',
'vin': 'SJNTBAE12U1158445',
'year': 2016}
2026-03-28 14:03:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GV16%2520HBD%27 HTTP/1.1" 200 None
2026-03-28 14:03:16 [bca.uk] INFO: Saving data for GV16%20HBD: {'created_time': 1774706596.310642, 'last_price_update_time': 1774706596.310653, 'auction_closing_time': 1774778400.0}
2026-03-28 14:03:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='GV16%2520HBD') HTTP/1.1" 204 0
2026-03-28 14:03:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DP19FWW/698227127/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/DP19FWW/42810375?sv=2020-08-04&st=2026-03-28T14%3A01%3A04Z&se=2026-03-28T14%3A26%3A04Z&sr=b&sp=r&sig=DYlHwmmm%2BkuE1QC9GfsRlnyT74V8OO0Bfy5POGMlRcU%3D)
2026-03-28 14:03:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/SD18YWW/42810346?sv=2020-08-04&st=2026-03-28T14%3A03%3A14Z&se=2026-03-28T14%3A28%3A14Z&sr=b&sp=r&sig=7AasTz5GkcbVg3mZlAj5bXm4eRmFaqXEvgRF5S45ypY%3D> (referer: https://www.bca.co.uk/)
2026-03-28 14:03:16 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LR11XWM/697880656/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=697880656>
2026-03-28 14:03:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YK67BOU/698928864/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YK67BOU/42810138?sv=2020-08-04&st=2026-03-28T14%3A01%3A06Z&se=2026-03-28T14%3A26%3A06Z&sr=b&sp=r&sig=lMZ3QjflOWAYgjfCxBohfGqFaZWJDMyvtEvO8nKSM7s%3D)
2026-03-28 14:03:16 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EA24TKX/698296262/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698296262>
2026-03-28 14:03:16 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MJ03HOW/698444414/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698444414>
2026-03-28 14:03:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/X28AVE/698923746/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/X28AVE/42809896?sv=2020-08-04&st=2026-03-28T14%3A01%3A06Z&se=2026-03-28T14%3A26%3A06Z&sr=b&sp=r&sig=AYxkyrr3IbeLdESXjdd9QmNEg4ZiUeF%2B%2BO3v1nuSrfg%3D)
2026-03-28 14:03:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:03:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c82c710>
2026-03-28 14:03:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:03:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:03:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:03:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_567b324e-2678-5f7b-ae48-9d6f040ce03b/567b324e-2678-5f7b-ae48-9d6f040ce03b_image_1.jpg HTTP/1.1" 201 0
2026-03-28 14:03:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FFY18CYT%252F698798448%252F600') HTTP/1.1" 204 0
2026-03-28 14:03:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FY18CYT/698798448/600 saved to cache
2026-03-28 14:03:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 567b324e-2678-5f7b-ae48-9d6f040ce03b
2026-03-28 14:03:16 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 567b324e-2678-5f7b-ae48-9d6f040ce03b, skipping ID generation
2026-03-28 14:03:16 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 567b324e-2678-5f7b-ae48-9d6f040ce03b sending to next pipeline
2026-03-28 14:03:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 567b324e-2678-5f7b-ae48-9d6f040ce03b, identifier: FY18%20CYT
2026-03-28 14:03:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 567b324e-2678-5f7b-ae48-9d6f040ce03b with identifier: FY18%20CYT
2026-03-28 14:03:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 567b324e-2678-5f7b-ae48-9d6f040ce03b with identifier: FY18%20CYT
2026-03-28 14:03:16 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 567b324e-2678-5f7b-ae48-9d6f040ce03b with identifier: FY18%20CYT to the API
2026-03-28 14:03:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:03:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:03:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FY18CYT/698798448/600>
{'auction_title': '',
'c_o_2_emission_value': 124,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_567b324e-2678-5f7b-ae48-9d6f040ce03b/567b324e-2678-5f7b-ae48-9d6f040ce03b_expert_report_file_e5c0a702-5f8a-445c-aebe-bbb3e817cca7.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=FY18%20CYT-GB',
'category': 'Car',
'color': 'white',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.5L',
'expiration_date': '2026-03-29T10:00:00Z',
'fuel_type': 'Petrol',
'id': '567b324e-2678-5f7b-ae48-9d6f040ce03b',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'FY18 CYT',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=FY18%20CYT&vehicleType=*',
'listing': 'auction',
'location': 'Leeds',
'make': 'MG MOTOR UK',
'model': 'MG3',
'odometer': 54811,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 11,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_567b324e-2678-5f7b-ae48-9d6f040ce03b/567b324e-2678-5f7b-ae48-9d6f040ce03b_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 40373,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FY18CYT/698798445/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_567b324e-2678-5f7b-ae48-9d6f040ce03b/567b324e-2678-5f7b-ae48-9d6f040ce03b_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 40330,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FY18CYT/698798448/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_567b324e-2678-5f7b-ae48-9d6f040ce03b/567b324e-2678-5f7b-ae48-9d6f040ce03b_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 39633,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FY18CYT/698798451/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_567b324e-2678-5f7b-ae48-9d6f040ce03b/567b324e-2678-5f7b-ae48-9d6f040ce03b_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 39058,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FY18CYT/698798455/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_567b324e-2678-5f7b-ae48-9d6f040ce03b/567b324e-2678-5f7b-ae48-9d6f040ce03b_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 40130,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FY18CYT/698798460/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_567b324e-2678-5f7b-ae48-9d6f040ce03b/567b324e-2678-5f7b-ae48-9d6f040ce03b_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 38151,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FY18CYT/698798471/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_567b324e-2678-5f7b-ae48-9d6f040ce03b/567b324e-2678-5f7b-ae48-9d6f040ce03b_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 77970,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FY18CYT/698798493/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_567b324e-2678-5f7b-ae48-9d6f040ce03b/567b324e-2678-5f7b-ae48-9d6f040ce03b_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 60230,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FY18CYT/698798512/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_567b324e-2678-5f7b-ae48-9d6f040ce03b/567b324e-2678-5f7b-ae48-9d6f040ce03b_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 74891,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FY18CYT/698798528/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_567b324e-2678-5f7b-ae48-9d6f040ce03b/567b324e-2678-5f7b-ae48-9d6f040ce03b_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 77231,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FY18CYT/698798541/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-01-01',
'seller_name': None,
'title': 'MG MOTOR UK MG3 1.5 VTI-TECH 3STYLE+ S/S Hatchback',
'transmission': 'manual',
'trim': 'VTI-TECH 3STYLE+ S/S',
'vin': 'SDPZ1CBDAHS106814',
'year': 2018}
2026-03-28 14:03:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FY18%2520CYT%27 HTTP/1.1" 200 None
2026-03-28 14:03:16 [bca.uk] INFO: Saving data for FY18%20CYT: {'created_time': 1774706596.835165, 'last_price_update_time': 1774706596.835177, 'auction_closing_time': 1774778400.0}
2026-03-28 14:03:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='FY18%2520CYT') HTTP/1.1" 204 0
2026-03-28 14:03:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/RF21EBD/42809773?sv=2020-08-04&st=2026-03-28T14%3A03%3A14Z&se=2026-03-28T14%3A28%3A14Z&sr=b&sp=r&sig=fw1hk%2FxP20iV0pBAL7NeH7NwSGkh4C74QjCjIGW34mQ%3D> (referer: https://www.bca.co.uk/)
2026-03-28 14:03:16 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:03:16 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:03:16 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:03:16 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:03:16 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:03:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:03:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c8bdcd0>
2026-03-28 14:03:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:03:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:03:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:03:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a936dd22-4905-520e-8ef4-c3c73c56eba4/a936dd22-4905-520e-8ef4-c3c73c56eba4_image_7.jpg HTTP/1.1" 201 0
2026-03-28 14:03:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FEA24TKX%252F698296270%252F600') HTTP/1.1" 204 0
2026-03-28 14:03:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EA24TKX/698296270/600 saved to cache
2026-03-28 14:03:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item a936dd22-4905-520e-8ef4-c3c73c56eba4
2026-03-28 14:03:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:03:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2de0cb50>
2026-03-28 14:03:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:03:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:03:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:03:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c697e335-b937-5194-8aed-71297a871cbe/c697e335-b937-5194-8aed-71297a871cbe_image_1.jpg HTTP/1.1" 201 0
2026-03-28 14:03:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FMJ62HDO%252F697888257%252F600') HTTP/1.1" 204 0
2026-03-28 14:03:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MJ62HDO/697888257/600 saved to cache
2026-03-28 14:03:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item c697e335-b937-5194-8aed-71297a871cbe
2026-03-28 14:03:16 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: c697e335-b937-5194-8aed-71297a871cbe, skipping ID generation
2026-03-28 14:03:16 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item c697e335-b937-5194-8aed-71297a871cbe sending to next pipeline
2026-03-28 14:03:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: c697e335-b937-5194-8aed-71297a871cbe, identifier: MJ62%20HDO
2026-03-28 14:03:17 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:03:17 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:03:17 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:03:17 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:03:17 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:03:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:03:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c4a62d0>
2026-03-28 14:03:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:03:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:03:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:03:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b75153fa-8bbc-5e83-87eb-81edd908fcda/b75153fa-8bbc-5e83-87eb-81edd908fcda_image_8.jpg HTTP/1.1" 201 0
2026-03-28 14:03:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FMJ03HOW%252F698444427%252F600') HTTP/1.1" 204 0
2026-03-28 14:03:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MJ03HOW/698444427/600 saved to cache
2026-03-28 14:03:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item b75153fa-8bbc-5e83-87eb-81edd908fcda
2026-03-28 14:03:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:03:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2d9a5a50>
2026-03-28 14:03:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:03:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:03:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:03:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4766d63c-47f2-5b85-8b2c-c4d089a16b5c/4766d63c-47f2-5b85-8b2c-c4d089a16b5c_image_3.jpg HTTP/1.1" 201 0
2026-03-28 14:03:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FWV13ZTH%252F698929305%252F600') HTTP/1.1" 204 0
2026-03-28 14:03:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WV13ZTH/698929305/600 saved to cache
2026-03-28 14:03:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 4766d63c-47f2-5b85-8b2c-c4d089a16b5c
2026-03-28 14:03:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:03:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c899350>
2026-03-28 14:03:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:03:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:03:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:03:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cdcc838c-10d3-5f36-90c6-59ef07eececc/cdcc838c-10d3-5f36-90c6-59ef07eececc_image_0.jpg HTTP/1.1" 201 0
2026-03-28 14:03:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FGF57MWW%252F698928757%252F600') HTTP/1.1" 204 0
2026-03-28 14:03:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GF57MWW/698928757/600 saved to cache
2026-03-28 14:03:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item cdcc838c-10d3-5f36-90c6-59ef07eececc
2026-03-28 14:03:17 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: cdcc838c-10d3-5f36-90c6-59ef07eececc, skipping ID generation
2026-03-28 14:03:17 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item cdcc838c-10d3-5f36-90c6-59ef07eececc sending to next pipeline
2026-03-28 14:03:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: cdcc838c-10d3-5f36-90c6-59ef07eececc, identifier: GF57%20MWW
2026-03-28 14:03:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EX10BXE/698923350/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/EX10BXE/42809799?sv=2020-08-04&st=2026-03-28T14%3A01%3A07Z&se=2026-03-28T14%3A26%3A07Z&sr=b&sp=r&sig=xoEQIFwTRaF8ZPdiio47BQcwaxFkt4KEonwRoN8KxQM%3D)
2026-03-28 14:03:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/ND17VGZ/698929237/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/ND17VGZ/42810273?sv=2020-08-04&st=2026-03-28T14%3A01%3A05Z&se=2026-03-28T14%3A26%3A05Z&sr=b&sp=r&sig=Ddznt5rliWG2eSFSeV1iYUxjjPUcheWJt3FgNXERnUs%3D)
2026-03-28 14:03:17 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DP19FWW/698227117/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698227117>
2026-03-28 14:03:17 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EJ13JTO/698540362/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698540362>
2026-03-28 14:03:17 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/OV64PLN/698966015/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698966015>
2026-03-28 14:03:17 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FY68WNB/698106426/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698106426>
2026-03-28 14:03:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: c697e335-b937-5194-8aed-71297a871cbe with identifier: MJ62%20HDO
2026-03-28 14:03:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: c697e335-b937-5194-8aed-71297a871cbe with identifier: MJ62%20HDO
2026-03-28 14:03:17 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: c697e335-b937-5194-8aed-71297a871cbe with identifier: MJ62%20HDO to the API
2026-03-28 14:03:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:03:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:03:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MJ62HDO/697888257/600>
{'auction_title': '',
'c_o_2_emission_value': 130,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c697e335-b937-5194-8aed-71297a871cbe/c697e335-b937-5194-8aed-71297a871cbe_expert_report_file_3d7fad5e-5030-421e-9f2f-8d75a3d85b56.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=MJ62%20HDO-GB',
'category': 'Car',
'color': 'silver',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.4L',
'expiration_date': '2026-03-29T10:00:00Z',
'fuel_type': 'Petrol',
'id': 'c697e335-b937-5194-8aed-71297a871cbe',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'MJ62 HDO',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=MJ62%20HDO&vehicleType=*',
'listing': 'auction',
'location': 'Preston',
'make': 'FORD',
'model': 'FIESTA',
'odometer': 57600,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 11,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c697e335-b937-5194-8aed-71297a871cbe/c697e335-b937-5194-8aed-71297a871cbe_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 44213,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MJ62HDO/697888251/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c697e335-b937-5194-8aed-71297a871cbe/c697e335-b937-5194-8aed-71297a871cbe_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 44946,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MJ62HDO/697888257/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c697e335-b937-5194-8aed-71297a871cbe/c697e335-b937-5194-8aed-71297a871cbe_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 45013,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MJ62HDO/697888265/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c697e335-b937-5194-8aed-71297a871cbe/c697e335-b937-5194-8aed-71297a871cbe_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 42797,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MJ62HDO/697888270/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c697e335-b937-5194-8aed-71297a871cbe/c697e335-b937-5194-8aed-71297a871cbe_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 42734,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MJ62HDO/697888273/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c697e335-b937-5194-8aed-71297a871cbe/c697e335-b937-5194-8aed-71297a871cbe_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 42570,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MJ62HDO/697888277/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c697e335-b937-5194-8aed-71297a871cbe/c697e335-b937-5194-8aed-71297a871cbe_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 86436,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MJ62HDO/697888285/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c697e335-b937-5194-8aed-71297a871cbe/c697e335-b937-5194-8aed-71297a871cbe_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 76735,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MJ62HDO/697888292/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c697e335-b937-5194-8aed-71297a871cbe/c697e335-b937-5194-8aed-71297a871cbe_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 87136,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MJ62HDO/697888302/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c697e335-b937-5194-8aed-71297a871cbe/c697e335-b937-5194-8aed-71297a871cbe_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 94414,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MJ62HDO/697888310/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2012-01-01',
'seller_name': None,
'title': 'FORD FIESTA 1.4 ZETEC Hatchback',
'transmission': 'manual',
'trim': 'ZETEC',
'vin': 'WF0JXXGAJJCY04732',
'year': 2012}
2026-03-28 14:03:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MJ62%2520HDO%27 HTTP/1.1" 200 None
2026-03-28 14:03:17 [bca.uk] INFO: Saving data for MJ62%20HDO: {'created_time': 1774706597.688183, 'last_price_update_time': 1774706597.688195, 'auction_closing_time': 1774778400.0}
2026-03-28 14:03:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='MJ62%2520HDO') HTTP/1.1" 204 0
2026-03-28 14:03:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: cdcc838c-10d3-5f36-90c6-59ef07eececc with identifier: GF57%20MWW
2026-03-28 14:03:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: cdcc838c-10d3-5f36-90c6-59ef07eececc with identifier: GF57%20MWW
2026-03-28 14:03:17 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: cdcc838c-10d3-5f36-90c6-59ef07eececc with identifier: GF57%20MWW to the API
2026-03-28 14:03:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:03:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:03:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GF57MWW/698928757/600>
{'auction_title': '',
'c_o_2_emission_value': 216,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cdcc838c-10d3-5f36-90c6-59ef07eececc/cdcc838c-10d3-5f36-90c6-59ef07eececc_expert_report_file_584752f6-bc46-4485-a626-77559eb47905.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=GF57%20MWW-GB',
'category': 'Car',
'color': 'grey',
'currency': 'GBP',
'doors_number': 5,
'engine': '2.0L',
'expiration_date': '2026-03-29T10:00:00Z',
'fuel_type': 'Diesel',
'id': 'cdcc838c-10d3-5f36-90c6-59ef07eececc',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'GF57 MWW',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=GF57%20MWW&vehicleType=*',
'listing': 'auction',
'location': 'Paddock Wood',
'make': 'NISSAN',
'model': 'X-TRAIL',
'odometer': 139336,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 11,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cdcc838c-10d3-5f36-90c6-59ef07eececc/cdcc838c-10d3-5f36-90c6-59ef07eececc_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 48935,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GF57MWW/698928757/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cdcc838c-10d3-5f36-90c6-59ef07eececc/cdcc838c-10d3-5f36-90c6-59ef07eececc_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 48252,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GF57MWW/698928776/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cdcc838c-10d3-5f36-90c6-59ef07eececc/cdcc838c-10d3-5f36-90c6-59ef07eececc_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 49017,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GF57MWW/698928797/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cdcc838c-10d3-5f36-90c6-59ef07eececc/cdcc838c-10d3-5f36-90c6-59ef07eececc_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 46293,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GF57MWW/698928823/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cdcc838c-10d3-5f36-90c6-59ef07eececc/cdcc838c-10d3-5f36-90c6-59ef07eececc_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 45323,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GF57MWW/698928844/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cdcc838c-10d3-5f36-90c6-59ef07eececc/cdcc838c-10d3-5f36-90c6-59ef07eececc_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 45008,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GF57MWW/698928862/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cdcc838c-10d3-5f36-90c6-59ef07eececc/cdcc838c-10d3-5f36-90c6-59ef07eececc_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 100147,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GF57MWW/698928890/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cdcc838c-10d3-5f36-90c6-59ef07eececc/cdcc838c-10d3-5f36-90c6-59ef07eececc_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 73810,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GF57MWW/698928920/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cdcc838c-10d3-5f36-90c6-59ef07eececc/cdcc838c-10d3-5f36-90c6-59ef07eececc_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 81416,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GF57MWW/698928941/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cdcc838c-10d3-5f36-90c6-59ef07eececc/cdcc838c-10d3-5f36-90c6-59ef07eececc_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 74298,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GF57MWW/698928965/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2007-01-01',
'seller_name': None,
'title': 'NISSAN X-TRAIL 2.0 DCI SPORT StationWagon',
'transmission': 'automatic',
'trim': 'DCI SPORT',
'vin': 'JN1TCNT31U0009236',
'year': 2007}
2026-03-28 14:03:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GF57%2520MWW%27 HTTP/1.1" 200 None
2026-03-28 14:03:18 [bca.uk] INFO: Saving data for GF57%20MWW: {'created_time': 1774706598.092464, 'last_price_update_time': 1774706598.092476, 'auction_closing_time': 1774778400.0}
2026-03-28 14:03:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='GF57%2520MWW') HTTP/1.1" 204 0
2026-03-28 14:03:18 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:03:18 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:03:18 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:03:18 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:03:18 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:03:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:03:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c64de90>
2026-03-28 14:03:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:03:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:03:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:03:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4b13d468-b932-5891-9e01-a66081b24d30/4b13d468-b932-5891-9e01-a66081b24d30_image_9.jpg HTTP/1.1" 201 0
2026-03-28 14:03:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FDP19FWW%252F698227127%252F600') HTTP/1.1" 204 0
2026-03-28 14:03:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DP19FWW/698227127/600 saved to cache
2026-03-28 14:03:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 4b13d468-b932-5891-9e01-a66081b24d30
2026-03-28 14:03:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:03:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c893250>
2026-03-28 14:03:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:03:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:03:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:03:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_12688ef2-2fc1-5a39-9796-e8677733238c/12688ef2-2fc1-5a39-9796-e8677733238c_expert_report_file_53a5f549-42ce-4ecb-a0c0-2dd1f268474d.pdf HTTP/1.1" 201 0
2026-03-28 14:03:18 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item 12688ef2-2fc1-5a39-9796-e8677733238c
2026-03-28 14:03:18 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 12688ef2-2fc1-5a39-9796-e8677733238c, skipping ID generation
2026-03-28 14:03:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 12688ef2-2fc1-5a39-9796-e8677733238c
2026-03-28 14:03:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DSD18YWW-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-28 14:03:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=SD18YWW-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-28 14:03:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:03:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a1ff23350>
2026-03-28 14:03:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:03:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:03:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:03:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_561c0b4f-3a2d-562b-bb16-d69244165df3/561c0b4f-3a2d-562b-bb16-d69244165df3_image_4.jpg HTTP/1.1" 201 0
2026-03-28 14:03:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FYK67BOU%252F698928864%252F600') HTTP/1.1" 204 0
2026-03-28 14:03:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YK67BOU/698928864/600 saved to cache
2026-03-28 14:03:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 561c0b4f-3a2d-562b-bb16-d69244165df3
2026-03-28 14:03:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:03:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c890250>
2026-03-28 14:03:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:03:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:03:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:03:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e788d11e-974b-5084-adb6-d49a23c42616/e788d11e-974b-5084-adb6-d49a23c42616_image_4.jpg HTTP/1.1" 201 0
2026-03-28 14:03:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FX28AVE%252F698923746%252F600') HTTP/1.1" 204 0
2026-03-28 14:03:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/X28AVE/698923746/600 saved to cache
2026-03-28 14:03:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item e788d11e-974b-5084-adb6-d49a23c42616
2026-03-28 14:03:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/DU19WRR/42810292?sv=2020-08-04&st=2026-03-28T14%3A03%3A15Z&se=2026-03-28T14%3A28%3A15Z&sr=b&sp=r&sig=MtD%2F8L7XEKrXW%2B2op3%2BPdiCG6LVJvVg4cKAzJgc4HxE%3D> (referer: https://www.bca.co.uk/)
2026-03-28 14:03:18 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/DG65GXU/42797313?sv=2020-08-04&st=2026-03-28T14%3A03%3A17Z&se=2026-03-28T14%3A28%3A17Z&sr=b&sp=r&sig=45h4YfquPE4gw%2FlPB0vAarzO40zZuLap4z1MHRigzDY%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=DG65%20GXU-GB>
2026-03-28 14:03:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698091573%27 HTTP/1.1" 200 None
2026-03-28 14:03:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698091573 not downloaded yet
2026-03-28 14:03:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:03:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c9d6b10>
2026-03-28 14:03:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:03:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:03:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:03:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_32911a92-e281-56af-bde9-3b2fa177bca3/32911a92-e281-56af-bde9-3b2fa177bca3_expert_report_file_11668d9c-d3bf-4976-a127-4798972af133.pdf HTTP/1.1" 201 0
2026-03-28 14:03:18 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item 32911a92-e281-56af-bde9-3b2fa177bca3
2026-03-28 14:03:18 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 32911a92-e281-56af-bde9-3b2fa177bca3, skipping ID generation
2026-03-28 14:03:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 32911a92-e281-56af-bde9-3b2fa177bca3
2026-03-28 14:03:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DRF21EBD-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-28 14:03:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=RF21EBD-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-28 14:03:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:03:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a1fdb3e10>
2026-03-28 14:03:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:03:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:03:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:03:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f5f9bed7-96bb-5ef8-8a52-e232dbf0b7d5/f5f9bed7-96bb-5ef8-8a52-e232dbf0b7d5_image_0.jpg HTTP/1.1" 201 0
2026-03-28 14:03:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FEX10BXE%252F698923350%252F600') HTTP/1.1" 204 0
2026-03-28 14:03:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EX10BXE/698923350/600 saved to cache
2026-03-28 14:03:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item f5f9bed7-96bb-5ef8-8a52-e232dbf0b7d5
2026-03-28 14:03:18 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: f5f9bed7-96bb-5ef8-8a52-e232dbf0b7d5, skipping ID generation
2026-03-28 14:03:18 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item f5f9bed7-96bb-5ef8-8a52-e232dbf0b7d5 sending to next pipeline
2026-03-28 14:03:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: f5f9bed7-96bb-5ef8-8a52-e232dbf0b7d5, identifier: EX10%20BXE
2026-03-28 14:03:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:03:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c9d4e90>
2026-03-28 14:03:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:03:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:03:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:03:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_03d2b309-0f29-57c0-bf73-2b86c16c227a/03d2b309-0f29-57c0-bf73-2b86c16c227a_image_1.jpg HTTP/1.1" 201 0
2026-03-28 14:03:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FND17VGZ%252F698929237%252F600') HTTP/1.1" 204 0
2026-03-28 14:03:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/ND17VGZ/698929237/600 saved to cache
2026-03-28 14:03:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 03d2b309-0f29-57c0-bf73-2b86c16c227a
2026-03-28 14:03:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698091582%27 HTTP/1.1" 200 None
2026-03-28 14:03:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698091582 not downloaded yet
2026-03-28 14:03:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: f5f9bed7-96bb-5ef8-8a52-e232dbf0b7d5 with identifier: EX10%20BXE
2026-03-28 14:03:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: f5f9bed7-96bb-5ef8-8a52-e232dbf0b7d5 with identifier: EX10%20BXE
2026-03-28 14:03:18 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: f5f9bed7-96bb-5ef8-8a52-e232dbf0b7d5 with identifier: EX10%20BXE to the API
2026-03-28 14:03:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:03:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:03:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EX10BXE/698923350/600>
{'auction_title': '',
'c_o_2_emission_value': 139,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f5f9bed7-96bb-5ef8-8a52-e232dbf0b7d5/f5f9bed7-96bb-5ef8-8a52-e232dbf0b7d5_expert_report_file_068aa374-a5bd-44bc-aa5b-2047a1a6ecb1.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=EX10%20BXE-GB',
'category': 'Car',
'color': 'silver',
'currency': 'GBP',
'doors_number': 3,
'engine': '1.6L',
'expiration_date': '2026-03-29T10:00:00Z',
'fuel_type': 'Petrol',
'id': 'f5f9bed7-96bb-5ef8-8a52-e232dbf0b7d5',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'EX10 BXE',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=EX10%20BXE&vehicleType=*',
'listing': 'auction',
'location': 'Paddock Wood',
'make': 'FORD',
'model': 'FIESTA',
'odometer': 87635,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 11,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f5f9bed7-96bb-5ef8-8a52-e232dbf0b7d5/f5f9bed7-96bb-5ef8-8a52-e232dbf0b7d5_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 49839,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EX10BXE/698923350/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f5f9bed7-96bb-5ef8-8a52-e232dbf0b7d5/f5f9bed7-96bb-5ef8-8a52-e232dbf0b7d5_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 48213,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EX10BXE/698923368/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f5f9bed7-96bb-5ef8-8a52-e232dbf0b7d5/f5f9bed7-96bb-5ef8-8a52-e232dbf0b7d5_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 48072,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EX10BXE/698923388/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f5f9bed7-96bb-5ef8-8a52-e232dbf0b7d5/f5f9bed7-96bb-5ef8-8a52-e232dbf0b7d5_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 45209,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EX10BXE/698923402/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f5f9bed7-96bb-5ef8-8a52-e232dbf0b7d5/f5f9bed7-96bb-5ef8-8a52-e232dbf0b7d5_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 47978,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EX10BXE/698923423/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f5f9bed7-96bb-5ef8-8a52-e232dbf0b7d5/f5f9bed7-96bb-5ef8-8a52-e232dbf0b7d5_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 47097,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EX10BXE/698923441/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f5f9bed7-96bb-5ef8-8a52-e232dbf0b7d5/f5f9bed7-96bb-5ef8-8a52-e232dbf0b7d5_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 86206,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EX10BXE/698923471/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f5f9bed7-96bb-5ef8-8a52-e232dbf0b7d5/f5f9bed7-96bb-5ef8-8a52-e232dbf0b7d5_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 56952,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EX10BXE/698923494/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f5f9bed7-96bb-5ef8-8a52-e232dbf0b7d5/f5f9bed7-96bb-5ef8-8a52-e232dbf0b7d5_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 68437,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EX10BXE/698923517/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f5f9bed7-96bb-5ef8-8a52-e232dbf0b7d5/f5f9bed7-96bb-5ef8-8a52-e232dbf0b7d5_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 78141,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EX10BXE/698923535/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2010-01-01',
'seller_name': None,
'title': 'FORD FIESTA 1.6 ZETEC S Hatchback',
'transmission': 'manual',
'trim': 'ZETEC S',
'vin': 'WF0GXXGAJGAY09442',
'year': 2010}
2026-03-28 14:03:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27EX10%2520BXE%27 HTTP/1.1" 200 None
2026-03-28 14:03:18 [bca.uk] INFO: Saving data for EX10%20BXE: {'created_time': 1774706598.922582, 'last_price_update_time': 1774706598.922593, 'auction_closing_time': 1774778400.0}
2026-03-28 14:03:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='EX10%2520BXE') HTTP/1.1" 204 0
2026-03-28 14:03:18 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YK67BOU/698928843/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698928843>
2026-03-28 14:03:18 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/X28AVE/698923736/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698923736>
2026-03-28 14:03:18 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/AO69YDV/42810516?sv=2020-08-04&st=2026-03-28T14%3A03%3A18Z&se=2026-03-28T14%3A28%3A18Z&sr=b&sp=r&sig=kth7LBRcZTbVN2IxcU%2F3tEYuPtUFnu10PDPk4DDda%2Fc%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=AO69%20YDV-GB>
2026-03-28 14:03:18 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WV13ZTH/698929295/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698929295>
2026-03-28 14:03:18 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YY70LWT/42810193?sv=2020-08-04&st=2026-03-28T14%3A03%3A18Z&se=2026-03-28T14%3A28%3A18Z&sr=b&sp=r&sig=PQQPbp7LgcrcfGY8GkVfWOvV1ULKBqIo0aCZ8cnvWF4%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=YY70%20LWT-GB>
2026-03-28 14:03:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D697663209%27 HTTP/1.1" 200 None
2026-03-28 14:03:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=697663209 not downloaded yet
2026-03-28 14:03:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MJ03HOW/698444414/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/MJ03HOW/42810316?sv=2020-08-04&st=2026-03-28T14%3A01%3A04Z&se=2026-03-28T14%3A26%3A04Z&sr=b&sp=r&sig=72R4f35YDQDGGwN55srQJ3YRSQrnD%2FGMmCWnMvmfOLc%3D)
2026-03-28 14:03:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EA24TKX/698296262/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/EA24TKX/42810378?sv=2020-08-04&st=2026-03-28T14%3A01%3A05Z&se=2026-03-28T14%3A26%3A05Z&sr=b&sp=r&sig=Ajk9rVQfTHJs3R0cJnmP5VnSS5rSnHfV6UlI7D3mmDQ%3D)
2026-03-28 14:03:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LR11XWM/697880656/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LR11XWM/42810294?sv=2020-08-04&st=2026-03-28T14%3A01%3A05Z&se=2026-03-28T14%3A26%3A05Z&sr=b&sp=r&sig=zHl%2Fkz2fSAoGVBY8ukVZULGVCGKqbTVidyooaEEBPNc%3D)
2026-03-28 14:03:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698091595%27 HTTP/1.1" 200 None
2026-03-28 14:03:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698091595 not downloaded yet
2026-03-28 14:03:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:03:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c9d4350>
2026-03-28 14:03:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:03:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:03:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:03:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_25ea238e-697d-5563-a2fc-e7cf5710c862/25ea238e-697d-5563-a2fc-e7cf5710c862_expert_report_file_979aad18-f8b5-4e2d-b10e-0400b89475a8.pdf HTTP/1.1" 201 0
2026-03-28 14:03:19 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item 25ea238e-697d-5563-a2fc-e7cf5710c862
2026-03-28 14:03:19 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 25ea238e-697d-5563-a2fc-e7cf5710c862, skipping ID generation
2026-03-28 14:03:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 25ea238e-697d-5563-a2fc-e7cf5710c862
2026-03-28 14:03:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DDU19WRR-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-28 14:03:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=DU19WRR-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-28 14:03:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D697663229%27 HTTP/1.1" 200 None
2026-03-28 14:03:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=697663229 not downloaded yet
2026-03-28 14:03:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698091599%27 HTTP/1.1" 200 None
2026-03-28 14:03:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698091599 not downloaded yet
2026-03-28 14:03:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D697718372%27 HTTP/1.1" 200 None
2026-03-28 14:03:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=697718372 not downloaded yet
2026-03-28 14:03:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D697663245%27 HTTP/1.1" 200 None
2026-03-28 14:03:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=697663245 not downloaded yet
2026-03-28 14:03:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/OV64PLN/698966015/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/OV64PLN/42810653?sv=2020-08-04&st=2026-03-28T14%3A01%3A03Z&se=2026-03-28T14%3A26%3A03Z&sr=b&sp=r&sig=APMfuiYXypC%2F8k81EUjJVNUqGlQEUGUldS81rN8I%2FN0%3D)
2026-03-28 14:03:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698091607%27 HTTP/1.1" 200 None
2026-03-28 14:03:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698091607 not downloaded yet
2026-03-28 14:03:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D697718376%27 HTTP/1.1" 200 None
2026-03-28 14:03:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=697718376 not downloaded yet
2026-03-28 14:03:19 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EA24TKX/698296254/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698296254>
2026-03-28 14:03:19 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LR11XWM/697880617/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=697880617>
2026-03-28 14:03:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D697663258%27 HTTP/1.1" 200 None
2026-03-28 14:03:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=697663258 not downloaded yet
2026-03-28 14:03:19 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/ND17VGZ/698929223/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=ND17VGZ-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-28 14:03:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DP19FWW/698227117/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/DP19FWW/42810375?sv=2020-08-04&st=2026-03-28T14%3A01%3A04Z&se=2026-03-28T14%3A26%3A04Z&sr=b&sp=r&sig=DYlHwmmm%2BkuE1QC9GfsRlnyT74V8OO0Bfy5POGMlRcU%3D)
2026-03-28 14:03:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698091618%27 HTTP/1.1" 200 None
2026-03-28 14:03:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698091618 not downloaded yet
2026-03-28 14:03:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D697718377%27 HTTP/1.1" 200 None
2026-03-28 14:03:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=697718377 not downloaded yet
2026-03-28 14:03:19 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:03:19 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:03:19 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:03:19 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:03:19 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:03:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:03:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c4fff10>
2026-03-28 14:03:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:03:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:03:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:03:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b75153fa-8bbc-5e83-87eb-81edd908fcda/b75153fa-8bbc-5e83-87eb-81edd908fcda_image_7.jpg HTTP/1.1" 201 0
2026-03-28 14:03:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FMJ03HOW%252F698444414%252F600') HTTP/1.1" 204 0
2026-03-28 14:03:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MJ03HOW/698444414/600 saved to cache
2026-03-28 14:03:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item b75153fa-8bbc-5e83-87eb-81edd908fcda
2026-03-28 14:03:19 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:03:19 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:03:19 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:03:19 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:03:19 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:03:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:03:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a1fed3fd0>
2026-03-28 14:03:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:03:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:03:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:03:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a936dd22-4905-520e-8ef4-c3c73c56eba4/a936dd22-4905-520e-8ef4-c3c73c56eba4_image_6.jpg HTTP/1.1" 201 0
2026-03-28 14:03:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FEA24TKX%252F698296262%252F600') HTTP/1.1" 204 0
2026-03-28 14:03:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EA24TKX/698296262/600 saved to cache
2026-03-28 14:03:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item a936dd22-4905-520e-8ef4-c3c73c56eba4
2026-03-28 14:03:19 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:03:19 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:03:19 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:03:19 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:03:19 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:03:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:03:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2ffb3210>
2026-03-28 14:03:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:03:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:03:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:03:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0b12c0fe-3ab8-5445-ad6b-256ccebc3b9e/0b12c0fe-3ab8-5445-ad6b-256ccebc3b9e_image_6.jpg HTTP/1.1" 201 0
2026-03-28 14:03:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLR11XWM%252F697880656%252F600') HTTP/1.1" 204 0
2026-03-28 14:03:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LR11XWM/697880656/600 saved to cache
2026-03-28 14:03:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 0b12c0fe-3ab8-5445-ad6b-256ccebc3b9e
2026-03-28 14:03:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FY68WNB/698106426/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/FY68WNB/42810373?sv=2020-08-04&st=2026-03-28T14%3A01%3A04Z&se=2026-03-28T14%3A26%3A04Z&sr=b&sp=r&sig=H2pJB0hzNCFCiICFkGnSt1gr2sn1tExob5yrsc4d3Vs%3D)
2026-03-28 14:03:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EJ13JTO/698540362/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/EJ13JTO/42810382?sv=2020-08-04&st=2026-03-28T14%3A01%3A03Z&se=2026-03-28T14%3A26%3A03Z&sr=b&sp=r&sig=9n5SmvjaM772xUjZdL0t%2BMeZRNBu1TSQPyTFa%2FZiaIA%3D)
2026-03-28 14:03:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D697663290%27 HTTP/1.1" 200 None
2026-03-28 14:03:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=697663290 not downloaded yet
2026-03-28 14:03:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/DG65GXU/42797313?sv=2020-08-04&st=2026-03-28T14%3A03%3A17Z&se=2026-03-28T14%3A28%3A17Z&sr=b&sp=r&sig=45h4YfquPE4gw%2FlPB0vAarzO40zZuLap4z1MHRigzDY%3D> (referer: https://www.bca.co.uk/)
2026-03-28 14:03:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698091624%27 HTTP/1.1" 200 None
2026-03-28 14:03:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698091624 not downloaded yet
2026-03-28 14:03:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D697718379%27 HTTP/1.1" 200 None
2026-03-28 14:03:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=697718379 not downloaded yet
2026-03-28 14:03:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YY70LWT/42810193?sv=2020-08-04&st=2026-03-28T14%3A03%3A18Z&se=2026-03-28T14%3A28%3A18Z&sr=b&sp=r&sig=PQQPbp7LgcrcfGY8GkVfWOvV1ULKBqIo0aCZ8cnvWF4%3D> (referer: https://www.bca.co.uk/)
2026-03-28 14:03:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D697663323%27 HTTP/1.1" 200 None
2026-03-28 14:03:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=697663323 not downloaded yet
2026-03-28 14:03:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WV13ZTH/698929295/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/WV13ZTH/42810161?sv=2020-08-04&st=2026-03-28T14%3A01%3A04Z&se=2026-03-28T14%3A26%3A04Z&sr=b&sp=r&sig=hbqIghhD97wvMs5qjsvBMdrtSptsqnkIa342PcMgOiA%3D)
2026-03-28 14:03:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YK67BOU/698928843/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YK67BOU/42810138?sv=2020-08-04&st=2026-03-28T14%3A01%3A06Z&se=2026-03-28T14%3A26%3A06Z&sr=b&sp=r&sig=lMZ3QjflOWAYgjfCxBohfGqFaZWJDMyvtEvO8nKSM7s%3D)
2026-03-28 14:03:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698091636%27 HTTP/1.1" 200 None
2026-03-28 14:03:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698091636 not downloaded yet
2026-03-28 14:03:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D697718381%27 HTTP/1.1" 200 None
2026-03-28 14:03:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=697718381 not downloaded yet
2026-03-28 14:03:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/X28AVE/698923736/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/X28AVE/42809896?sv=2020-08-04&st=2026-03-28T14%3A01%3A06Z&se=2026-03-28T14%3A26%3A06Z&sr=b&sp=r&sig=AYxkyrr3IbeLdESXjdd9QmNEg4ZiUeF%2B%2BO3v1nuSrfg%3D)
2026-03-28 14:03:19 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SD18YWW/698091582/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698091582>
2026-03-28 14:03:19 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SD18YWW/698091573/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698091573>
2026-03-28 14:03:19 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RF21EBD/697663193/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=RF21EBD-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-28 14:03:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D697663345%27 HTTP/1.1" 200 None
2026-03-28 14:03:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=697663345 not downloaded yet
2026-03-28 14:03:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:03:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2d9f0910>
2026-03-28 14:03:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:03:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:03:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:03:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d75bc751-3167-5395-a067-9fe76cc20a2d/d75bc751-3167-5395-a067-9fe76cc20a2d_image_9.jpg HTTP/1.1" 201 0
2026-03-28 14:03:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FOV64PLN%252F698966015%252F600') HTTP/1.1" 204 0
2026-03-28 14:03:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/OV64PLN/698966015/600 saved to cache
2026-03-28 14:03:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item d75bc751-3167-5395-a067-9fe76cc20a2d
2026-03-28 14:03:19 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:03:19 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:03:19 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:03:19 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:03:19 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:03:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:03:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2d9fc610>
2026-03-28 14:03:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:03:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:03:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:03:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4b13d468-b932-5891-9e01-a66081b24d30/4b13d468-b932-5891-9e01-a66081b24d30_image_8.jpg HTTP/1.1" 201 0
2026-03-28 14:03:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FDP19FWW%252F698227117%252F600') HTTP/1.1" 204 0
2026-03-28 14:03:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DP19FWW/698227117/600 saved to cache
2026-03-28 14:03:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 4b13d468-b932-5891-9e01-a66081b24d30
2026-03-28 14:03:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698091644%27 HTTP/1.1" 200 None
2026-03-28 14:03:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698091644 not downloaded yet
2026-03-28 14:03:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D697718386%27 HTTP/1.1" 200 None
2026-03-28 14:03:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=697718386 not downloaded yet
2026-03-28 14:03:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/AO69YDV/42810516?sv=2020-08-04&st=2026-03-28T14%3A03%3A18Z&se=2026-03-28T14%3A28%3A18Z&sr=b&sp=r&sig=kth7LBRcZTbVN2IxcU%2F3tEYuPtUFnu10PDPk4DDda%2Fc%3D> (referer: https://www.bca.co.uk/)
2026-03-28 14:03:19 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DU19WRR/697718372/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=697718372>
2026-03-28 14:03:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D697663366%27 HTTP/1.1" 200 None
2026-03-28 14:03:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=697663366 not downloaded yet
2026-03-28 14:03:19 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:03:19 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:03:19 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:03:19 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:03:19 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:03:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:03:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c658710>
2026-03-28 14:03:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:03:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:03:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:03:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d8436e02-8218-5d88-bcc5-e01ffac7eb8e/d8436e02-8218-5d88-bcc5-e01ffac7eb8e_image_9.jpg HTTP/1.1" 201 0
2026-03-28 14:03:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FFY68WNB%252F698106426%252F600') HTTP/1.1" 204 0
2026-03-28 14:03:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FY68WNB/698106426/600 saved to cache
2026-03-28 14:03:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item d8436e02-8218-5d88-bcc5-e01ffac7eb8e
2026-03-28 14:03:19 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:03:19 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:03:19 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:03:19 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:03:19 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:03:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:03:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2d9b2b50>
2026-03-28 14:03:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:03:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:03:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:03:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5be82b2b-6926-5451-8e0e-f3d801ad1cad/5be82b2b-6926-5451-8e0e-f3d801ad1cad_image_9.jpg HTTP/1.1" 201 0
2026-03-28 14:03:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FEJ13JTO%252F698540362%252F600') HTTP/1.1" 204 0
2026-03-28 14:03:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EJ13JTO/698540362/600 saved to cache
2026-03-28 14:03:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 5be82b2b-6926-5451-8e0e-f3d801ad1cad
2026-03-28 14:03:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:03:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c5f8fd0>
2026-03-28 14:03:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:03:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:03:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:03:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d8f0d404-7eeb-556b-ba0e-71ee720847de/d8f0d404-7eeb-556b-ba0e-71ee720847de_expert_report_file_5a8e762a-f606-4130-a959-1ff32bcd893d.pdf HTTP/1.1" 201 0
2026-03-28 14:03:19 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item d8f0d404-7eeb-556b-ba0e-71ee720847de
2026-03-28 14:03:19 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: d8f0d404-7eeb-556b-ba0e-71ee720847de, skipping ID generation
2026-03-28 14:03:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item d8f0d404-7eeb-556b-ba0e-71ee720847de
2026-03-28 14:03:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DDG65GXU-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-28 14:03:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=DG65GXU-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-28 14:03:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:03:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2d9b1510>
2026-03-28 14:03:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:03:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:03:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:03:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_05627c71-8f78-5f09-9412-0b2354bea98e/05627c71-8f78-5f09-9412-0b2354bea98e_expert_report_file_a7c2886b-381a-4890-a14a-26248553084e.pdf HTTP/1.1" 201 0
2026-03-28 14:03:19 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item 05627c71-8f78-5f09-9412-0b2354bea98e
2026-03-28 14:03:19 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 05627c71-8f78-5f09-9412-0b2354bea98e, skipping ID generation
2026-03-28 14:03:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 05627c71-8f78-5f09-9412-0b2354bea98e
2026-03-28 14:03:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DYY70LWT-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-28 14:03:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=YY70LWT-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-28 14:03:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D697718389%27 HTTP/1.1" 200 None
2026-03-28 14:03:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=697718389 not downloaded yet
2026-03-28 14:03:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/ND17VGZ/698929223/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/ND17VGZ/42810273?sv=2020-08-04&st=2026-03-28T14%3A01%3A05Z&se=2026-03-28T14%3A26%3A05Z&sr=b&sp=r&sig=Ddznt5rliWG2eSFSeV1iYUxjjPUcheWJt3FgNXERnUs%3D)
2026-03-28 14:03:19 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DU19WRR/697718377/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=697718377>
2026-03-28 14:03:19 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DU19WRR/697718376/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=697718376>
2026-03-28 14:03:19 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SD18YWW/698091618/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698091618>
2026-03-28 14:03:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LR11XWM/697880617/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LR11XWM/42810294?sv=2020-08-04&st=2026-03-28T14%3A01%3A05Z&se=2026-03-28T14%3A26%3A05Z&sr=b&sp=r&sig=zHl%2Fkz2fSAoGVBY8ukVZULGVCGKqbTVidyooaEEBPNc%3D)
2026-03-28 14:03:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EA24TKX/698296254/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/EA24TKX/42810378?sv=2020-08-04&st=2026-03-28T14%3A01%3A05Z&se=2026-03-28T14%3A26%3A05Z&sr=b&sp=r&sig=Ajk9rVQfTHJs3R0cJnmP5VnSS5rSnHfV6UlI7D3mmDQ%3D)
2026-03-28 14:03:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D697663376%27 HTTP/1.1" 200 None
2026-03-28 14:03:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=697663376 not downloaded yet
2026-03-28 14:03:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698271509%27 HTTP/1.1" 200 None
2026-03-28 14:03:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698271509 not downloaded yet
2026-03-28 14:03:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698474551%27 HTTP/1.1" 200 None
2026-03-28 14:03:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698474551 not downloaded yet
2026-03-28 14:03:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D697718393%27 HTTP/1.1" 200 None
2026-03-28 14:03:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=697718393 not downloaded yet
2026-03-28 14:03:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:03:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2d7da510>
2026-03-28 14:03:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:03:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:03:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:03:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4766d63c-47f2-5b85-8b2c-c4d089a16b5c/4766d63c-47f2-5b85-8b2c-c4d089a16b5c_image_2.jpg HTTP/1.1" 201 0
2026-03-28 14:03:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FWV13ZTH%252F698929295%252F600') HTTP/1.1" 204 0
2026-03-28 14:03:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WV13ZTH/698929295/600 saved to cache
2026-03-28 14:03:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 4766d63c-47f2-5b85-8b2c-c4d089a16b5c
2026-03-28 14:03:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:03:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c64db10>
2026-03-28 14:03:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:03:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:03:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:03:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_561c0b4f-3a2d-562b-bb16-d69244165df3/561c0b4f-3a2d-562b-bb16-d69244165df3_image_3.jpg HTTP/1.1" 201 0
2026-03-28 14:03:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FYK67BOU%252F698928843%252F600') HTTP/1.1" 204 0
2026-03-28 14:03:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YK67BOU/698928843/600 saved to cache
2026-03-28 14:03:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 561c0b4f-3a2d-562b-bb16-d69244165df3
2026-03-28 14:03:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:03:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a3008fb10>
2026-03-28 14:03:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:03:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:03:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:03:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e788d11e-974b-5084-adb6-d49a23c42616/e788d11e-974b-5084-adb6-d49a23c42616_image_3.jpg HTTP/1.1" 201 0
2026-03-28 14:03:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FX28AVE%252F698923736%252F600') HTTP/1.1" 204 0
2026-03-28 14:03:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/X28AVE/698923736/600 saved to cache
2026-03-28 14:03:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item e788d11e-974b-5084-adb6-d49a23c42616
2026-03-28 14:03:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:03:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a1fed3350>
2026-03-28 14:03:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:03:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:03:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:03:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_05dbf1b7-4974-55c1-bc1d-1c2597466589/05dbf1b7-4974-55c1-bc1d-1c2597466589_expert_report_file_4befd2a5-6505-426b-becf-a419aa7b2643.pdf HTTP/1.1" 201 0
2026-03-28 14:03:20 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item 05dbf1b7-4974-55c1-bc1d-1c2597466589
2026-03-28 14:03:20 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 05dbf1b7-4974-55c1-bc1d-1c2597466589, skipping ID generation
2026-03-28 14:03:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 05dbf1b7-4974-55c1-bc1d-1c2597466589
2026-03-28 14:03:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DAO69YDV-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-28 14:03:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=AO69YDV-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-28 14:03:20 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RF21EBD/697663290/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=697663290>
2026-03-28 14:03:20 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RF21EBD/697663258/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=697663258>
2026-03-28 14:03:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698271512%27 HTTP/1.1" 200 None
2026-03-28 14:03:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698271512 not downloaded yet
2026-03-28 14:03:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698474577%27 HTTP/1.1" 200 None
2026-03-28 14:03:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698474577 not downloaded yet
2026-03-28 14:03:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D697718395%27 HTTP/1.1" 200 None
2026-03-28 14:03:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=697718395 not downloaded yet
2026-03-28 14:03:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698941070%27 HTTP/1.1" 200 None
2026-03-28 14:03:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698941070 not downloaded yet
2026-03-28 14:03:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698271514%27 HTTP/1.1" 200 None
2026-03-28 14:03:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698271514 not downloaded yet
2026-03-28 14:03:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698474602%27 HTTP/1.1" 200 None
2026-03-28 14:03:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698474602 not downloaded yet
2026-03-28 14:03:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:03:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c863c50>
2026-03-28 14:03:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:03:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:03:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:03:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_03d2b309-0f29-57c0-bf73-2b86c16c227a/03d2b309-0f29-57c0-bf73-2b86c16c227a_image_0.jpg HTTP/1.1" 201 0
2026-03-28 14:03:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FND17VGZ%252F698929223%252F600') HTTP/1.1" 204 0
2026-03-28 14:03:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/ND17VGZ/698929223/600 saved to cache
2026-03-28 14:03:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 03d2b309-0f29-57c0-bf73-2b86c16c227a
2026-03-28 14:03:20 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 03d2b309-0f29-57c0-bf73-2b86c16c227a, skipping ID generation
2026-03-28 14:03:20 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 03d2b309-0f29-57c0-bf73-2b86c16c227a sending to next pipeline
2026-03-28 14:03:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 03d2b309-0f29-57c0-bf73-2b86c16c227a, identifier: ND17%20VGZ
2026-03-28 14:03:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:03:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c0cd410>
2026-03-28 14:03:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:03:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:03:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:03:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0b12c0fe-3ab8-5445-ad6b-256ccebc3b9e/0b12c0fe-3ab8-5445-ad6b-256ccebc3b9e_image_5.jpg HTTP/1.1" 201 0
2026-03-28 14:03:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLR11XWM%252F697880617%252F600') HTTP/1.1" 204 0
2026-03-28 14:03:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LR11XWM/697880617/600 saved to cache
2026-03-28 14:03:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 0b12c0fe-3ab8-5445-ad6b-256ccebc3b9e
2026-03-28 14:03:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:03:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a1fd60850>
2026-03-28 14:03:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:03:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:03:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:03:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a936dd22-4905-520e-8ef4-c3c73c56eba4/a936dd22-4905-520e-8ef4-c3c73c56eba4_image_5.jpg HTTP/1.1" 201 0
2026-03-28 14:03:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FEA24TKX%252F698296254%252F600') HTTP/1.1" 204 0
2026-03-28 14:03:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EA24TKX/698296254/600 saved to cache
2026-03-28 14:03:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item a936dd22-4905-520e-8ef4-c3c73c56eba4
2026-03-28 14:03:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SD18YWW/698091582/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/SD18YWW/42810346?sv=2020-08-04&st=2026-03-28T14%3A03%3A14Z&se=2026-03-28T14%3A28%3A14Z&sr=b&sp=r&sig=7AasTz5GkcbVg3mZlAj5bXm4eRmFaqXEvgRF5S45ypY%3D)
2026-03-28 14:03:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RF21EBD/697663193/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/RF21EBD/42809773?sv=2020-08-04&st=2026-03-28T14%3A03%3A14Z&se=2026-03-28T14%3A28%3A14Z&sr=b&sp=r&sig=fw1hk%2FxP20iV0pBAL7NeH7NwSGkh4C74QjCjIGW34mQ%3D)
2026-03-28 14:03:20 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RF21EBD/697663323/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=697663323>
2026-03-28 14:03:20 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DU19WRR/697718379/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=697718379>
2026-03-28 14:03:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698941096%27 HTTP/1.1" 200 None
2026-03-28 14:03:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698941096 not downloaded yet
2026-03-28 14:03:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 03d2b309-0f29-57c0-bf73-2b86c16c227a with identifier: ND17%20VGZ
2026-03-28 14:03:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 03d2b309-0f29-57c0-bf73-2b86c16c227a with identifier: ND17%20VGZ
2026-03-28 14:03:20 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 03d2b309-0f29-57c0-bf73-2b86c16c227a with identifier: ND17%20VGZ to the API
2026-03-28 14:03:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:03:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:03:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/ND17VGZ/698929223/600>
{'auction_title': '',
'c_o_2_emission_value': 107,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_03d2b309-0f29-57c0-bf73-2b86c16c227a/03d2b309-0f29-57c0-bf73-2b86c16c227a_expert_report_file_bdb6cb51-6d35-4b6c-8ad3-62f4b946f3a3.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=ND17%20VGZ-GB',
'category': 'Car',
'color': 'blue',
'currency': 'GBP',
'doors_number': 5,
'engine': '2.2L',
'expiration_date': '2026-03-29T10:00:00Z',
'fuel_type': 'Diesel',
'id': '03d2b309-0f29-57c0-bf73-2b86c16c227a',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'ND17 VGZ',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=ND17%20VGZ&vehicleType=*',
'listing': 'auction',
'location': 'Walsall',
'make': 'MAZDA',
'model': '3',
'odometer': 76902,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 11,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_03d2b309-0f29-57c0-bf73-2b86c16c227a/03d2b309-0f29-57c0-bf73-2b86c16c227a_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 43734,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/ND17VGZ/698929223/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_03d2b309-0f29-57c0-bf73-2b86c16c227a/03d2b309-0f29-57c0-bf73-2b86c16c227a_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 44153,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/ND17VGZ/698929237/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_03d2b309-0f29-57c0-bf73-2b86c16c227a/03d2b309-0f29-57c0-bf73-2b86c16c227a_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 42743,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/ND17VGZ/698929257/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_03d2b309-0f29-57c0-bf73-2b86c16c227a/03d2b309-0f29-57c0-bf73-2b86c16c227a_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 42035,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/ND17VGZ/698929269/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_03d2b309-0f29-57c0-bf73-2b86c16c227a/03d2b309-0f29-57c0-bf73-2b86c16c227a_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 40018,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/ND17VGZ/698929290/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_03d2b309-0f29-57c0-bf73-2b86c16c227a/03d2b309-0f29-57c0-bf73-2b86c16c227a_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 40575,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/ND17VGZ/698929297/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_03d2b309-0f29-57c0-bf73-2b86c16c227a/03d2b309-0f29-57c0-bf73-2b86c16c227a_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 93641,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/ND17VGZ/698929315/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_03d2b309-0f29-57c0-bf73-2b86c16c227a/03d2b309-0f29-57c0-bf73-2b86c16c227a_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 87156,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/ND17VGZ/698929328/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_03d2b309-0f29-57c0-bf73-2b86c16c227a/03d2b309-0f29-57c0-bf73-2b86c16c227a_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 93461,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/ND17VGZ/698929339/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_03d2b309-0f29-57c0-bf73-2b86c16c227a/03d2b309-0f29-57c0-bf73-2b86c16c227a_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 73236,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/ND17VGZ/698929349/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-01-01',
'seller_name': None,
'title': 'MAZDA 3 2.2 D SPORT Hatchback',
'transmission': 'manual',
'trim': 'D SPORT',
'vin': 'JMZBN642601522059',
'year': 2017}
2026-03-28 14:03:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27ND17%2520VGZ%27 HTTP/1.1" 200 None
2026-03-28 14:03:20 [bca.uk] INFO: Saving data for ND17%20VGZ: {'created_time': 1774706600.99855, 'last_price_update_time': 1774706600.998562, 'auction_closing_time': 1774778400.0}
2026-03-28 14:03:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='ND17%2520VGZ') HTTP/1.1" 204 0
2026-03-28 14:03:21 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SD18YWW/698091624/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698091624>
2026-03-28 14:03:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SD18YWW/698091573/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/SD18YWW/42810346?sv=2020-08-04&st=2026-03-28T14%3A03%3A14Z&se=2026-03-28T14%3A28%3A14Z&sr=b&sp=r&sig=7AasTz5GkcbVg3mZlAj5bXm4eRmFaqXEvgRF5S45ypY%3D)
2026-03-28 14:03:21 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RF21EBD/697663345/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=697663345>
2026-03-28 14:03:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DU19WRR/697718372/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/DU19WRR/42810292?sv=2020-08-04&st=2026-03-28T14%3A03%3A15Z&se=2026-03-28T14%3A28%3A15Z&sr=b&sp=r&sig=MtD%2F8L7XEKrXW%2B2op3%2BPdiCG6LVJvVg4cKAzJgc4HxE%3D)
2026-03-28 14:03:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698271517%27 HTTP/1.1" 200 None
2026-03-28 14:03:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698271517 not downloaded yet
2026-03-28 14:03:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698474627%27 HTTP/1.1" 200 None
2026-03-28 14:03:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698474627 not downloaded yet
2026-03-28 14:03:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698941135%27 HTTP/1.1" 200 None
2026-03-28 14:03:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698941135 not downloaded yet
2026-03-28 14:03:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698271518%27 HTTP/1.1" 200 None
2026-03-28 14:03:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698271518 not downloaded yet
2026-03-28 14:03:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698474652%27 HTTP/1.1" 200 None
2026-03-28 14:03:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698474652 not downloaded yet
2026-03-28 14:03:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698941155%27 HTTP/1.1" 200 None
2026-03-28 14:03:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698941155 not downloaded yet
2026-03-28 14:03:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:03:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c861990>
2026-03-28 14:03:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:03:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:03:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:03:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_12688ef2-2fc1-5a39-9796-e8677733238c/12688ef2-2fc1-5a39-9796-e8677733238c_image_2.jpg HTTP/1.1" 201 0
2026-03-28 14:03:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FSD18YWW%252F698091582%252F600') HTTP/1.1" 204 0
2026-03-28 14:03:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SD18YWW/698091582/600 saved to cache
2026-03-28 14:03:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 12688ef2-2fc1-5a39-9796-e8677733238c
2026-03-28 14:03:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:03:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a1fea1d10>
2026-03-28 14:03:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:03:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:03:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:03:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_32911a92-e281-56af-bde9-3b2fa177bca3/32911a92-e281-56af-bde9-3b2fa177bca3_image_0.jpg HTTP/1.1" 201 0
2026-03-28 14:03:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FRF21EBD%252F697663193%252F600') HTTP/1.1" 204 0
2026-03-28 14:03:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RF21EBD/697663193/600 saved to cache
2026-03-28 14:03:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 32911a92-e281-56af-bde9-3b2fa177bca3
2026-03-28 14:03:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DU19WRR/697718376/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/DU19WRR/42810292?sv=2020-08-04&st=2026-03-28T14%3A03%3A15Z&se=2026-03-28T14%3A28%3A15Z&sr=b&sp=r&sig=MtD%2F8L7XEKrXW%2B2op3%2BPdiCG6LVJvVg4cKAzJgc4HxE%3D)
2026-03-28 14:03:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DU19WRR/697718377/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/DU19WRR/42810292?sv=2020-08-04&st=2026-03-28T14%3A03%3A15Z&se=2026-03-28T14%3A28%3A15Z&sr=b&sp=r&sig=MtD%2F8L7XEKrXW%2B2op3%2BPdiCG6LVJvVg4cKAzJgc4HxE%3D)
2026-03-28 14:03:21 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DU19WRR/697718389/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=697718389>
2026-03-28 14:03:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698271523%27 HTTP/1.1" 200 None
2026-03-28 14:03:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698271523 not downloaded yet
2026-03-28 14:03:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698474680%27 HTTP/1.1" 200 None
2026-03-28 14:03:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698474680 not downloaded yet
2026-03-28 14:03:21 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DG65GXU/698271506/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=DG65GXU-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-28 14:03:21 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YY70LWT/698474530/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=YY70LWT-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-28 14:03:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RF21EBD/697663290/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/RF21EBD/42809773?sv=2020-08-04&st=2026-03-28T14%3A03%3A14Z&se=2026-03-28T14%3A28%3A14Z&sr=b&sp=r&sig=fw1hk%2FxP20iV0pBAL7NeH7NwSGkh4C74QjCjIGW34mQ%3D)
2026-03-28 14:03:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RF21EBD/697663258/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/RF21EBD/42809773?sv=2020-08-04&st=2026-03-28T14%3A03%3A14Z&se=2026-03-28T14%3A28%3A14Z&sr=b&sp=r&sig=fw1hk%2FxP20iV0pBAL7NeH7NwSGkh4C74QjCjIGW34mQ%3D)
2026-03-28 14:03:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SD18YWW/698091618/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/SD18YWW/42810346?sv=2020-08-04&st=2026-03-28T14%3A03%3A14Z&se=2026-03-28T14%3A28%3A14Z&sr=b&sp=r&sig=7AasTz5GkcbVg3mZlAj5bXm4eRmFaqXEvgRF5S45ypY%3D)
2026-03-28 14:03:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698941176%27 HTTP/1.1" 200 None
2026-03-28 14:03:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698941176 not downloaded yet
2026-03-28 14:03:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698271527%27 HTTP/1.1" 200 None
2026-03-28 14:03:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698271527 not downloaded yet
2026-03-28 14:03:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698474703%27 HTTP/1.1" 200 None
2026-03-28 14:03:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698474703 not downloaded yet
2026-03-28 14:03:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698941196%27 HTTP/1.1" 200 None
2026-03-28 14:03:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698941196 not downloaded yet
2026-03-28 14:03:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698271534%27 HTTP/1.1" 200 None
2026-03-28 14:03:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698271534 not downloaded yet
2026-03-28 14:03:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698474726%27 HTTP/1.1" 200 None
2026-03-28 14:03:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698474726 not downloaded yet
2026-03-28 14:03:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:03:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c51fcd0>
2026-03-28 14:03:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:03:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:03:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:03:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_12688ef2-2fc1-5a39-9796-e8677733238c/12688ef2-2fc1-5a39-9796-e8677733238c_image_1.jpg HTTP/1.1" 201 0
2026-03-28 14:03:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FSD18YWW%252F698091573%252F600') HTTP/1.1" 204 0
2026-03-28 14:03:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SD18YWW/698091573/600 saved to cache
2026-03-28 14:03:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 12688ef2-2fc1-5a39-9796-e8677733238c
2026-03-28 14:03:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:03:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c9b6190>
2026-03-28 14:03:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:03:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:03:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:03:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_25ea238e-697d-5563-a2fc-e7cf5710c862/25ea238e-697d-5563-a2fc-e7cf5710c862_image_1.jpg HTTP/1.1" 201 0
2026-03-28 14:03:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FDU19WRR%252F697718372%252F600') HTTP/1.1" 204 0
2026-03-28 14:03:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DU19WRR/697718372/600 saved to cache
2026-03-28 14:03:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 25ea238e-697d-5563-a2fc-e7cf5710c862
2026-03-28 14:03:21 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AO69YDV/698941096/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698941096>
2026-03-28 14:03:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698941232%27 HTTP/1.1" 200 None
2026-03-28 14:03:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698941232 not downloaded yet
2026-03-28 14:03:21 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YY70LWT/698474602/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698474602>
2026-03-28 14:03:21 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DU19WRR/697718395/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=697718395>
2026-03-28 14:03:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DU19WRR/697718379/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/DU19WRR/42810292?sv=2020-08-04&st=2026-03-28T14%3A03%3A15Z&se=2026-03-28T14%3A28%3A15Z&sr=b&sp=r&sig=MtD%2F8L7XEKrXW%2B2op3%2BPdiCG6LVJvVg4cKAzJgc4HxE%3D)
2026-03-28 14:03:21 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AO69YDV/698941070/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698941070>
2026-03-28 14:03:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RF21EBD/697663345/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/RF21EBD/42809773?sv=2020-08-04&st=2026-03-28T14%3A03%3A14Z&se=2026-03-28T14%3A28%3A14Z&sr=b&sp=r&sig=fw1hk%2FxP20iV0pBAL7NeH7NwSGkh4C74QjCjIGW34mQ%3D)
2026-03-28 14:03:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RF21EBD/697663323/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/RF21EBD/42809773?sv=2020-08-04&st=2026-03-28T14%3A03%3A14Z&se=2026-03-28T14%3A28%3A14Z&sr=b&sp=r&sig=fw1hk%2FxP20iV0pBAL7NeH7NwSGkh4C74QjCjIGW34mQ%3D)
2026-03-28 14:03:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698271540%27 HTTP/1.1" 200 None
2026-03-28 14:03:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698271540 not downloaded yet
2026-03-28 14:03:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698474759%27 HTTP/1.1" 200 None
2026-03-28 14:03:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698474759 not downloaded yet
2026-03-28 14:03:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:03:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c890390>
2026-03-28 14:03:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:03:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:03:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:03:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_25ea238e-697d-5563-a2fc-e7cf5710c862/25ea238e-697d-5563-a2fc-e7cf5710c862_image_2.jpg HTTP/1.1" 201 0
2026-03-28 14:03:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FDU19WRR%252F697718376%252F600') HTTP/1.1" 204 0
2026-03-28 14:03:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DU19WRR/697718376/600 saved to cache
2026-03-28 14:03:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 25ea238e-697d-5563-a2fc-e7cf5710c862
2026-03-28 14:03:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:03:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a1ffb25d0>
2026-03-28 14:03:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:03:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:03:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:03:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_25ea238e-697d-5563-a2fc-e7cf5710c862/25ea238e-697d-5563-a2fc-e7cf5710c862_image_3.jpg HTTP/1.1" 201 0
2026-03-28 14:03:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FDU19WRR%252F697718377%252F600') HTTP/1.1" 204 0
2026-03-28 14:03:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DU19WRR/697718377/600 saved to cache
2026-03-28 14:03:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 25ea238e-697d-5563-a2fc-e7cf5710c862
2026-03-28 14:03:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SD18YWW/698091624/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/SD18YWW/42810346?sv=2020-08-04&st=2026-03-28T14%3A03%3A14Z&se=2026-03-28T14%3A28%3A14Z&sr=b&sp=r&sig=7AasTz5GkcbVg3mZlAj5bXm4eRmFaqXEvgRF5S45ypY%3D)
2026-03-28 14:03:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698941257%27 HTTP/1.1" 200 None
2026-03-28 14:03:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698941257 not downloaded yet
2026-03-28 14:03:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698941275%27 HTTP/1.1" 200 None
2026-03-28 14:03:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698941275 not downloaded yet
2026-03-28 14:03:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:03:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c418ed0>
2026-03-28 14:03:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:03:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:03:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:03:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_32911a92-e281-56af-bde9-3b2fa177bca3/32911a92-e281-56af-bde9-3b2fa177bca3_image_5.jpg HTTP/1.1" 201 0
2026-03-28 14:03:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FRF21EBD%252F697663290%252F600') HTTP/1.1" 204 0
2026-03-28 14:03:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RF21EBD/697663290/600 saved to cache
2026-03-28 14:03:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 32911a92-e281-56af-bde9-3b2fa177bca3
2026-03-28 14:03:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:03:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2d9bee10>
2026-03-28 14:03:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:03:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:03:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:03:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_32911a92-e281-56af-bde9-3b2fa177bca3/32911a92-e281-56af-bde9-3b2fa177bca3_image_4.jpg HTTP/1.1" 201 0
2026-03-28 14:03:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FRF21EBD%252F697663258%252F600') HTTP/1.1" 204 0
2026-03-28 14:03:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RF21EBD/697663258/600 saved to cache
2026-03-28 14:03:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 32911a92-e281-56af-bde9-3b2fa177bca3
2026-03-28 14:03:21 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:03:21 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:03:21 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:03:21 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:03:21 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:03:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:03:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c898890>
2026-03-28 14:03:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:03:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:03:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:03:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_12688ef2-2fc1-5a39-9796-e8677733238c/12688ef2-2fc1-5a39-9796-e8677733238c_image_6.jpg HTTP/1.1" 201 0
2026-03-28 14:03:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FSD18YWW%252F698091618%252F600') HTTP/1.1" 204 0
2026-03-28 14:03:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SD18YWW/698091618/600 saved to cache
2026-03-28 14:03:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 12688ef2-2fc1-5a39-9796-e8677733238c
2026-03-28 14:03:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:03:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a1fed0390>
2026-03-28 14:03:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:03:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:03:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:03:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_25ea238e-697d-5563-a2fc-e7cf5710c862/25ea238e-697d-5563-a2fc-e7cf5710c862_image_4.jpg HTTP/1.1" 201 0
2026-03-28 14:03:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FDU19WRR%252F697718379%252F600') HTTP/1.1" 204 0
2026-03-28 14:03:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DU19WRR/697718379/600 saved to cache
2026-03-28 14:03:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 25ea238e-697d-5563-a2fc-e7cf5710c862
2026-03-28 14:03:21 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:03:21 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:03:21 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:03:21 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:03:21 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:03:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:03:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a1fd60f50>
2026-03-28 14:03:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:03:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:03:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:03:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_32911a92-e281-56af-bde9-3b2fa177bca3/32911a92-e281-56af-bde9-3b2fa177bca3_image_7.jpg HTTP/1.1" 201 0
2026-03-28 14:03:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FRF21EBD%252F697663345%252F600') HTTP/1.1" 204 0
2026-03-28 14:03:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RF21EBD/697663345/600 saved to cache
2026-03-28 14:03:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 32911a92-e281-56af-bde9-3b2fa177bca3
2026-03-28 14:03:21 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:03:21 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:03:21 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:03:21 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:03:21 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:03:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:03:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a1fea0990>
2026-03-28 14:03:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:03:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:03:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:03:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_32911a92-e281-56af-bde9-3b2fa177bca3/32911a92-e281-56af-bde9-3b2fa177bca3_image_6.jpg HTTP/1.1" 201 0
2026-03-28 14:03:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FRF21EBD%252F697663323%252F600') HTTP/1.1" 204 0
2026-03-28 14:03:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RF21EBD/697663323/600 saved to cache
2026-03-28 14:03:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 32911a92-e281-56af-bde9-3b2fa177bca3
2026-03-28 14:03:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DG65GXU/698271506/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/DG65GXU/42797313?sv=2020-08-04&st=2026-03-28T14%3A03%3A17Z&se=2026-03-28T14%3A28%3A17Z&sr=b&sp=r&sig=45h4YfquPE4gw%2FlPB0vAarzO40zZuLap4z1MHRigzDY%3D)
2026-03-28 14:03:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DU19WRR/697718389/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/DU19WRR/42810292?sv=2020-08-04&st=2026-03-28T14%3A03%3A15Z&se=2026-03-28T14%3A28%3A15Z&sr=b&sp=r&sig=MtD%2F8L7XEKrXW%2B2op3%2BPdiCG6LVJvVg4cKAzJgc4HxE%3D)
2026-03-28 14:03:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YY70LWT/698474530/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YY70LWT/42810193?sv=2020-08-04&st=2026-03-28T14%3A03%3A18Z&se=2026-03-28T14%3A28%3A18Z&sr=b&sp=r&sig=PQQPbp7LgcrcfGY8GkVfWOvV1ULKBqIo0aCZ8cnvWF4%3D)
2026-03-28 14:03:21 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AO69YDV/698941155/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698941155>
2026-03-28 14:03:21 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DG65GXU/698271518/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698271518>
2026-03-28 14:03:21 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AO69YDV/698941135/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698941135>
2026-03-28 14:03:21 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YY70LWT/698474652/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698474652>
2026-03-28 14:03:21 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YY70LWT/698474627/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698474627>
2026-03-28 14:03:21 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:03:21 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:03:21 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:03:21 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:03:21 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:03:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:03:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2d97a750>
2026-03-28 14:03:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:03:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:03:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:03:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_12688ef2-2fc1-5a39-9796-e8677733238c/12688ef2-2fc1-5a39-9796-e8677733238c_image_7.jpg HTTP/1.1" 201 0
2026-03-28 14:03:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FSD18YWW%252F698091624%252F600') HTTP/1.1" 204 0
2026-03-28 14:03:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SD18YWW/698091624/600 saved to cache
2026-03-28 14:03:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 12688ef2-2fc1-5a39-9796-e8677733238c
2026-03-28 14:03:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AO69YDV/698941096/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/AO69YDV/42810516?sv=2020-08-04&st=2026-03-28T14%3A03%3A18Z&se=2026-03-28T14%3A28%3A18Z&sr=b&sp=r&sig=kth7LBRcZTbVN2IxcU%2F3tEYuPtUFnu10PDPk4DDda%2Fc%3D)
2026-03-28 14:03:21 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AO69YDV/698941196/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698941196>
2026-03-28 14:03:21 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YY70LWT/698474726/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698474726>
2026-03-28 14:03:21 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AO69YDV/698941232/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698941232>
2026-03-28 14:03:21 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DG65GXU/698271534/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698271534>
2026-03-28 14:03:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:03:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a3008e750>
2026-03-28 14:03:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:03:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:03:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:03:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d8f0d404-7eeb-556b-ba0e-71ee720847de/d8f0d404-7eeb-556b-ba0e-71ee720847de_image_0.jpg HTTP/1.1" 201 0
2026-03-28 14:03:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FDG65GXU%252F698271506%252F600') HTTP/1.1" 204 0
2026-03-28 14:03:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DG65GXU/698271506/600 saved to cache
2026-03-28 14:03:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item d8f0d404-7eeb-556b-ba0e-71ee720847de
2026-03-28 14:03:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AO69YDV/698941070/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/AO69YDV/42810516?sv=2020-08-04&st=2026-03-28T14%3A03%3A18Z&se=2026-03-28T14%3A28%3A18Z&sr=b&sp=r&sig=kth7LBRcZTbVN2IxcU%2F3tEYuPtUFnu10PDPk4DDda%2Fc%3D)
2026-03-28 14:03:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YY70LWT/698474602/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YY70LWT/42810193?sv=2020-08-04&st=2026-03-28T14%3A03%3A18Z&se=2026-03-28T14%3A28%3A18Z&sr=b&sp=r&sig=PQQPbp7LgcrcfGY8GkVfWOvV1ULKBqIo0aCZ8cnvWF4%3D)
2026-03-28 14:03:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AO69YDV/698941135/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/AO69YDV/42810516?sv=2020-08-04&st=2026-03-28T14%3A03%3A18Z&se=2026-03-28T14%3A28%3A18Z&sr=b&sp=r&sig=kth7LBRcZTbVN2IxcU%2F3tEYuPtUFnu10PDPk4DDda%2Fc%3D)
2026-03-28 14:03:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YY70LWT/698474627/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YY70LWT/42810193?sv=2020-08-04&st=2026-03-28T14%3A03%3A18Z&se=2026-03-28T14%3A28%3A18Z&sr=b&sp=r&sig=PQQPbp7LgcrcfGY8GkVfWOvV1ULKBqIo0aCZ8cnvWF4%3D)
2026-03-28 14:03:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AO69YDV/698941155/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/AO69YDV/42810516?sv=2020-08-04&st=2026-03-28T14%3A03%3A18Z&se=2026-03-28T14%3A28%3A18Z&sr=b&sp=r&sig=kth7LBRcZTbVN2IxcU%2F3tEYuPtUFnu10PDPk4DDda%2Fc%3D)
2026-03-28 14:03:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DU19WRR/697718395/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/DU19WRR/42810292?sv=2020-08-04&st=2026-03-28T14%3A03%3A15Z&se=2026-03-28T14%3A28%3A15Z&sr=b&sp=r&sig=MtD%2F8L7XEKrXW%2B2op3%2BPdiCG6LVJvVg4cKAzJgc4HxE%3D)
2026-03-28 14:03:22 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:03:22 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:03:22 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:03:22 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:03:22 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:03:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:03:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c99f6d0>
2026-03-28 14:03:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:03:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:03:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:03:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_25ea238e-697d-5563-a2fc-e7cf5710c862/25ea238e-697d-5563-a2fc-e7cf5710c862_image_7.jpg HTTP/1.1" 201 0
2026-03-28 14:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FDU19WRR%252F697718389%252F600') HTTP/1.1" 204 0
2026-03-28 14:03:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DU19WRR/697718389/600 saved to cache
2026-03-28 14:03:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 25ea238e-697d-5563-a2fc-e7cf5710c862
2026-03-28 14:03:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:03:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c5e8cd0>
2026-03-28 14:03:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:03:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:03:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:03:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_05627c71-8f78-5f09-9412-0b2354bea98e/05627c71-8f78-5f09-9412-0b2354bea98e_image_0.jpg HTTP/1.1" 201 0
2026-03-28 14:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FYY70LWT%252F698474530%252F600') HTTP/1.1" 204 0
2026-03-28 14:03:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YY70LWT/698474530/600 saved to cache
2026-03-28 14:03:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 05627c71-8f78-5f09-9412-0b2354bea98e
2026-03-28 14:03:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:03:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2d9bd350>
2026-03-28 14:03:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:03:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:03:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:03:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_05dbf1b7-4974-55c1-bc1d-1c2597466589/05dbf1b7-4974-55c1-bc1d-1c2597466589_image_2.jpg HTTP/1.1" 201 0
2026-03-28 14:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FAO69YDV%252F698941096%252F600') HTTP/1.1" 204 0
2026-03-28 14:03:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AO69YDV/698941096/600 saved to cache
2026-03-28 14:03:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 05dbf1b7-4974-55c1-bc1d-1c2597466589
2026-03-28 14:03:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DG65GXU/698271518/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/DG65GXU/42797313?sv=2020-08-04&st=2026-03-28T14%3A03%3A17Z&se=2026-03-28T14%3A28%3A17Z&sr=b&sp=r&sig=45h4YfquPE4gw%2FlPB0vAarzO40zZuLap4z1MHRigzDY%3D)
2026-03-28 14:03:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YY70LWT/698474652/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YY70LWT/42810193?sv=2020-08-04&st=2026-03-28T14%3A03%3A18Z&se=2026-03-28T14%3A28%3A18Z&sr=b&sp=r&sig=PQQPbp7LgcrcfGY8GkVfWOvV1ULKBqIo0aCZ8cnvWF4%3D)
2026-03-28 14:03:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:03:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2d692a50>
2026-03-28 14:03:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:03:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:03:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:03:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_05dbf1b7-4974-55c1-bc1d-1c2597466589/05dbf1b7-4974-55c1-bc1d-1c2597466589_image_1.jpg HTTP/1.1" 201 0
2026-03-28 14:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FAO69YDV%252F698941070%252F600') HTTP/1.1" 204 0
2026-03-28 14:03:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AO69YDV/698941070/600 saved to cache
2026-03-28 14:03:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 05dbf1b7-4974-55c1-bc1d-1c2597466589
2026-03-28 14:03:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:03:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c59bf10>
2026-03-28 14:03:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:03:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:03:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:03:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_05627c71-8f78-5f09-9412-0b2354bea98e/05627c71-8f78-5f09-9412-0b2354bea98e_image_3.jpg HTTP/1.1" 201 0
2026-03-28 14:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FYY70LWT%252F698474602%252F600') HTTP/1.1" 204 0
2026-03-28 14:03:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YY70LWT/698474602/600 saved to cache
2026-03-28 14:03:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 05627c71-8f78-5f09-9412-0b2354bea98e
2026-03-28 14:03:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:03:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a1fda8410>
2026-03-28 14:03:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:03:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:03:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:03:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_05dbf1b7-4974-55c1-bc1d-1c2597466589/05dbf1b7-4974-55c1-bc1d-1c2597466589_image_3.jpg HTTP/1.1" 201 0
2026-03-28 14:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FAO69YDV%252F698941135%252F600') HTTP/1.1" 204 0
2026-03-28 14:03:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AO69YDV/698941135/600 saved to cache
2026-03-28 14:03:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 05dbf1b7-4974-55c1-bc1d-1c2597466589
2026-03-28 14:03:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:03:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c5993d0>
2026-03-28 14:03:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:03:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:03:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:03:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_05627c71-8f78-5f09-9412-0b2354bea98e/05627c71-8f78-5f09-9412-0b2354bea98e_image_4.jpg HTTP/1.1" 201 0
2026-03-28 14:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FYY70LWT%252F698474627%252F600') HTTP/1.1" 204 0
2026-03-28 14:03:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YY70LWT/698474627/600 saved to cache
2026-03-28 14:03:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 05627c71-8f78-5f09-9412-0b2354bea98e
2026-03-28 14:03:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:03:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2d979350>
2026-03-28 14:03:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:03:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:03:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:03:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_05dbf1b7-4974-55c1-bc1d-1c2597466589/05dbf1b7-4974-55c1-bc1d-1c2597466589_image_4.jpg HTTP/1.1" 201 0
2026-03-28 14:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FAO69YDV%252F698941155%252F600') HTTP/1.1" 204 0
2026-03-28 14:03:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AO69YDV/698941155/600 saved to cache
2026-03-28 14:03:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 05dbf1b7-4974-55c1-bc1d-1c2597466589
2026-03-28 14:03:22 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:03:22 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:03:22 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:03:22 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:03:22 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:03:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:03:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c9d51d0>
2026-03-28 14:03:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:03:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:03:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:03:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_25ea238e-697d-5563-a2fc-e7cf5710c862/25ea238e-697d-5563-a2fc-e7cf5710c862_image_9.jpg HTTP/1.1" 201 0
2026-03-28 14:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FDU19WRR%252F697718395%252F600') HTTP/1.1" 204 0
2026-03-28 14:03:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DU19WRR/697718395/600 saved to cache
2026-03-28 14:03:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 25ea238e-697d-5563-a2fc-e7cf5710c862
2026-03-28 14:03:22 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AO69YDV/698941275/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698941275>
2026-03-28 14:03:22 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AO69YDV/698941257/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698941257>
2026-03-28 14:03:22 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YY70LWT/698474759/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698474759>
2026-03-28 14:03:22 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DG65GXU/698271540/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698271540>
2026-03-28 14:03:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AO69YDV/698941232/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/AO69YDV/42810516?sv=2020-08-04&st=2026-03-28T14%3A03%3A18Z&se=2026-03-28T14%3A28%3A18Z&sr=b&sp=r&sig=kth7LBRcZTbVN2IxcU%2F3tEYuPtUFnu10PDPk4DDda%2Fc%3D)
2026-03-28 14:03:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YY70LWT/698474726/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YY70LWT/42810193?sv=2020-08-04&st=2026-03-28T14%3A03%3A18Z&se=2026-03-28T14%3A28%3A18Z&sr=b&sp=r&sig=PQQPbp7LgcrcfGY8GkVfWOvV1ULKBqIo0aCZ8cnvWF4%3D)
2026-03-28 14:03:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DG65GXU/698271534/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/DG65GXU/42797313?sv=2020-08-04&st=2026-03-28T14%3A03%3A17Z&se=2026-03-28T14%3A28%3A17Z&sr=b&sp=r&sig=45h4YfquPE4gw%2FlPB0vAarzO40zZuLap4z1MHRigzDY%3D)
2026-03-28 14:03:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AO69YDV/698941196/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/AO69YDV/42810516?sv=2020-08-04&st=2026-03-28T14%3A03%3A18Z&se=2026-03-28T14%3A28%3A18Z&sr=b&sp=r&sig=kth7LBRcZTbVN2IxcU%2F3tEYuPtUFnu10PDPk4DDda%2Fc%3D)
2026-03-28 14:03:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:03:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c898210>
2026-03-28 14:03:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:03:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:03:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:03:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d8f0d404-7eeb-556b-ba0e-71ee720847de/d8f0d404-7eeb-556b-ba0e-71ee720847de_image_5.jpg HTTP/1.1" 201 0
2026-03-28 14:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FDG65GXU%252F698271518%252F600') HTTP/1.1" 204 0
2026-03-28 14:03:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DG65GXU/698271518/600 saved to cache
2026-03-28 14:03:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item d8f0d404-7eeb-556b-ba0e-71ee720847de
2026-03-28 14:03:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:03:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c8908d0>
2026-03-28 14:03:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:03:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:03:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:03:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_05627c71-8f78-5f09-9412-0b2354bea98e/05627c71-8f78-5f09-9412-0b2354bea98e_image_5.jpg HTTP/1.1" 201 0
2026-03-28 14:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FYY70LWT%252F698474652%252F600') HTTP/1.1" 204 0
2026-03-28 14:03:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YY70LWT/698474652/600 saved to cache
2026-03-28 14:03:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 05627c71-8f78-5f09-9412-0b2354bea98e
2026-03-28 14:03:22 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DG65GXU/698271527/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698271527>
2026-03-28 14:03:22 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AO69YDV/698941176/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698941176>
2026-03-28 14:03:22 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YY70LWT/698474680/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698474680>
2026-03-28 14:03:22 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YY70LWT/698474703/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698474703>
2026-03-28 14:03:22 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:03:22 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:03:22 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:03:22 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:03:22 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:03:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:03:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c4ba310>
2026-03-28 14:03:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:03:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:03:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:03:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_05dbf1b7-4974-55c1-bc1d-1c2597466589/05dbf1b7-4974-55c1-bc1d-1c2597466589_image_7.jpg HTTP/1.1" 201 0
2026-03-28 14:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FAO69YDV%252F698941232%252F600') HTTP/1.1" 204 0
2026-03-28 14:03:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AO69YDV/698941232/600 saved to cache
2026-03-28 14:03:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 05dbf1b7-4974-55c1-bc1d-1c2597466589
2026-03-28 14:03:22 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DG65GXU/698271523/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698271523>
2026-03-28 14:03:22 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DG65GXU/698271517/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698271517>
2026-03-28 14:03:22 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YY70LWT/698474577/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698474577>
2026-03-28 14:03:22 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DG65GXU/698271514/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698271514>
2026-03-28 14:03:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AO69YDV/698941275/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/AO69YDV/42810516?sv=2020-08-04&st=2026-03-28T14%3A03%3A18Z&se=2026-03-28T14%3A28%3A18Z&sr=b&sp=r&sig=kth7LBRcZTbVN2IxcU%2F3tEYuPtUFnu10PDPk4DDda%2Fc%3D)
2026-03-28 14:03:22 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:03:22 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:03:22 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:03:22 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:03:22 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:03:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:03:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c4c85d0>
2026-03-28 14:03:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:03:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:03:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:03:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_05627c71-8f78-5f09-9412-0b2354bea98e/05627c71-8f78-5f09-9412-0b2354bea98e_image_8.jpg HTTP/1.1" 201 0
2026-03-28 14:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FYY70LWT%252F698474726%252F600') HTTP/1.1" 204 0
2026-03-28 14:03:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YY70LWT/698474726/600 saved to cache
2026-03-28 14:03:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 05627c71-8f78-5f09-9412-0b2354bea98e
2026-03-28 14:03:22 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:03:22 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:03:22 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:03:22 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:03:22 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:03:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:03:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a1fdb4490>
2026-03-28 14:03:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:03:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:03:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:03:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d8f0d404-7eeb-556b-ba0e-71ee720847de/d8f0d404-7eeb-556b-ba0e-71ee720847de_image_8.jpg HTTP/1.1" 201 0
2026-03-28 14:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FDG65GXU%252F698271534%252F600') HTTP/1.1" 204 0
2026-03-28 14:03:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DG65GXU/698271534/600 saved to cache
2026-03-28 14:03:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item d8f0d404-7eeb-556b-ba0e-71ee720847de
2026-03-28 14:03:22 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:03:22 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:03:22 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:03:22 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:03:22 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:03:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:03:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a1ff163d0>
2026-03-28 14:03:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:03:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:03:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:03:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_05dbf1b7-4974-55c1-bc1d-1c2597466589/05dbf1b7-4974-55c1-bc1d-1c2597466589_image_6.jpg HTTP/1.1" 201 0
2026-03-28 14:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FAO69YDV%252F698941196%252F600') HTTP/1.1" 204 0
2026-03-28 14:03:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AO69YDV/698941196/600 saved to cache
2026-03-28 14:03:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 05dbf1b7-4974-55c1-bc1d-1c2597466589
2026-03-28 14:03:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DG65GXU/698271540/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/DG65GXU/42797313?sv=2020-08-04&st=2026-03-28T14%3A03%3A17Z&se=2026-03-28T14%3A28%3A17Z&sr=b&sp=r&sig=45h4YfquPE4gw%2FlPB0vAarzO40zZuLap4z1MHRigzDY%3D)
2026-03-28 14:03:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AO69YDV/698941257/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/AO69YDV/42810516?sv=2020-08-04&st=2026-03-28T14%3A03%3A18Z&se=2026-03-28T14%3A28%3A18Z&sr=b&sp=r&sig=kth7LBRcZTbVN2IxcU%2F3tEYuPtUFnu10PDPk4DDda%2Fc%3D)
2026-03-28 14:03:22 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:03:22 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:03:22 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:03:22 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:03:22 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:03:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:03:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a1ff17ad0>
2026-03-28 14:03:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:03:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:03:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:03:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_05dbf1b7-4974-55c1-bc1d-1c2597466589/05dbf1b7-4974-55c1-bc1d-1c2597466589_image_9.jpg HTTP/1.1" 201 0
2026-03-28 14:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FAO69YDV%252F698941275%252F600') HTTP/1.1" 204 0
2026-03-28 14:03:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AO69YDV/698941275/600 saved to cache
2026-03-28 14:03:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 05dbf1b7-4974-55c1-bc1d-1c2597466589
2026-03-28 14:03:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YY70LWT/698474703/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YY70LWT/42810193?sv=2020-08-04&st=2026-03-28T14%3A03%3A18Z&se=2026-03-28T14%3A28%3A18Z&sr=b&sp=r&sig=PQQPbp7LgcrcfGY8GkVfWOvV1ULKBqIo0aCZ8cnvWF4%3D)
2026-03-28 14:03:22 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DG65GXU/698271512/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698271512>
2026-03-28 14:03:22 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AO69YDV/698941043/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=AO69YDV-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-28 14:03:22 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DU19WRR/697718393/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=697718393>
2026-03-28 14:03:22 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YY70LWT/698474551/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698474551>
2026-03-28 14:03:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YY70LWT/698474680/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YY70LWT/42810193?sv=2020-08-04&st=2026-03-28T14%3A03%3A18Z&se=2026-03-28T14%3A28%3A18Z&sr=b&sp=r&sig=PQQPbp7LgcrcfGY8GkVfWOvV1ULKBqIo0aCZ8cnvWF4%3D)
2026-03-28 14:03:22 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:03:22 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:03:22 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:03:22 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:03:22 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:03:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:03:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c6c5c10>
2026-03-28 14:03:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:03:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:03:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:03:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d8f0d404-7eeb-556b-ba0e-71ee720847de/d8f0d404-7eeb-556b-ba0e-71ee720847de_image_9.jpg HTTP/1.1" 201 0
2026-03-28 14:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FDG65GXU%252F698271540%252F600') HTTP/1.1" 204 0
2026-03-28 14:03:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DG65GXU/698271540/600 saved to cache
2026-03-28 14:03:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item d8f0d404-7eeb-556b-ba0e-71ee720847de
2026-03-28 14:03:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AO69YDV/698941176/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/AO69YDV/42810516?sv=2020-08-04&st=2026-03-28T14%3A03%3A18Z&se=2026-03-28T14%3A28%3A18Z&sr=b&sp=r&sig=kth7LBRcZTbVN2IxcU%2F3tEYuPtUFnu10PDPk4DDda%2Fc%3D)
2026-03-28 14:03:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DG65GXU/698271517/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/DG65GXU/42797313?sv=2020-08-04&st=2026-03-28T14%3A03%3A17Z&se=2026-03-28T14%3A28%3A17Z&sr=b&sp=r&sig=45h4YfquPE4gw%2FlPB0vAarzO40zZuLap4z1MHRigzDY%3D)
2026-03-28 14:03:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DG65GXU/698271514/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/DG65GXU/42797313?sv=2020-08-04&st=2026-03-28T14%3A03%3A17Z&se=2026-03-28T14%3A28%3A17Z&sr=b&sp=r&sig=45h4YfquPE4gw%2FlPB0vAarzO40zZuLap4z1MHRigzDY%3D)
2026-03-28 14:03:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DG65GXU/698271523/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/DG65GXU/42797313?sv=2020-08-04&st=2026-03-28T14%3A03%3A17Z&se=2026-03-28T14%3A28%3A17Z&sr=b&sp=r&sig=45h4YfquPE4gw%2FlPB0vAarzO40zZuLap4z1MHRigzDY%3D)
2026-03-28 14:03:22 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:03:22 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:03:22 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:03:22 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:03:22 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:03:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:03:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a1fedc890>
2026-03-28 14:03:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:03:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:03:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:03:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_05dbf1b7-4974-55c1-bc1d-1c2597466589/05dbf1b7-4974-55c1-bc1d-1c2597466589_image_8.jpg HTTP/1.1" 201 0
2026-03-28 14:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FAO69YDV%252F698941257%252F600') HTTP/1.1" 204 0
2026-03-28 14:03:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AO69YDV/698941257/600 saved to cache
2026-03-28 14:03:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 05dbf1b7-4974-55c1-bc1d-1c2597466589
2026-03-28 14:03:22 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DG65GXU/698271509/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698271509>
2026-03-28 14:03:22 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:03:22 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:03:22 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:03:22 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:03:22 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:03:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:03:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a1ffb16d0>
2026-03-28 14:03:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:03:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:03:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:03:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_05627c71-8f78-5f09-9412-0b2354bea98e/05627c71-8f78-5f09-9412-0b2354bea98e_image_7.jpg HTTP/1.1" 201 0
2026-03-28 14:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FYY70LWT%252F698474703%252F600') HTTP/1.1" 204 0
2026-03-28 14:03:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YY70LWT/698474703/600 saved to cache
2026-03-28 14:03:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 05627c71-8f78-5f09-9412-0b2354bea98e
2026-03-28 14:03:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YY70LWT/698474759/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YY70LWT/42810193?sv=2020-08-04&st=2026-03-28T14%3A03%3A18Z&se=2026-03-28T14%3A28%3A18Z&sr=b&sp=r&sig=PQQPbp7LgcrcfGY8GkVfWOvV1ULKBqIo0aCZ8cnvWF4%3D)
2026-03-28 14:03:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YY70LWT/698474577/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YY70LWT/42810193?sv=2020-08-04&st=2026-03-28T14%3A03%3A18Z&se=2026-03-28T14%3A28%3A18Z&sr=b&sp=r&sig=PQQPbp7LgcrcfGY8GkVfWOvV1ULKBqIo0aCZ8cnvWF4%3D)
2026-03-28 14:03:23 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RF21EBD/697663366/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=697663366>
2026-03-28 14:03:23 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DU19WRR/697718386/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=697718386>
2026-03-28 14:03:23 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RF21EBD/697663376/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=697663376>
2026-03-28 14:03:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DG65GXU/698271527/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/DG65GXU/42797313?sv=2020-08-04&st=2026-03-28T14%3A03%3A17Z&se=2026-03-28T14%3A28%3A17Z&sr=b&sp=r&sig=45h4YfquPE4gw%2FlPB0vAarzO40zZuLap4z1MHRigzDY%3D)
2026-03-28 14:03:23 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:03:23 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:03:23 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:03:23 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:03:23 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:03:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:03:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c0ce6d0>
2026-03-28 14:03:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:03:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:03:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:03:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_05627c71-8f78-5f09-9412-0b2354bea98e/05627c71-8f78-5f09-9412-0b2354bea98e_image_6.jpg HTTP/1.1" 201 0
2026-03-28 14:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FYY70LWT%252F698474680%252F600') HTTP/1.1" 204 0
2026-03-28 14:03:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YY70LWT/698474680/600 saved to cache
2026-03-28 14:03:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 05627c71-8f78-5f09-9412-0b2354bea98e
2026-03-28 14:03:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AO69YDV/698941043/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/AO69YDV/42810516?sv=2020-08-04&st=2026-03-28T14%3A03%3A18Z&se=2026-03-28T14%3A28%3A18Z&sr=b&sp=r&sig=kth7LBRcZTbVN2IxcU%2F3tEYuPtUFnu10PDPk4DDda%2Fc%3D)
2026-03-28 14:03:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DU19WRR/697718393/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/DU19WRR/42810292?sv=2020-08-04&st=2026-03-28T14%3A03%3A15Z&se=2026-03-28T14%3A28%3A15Z&sr=b&sp=r&sig=MtD%2F8L7XEKrXW%2B2op3%2BPdiCG6LVJvVg4cKAzJgc4HxE%3D)
2026-03-28 14:03:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:03:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a1fd599d0>
2026-03-28 14:03:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:03:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:03:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:03:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_05dbf1b7-4974-55c1-bc1d-1c2597466589/05dbf1b7-4974-55c1-bc1d-1c2597466589_image_5.jpg HTTP/1.1" 201 0
2026-03-28 14:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FAO69YDV%252F698941176%252F600') HTTP/1.1" 204 0
2026-03-28 14:03:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AO69YDV/698941176/600 saved to cache
2026-03-28 14:03:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 05dbf1b7-4974-55c1-bc1d-1c2597466589
2026-03-28 14:03:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:03:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c57e210>
2026-03-28 14:03:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:03:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:03:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:03:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d8f0d404-7eeb-556b-ba0e-71ee720847de/d8f0d404-7eeb-556b-ba0e-71ee720847de_image_4.jpg HTTP/1.1" 201 0
2026-03-28 14:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FDG65GXU%252F698271517%252F600') HTTP/1.1" 204 0
2026-03-28 14:03:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DG65GXU/698271517/600 saved to cache
2026-03-28 14:03:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item d8f0d404-7eeb-556b-ba0e-71ee720847de
2026-03-28 14:03:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:03:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2d9bff10>
2026-03-28 14:03:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:03:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:03:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:03:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d8f0d404-7eeb-556b-ba0e-71ee720847de/d8f0d404-7eeb-556b-ba0e-71ee720847de_image_3.jpg HTTP/1.1" 201 0
2026-03-28 14:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FDG65GXU%252F698271514%252F600') HTTP/1.1" 204 0
2026-03-28 14:03:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DG65GXU/698271514/600 saved to cache
2026-03-28 14:03:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item d8f0d404-7eeb-556b-ba0e-71ee720847de
2026-03-28 14:03:23 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:03:23 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:03:23 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:03:23 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:03:23 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:03:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:03:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a1ff203d0>
2026-03-28 14:03:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:03:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:03:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:03:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d8f0d404-7eeb-556b-ba0e-71ee720847de/d8f0d404-7eeb-556b-ba0e-71ee720847de_image_6.jpg HTTP/1.1" 201 0
2026-03-28 14:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FDG65GXU%252F698271523%252F600') HTTP/1.1" 204 0
2026-03-28 14:03:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DG65GXU/698271523/600 saved to cache
2026-03-28 14:03:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item d8f0d404-7eeb-556b-ba0e-71ee720847de
2026-03-28 14:03:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DG65GXU/698271512/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/DG65GXU/42797313?sv=2020-08-04&st=2026-03-28T14%3A03%3A17Z&se=2026-03-28T14%3A28%3A17Z&sr=b&sp=r&sig=45h4YfquPE4gw%2FlPB0vAarzO40zZuLap4z1MHRigzDY%3D)
2026-03-28 14:03:23 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SD18YWW/698091644/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698091644>
2026-03-28 14:03:23 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DU19WRR/697718381/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=697718381>
2026-03-28 14:03:23 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RF21EBD/697663245/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=697663245>
2026-03-28 14:03:23 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SD18YWW/698091636/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698091636>
2026-03-28 14:03:23 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SD18YWW/698091607/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698091607>
2026-03-28 14:03:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YY70LWT/698474551/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YY70LWT/42810193?sv=2020-08-04&st=2026-03-28T14%3A03%3A18Z&se=2026-03-28T14%3A28%3A18Z&sr=b&sp=r&sig=PQQPbp7LgcrcfGY8GkVfWOvV1ULKBqIo0aCZ8cnvWF4%3D)
2026-03-28 14:03:23 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:03:23 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:03:23 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:03:23 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:03:23 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:03:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:03:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c8629d0>
2026-03-28 14:03:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:03:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:03:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:03:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_05627c71-8f78-5f09-9412-0b2354bea98e/05627c71-8f78-5f09-9412-0b2354bea98e_image_9.jpg HTTP/1.1" 201 0
2026-03-28 14:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FYY70LWT%252F698474759%252F600') HTTP/1.1" 204 0
2026-03-28 14:03:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YY70LWT/698474759/600 saved to cache
2026-03-28 14:03:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 05627c71-8f78-5f09-9412-0b2354bea98e
2026-03-28 14:03:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:03:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a1fd7e450>
2026-03-28 14:03:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:03:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:03:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:03:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_05627c71-8f78-5f09-9412-0b2354bea98e/05627c71-8f78-5f09-9412-0b2354bea98e_image_2.jpg HTTP/1.1" 201 0
2026-03-28 14:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FYY70LWT%252F698474577%252F600') HTTP/1.1" 204 0
2026-03-28 14:03:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YY70LWT/698474577/600 saved to cache
2026-03-28 14:03:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 05627c71-8f78-5f09-9412-0b2354bea98e
2026-03-28 14:03:23 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:03:23 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:03:23 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:03:23 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:03:23 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:03:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:03:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c9d55d0>
2026-03-28 14:03:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:03:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:03:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:03:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d8f0d404-7eeb-556b-ba0e-71ee720847de/d8f0d404-7eeb-556b-ba0e-71ee720847de_image_7.jpg HTTP/1.1" 201 0
2026-03-28 14:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FDG65GXU%252F698271527%252F600') HTTP/1.1" 204 0
2026-03-28 14:03:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DG65GXU/698271527/600 saved to cache
2026-03-28 14:03:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item d8f0d404-7eeb-556b-ba0e-71ee720847de
2026-03-28 14:03:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:03:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c461550>
2026-03-28 14:03:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:03:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:03:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:03:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_05dbf1b7-4974-55c1-bc1d-1c2597466589/05dbf1b7-4974-55c1-bc1d-1c2597466589_image_0.jpg HTTP/1.1" 201 0
2026-03-28 14:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FAO69YDV%252F698941043%252F600') HTTP/1.1" 204 0
2026-03-28 14:03:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AO69YDV/698941043/600 saved to cache
2026-03-28 14:03:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 05dbf1b7-4974-55c1-bc1d-1c2597466589
2026-03-28 14:03:23 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 05dbf1b7-4974-55c1-bc1d-1c2597466589, skipping ID generation
2026-03-28 14:03:23 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 05dbf1b7-4974-55c1-bc1d-1c2597466589 sending to next pipeline
2026-03-28 14:03:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 05dbf1b7-4974-55c1-bc1d-1c2597466589, identifier: AO69%20YDV
2026-03-28 14:03:23 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:03:23 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:03:23 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:03:23 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:03:23 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:03:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:03:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2d686210>
2026-03-28 14:03:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:03:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:03:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:03:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_25ea238e-697d-5563-a2fc-e7cf5710c862/25ea238e-697d-5563-a2fc-e7cf5710c862_image_8.jpg HTTP/1.1" 201 0
2026-03-28 14:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FDU19WRR%252F697718393%252F600') HTTP/1.1" 204 0
2026-03-28 14:03:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DU19WRR/697718393/600 saved to cache
2026-03-28 14:03:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 25ea238e-697d-5563-a2fc-e7cf5710c862
2026-03-28 14:03:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 05dbf1b7-4974-55c1-bc1d-1c2597466589 with identifier: AO69%20YDV
2026-03-28 14:03:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 05dbf1b7-4974-55c1-bc1d-1c2597466589 with identifier: AO69%20YDV
2026-03-28 14:03:23 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 05dbf1b7-4974-55c1-bc1d-1c2597466589 with identifier: AO69%20YDV to the API
2026-03-28 14:03:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:03:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:03:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AO69YDV/698941043/600>
{'auction_title': '',
'c_o_2_emission_value': 113,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_05dbf1b7-4974-55c1-bc1d-1c2597466589/05dbf1b7-4974-55c1-bc1d-1c2597466589_expert_report_file_4befd2a5-6505-426b-becf-a419aa7b2643.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=AO69%20YDV-GB',
'category': 'Car',
'color': 'grey',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.5L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol',
'id': '05dbf1b7-4974-55c1-bc1d-1c2597466589',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'AO69 YDV',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=AO69%20YDV&vehicleType=*',
'listing': 'auction',
'location': 'Paddock Wood',
'make': 'BMW',
'model': '118I',
'odometer': 76338,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 11,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_05dbf1b7-4974-55c1-bc1d-1c2597466589/05dbf1b7-4974-55c1-bc1d-1c2597466589_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 54228,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AO69YDV/698941043/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_05dbf1b7-4974-55c1-bc1d-1c2597466589/05dbf1b7-4974-55c1-bc1d-1c2597466589_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 52471,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AO69YDV/698941070/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_05dbf1b7-4974-55c1-bc1d-1c2597466589/05dbf1b7-4974-55c1-bc1d-1c2597466589_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 50882,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AO69YDV/698941096/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_05dbf1b7-4974-55c1-bc1d-1c2597466589/05dbf1b7-4974-55c1-bc1d-1c2597466589_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 48321,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AO69YDV/698941135/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_05dbf1b7-4974-55c1-bc1d-1c2597466589/05dbf1b7-4974-55c1-bc1d-1c2597466589_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 46778,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AO69YDV/698941155/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_05dbf1b7-4974-55c1-bc1d-1c2597466589/05dbf1b7-4974-55c1-bc1d-1c2597466589_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 46568,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AO69YDV/698941176/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_05dbf1b7-4974-55c1-bc1d-1c2597466589/05dbf1b7-4974-55c1-bc1d-1c2597466589_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 88747,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AO69YDV/698941196/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_05dbf1b7-4974-55c1-bc1d-1c2597466589/05dbf1b7-4974-55c1-bc1d-1c2597466589_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 77442,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AO69YDV/698941232/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_05dbf1b7-4974-55c1-bc1d-1c2597466589/05dbf1b7-4974-55c1-bc1d-1c2597466589_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 82171,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AO69YDV/698941257/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_05dbf1b7-4974-55c1-bc1d-1c2597466589/05dbf1b7-4974-55c1-bc1d-1c2597466589_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 84564,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AO69YDV/698941275/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-01-01',
'seller_name': None,
'title': 'BMW 118I 1.5 M SPORT STEP Hatchback',
'transmission': 'automatic',
'trim': 'M SPORT STEP',
'vin': 'WBA7K320607F48180',
'year': 2019}
2026-03-28 14:03:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27AO69%2520YDV%27 HTTP/1.1" 200 None
2026-03-28 14:03:24 [bca.uk] INFO: Saving data for AO69%20YDV: {'created_time': 1774706604.176122, 'last_price_update_time': 1774706604.176131, 'auction_closing_time': 1774864800.0}
2026-03-28 14:03:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='AO69%2520YDV') HTTP/1.1" 204 0
2026-03-28 14:03:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DG65GXU/698271509/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/DG65GXU/42797313?sv=2020-08-04&st=2026-03-28T14%3A03%3A17Z&se=2026-03-28T14%3A28%3A17Z&sr=b&sp=r&sig=45h4YfquPE4gw%2FlPB0vAarzO40zZuLap4z1MHRigzDY%3D)
2026-03-28 14:03:24 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SD18YWW/698091599/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698091599>
2026-03-28 14:03:24 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RF21EBD/697663229/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=697663229>
2026-03-28 14:03:24 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SD18YWW/698091595/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698091595>
2026-03-28 14:03:24 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DU19WRR/697718371/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=DU19WRR-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-28 14:03:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DU19WRR/697718386/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/DU19WRR/42810292?sv=2020-08-04&st=2026-03-28T14%3A03%3A15Z&se=2026-03-28T14%3A28%3A15Z&sr=b&sp=r&sig=MtD%2F8L7XEKrXW%2B2op3%2BPdiCG6LVJvVg4cKAzJgc4HxE%3D)
2026-03-28 14:03:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RF21EBD/697663366/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/RF21EBD/42809773?sv=2020-08-04&st=2026-03-28T14%3A03%3A14Z&se=2026-03-28T14%3A28%3A14Z&sr=b&sp=r&sig=fw1hk%2FxP20iV0pBAL7NeH7NwSGkh4C74QjCjIGW34mQ%3D)
2026-03-28 14:03:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RF21EBD/697663376/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/RF21EBD/42809773?sv=2020-08-04&st=2026-03-28T14%3A03%3A14Z&se=2026-03-28T14%3A28%3A14Z&sr=b&sp=r&sig=fw1hk%2FxP20iV0pBAL7NeH7NwSGkh4C74QjCjIGW34mQ%3D)
2026-03-28 14:03:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:03:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a3073bd10>
2026-03-28 14:03:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:03:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:03:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:03:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d8f0d404-7eeb-556b-ba0e-71ee720847de/d8f0d404-7eeb-556b-ba0e-71ee720847de_image_2.jpg HTTP/1.1" 201 0
2026-03-28 14:03:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FDG65GXU%252F698271512%252F600') HTTP/1.1" 204 0
2026-03-28 14:03:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DG65GXU/698271512/600 saved to cache
2026-03-28 14:03:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item d8f0d404-7eeb-556b-ba0e-71ee720847de
2026-03-28 14:03:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:03:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c170390>
2026-03-28 14:03:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:03:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:03:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:03:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_05627c71-8f78-5f09-9412-0b2354bea98e/05627c71-8f78-5f09-9412-0b2354bea98e_image_1.jpg HTTP/1.1" 201 0
2026-03-28 14:03:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FYY70LWT%252F698474551%252F600') HTTP/1.1" 204 0
2026-03-28 14:03:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YY70LWT/698474551/600 saved to cache
2026-03-28 14:03:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 05627c71-8f78-5f09-9412-0b2354bea98e
2026-03-28 14:03:24 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 05627c71-8f78-5f09-9412-0b2354bea98e, skipping ID generation
2026-03-28 14:03:24 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 05627c71-8f78-5f09-9412-0b2354bea98e sending to next pipeline
2026-03-28 14:03:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 05627c71-8f78-5f09-9412-0b2354bea98e, identifier: YY70%20LWT
2026-03-28 14:03:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 05627c71-8f78-5f09-9412-0b2354bea98e with identifier: YY70%20LWT
2026-03-28 14:03:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 05627c71-8f78-5f09-9412-0b2354bea98e with identifier: YY70%20LWT
2026-03-28 14:03:24 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 05627c71-8f78-5f09-9412-0b2354bea98e with identifier: YY70%20LWT to the API
2026-03-28 14:03:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:03:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:03:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YY70LWT/698474551/600>
{'auction_title': '',
'c_o_2_emission_value': 146,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_05627c71-8f78-5f09-9412-0b2354bea98e/05627c71-8f78-5f09-9412-0b2354bea98e_expert_report_file_a7c2886b-381a-4890-a14a-26248553084e.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=YY70%20LWT-GB',
'category': 'Car',
'color': 'grey',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.2L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol',
'id': '05627c71-8f78-5f09-9412-0b2354bea98e',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'YY70 LWT',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=YY70%20LWT&vehicleType=*',
'listing': 'auction',
'location': 'Leeds',
'make': 'VAUXHALL',
'model': 'CROSSLAND X',
'odometer': 41525,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 11,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_05627c71-8f78-5f09-9412-0b2354bea98e/05627c71-8f78-5f09-9412-0b2354bea98e_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 42679,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YY70LWT/698474530/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_05627c71-8f78-5f09-9412-0b2354bea98e/05627c71-8f78-5f09-9412-0b2354bea98e_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 41822,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YY70LWT/698474551/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_05627c71-8f78-5f09-9412-0b2354bea98e/05627c71-8f78-5f09-9412-0b2354bea98e_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 39906,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YY70LWT/698474577/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_05627c71-8f78-5f09-9412-0b2354bea98e/05627c71-8f78-5f09-9412-0b2354bea98e_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 39886,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YY70LWT/698474602/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_05627c71-8f78-5f09-9412-0b2354bea98e/05627c71-8f78-5f09-9412-0b2354bea98e_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 43010,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YY70LWT/698474627/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_05627c71-8f78-5f09-9412-0b2354bea98e/05627c71-8f78-5f09-9412-0b2354bea98e_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 39989,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YY70LWT/698474652/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_05627c71-8f78-5f09-9412-0b2354bea98e/05627c71-8f78-5f09-9412-0b2354bea98e_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 70079,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YY70LWT/698474680/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_05627c71-8f78-5f09-9412-0b2354bea98e/05627c71-8f78-5f09-9412-0b2354bea98e_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 58309,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YY70LWT/698474703/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_05627c71-8f78-5f09-9412-0b2354bea98e/05627c71-8f78-5f09-9412-0b2354bea98e_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 79376,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YY70LWT/698474726/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_05627c71-8f78-5f09-9412-0b2354bea98e/05627c71-8f78-5f09-9412-0b2354bea98e_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 78264,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YY70LWT/698474759/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-01-01',
'seller_name': None,
'title': 'VAUXHALL CROSSLAND X 1.2 T 130 ELITE S/S Hatchback',
'transmission': 'automatic',
'trim': 'T 130 ELITE S/S',
'vin': 'W0V7H9EB1L4372360',
'year': 2020}
2026-03-28 14:03:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YY70%2520LWT%27 HTTP/1.1" 200 None
2026-03-28 14:03:24 [bca.uk] INFO: Saving data for YY70%20LWT: {'created_time': 1774706604.91178, 'last_price_update_time': 1774706604.911793, 'auction_closing_time': 1774864800.0}
2026-03-28 14:03:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='YY70%2520LWT') HTTP/1.1" 204 0
2026-03-28 14:03:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SD18YWW/698091607/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/SD18YWW/42810346?sv=2020-08-04&st=2026-03-28T14%3A03%3A14Z&se=2026-03-28T14%3A28%3A14Z&sr=b&sp=r&sig=7AasTz5GkcbVg3mZlAj5bXm4eRmFaqXEvgRF5S45ypY%3D)
2026-03-28 14:03:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DU19WRR/697718381/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/DU19WRR/42810292?sv=2020-08-04&st=2026-03-28T14%3A03%3A15Z&se=2026-03-28T14%3A28%3A15Z&sr=b&sp=r&sig=MtD%2F8L7XEKrXW%2B2op3%2BPdiCG6LVJvVg4cKAzJgc4HxE%3D)
2026-03-28 14:03:24 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RF21EBD/697663209/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=697663209>
2026-03-28 14:03:24 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MJ03HOW/698444403/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698444403>
2026-03-28 14:03:24 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SD18YWW/698091566/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=SD18YWW-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-28 14:03:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RF21EBD/697663245/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/RF21EBD/42809773?sv=2020-08-04&st=2026-03-28T14%3A03%3A14Z&se=2026-03-28T14%3A28%3A14Z&sr=b&sp=r&sig=fw1hk%2FxP20iV0pBAL7NeH7NwSGkh4C74QjCjIGW34mQ%3D)
2026-03-28 14:03:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SD18YWW/698091636/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/SD18YWW/42810346?sv=2020-08-04&st=2026-03-28T14%3A03%3A14Z&se=2026-03-28T14%3A28%3A14Z&sr=b&sp=r&sig=7AasTz5GkcbVg3mZlAj5bXm4eRmFaqXEvgRF5S45ypY%3D)
2026-03-28 14:03:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:03:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c836bd0>
2026-03-28 14:03:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:03:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:03:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:03:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d8f0d404-7eeb-556b-ba0e-71ee720847de/d8f0d404-7eeb-556b-ba0e-71ee720847de_image_1.jpg HTTP/1.1" 201 0
2026-03-28 14:03:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FDG65GXU%252F698271509%252F600') HTTP/1.1" 204 0
2026-03-28 14:03:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DG65GXU/698271509/600 saved to cache
2026-03-28 14:03:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item d8f0d404-7eeb-556b-ba0e-71ee720847de
2026-03-28 14:03:24 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: d8f0d404-7eeb-556b-ba0e-71ee720847de, skipping ID generation
2026-03-28 14:03:24 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item d8f0d404-7eeb-556b-ba0e-71ee720847de sending to next pipeline
2026-03-28 14:03:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: d8f0d404-7eeb-556b-ba0e-71ee720847de, identifier: DG65%20GXU
2026-03-28 14:03:25 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:03:25 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:03:25 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:03:25 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:03:25 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:03:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:03:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2ffb3490>
2026-03-28 14:03:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:03:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:03:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:03:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_25ea238e-697d-5563-a2fc-e7cf5710c862/25ea238e-697d-5563-a2fc-e7cf5710c862_image_6.jpg HTTP/1.1" 201 0
2026-03-28 14:03:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FDU19WRR%252F697718386%252F600') HTTP/1.1" 204 0
2026-03-28 14:03:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DU19WRR/697718386/600 saved to cache
2026-03-28 14:03:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 25ea238e-697d-5563-a2fc-e7cf5710c862
2026-03-28 14:03:25 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:03:25 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:03:25 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:03:25 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:03:25 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:03:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:03:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2d9784d0>
2026-03-28 14:03:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:03:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:03:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:03:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_32911a92-e281-56af-bde9-3b2fa177bca3/32911a92-e281-56af-bde9-3b2fa177bca3_image_8.jpg HTTP/1.1" 201 0
2026-03-28 14:03:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FRF21EBD%252F697663366%252F600') HTTP/1.1" 204 0
2026-03-28 14:03:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RF21EBD/697663366/600 saved to cache
2026-03-28 14:03:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 32911a92-e281-56af-bde9-3b2fa177bca3
2026-03-28 14:03:25 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:03:25 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:03:25 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:03:25 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:03:25 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:03:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:03:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c89b690>
2026-03-28 14:03:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:03:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:03:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:03:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_32911a92-e281-56af-bde9-3b2fa177bca3/32911a92-e281-56af-bde9-3b2fa177bca3_image_9.jpg HTTP/1.1" 201 0
2026-03-28 14:03:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FRF21EBD%252F697663376%252F600') HTTP/1.1" 204 0
2026-03-28 14:03:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RF21EBD/697663376/600 saved to cache
2026-03-28 14:03:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 32911a92-e281-56af-bde9-3b2fa177bca3
2026-03-28 14:03:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SD18YWW/698091644/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/SD18YWW/42810346?sv=2020-08-04&st=2026-03-28T14%3A03%3A14Z&se=2026-03-28T14%3A28%3A14Z&sr=b&sp=r&sig=7AasTz5GkcbVg3mZlAj5bXm4eRmFaqXEvgRF5S45ypY%3D)
2026-03-28 14:03:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: d8f0d404-7eeb-556b-ba0e-71ee720847de with identifier: DG65%20GXU
2026-03-28 14:03:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: d8f0d404-7eeb-556b-ba0e-71ee720847de with identifier: DG65%20GXU
2026-03-28 14:03:25 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: d8f0d404-7eeb-556b-ba0e-71ee720847de with identifier: DG65%20GXU to the API
2026-03-28 14:03:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:03:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:03:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DG65GXU/698271509/600>
{'auction_title': '',
'c_o_2_emission_value': 107,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d8f0d404-7eeb-556b-ba0e-71ee720847de/d8f0d404-7eeb-556b-ba0e-71ee720847de_expert_report_file_5a8e762a-f606-4130-a959-1ff32bcd893d.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=DG65%20GXU-GB',
'category': 'Car',
'color': 'black',
'currency': 'GBP',
'doors_number': 5,
'engine': '2.1L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Diesel',
'id': 'd8f0d404-7eeb-556b-ba0e-71ee720847de',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'DG65 GXU',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=DG65%20GXU&vehicleType=*',
'listing': 'auction',
'location': 'Preston',
'make': 'MERCEDES-BENZ',
'model': 'A220',
'odometer': 62168,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 11,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d8f0d404-7eeb-556b-ba0e-71ee720847de/d8f0d404-7eeb-556b-ba0e-71ee720847de_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 45128,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DG65GXU/698271506/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d8f0d404-7eeb-556b-ba0e-71ee720847de/d8f0d404-7eeb-556b-ba0e-71ee720847de_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 45355,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DG65GXU/698271509/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d8f0d404-7eeb-556b-ba0e-71ee720847de/d8f0d404-7eeb-556b-ba0e-71ee720847de_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 44299,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DG65GXU/698271512/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d8f0d404-7eeb-556b-ba0e-71ee720847de/d8f0d404-7eeb-556b-ba0e-71ee720847de_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 41918,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DG65GXU/698271514/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d8f0d404-7eeb-556b-ba0e-71ee720847de/d8f0d404-7eeb-556b-ba0e-71ee720847de_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 40892,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DG65GXU/698271517/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d8f0d404-7eeb-556b-ba0e-71ee720847de/d8f0d404-7eeb-556b-ba0e-71ee720847de_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 39730,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DG65GXU/698271518/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d8f0d404-7eeb-556b-ba0e-71ee720847de/d8f0d404-7eeb-556b-ba0e-71ee720847de_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 85715,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DG65GXU/698271523/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d8f0d404-7eeb-556b-ba0e-71ee720847de/d8f0d404-7eeb-556b-ba0e-71ee720847de_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 64433,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DG65GXU/698271527/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d8f0d404-7eeb-556b-ba0e-71ee720847de/d8f0d404-7eeb-556b-ba0e-71ee720847de_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 84572,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DG65GXU/698271534/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d8f0d404-7eeb-556b-ba0e-71ee720847de/d8f0d404-7eeb-556b-ba0e-71ee720847de_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 63632,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DG65GXU/698271540/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-01-01',
'seller_name': None,
'title': 'MERCEDES-BENZ A220 2.1 CDI AMG NIGHT EDITION DCT Hatchback',
'transmission': 'automatic',
'trim': 'CDI AMG NIGHT EDITION DCT',
'vin': 'WDD1760032J411483',
'year': 2015}
2026-03-28 14:03:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DG65%2520GXU%27 HTTP/1.1" 200 None
2026-03-28 14:03:25 [bca.uk] INFO: Saving data for DG65%20GXU: {'created_time': 1774706605.580675, 'last_price_update_time': 1774706605.580687, 'auction_closing_time': 1774864800.0}
2026-03-28 14:03:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='DG65%2520GXU') HTTP/1.1" 204 0
2026-03-28 14:03:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DU19WRR/697718371/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/DU19WRR/42810292?sv=2020-08-04&st=2026-03-28T14%3A03%3A15Z&se=2026-03-28T14%3A28%3A15Z&sr=b&sp=r&sig=MtD%2F8L7XEKrXW%2B2op3%2BPdiCG6LVJvVg4cKAzJgc4HxE%3D)
2026-03-28 14:03:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RF21EBD/697663229/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/RF21EBD/42809773?sv=2020-08-04&st=2026-03-28T14%3A03%3A14Z&se=2026-03-28T14%3A28%3A14Z&sr=b&sp=r&sig=fw1hk%2FxP20iV0pBAL7NeH7NwSGkh4C74QjCjIGW34mQ%3D)
2026-03-28 14:03:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SD18YWW/698091599/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/SD18YWW/42810346?sv=2020-08-04&st=2026-03-28T14%3A03%3A14Z&se=2026-03-28T14%3A28%3A14Z&sr=b&sp=r&sig=7AasTz5GkcbVg3mZlAj5bXm4eRmFaqXEvgRF5S45ypY%3D)
2026-03-28 14:03:25 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FY68WNB/698106404/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698106404>
2026-03-28 14:03:25 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/OV64PLN/698953438/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698953438>
2026-03-28 14:03:25 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DP19FWW/698227107/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698227107>
2026-03-28 14:03:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SD18YWW/698091595/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/SD18YWW/42810346?sv=2020-08-04&st=2026-03-28T14%3A03%3A14Z&se=2026-03-28T14%3A28%3A14Z&sr=b&sp=r&sig=7AasTz5GkcbVg3mZlAj5bXm4eRmFaqXEvgRF5S45ypY%3D)
2026-03-28 14:03:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:03:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c9d56d0>
2026-03-28 14:03:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:03:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:03:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:03:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_12688ef2-2fc1-5a39-9796-e8677733238c/12688ef2-2fc1-5a39-9796-e8677733238c_image_5.jpg HTTP/1.1" 201 0
2026-03-28 14:03:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FSD18YWW%252F698091607%252F600') HTTP/1.1" 204 0
2026-03-28 14:03:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SD18YWW/698091607/600 saved to cache
2026-03-28 14:03:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 12688ef2-2fc1-5a39-9796-e8677733238c
2026-03-28 14:03:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:03:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2d73f1d0>
2026-03-28 14:03:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:03:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:03:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:03:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_25ea238e-697d-5563-a2fc-e7cf5710c862/25ea238e-697d-5563-a2fc-e7cf5710c862_image_5.jpg HTTP/1.1" 201 0
2026-03-28 14:03:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FDU19WRR%252F697718381%252F600') HTTP/1.1" 204 0
2026-03-28 14:03:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DU19WRR/697718381/600 saved to cache
2026-03-28 14:03:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 25ea238e-697d-5563-a2fc-e7cf5710c862
2026-03-28 14:03:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:03:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c732650>
2026-03-28 14:03:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:03:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:03:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:03:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_32911a92-e281-56af-bde9-3b2fa177bca3/32911a92-e281-56af-bde9-3b2fa177bca3_image_3.jpg HTTP/1.1" 201 0
2026-03-28 14:03:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FRF21EBD%252F697663245%252F600') HTTP/1.1" 204 0
2026-03-28 14:03:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RF21EBD/697663245/600 saved to cache
2026-03-28 14:03:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 32911a92-e281-56af-bde9-3b2fa177bca3
2026-03-28 14:03:25 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:03:25 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:03:25 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:03:25 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:03:25 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:03:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:03:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a1fdaa290>
2026-03-28 14:03:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:03:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:03:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:03:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_12688ef2-2fc1-5a39-9796-e8677733238c/12688ef2-2fc1-5a39-9796-e8677733238c_image_8.jpg HTTP/1.1" 201 0
2026-03-28 14:03:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FSD18YWW%252F698091636%252F600') HTTP/1.1" 204 0
2026-03-28 14:03:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SD18YWW/698091636/600 saved to cache
2026-03-28 14:03:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 12688ef2-2fc1-5a39-9796-e8677733238c
2026-03-28 14:03:25 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:03:25 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:03:25 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:03:25 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:03:25 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:03:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:03:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c732410>
2026-03-28 14:03:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:03:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:03:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:03:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_12688ef2-2fc1-5a39-9796-e8677733238c/12688ef2-2fc1-5a39-9796-e8677733238c_image_9.jpg HTTP/1.1" 201 0
2026-03-28 14:03:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FSD18YWW%252F698091644%252F600') HTTP/1.1" 204 0
2026-03-28 14:03:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SD18YWW/698091644/600 saved to cache
2026-03-28 14:03:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 12688ef2-2fc1-5a39-9796-e8677733238c
2026-03-28 14:03:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SD18YWW/698091566/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/SD18YWW/42810346?sv=2020-08-04&st=2026-03-28T14%3A03%3A14Z&se=2026-03-28T14%3A28%3A14Z&sr=b&sp=r&sig=7AasTz5GkcbVg3mZlAj5bXm4eRmFaqXEvgRF5S45ypY%3D)
2026-03-28 14:03:25 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EJ13JTO/698540323/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698540323>
2026-03-28 14:03:25 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YH13CHD/698786622/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698786622>
2026-03-28 14:03:25 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/X28AVE/698923722/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698923722>
2026-03-28 14:03:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RF21EBD/697663209/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/RF21EBD/42809773?sv=2020-08-04&st=2026-03-28T14%3A03%3A14Z&se=2026-03-28T14%3A28%3A14Z&sr=b&sp=r&sig=fw1hk%2FxP20iV0pBAL7NeH7NwSGkh4C74QjCjIGW34mQ%3D)
2026-03-28 14:03:25 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/FG22EFZ/42810348?sv=2020-08-04&st=2026-03-28T14%3A03%3A25Z&se=2026-03-28T14%3A28%3A25Z&sr=b&sp=r&sig=znOCBlcX4%2BITNfLLXK1J3VwsbyM08uOiUJYZW5ymtnw%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=FG22%20EFZ-GB>
2026-03-28 14:03:25 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WV13ZTH/698929286/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698929286>
2026-03-28 14:03:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MJ03HOW/698444403/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/MJ03HOW/42810316?sv=2020-08-04&st=2026-03-28T14%3A01%3A04Z&se=2026-03-28T14%3A26%3A04Z&sr=b&sp=r&sig=72R4f35YDQDGGwN55srQJ3YRSQrnD%2FGMmCWnMvmfOLc%3D)
2026-03-28 14:03:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:03:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c3b6a90>
2026-03-28 14:03:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:03:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:03:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:03:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_25ea238e-697d-5563-a2fc-e7cf5710c862/25ea238e-697d-5563-a2fc-e7cf5710c862_image_0.jpg HTTP/1.1" 201 0
2026-03-28 14:03:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FDU19WRR%252F697718371%252F600') HTTP/1.1" 204 0
2026-03-28 14:03:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DU19WRR/697718371/600 saved to cache
2026-03-28 14:03:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 25ea238e-697d-5563-a2fc-e7cf5710c862
2026-03-28 14:03:25 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 25ea238e-697d-5563-a2fc-e7cf5710c862, skipping ID generation
2026-03-28 14:03:25 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 25ea238e-697d-5563-a2fc-e7cf5710c862 sending to next pipeline
2026-03-28 14:03:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 25ea238e-697d-5563-a2fc-e7cf5710c862, identifier: DU19%20WRR
2026-03-28 14:03:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:03:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2d73c510>
2026-03-28 14:03:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:03:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:03:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:03:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_32911a92-e281-56af-bde9-3b2fa177bca3/32911a92-e281-56af-bde9-3b2fa177bca3_image_2.jpg HTTP/1.1" 201 0
2026-03-28 14:03:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FRF21EBD%252F697663229%252F600') HTTP/1.1" 204 0
2026-03-28 14:03:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RF21EBD/697663229/600 saved to cache
2026-03-28 14:03:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 32911a92-e281-56af-bde9-3b2fa177bca3
2026-03-28 14:03:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:03:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c7635d0>
2026-03-28 14:03:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:03:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:03:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:03:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_12688ef2-2fc1-5a39-9796-e8677733238c/12688ef2-2fc1-5a39-9796-e8677733238c_image_4.jpg HTTP/1.1" 201 0
2026-03-28 14:03:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FSD18YWW%252F698091599%252F600') HTTP/1.1" 204 0
2026-03-28 14:03:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SD18YWW/698091599/600 saved to cache
2026-03-28 14:03:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 12688ef2-2fc1-5a39-9796-e8677733238c
2026-03-28 14:03:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:03:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2ec92f50>
2026-03-28 14:03:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:03:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:03:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:03:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_12688ef2-2fc1-5a39-9796-e8677733238c/12688ef2-2fc1-5a39-9796-e8677733238c_image_3.jpg HTTP/1.1" 201 0
2026-03-28 14:03:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FSD18YWW%252F698091595%252F600') HTTP/1.1" 204 0
2026-03-28 14:03:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SD18YWW/698091595/600 saved to cache
2026-03-28 14:03:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 12688ef2-2fc1-5a39-9796-e8677733238c
2026-03-28 14:03:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 25ea238e-697d-5563-a2fc-e7cf5710c862 with identifier: DU19%20WRR
2026-03-28 14:03:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 25ea238e-697d-5563-a2fc-e7cf5710c862 with identifier: DU19%20WRR
2026-03-28 14:03:26 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 25ea238e-697d-5563-a2fc-e7cf5710c862 with identifier: DU19%20WRR to the API
2026-03-28 14:03:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:03:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:03:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DU19WRR/697718371/600>
{'auction_title': '',
'c_o_2_emission_value': 150,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_25ea238e-697d-5563-a2fc-e7cf5710c862/25ea238e-697d-5563-a2fc-e7cf5710c862_expert_report_file_979aad18-f8b5-4e2d-b10e-0400b89475a8.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=DU19%20WRR-GB',
'category': 'Car',
'color': 'white',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.4L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol',
'id': '25ea238e-697d-5563-a2fc-e7cf5710c862',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'DU19 WRR',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=DU19%20WRR&vehicleType=*',
'listing': 'auction',
'location': 'Paddock Wood',
'make': 'VAUXHALL',
'model': 'MOKKA X',
'odometer': 34352,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 11,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_25ea238e-697d-5563-a2fc-e7cf5710c862/25ea238e-697d-5563-a2fc-e7cf5710c862_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 46974,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DU19WRR/697718371/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_25ea238e-697d-5563-a2fc-e7cf5710c862/25ea238e-697d-5563-a2fc-e7cf5710c862_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 46476,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DU19WRR/697718372/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_25ea238e-697d-5563-a2fc-e7cf5710c862/25ea238e-697d-5563-a2fc-e7cf5710c862_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 45397,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DU19WRR/697718376/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_25ea238e-697d-5563-a2fc-e7cf5710c862/25ea238e-697d-5563-a2fc-e7cf5710c862_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 43007,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DU19WRR/697718377/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_25ea238e-697d-5563-a2fc-e7cf5710c862/25ea238e-697d-5563-a2fc-e7cf5710c862_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 43748,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DU19WRR/697718379/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_25ea238e-697d-5563-a2fc-e7cf5710c862/25ea238e-697d-5563-a2fc-e7cf5710c862_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 44578,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DU19WRR/697718381/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_25ea238e-697d-5563-a2fc-e7cf5710c862/25ea238e-697d-5563-a2fc-e7cf5710c862_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 96025,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DU19WRR/697718386/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_25ea238e-697d-5563-a2fc-e7cf5710c862/25ea238e-697d-5563-a2fc-e7cf5710c862_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 64007,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DU19WRR/697718389/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_25ea238e-697d-5563-a2fc-e7cf5710c862/25ea238e-697d-5563-a2fc-e7cf5710c862_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 88440,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DU19WRR/697718393/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_25ea238e-697d-5563-a2fc-e7cf5710c862/25ea238e-697d-5563-a2fc-e7cf5710c862_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 69207,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DU19WRR/697718395/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-01-01',
'seller_name': None,
'title': 'VAUXHALL MOKKA X 1.4 T 140 ECOTEC ELITE Hatchback',
'transmission': 'manual',
'trim': 'T 140 ECOTEC ELITE',
'vin': 'W0VJD7E80KB832032',
'year': 2019}
2026-03-28 14:03:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DU19%2520WRR%27 HTTP/1.1" 200 None
2026-03-28 14:03:26 [bca.uk] INFO: Saving data for DU19%20WRR: {'created_time': 1774706606.482832, 'last_price_update_time': 1774706606.482843, 'auction_closing_time': 1774864800.0}
2026-03-28 14:03:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='DU19%2520WRR') HTTP/1.1" 204 0
2026-03-28 14:03:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/OV64PLN/698953438/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/OV64PLN/42810653?sv=2020-08-04&st=2026-03-28T14%3A01%3A03Z&se=2026-03-28T14%3A26%3A03Z&sr=b&sp=r&sig=APMfuiYXypC%2F8k81EUjJVNUqGlQEUGUldS81rN8I%2FN0%3D)
2026-03-28 14:03:26 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YK67BOU/698928817/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698928817>
2026-03-28 14:03:26 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EA24TKX/698296251/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698296251>
2026-03-28 14:03:26 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MJ03HOW/698444392/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698444392>
2026-03-28 14:03:26 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LR11XWM/697880599/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=697880599>
2026-03-28 14:03:26 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YM68ZFO/42810291?sv=2020-08-04&st=2026-03-28T14%3A03%3A26Z&se=2026-03-28T14%3A28%3A26Z&sr=b&sp=r&sig=arppF1K143T0evTDmxHZrgrIN9Emgox3ISmOQq35b74%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=YM68%20ZFO-GB>
2026-03-28 14:03:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FY68WNB/698106404/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/FY68WNB/42810373?sv=2020-08-04&st=2026-03-28T14%3A01%3A04Z&se=2026-03-28T14%3A26%3A04Z&sr=b&sp=r&sig=H2pJB0hzNCFCiICFkGnSt1gr2sn1tExob5yrsc4d3Vs%3D)
2026-03-28 14:03:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DP19FWW/698227107/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/DP19FWW/42810375?sv=2020-08-04&st=2026-03-28T14%3A01%3A04Z&se=2026-03-28T14%3A26%3A04Z&sr=b&sp=r&sig=DYlHwmmm%2BkuE1QC9GfsRlnyT74V8OO0Bfy5POGMlRcU%3D)
2026-03-28 14:03:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:03:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a1fe64150>
2026-03-28 14:03:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:03:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:03:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:03:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_12688ef2-2fc1-5a39-9796-e8677733238c/12688ef2-2fc1-5a39-9796-e8677733238c_image_0.jpg HTTP/1.1" 201 0
2026-03-28 14:03:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FSD18YWW%252F698091566%252F600') HTTP/1.1" 204 0
2026-03-28 14:03:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SD18YWW/698091566/600 saved to cache
2026-03-28 14:03:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 12688ef2-2fc1-5a39-9796-e8677733238c
2026-03-28 14:03:26 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 12688ef2-2fc1-5a39-9796-e8677733238c, skipping ID generation
2026-03-28 14:03:26 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 12688ef2-2fc1-5a39-9796-e8677733238c sending to next pipeline
2026-03-28 14:03:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 12688ef2-2fc1-5a39-9796-e8677733238c, identifier: SD18%20YWW
2026-03-28 14:03:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:03:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c6783d0>
2026-03-28 14:03:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:03:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:03:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:03:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_32911a92-e281-56af-bde9-3b2fa177bca3/32911a92-e281-56af-bde9-3b2fa177bca3_image_1.jpg HTTP/1.1" 201 0
2026-03-28 14:03:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FRF21EBD%252F697663209%252F600') HTTP/1.1" 204 0
2026-03-28 14:03:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RF21EBD/697663209/600 saved to cache
2026-03-28 14:03:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 32911a92-e281-56af-bde9-3b2fa177bca3
2026-03-28 14:03:26 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 32911a92-e281-56af-bde9-3b2fa177bca3, skipping ID generation
2026-03-28 14:03:26 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 32911a92-e281-56af-bde9-3b2fa177bca3 sending to next pipeline
2026-03-28 14:03:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 32911a92-e281-56af-bde9-3b2fa177bca3, identifier: RF21%20EBD
2026-03-28 14:03:26 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:03:26 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:03:26 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:03:26 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:03:26 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:03:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:03:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a1fd34750>
2026-03-28 14:03:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:03:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:03:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:03:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b75153fa-8bbc-5e83-87eb-81edd908fcda/b75153fa-8bbc-5e83-87eb-81edd908fcda_image_6.jpg HTTP/1.1" 201 0
2026-03-28 14:03:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FMJ03HOW%252F698444403%252F600') HTTP/1.1" 204 0
2026-03-28 14:03:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MJ03HOW/698444403/600 saved to cache
2026-03-28 14:03:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item b75153fa-8bbc-5e83-87eb-81edd908fcda
2026-03-28 14:03:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 12688ef2-2fc1-5a39-9796-e8677733238c with identifier: SD18%20YWW
2026-03-28 14:03:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 12688ef2-2fc1-5a39-9796-e8677733238c with identifier: SD18%20YWW
2026-03-28 14:03:26 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 12688ef2-2fc1-5a39-9796-e8677733238c with identifier: SD18%20YWW to the API
2026-03-28 14:03:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:03:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:03:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SD18YWW/698091566/600>
{'auction_title': '',
'c_o_2_emission_value': 114,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_12688ef2-2fc1-5a39-9796-e8677733238c/12688ef2-2fc1-5a39-9796-e8677733238c_expert_report_file_53a5f549-42ce-4ecb-a0c0-2dd1f268474d.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=SD18%20YWW-GB',
'category': 'Car',
'color': 'white',
'currency': 'GBP',
'doors_number': 4,
'engine': '2.0L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Diesel',
'id': '12688ef2-2fc1-5a39-9796-e8677733238c',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'SD18 YWW',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=SD18%20YWW&vehicleType=*',
'listing': 'auction',
'location': 'Preston',
'make': 'JAGUAR',
'model': 'XF',
'odometer': 106215,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 11,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_12688ef2-2fc1-5a39-9796-e8677733238c/12688ef2-2fc1-5a39-9796-e8677733238c_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 42489,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SD18YWW/698091566/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_12688ef2-2fc1-5a39-9796-e8677733238c/12688ef2-2fc1-5a39-9796-e8677733238c_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 42478,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SD18YWW/698091573/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_12688ef2-2fc1-5a39-9796-e8677733238c/12688ef2-2fc1-5a39-9796-e8677733238c_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 41993,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SD18YWW/698091582/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_12688ef2-2fc1-5a39-9796-e8677733238c/12688ef2-2fc1-5a39-9796-e8677733238c_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 39895,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SD18YWW/698091595/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_12688ef2-2fc1-5a39-9796-e8677733238c/12688ef2-2fc1-5a39-9796-e8677733238c_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 40816,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SD18YWW/698091599/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_12688ef2-2fc1-5a39-9796-e8677733238c/12688ef2-2fc1-5a39-9796-e8677733238c_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 40032,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SD18YWW/698091607/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_12688ef2-2fc1-5a39-9796-e8677733238c/12688ef2-2fc1-5a39-9796-e8677733238c_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 66018,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SD18YWW/698091618/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_12688ef2-2fc1-5a39-9796-e8677733238c/12688ef2-2fc1-5a39-9796-e8677733238c_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 66553,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SD18YWW/698091624/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_12688ef2-2fc1-5a39-9796-e8677733238c/12688ef2-2fc1-5a39-9796-e8677733238c_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 80472,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SD18YWW/698091636/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_12688ef2-2fc1-5a39-9796-e8677733238c/12688ef2-2fc1-5a39-9796-e8677733238c_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 77836,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SD18YWW/698091644/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-01-01',
'seller_name': None,
'title': 'JAGUAR XF 2.0 D 180 R SPORT Saloon',
'transmission': 'automatic',
'trim': 'D 180 R SPORT',
'vin': 'SAJBB4AN6JCY53346',
'year': 2018}
2026-03-28 14:03:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SD18%2520YWW%27 HTTP/1.1" 200 None
2026-03-28 14:03:27 [bca.uk] INFO: Saving data for SD18%20YWW: {'created_time': 1774706607.188989, 'last_price_update_time': 1774706607.189002, 'auction_closing_time': 1774864800.0}
2026-03-28 14:03:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='SD18%2520YWW') HTTP/1.1" 204 0
2026-03-28 14:03:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 32911a92-e281-56af-bde9-3b2fa177bca3 with identifier: RF21%20EBD
2026-03-28 14:03:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 32911a92-e281-56af-bde9-3b2fa177bca3 with identifier: RF21%20EBD
2026-03-28 14:03:27 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 32911a92-e281-56af-bde9-3b2fa177bca3 with identifier: RF21%20EBD to the API
2026-03-28 14:03:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:03:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:03:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RF21EBD/697663209/600>
{'auction_title': '',
'c_o_2_emission_value': 126,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_32911a92-e281-56af-bde9-3b2fa177bca3/32911a92-e281-56af-bde9-3b2fa177bca3_expert_report_file_11668d9c-d3bf-4976-a127-4798972af133.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=RF21%20EBD-GB',
'category': 'Car',
'color': 'black',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.0L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol',
'id': '32911a92-e281-56af-bde9-3b2fa177bca3',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'RF21 EBD',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=RF21%20EBD&vehicleType=*',
'listing': 'auction',
'location': 'Leeds',
'make': 'KIA',
'model': 'CEED',
'odometer': 44991,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 11,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_32911a92-e281-56af-bde9-3b2fa177bca3/32911a92-e281-56af-bde9-3b2fa177bca3_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 42303,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RF21EBD/697663193/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_32911a92-e281-56af-bde9-3b2fa177bca3/32911a92-e281-56af-bde9-3b2fa177bca3_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 41346,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RF21EBD/697663209/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_32911a92-e281-56af-bde9-3b2fa177bca3/32911a92-e281-56af-bde9-3b2fa177bca3_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 40046,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RF21EBD/697663229/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_32911a92-e281-56af-bde9-3b2fa177bca3/32911a92-e281-56af-bde9-3b2fa177bca3_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 39901,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RF21EBD/697663245/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_32911a92-e281-56af-bde9-3b2fa177bca3/32911a92-e281-56af-bde9-3b2fa177bca3_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 41089,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RF21EBD/697663258/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_32911a92-e281-56af-bde9-3b2fa177bca3/32911a92-e281-56af-bde9-3b2fa177bca3_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 38572,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RF21EBD/697663290/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_32911a92-e281-56af-bde9-3b2fa177bca3/32911a92-e281-56af-bde9-3b2fa177bca3_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 63824,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RF21EBD/697663323/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_32911a92-e281-56af-bde9-3b2fa177bca3/32911a92-e281-56af-bde9-3b2fa177bca3_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 58090,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RF21EBD/697663345/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_32911a92-e281-56af-bde9-3b2fa177bca3/32911a92-e281-56af-bde9-3b2fa177bca3_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 80419,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RF21EBD/697663366/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_32911a92-e281-56af-bde9-3b2fa177bca3/32911a92-e281-56af-bde9-3b2fa177bca3_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 75377,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RF21EBD/697663376/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-01-01',
'seller_name': None,
'title': 'KIA CEED 1.0 T GDI 120 GT-LINE ISG Hatchback',
'transmission': 'manual',
'trim': 'T GDI 120 GT-LINE ISG',
'vin': 'U5YH6512LML127858',
'year': 2021}
2026-03-28 14:03:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27RF21%2520EBD%27 HTTP/1.1" 200 None
2026-03-28 14:03:27 [bca.uk] INFO: Saving data for RF21%20EBD: {'created_time': 1774706607.594825, 'last_price_update_time': 1774706607.59484, 'auction_closing_time': 1774864800.0}
2026-03-28 14:03:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='RF21%2520EBD') HTTP/1.1" 204 0
2026-03-28 14:03:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/X28AVE/698923722/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/X28AVE/42809896?sv=2020-08-04&st=2026-03-28T14%3A01%3A06Z&se=2026-03-28T14%3A26%3A06Z&sr=b&sp=r&sig=AYxkyrr3IbeLdESXjdd9QmNEg4ZiUeF%2B%2BO3v1nuSrfg%3D)
2026-03-28 14:03:27 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DP19FWW/698227092/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698227092>
2026-03-28 14:03:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WV13ZTH/698929286/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/WV13ZTH/42810161?sv=2020-08-04&st=2026-03-28T14%3A01%3A04Z&se=2026-03-28T14%3A26%3A04Z&sr=b&sp=r&sig=hbqIghhD97wvMs5qjsvBMdrtSptsqnkIa342PcMgOiA%3D)
2026-03-28 14:03:27 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FY68WNB/698106384/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698106384>
2026-03-28 14:03:27 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/OV64PLN/698966009/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698966009>
2026-03-28 14:03:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EJ13JTO/698540323/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/EJ13JTO/42810382?sv=2020-08-04&st=2026-03-28T14%3A01%3A03Z&se=2026-03-28T14%3A26%3A03Z&sr=b&sp=r&sig=9n5SmvjaM772xUjZdL0t%2BMeZRNBu1TSQPyTFa%2FZiaIA%3D)
2026-03-28 14:03:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YH13CHD/698786622/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YH13CHD/42807762?sv=2020-08-04&st=2026-03-28T14%3A01%3A02Z&se=2026-03-28T14%3A26%3A02Z&sr=b&sp=r&sig=Kk3ZnO0H7wXbnR6jzpTNZkeJ9EaoXS3djv9g6kExg8o%3D)
2026-03-28 14:03:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/FG22EFZ/42810348?sv=2020-08-04&st=2026-03-28T14%3A03%3A25Z&se=2026-03-28T14%3A28%3A25Z&sr=b&sp=r&sig=znOCBlcX4%2BITNfLLXK1J3VwsbyM08uOiUJYZW5ymtnw%3D> (referer: https://www.bca.co.uk/)
2026-03-28 14:03:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:03:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2eb26390>
2026-03-28 14:03:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:03:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:03:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:03:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d75bc751-3167-5395-a067-9fe76cc20a2d/d75bc751-3167-5395-a067-9fe76cc20a2d_image_8.jpg HTTP/1.1" 201 0
2026-03-28 14:03:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FOV64PLN%252F698953438%252F600') HTTP/1.1" 204 0
2026-03-28 14:03:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/OV64PLN/698953438/600 saved to cache
2026-03-28 14:03:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item d75bc751-3167-5395-a067-9fe76cc20a2d
2026-03-28 14:03:27 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:03:27 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:03:27 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:03:27 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:03:27 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:03:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:03:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c58a5d0>
2026-03-28 14:03:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:03:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:03:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:03:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d8436e02-8218-5d88-bcc5-e01ffac7eb8e/d8436e02-8218-5d88-bcc5-e01ffac7eb8e_image_8.jpg HTTP/1.1" 201 0
2026-03-28 14:03:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FFY68WNB%252F698106404%252F600') HTTP/1.1" 204 0
2026-03-28 14:03:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FY68WNB/698106404/600 saved to cache
2026-03-28 14:03:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item d8436e02-8218-5d88-bcc5-e01ffac7eb8e
2026-03-28 14:03:27 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:03:27 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:03:27 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:03:27 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:03:27 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:03:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:03:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a3073b490>
2026-03-28 14:03:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:03:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:03:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:03:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4b13d468-b932-5891-9e01-a66081b24d30/4b13d468-b932-5891-9e01-a66081b24d30_image_7.jpg HTTP/1.1" 201 0
2026-03-28 14:03:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FDP19FWW%252F698227107%252F600') HTTP/1.1" 204 0
2026-03-28 14:03:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DP19FWW/698227107/600 saved to cache
2026-03-28 14:03:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 4b13d468-b932-5891-9e01-a66081b24d30
2026-03-28 14:03:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LR11XWM/697880599/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LR11XWM/42810294?sv=2020-08-04&st=2026-03-28T14%3A01%3A05Z&se=2026-03-28T14%3A26%3A05Z&sr=b&sp=r&sig=zHl%2Fkz2fSAoGVBY8ukVZULGVCGKqbTVidyooaEEBPNc%3D)
2026-03-28 14:03:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MJ03HOW/698444392/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/MJ03HOW/42810316?sv=2020-08-04&st=2026-03-28T14%3A01%3A04Z&se=2026-03-28T14%3A26%3A04Z&sr=b&sp=r&sig=72R4f35YDQDGGwN55srQJ3YRSQrnD%2FGMmCWnMvmfOLc%3D)
2026-03-28 14:03:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:03:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2fe62b10>
2026-03-28 14:03:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:03:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:03:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:03:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e788d11e-974b-5084-adb6-d49a23c42616/e788d11e-974b-5084-adb6-d49a23c42616_image_2.jpg HTTP/1.1" 201 0
2026-03-28 14:03:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FX28AVE%252F698923722%252F600') HTTP/1.1" 204 0
2026-03-28 14:03:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/X28AVE/698923722/600 saved to cache
2026-03-28 14:03:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item e788d11e-974b-5084-adb6-d49a23c42616
2026-03-28 14:03:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:03:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2fdbc750>
2026-03-28 14:03:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:03:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:03:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:03:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4766d63c-47f2-5b85-8b2c-c4d089a16b5c/4766d63c-47f2-5b85-8b2c-c4d089a16b5c_image_1.jpg HTTP/1.1" 201 0
2026-03-28 14:03:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FWV13ZTH%252F698929286%252F600') HTTP/1.1" 204 0
2026-03-28 14:03:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WV13ZTH/698929286/600 saved to cache
2026-03-28 14:03:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 4766d63c-47f2-5b85-8b2c-c4d089a16b5c
2026-03-28 14:03:27 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:03:27 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:03:27 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:03:27 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:03:27 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:03:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:03:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2da0ce10>
2026-03-28 14:03:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:03:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:03:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:03:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5be82b2b-6926-5451-8e0e-f3d801ad1cad/5be82b2b-6926-5451-8e0e-f3d801ad1cad_image_8.jpg HTTP/1.1" 201 0
2026-03-28 14:03:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FEJ13JTO%252F698540323%252F600') HTTP/1.1" 204 0
2026-03-28 14:03:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EJ13JTO/698540323/600 saved to cache
2026-03-28 14:03:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 5be82b2b-6926-5451-8e0e-f3d801ad1cad
2026-03-28 14:03:27 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:03:27 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:03:27 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:03:27 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:03:27 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:03:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:03:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c7143d0>
2026-03-28 14:03:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:03:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:03:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:03:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dabe1fc4-09bf-52ef-9042-78b5e1d2db10/dabe1fc4-09bf-52ef-9042-78b5e1d2db10_image_9.jpg HTTP/1.1" 201 0
2026-03-28 14:03:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FYH13CHD%252F698786622%252F600') HTTP/1.1" 204 0
2026-03-28 14:03:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YH13CHD/698786622/600 saved to cache
2026-03-28 14:03:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item dabe1fc4-09bf-52ef-9042-78b5e1d2db10
2026-03-28 14:03:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:03:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2da0dad0>
2026-03-28 14:03:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:03:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:03:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:03:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_08bf8f74-9225-5902-b2d3-8dce4ca2dbfe/08bf8f74-9225-5902-b2d3-8dce4ca2dbfe_expert_report_file_bab4dd0e-76f3-473b-83f5-c0a011f21847.pdf HTTP/1.1" 201 0
2026-03-28 14:03:27 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item 08bf8f74-9225-5902-b2d3-8dce4ca2dbfe
2026-03-28 14:03:27 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 08bf8f74-9225-5902-b2d3-8dce4ca2dbfe, skipping ID generation
2026-03-28 14:03:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 08bf8f74-9225-5902-b2d3-8dce4ca2dbfe
2026-03-28 14:03:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DFG22EFZ-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-28 14:03:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=FG22EFZ-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-28 14:03:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YM68ZFO/42810291?sv=2020-08-04&st=2026-03-28T14%3A03%3A26Z&se=2026-03-28T14%3A28%3A26Z&sr=b&sp=r&sig=arppF1K143T0evTDmxHZrgrIN9Emgox3ISmOQq35b74%3D> (referer: https://www.bca.co.uk/)
2026-03-28 14:03:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YK67BOU/698928817/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YK67BOU/42810138?sv=2020-08-04&st=2026-03-28T14%3A01%3A06Z&se=2026-03-28T14%3A26%3A06Z&sr=b&sp=r&sig=lMZ3QjflOWAYgjfCxBohfGqFaZWJDMyvtEvO8nKSM7s%3D)
2026-03-28 14:03:28 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EJ13JTO/698540291/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698540291>
2026-03-28 14:03:28 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VX19OYP/698251084/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698251084>
2026-03-28 14:03:28 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YH13CHD/698786598/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698786598>
2026-03-28 14:03:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EA24TKX/698296251/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/EA24TKX/42810378?sv=2020-08-04&st=2026-03-28T14%3A01%3A05Z&se=2026-03-28T14%3A26%3A05Z&sr=b&sp=r&sig=Ajk9rVQfTHJs3R0cJnmP5VnSS5rSnHfV6UlI7D3mmDQ%3D)
2026-03-28 14:03:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698271606%27 HTTP/1.1" 200 None
2026-03-28 14:03:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698271606 not downloaded yet
2026-03-28 14:03:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698271607%27 HTTP/1.1" 200 None
2026-03-28 14:03:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698271607 not downloaded yet
2026-03-28 14:03:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:03:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c8d7e50>
2026-03-28 14:03:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:03:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:03:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:03:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0b12c0fe-3ab8-5445-ad6b-256ccebc3b9e/0b12c0fe-3ab8-5445-ad6b-256ccebc3b9e_image_4.jpg HTTP/1.1" 201 0
2026-03-28 14:03:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLR11XWM%252F697880599%252F600') HTTP/1.1" 204 0
2026-03-28 14:03:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LR11XWM/697880599/600 saved to cache
2026-03-28 14:03:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 0b12c0fe-3ab8-5445-ad6b-256ccebc3b9e
2026-03-28 14:03:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:03:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c52db90>
2026-03-28 14:03:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:03:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:03:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:03:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b75153fa-8bbc-5e83-87eb-81edd908fcda/b75153fa-8bbc-5e83-87eb-81edd908fcda_image_5.jpg HTTP/1.1" 201 0
2026-03-28 14:03:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FMJ03HOW%252F698444392%252F600') HTTP/1.1" 204 0
2026-03-28 14:03:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MJ03HOW/698444392/600 saved to cache
2026-03-28 14:03:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item b75153fa-8bbc-5e83-87eb-81edd908fcda
2026-03-28 14:03:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698271610%27 HTTP/1.1" 200 None
2026-03-28 14:03:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698271610 not downloaded yet
2026-03-28 14:03:28 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KV60ZZA/698934409/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698934409>
2026-03-28 14:03:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/OV64PLN/698966009/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/OV64PLN/42810653?sv=2020-08-04&st=2026-03-28T14%3A01%3A03Z&se=2026-03-28T14%3A26%3A03Z&sr=b&sp=r&sig=APMfuiYXypC%2F8k81EUjJVNUqGlQEUGUldS81rN8I%2FN0%3D)
2026-03-28 14:03:28 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/X28AVE/698923705/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698923705>
2026-03-28 14:03:28 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WV13ZTH/698929266/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=WV13ZTH-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-28 14:03:28 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YK67BOU/698928794/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698928794>
2026-03-28 14:03:28 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YL69MMV/42809459?sv=2020-08-04&st=2026-03-28T14%3A03%3A28Z&se=2026-03-28T14%3A28%3A28Z&sr=b&sp=r&sig=37dAHykHMzQFv2CL%2F7fhqtM34jervZ3j4WH%2FnrFDC7s%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=YL69%20MMV-GB>
2026-03-28 14:03:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DP19FWW/698227092/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/DP19FWW/42810375?sv=2020-08-04&st=2026-03-28T14%3A01%3A04Z&se=2026-03-28T14%3A26%3A04Z&sr=b&sp=r&sig=DYlHwmmm%2BkuE1QC9GfsRlnyT74V8OO0Bfy5POGMlRcU%3D)
2026-03-28 14:03:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FY68WNB/698106384/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/FY68WNB/42810373?sv=2020-08-04&st=2026-03-28T14%3A01%3A04Z&se=2026-03-28T14%3A26%3A04Z&sr=b&sp=r&sig=H2pJB0hzNCFCiICFkGnSt1gr2sn1tExob5yrsc4d3Vs%3D)
2026-03-28 14:03:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698271612%27 HTTP/1.1" 200 None
2026-03-28 14:03:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698271612 not downloaded yet
2026-03-28 14:03:28 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LR11XWM/697880578/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=697880578>
2026-03-28 14:03:28 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/WR21RBV/42810300?sv=2020-08-04&st=2026-03-28T14%3A03%3A28Z&se=2026-03-28T14%3A28%3A28Z&sr=b&sp=r&sig=5eIXJ4C2W5CqH1wkFme5yT36UNTwtzN6aR4WpeBrxbA%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=WR21%20RBV-GB>
2026-03-28 14:03:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698271632%27 HTTP/1.1" 200 None
2026-03-28 14:03:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698271632 not downloaded yet
2026-03-28 14:03:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:03:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c4a7510>
2026-03-28 14:03:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:03:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:03:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:03:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_16700d5d-3bb0-5d53-97b0-526970b8dd7a/16700d5d-3bb0-5d53-97b0-526970b8dd7a_expert_report_file_f2278f44-b206-40f0-90ed-42a0cccddbe3.pdf HTTP/1.1" 201 0
2026-03-28 14:03:28 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item 16700d5d-3bb0-5d53-97b0-526970b8dd7a
2026-03-28 14:03:28 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 16700d5d-3bb0-5d53-97b0-526970b8dd7a, skipping ID generation
2026-03-28 14:03:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 16700d5d-3bb0-5d53-97b0-526970b8dd7a
2026-03-28 14:03:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DYM68ZFO-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-28 14:03:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=YM68ZFO-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-28 14:03:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:03:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c1704d0>
2026-03-28 14:03:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:03:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:03:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:03:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_561c0b4f-3a2d-562b-bb16-d69244165df3/561c0b4f-3a2d-562b-bb16-d69244165df3_image_2.jpg HTTP/1.1" 201 0
2026-03-28 14:03:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FYK67BOU%252F698928817%252F600') HTTP/1.1" 204 0
2026-03-28 14:03:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YK67BOU/698928817/600 saved to cache
2026-03-28 14:03:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 561c0b4f-3a2d-562b-bb16-d69244165df3
2026-03-28 14:03:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:03:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c763710>
2026-03-28 14:03:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:03:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:03:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:03:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a936dd22-4905-520e-8ef4-c3c73c56eba4/a936dd22-4905-520e-8ef4-c3c73c56eba4_image_4.jpg HTTP/1.1" 201 0
2026-03-28 14:03:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FEA24TKX%252F698296251%252F600') HTTP/1.1" 204 0
2026-03-28 14:03:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EA24TKX/698296251/600 saved to cache
2026-03-28 14:03:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item a936dd22-4905-520e-8ef4-c3c73c56eba4
2026-03-28 14:03:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YH13CHD/698786598/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YH13CHD/42807762?sv=2020-08-04&st=2026-03-28T14%3A01%3A02Z&se=2026-03-28T14%3A26%3A02Z&sr=b&sp=r&sig=Kk3ZnO0H7wXbnR6jzpTNZkeJ9EaoXS3djv9g6kExg8o%3D)
2026-03-28 14:03:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EJ13JTO/698540291/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/EJ13JTO/42810382?sv=2020-08-04&st=2026-03-28T14%3A01%3A03Z&se=2026-03-28T14%3A26%3A03Z&sr=b&sp=r&sig=9n5SmvjaM772xUjZdL0t%2BMeZRNBu1TSQPyTFa%2FZiaIA%3D)
2026-03-28 14:03:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VX19OYP/698251084/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/VX19OYP/42810376?sv=2020-08-04&st=2026-03-28T14%3A01%3A04Z&se=2026-03-28T14%3A26%3A04Z&sr=b&sp=r&sig=ZoloAWIhiMuraB8%2BrUA7GYd%2BDLx9PxJOBzKxmER1A8U%3D)
2026-03-28 14:03:28 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MJ03HOW/698444388/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698444388>
2026-03-28 14:03:28 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FG22EFZ/698271601/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=FG22EFZ-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-28 14:03:28 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EA24TKX/698296242/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698296242>
2026-03-28 14:03:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698271643%27 HTTP/1.1" 200 None
2026-03-28 14:03:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698271643 not downloaded yet
2026-03-28 14:03:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D697662471%27 HTTP/1.1" 200 None
2026-03-28 14:03:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=697662471 not downloaded yet
2026-03-28 14:03:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:03:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c3d9a90>
2026-03-28 14:03:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:03:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:03:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:03:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d75bc751-3167-5395-a067-9fe76cc20a2d/d75bc751-3167-5395-a067-9fe76cc20a2d_image_7.jpg HTTP/1.1" 201 0
2026-03-28 14:03:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FOV64PLN%252F698966009%252F600') HTTP/1.1" 204 0
2026-03-28 14:03:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/OV64PLN/698966009/600 saved to cache
2026-03-28 14:03:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item d75bc751-3167-5395-a067-9fe76cc20a2d
2026-03-28 14:03:28 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:03:28 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:03:28 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:03:28 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:03:28 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:03:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:03:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c6c6c10>
2026-03-28 14:03:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:03:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:03:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:03:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4b13d468-b932-5891-9e01-a66081b24d30/4b13d468-b932-5891-9e01-a66081b24d30_image_6.jpg HTTP/1.1" 201 0
2026-03-28 14:03:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FDP19FWW%252F698227092%252F600') HTTP/1.1" 204 0
2026-03-28 14:03:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DP19FWW/698227092/600 saved to cache
2026-03-28 14:03:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 4b13d468-b932-5891-9e01-a66081b24d30
2026-03-28 14:03:28 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:03:28 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:03:28 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:03:28 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:03:28 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:03:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:03:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c599410>
2026-03-28 14:03:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:03:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:03:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:03:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d8436e02-8218-5d88-bcc5-e01ffac7eb8e/d8436e02-8218-5d88-bcc5-e01ffac7eb8e_image_7.jpg HTTP/1.1" 201 0
2026-03-28 14:03:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FFY68WNB%252F698106384%252F600') HTTP/1.1" 204 0
2026-03-28 14:03:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FY68WNB/698106384/600 saved to cache
2026-03-28 14:03:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item d8436e02-8218-5d88-bcc5-e01ffac7eb8e
2026-03-28 14:03:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WV13ZTH/698929266/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/WV13ZTH/42810161?sv=2020-08-04&st=2026-03-28T14%3A01%3A04Z&se=2026-03-28T14%3A26%3A04Z&sr=b&sp=r&sig=hbqIghhD97wvMs5qjsvBMdrtSptsqnkIa342PcMgOiA%3D)
2026-03-28 14:03:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YK67BOU/698928794/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YK67BOU/42810138?sv=2020-08-04&st=2026-03-28T14%3A01%3A06Z&se=2026-03-28T14%3A26%3A06Z&sr=b&sp=r&sig=lMZ3QjflOWAYgjfCxBohfGqFaZWJDMyvtEvO8nKSM7s%3D)
2026-03-28 14:03:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698271653%27 HTTP/1.1" 200 None
2026-03-28 14:03:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698271653 not downloaded yet
2026-03-28 14:03:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D697662475%27 HTTP/1.1" 200 None
2026-03-28 14:03:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=697662475 not downloaded yet
2026-03-28 14:03:28 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:03:28 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:03:28 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:03:28 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:03:28 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:03:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:03:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c705950>
2026-03-28 14:03:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:03:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:03:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:03:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dabe1fc4-09bf-52ef-9042-78b5e1d2db10/dabe1fc4-09bf-52ef-9042-78b5e1d2db10_image_8.jpg HTTP/1.1" 201 0
2026-03-28 14:03:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FYH13CHD%252F698786598%252F600') HTTP/1.1" 204 0
2026-03-28 14:03:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YH13CHD/698786598/600 saved to cache
2026-03-28 14:03:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item dabe1fc4-09bf-52ef-9042-78b5e1d2db10
2026-03-28 14:03:28 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:03:28 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:03:28 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:03:28 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:03:28 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:03:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:03:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c5e01d0>
2026-03-28 14:03:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:03:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:03:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:03:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5be82b2b-6926-5451-8e0e-f3d801ad1cad/5be82b2b-6926-5451-8e0e-f3d801ad1cad_image_7.jpg HTTP/1.1" 201 0
2026-03-28 14:03:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FEJ13JTO%252F698540291%252F600') HTTP/1.1" 204 0
2026-03-28 14:03:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EJ13JTO/698540291/600 saved to cache
2026-03-28 14:03:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 5be82b2b-6926-5451-8e0e-f3d801ad1cad
2026-03-28 14:03:28 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:03:28 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:03:28 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:03:28 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:03:28 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:03:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:03:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a1fd7ec10>
2026-03-28 14:03:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:03:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:03:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:03:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b7b36a17-d5d4-5e94-9bbf-8a754ca74b60/b7b36a17-d5d4-5e94-9bbf-8a754ca74b60_image_9.jpg HTTP/1.1" 201 0
2026-03-28 14:03:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FVX19OYP%252F698251084%252F600') HTTP/1.1" 204 0
2026-03-28 14:03:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VX19OYP/698251084/600 saved to cache
2026-03-28 14:03:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item b7b36a17-d5d4-5e94-9bbf-8a754ca74b60
2026-03-28 14:03:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698271662%27 HTTP/1.1" 200 None
2026-03-28 14:03:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698271662 not downloaded yet
2026-03-28 14:03:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D697662477%27 HTTP/1.1" 200 None
2026-03-28 14:03:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=697662477 not downloaded yet
2026-03-28 14:03:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/X28AVE/698923705/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/X28AVE/42809896?sv=2020-08-04&st=2026-03-28T14%3A01%3A06Z&se=2026-03-28T14%3A26%3A06Z&sr=b&sp=r&sig=AYxkyrr3IbeLdESXjdd9QmNEg4ZiUeF%2B%2BO3v1nuSrfg%3D)
2026-03-28 14:03:28 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FG22EFZ/698271606/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698271606>
2026-03-28 14:03:28 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FG22EFZ/698271607/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698271607>
2026-03-28 14:03:28 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FG22EFZ/698271610/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698271610>
2026-03-28 14:03:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KV60ZZA/698934409/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/KV60ZZA/42810415?sv=2020-08-04&st=2026-03-28T14%3A01%3A03Z&se=2026-03-28T14%3A26%3A03Z&sr=b&sp=r&sig=IuzavW0HE55HWRn715zywGMWMJJZSa9qrno76VZ5d%2FU%3D)
2026-03-28 14:03:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698271669%27 HTTP/1.1" 200 None
2026-03-28 14:03:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698271669 not downloaded yet
2026-03-28 14:03:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D697662479%27 HTTP/1.1" 200 None
2026-03-28 14:03:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=697662479 not downloaded yet
2026-03-28 14:03:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:03:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c7072d0>
2026-03-28 14:03:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:03:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:03:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:03:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4766d63c-47f2-5b85-8b2c-c4d089a16b5c/4766d63c-47f2-5b85-8b2c-c4d089a16b5c_image_0.jpg HTTP/1.1" 201 0
2026-03-28 14:03:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FWV13ZTH%252F698929266%252F600') HTTP/1.1" 204 0
2026-03-28 14:03:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WV13ZTH/698929266/600 saved to cache
2026-03-28 14:03:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 4766d63c-47f2-5b85-8b2c-c4d089a16b5c
2026-03-28 14:03:28 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 4766d63c-47f2-5b85-8b2c-c4d089a16b5c, skipping ID generation
2026-03-28 14:03:28 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 4766d63c-47f2-5b85-8b2c-c4d089a16b5c sending to next pipeline
2026-03-28 14:03:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 4766d63c-47f2-5b85-8b2c-c4d089a16b5c, identifier: WV13%20ZTH
2026-03-28 14:03:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:03:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a3025e510>
2026-03-28 14:03:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:03:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:03:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:03:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_561c0b4f-3a2d-562b-bb16-d69244165df3/561c0b4f-3a2d-562b-bb16-d69244165df3_image_1.jpg HTTP/1.1" 201 0
2026-03-28 14:03:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FYK67BOU%252F698928794%252F600') HTTP/1.1" 204 0
2026-03-28 14:03:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YK67BOU/698928794/600 saved to cache
2026-03-28 14:03:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 561c0b4f-3a2d-562b-bb16-d69244165df3
2026-03-28 14:03:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YL69MMV/42809459?sv=2020-08-04&st=2026-03-28T14%3A03%3A28Z&se=2026-03-28T14%3A28%3A28Z&sr=b&sp=r&sig=37dAHykHMzQFv2CL%2F7fhqtM34jervZ3j4WH%2FnrFDC7s%3D> (referer: https://www.bca.co.uk/)
2026-03-28 14:03:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 4766d63c-47f2-5b85-8b2c-c4d089a16b5c with identifier: WV13%20ZTH
2026-03-28 14:03:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 4766d63c-47f2-5b85-8b2c-c4d089a16b5c with identifier: WV13%20ZTH
2026-03-28 14:03:29 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 4766d63c-47f2-5b85-8b2c-c4d089a16b5c with identifier: WV13%20ZTH to the API
2026-03-28 14:03:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:03:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:03:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WV13ZTH/698929266/600>
{'auction_title': '',
'c_o_2_emission_value': 129,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4766d63c-47f2-5b85-8b2c-c4d089a16b5c/4766d63c-47f2-5b85-8b2c-c4d089a16b5c_expert_report_file_eeebd9eb-b6de-4293-9cd5-d6c3572c2a80.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=WV13%20ZTH-GB',
'category': 'Car',
'color': 'white',
'currency': 'GBP',
'doors_number': 5,
'engine': '2.0L',
'expiration_date': '2026-03-29T10:00:00Z',
'fuel_type': 'Diesel',
'id': '4766d63c-47f2-5b85-8b2c-c4d089a16b5c',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'WV13 ZTH',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=WV13%20ZTH&vehicleType=*',
'listing': 'auction',
'location': 'Walsall',
'make': 'FORD',
'model': 'C-MAX',
'odometer': 114926,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 11,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4766d63c-47f2-5b85-8b2c-c4d089a16b5c/4766d63c-47f2-5b85-8b2c-c4d089a16b5c_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 44144,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WV13ZTH/698929266/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4766d63c-47f2-5b85-8b2c-c4d089a16b5c/4766d63c-47f2-5b85-8b2c-c4d089a16b5c_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 43596,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WV13ZTH/698929286/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4766d63c-47f2-5b85-8b2c-c4d089a16b5c/4766d63c-47f2-5b85-8b2c-c4d089a16b5c_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 41915,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WV13ZTH/698929295/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4766d63c-47f2-5b85-8b2c-c4d089a16b5c/4766d63c-47f2-5b85-8b2c-c4d089a16b5c_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 41717,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WV13ZTH/698929305/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4766d63c-47f2-5b85-8b2c-c4d089a16b5c/4766d63c-47f2-5b85-8b2c-c4d089a16b5c_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 41622,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WV13ZTH/698929313/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4766d63c-47f2-5b85-8b2c-c4d089a16b5c/4766d63c-47f2-5b85-8b2c-c4d089a16b5c_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 41421,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WV13ZTH/698929321/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4766d63c-47f2-5b85-8b2c-c4d089a16b5c/4766d63c-47f2-5b85-8b2c-c4d089a16b5c_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 59930,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WV13ZTH/698929332/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4766d63c-47f2-5b85-8b2c-c4d089a16b5c/4766d63c-47f2-5b85-8b2c-c4d089a16b5c_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 54124,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WV13ZTH/698929340/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4766d63c-47f2-5b85-8b2c-c4d089a16b5c/4766d63c-47f2-5b85-8b2c-c4d089a16b5c_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 69973,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WV13ZTH/698929353/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4766d63c-47f2-5b85-8b2c-c4d089a16b5c/4766d63c-47f2-5b85-8b2c-c4d089a16b5c_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 67085,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WV13ZTH/698929371/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2013-01-01',
'seller_name': None,
'title': 'FORD C-MAX 2.0 TDCI 163 TITANIUM X MPV',
'transmission': 'manual',
'trim': 'TDCI 163 TITANIUM X',
'vin': 'WF0JXXWPBJDP35712',
'year': 2013}
2026-03-28 14:03:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WV13%2520ZTH%27 HTTP/1.1" 200 None
2026-03-28 14:03:29 [bca.uk] INFO: Saving data for WV13%20ZTH: {'created_time': 1774706609.436311, 'last_price_update_time': 1774706609.436325, 'auction_closing_time': 1774778400.0}
2026-03-28 14:03:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='WV13%2520ZTH') HTTP/1.1" 204 0
2026-03-28 14:03:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LR11XWM/697880578/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LR11XWM/42810294?sv=2020-08-04&st=2026-03-28T14%3A01%3A05Z&se=2026-03-28T14%3A26%3A05Z&sr=b&sp=r&sig=zHl%2Fkz2fSAoGVBY8ukVZULGVCGKqbTVidyooaEEBPNc%3D)
2026-03-28 14:03:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D697662482%27 HTTP/1.1" 200 None
2026-03-28 14:03:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=697662482 not downloaded yet
2026-03-28 14:03:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MJ03HOW/698444388/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/MJ03HOW/42810316?sv=2020-08-04&st=2026-03-28T14%3A01%3A04Z&se=2026-03-28T14%3A26%3A04Z&sr=b&sp=r&sig=72R4f35YDQDGGwN55srQJ3YRSQrnD%2FGMmCWnMvmfOLc%3D)
2026-03-28 14:03:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EA24TKX/698296242/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/EA24TKX/42810378?sv=2020-08-04&st=2026-03-28T14%3A01%3A05Z&se=2026-03-28T14%3A26%3A05Z&sr=b&sp=r&sig=Ajk9rVQfTHJs3R0cJnmP5VnSS5rSnHfV6UlI7D3mmDQ%3D)
2026-03-28 14:03:29 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FG22EFZ/698271632/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698271632>
2026-03-28 14:03:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FG22EFZ/698271601/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/FG22EFZ/42810348?sv=2020-08-04&st=2026-03-28T14%3A03%3A25Z&se=2026-03-28T14%3A28%3A25Z&sr=b&sp=r&sig=znOCBlcX4%2BITNfLLXK1J3VwsbyM08uOiUJYZW5ymtnw%3D)
2026-03-28 14:03:29 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YM68ZFO/697662470/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=YM68ZFO-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-28 14:03:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/WR21RBV/42810300?sv=2020-08-04&st=2026-03-28T14%3A03%3A28Z&se=2026-03-28T14%3A28%3A28Z&sr=b&sp=r&sig=5eIXJ4C2W5CqH1wkFme5yT36UNTwtzN6aR4WpeBrxbA%3D> (referer: https://www.bca.co.uk/)
2026-03-28 14:03:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D697662488%27 HTTP/1.1" 200 None
2026-03-28 14:03:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=697662488 not downloaded yet
2026-03-28 14:03:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:03:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a30ea47d0>
2026-03-28 14:03:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:03:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:03:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:03:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e788d11e-974b-5084-adb6-d49a23c42616/e788d11e-974b-5084-adb6-d49a23c42616_image_1.jpg HTTP/1.1" 201 0
2026-03-28 14:03:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FX28AVE%252F698923705%252F600') HTTP/1.1" 204 0
2026-03-28 14:03:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/X28AVE/698923705/600 saved to cache
2026-03-28 14:03:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item e788d11e-974b-5084-adb6-d49a23c42616
2026-03-28 14:03:29 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:03:29 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:03:29 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:03:29 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:03:29 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:03:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:03:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c6b27d0>
2026-03-28 14:03:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:03:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:03:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:03:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3f54d261-9f82-51f4-9ce3-cc4413b8b6c4/3f54d261-9f82-51f4-9ce3-cc4413b8b6c4_image_9.jpg HTTP/1.1" 201 0
2026-03-28 14:03:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FKV60ZZA%252F698934409%252F600') HTTP/1.1" 204 0
2026-03-28 14:03:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KV60ZZA/698934409/600 saved to cache
2026-03-28 14:03:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 3f54d261-9f82-51f4-9ce3-cc4413b8b6c4
2026-03-28 14:03:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:03:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c5560d0>
2026-03-28 14:03:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:03:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:03:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:03:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3bc89657-c659-5489-9b8d-2c0e3a987c9c/3bc89657-c659-5489-9b8d-2c0e3a987c9c_expert_report_file_1de3db90-bf83-4896-8af7-0a28c179bbb7.pdf HTTP/1.1" 201 0
2026-03-28 14:03:29 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item 3bc89657-c659-5489-9b8d-2c0e3a987c9c
2026-03-28 14:03:29 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 3bc89657-c659-5489-9b8d-2c0e3a987c9c, skipping ID generation
2026-03-28 14:03:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 3bc89657-c659-5489-9b8d-2c0e3a987c9c
2026-03-28 14:03:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DYL69MMV-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-28 14:03:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=YL69MMV-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-28 14:03:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D697662492%27 HTTP/1.1" 200 None
2026-03-28 14:03:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=697662492 not downloaded yet
2026-03-28 14:03:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FG22EFZ/698271607/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/FG22EFZ/42810348?sv=2020-08-04&st=2026-03-28T14%3A03%3A25Z&se=2026-03-28T14%3A28%3A25Z&sr=b&sp=r&sig=znOCBlcX4%2BITNfLLXK1J3VwsbyM08uOiUJYZW5ymtnw%3D)
2026-03-28 14:03:29 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YM68ZFO/697662471/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=697662471>
2026-03-28 14:03:29 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FG22EFZ/698271612/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698271612>
2026-03-28 14:03:29 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YM68ZFO/697662477/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=697662477>
2026-03-28 14:03:29 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FG22EFZ/698271643/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698271643>
2026-03-28 14:03:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FG22EFZ/698271610/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/FG22EFZ/42810348?sv=2020-08-04&st=2026-03-28T14%3A03%3A25Z&se=2026-03-28T14%3A28%3A25Z&sr=b&sp=r&sig=znOCBlcX4%2BITNfLLXK1J3VwsbyM08uOiUJYZW5ymtnw%3D)
2026-03-28 14:03:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FG22EFZ/698271606/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/FG22EFZ/42810348?sv=2020-08-04&st=2026-03-28T14%3A03%3A25Z&se=2026-03-28T14%3A28%3A25Z&sr=b&sp=r&sig=znOCBlcX4%2BITNfLLXK1J3VwsbyM08uOiUJYZW5ymtnw%3D)
2026-03-28 14:03:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698104145%27 HTTP/1.1" 200 None
2026-03-28 14:03:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698104145 not downloaded yet
2026-03-28 14:03:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D697662494%27 HTTP/1.1" 200 None
2026-03-28 14:03:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=697662494 not downloaded yet
2026-03-28 14:03:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:03:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c6b34d0>
2026-03-28 14:03:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:03:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:03:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:03:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0b12c0fe-3ab8-5445-ad6b-256ccebc3b9e/0b12c0fe-3ab8-5445-ad6b-256ccebc3b9e_image_3.jpg HTTP/1.1" 201 0
2026-03-28 14:03:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLR11XWM%252F697880578%252F600') HTTP/1.1" 204 0
2026-03-28 14:03:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LR11XWM/697880578/600 saved to cache
2026-03-28 14:03:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 0b12c0fe-3ab8-5445-ad6b-256ccebc3b9e
2026-03-28 14:03:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:03:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2d9bf450>
2026-03-28 14:03:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:03:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:03:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:03:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b75153fa-8bbc-5e83-87eb-81edd908fcda/b75153fa-8bbc-5e83-87eb-81edd908fcda_image_4.jpg HTTP/1.1" 201 0
2026-03-28 14:03:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FMJ03HOW%252F698444388%252F600') HTTP/1.1" 204 0
2026-03-28 14:03:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MJ03HOW/698444388/600 saved to cache
2026-03-28 14:03:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item b75153fa-8bbc-5e83-87eb-81edd908fcda
2026-03-28 14:03:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:03:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2d78f810>
2026-03-28 14:03:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:03:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:03:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:03:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a936dd22-4905-520e-8ef4-c3c73c56eba4/a936dd22-4905-520e-8ef4-c3c73c56eba4_image_3.jpg HTTP/1.1" 201 0
2026-03-28 14:03:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FEA24TKX%252F698296242%252F600') HTTP/1.1" 204 0
2026-03-28 14:03:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EA24TKX/698296242/600 saved to cache
2026-03-28 14:03:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item a936dd22-4905-520e-8ef4-c3c73c56eba4
2026-03-28 14:03:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:03:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a1ff17350>
2026-03-28 14:03:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:03:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:03:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:03:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_08bf8f74-9225-5902-b2d3-8dce4ca2dbfe/08bf8f74-9225-5902-b2d3-8dce4ca2dbfe_image_0.jpg HTTP/1.1" 201 0
2026-03-28 14:03:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FFG22EFZ%252F698271601%252F600') HTTP/1.1" 204 0
2026-03-28 14:03:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FG22EFZ/698271601/600 saved to cache
2026-03-28 14:03:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 08bf8f74-9225-5902-b2d3-8dce4ca2dbfe
2026-03-28 14:03:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:03:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c742350>
2026-03-28 14:03:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:03:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:03:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:03:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a29fef22-1343-5214-87a8-25c25aa3608e/a29fef22-1343-5214-87a8-25c25aa3608e_expert_report_file_1e2d58a5-8234-451f-a0ef-9385066a89f7.pdf HTTP/1.1" 201 0
2026-03-28 14:03:30 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item a29fef22-1343-5214-87a8-25c25aa3608e
2026-03-28 14:03:30 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: a29fef22-1343-5214-87a8-25c25aa3608e, skipping ID generation
2026-03-28 14:03:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item a29fef22-1343-5214-87a8-25c25aa3608e
2026-03-28 14:03:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DWR21RBV-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-28 14:03:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=WR21RBV-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-28 14:03:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698104160%27 HTTP/1.1" 200 None
2026-03-28 14:03:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698104160 not downloaded yet
2026-03-28 14:03:30 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FG22EFZ/698271662/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698271662>
2026-03-28 14:03:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D697662499%27 HTTP/1.1" 200 None
2026-03-28 14:03:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=697662499 not downloaded yet
2026-03-28 14:03:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698067980%27 HTTP/1.1" 200 None
2026-03-28 14:03:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698067980 not downloaded yet
2026-03-28 14:03:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698104174%27 HTTP/1.1" 200 None
2026-03-28 14:03:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698104174 not downloaded yet
2026-03-28 14:03:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698067982%27 HTTP/1.1" 200 None
2026-03-28 14:03:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698067982 not downloaded yet
2026-03-28 14:03:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YM68ZFO/697662470/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YM68ZFO/42810291?sv=2020-08-04&st=2026-03-28T14%3A03%3A26Z&se=2026-03-28T14%3A28%3A26Z&sr=b&sp=r&sig=arppF1K143T0evTDmxHZrgrIN9Emgox3ISmOQq35b74%3D)
2026-03-28 14:03:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FG22EFZ/698271632/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/FG22EFZ/42810348?sv=2020-08-04&st=2026-03-28T14%3A03%3A25Z&se=2026-03-28T14%3A28%3A25Z&sr=b&sp=r&sig=znOCBlcX4%2BITNfLLXK1J3VwsbyM08uOiUJYZW5ymtnw%3D)
2026-03-28 14:03:30 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YM68ZFO/697662479/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=697662479>
2026-03-28 14:03:30 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DP19FWW/698227082/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698227082>
2026-03-28 14:03:30 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YM68ZFO/697662475/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=697662475>
2026-03-28 14:03:30 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FG22EFZ/698271653/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698271653>
2026-03-28 14:03:30 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FG22EFZ/698271669/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698271669>
2026-03-28 14:03:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698104187%27 HTTP/1.1" 200 None
2026-03-28 14:03:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698104187 not downloaded yet
2026-03-28 14:03:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:03:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c6b3450>
2026-03-28 14:03:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:03:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:03:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:03:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_08bf8f74-9225-5902-b2d3-8dce4ca2dbfe/08bf8f74-9225-5902-b2d3-8dce4ca2dbfe_image_2.jpg HTTP/1.1" 201 0
2026-03-28 14:03:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FFG22EFZ%252F698271607%252F600') HTTP/1.1" 204 0
2026-03-28 14:03:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FG22EFZ/698271607/600 saved to cache
2026-03-28 14:03:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 08bf8f74-9225-5902-b2d3-8dce4ca2dbfe
2026-03-28 14:03:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:03:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2d687d50>
2026-03-28 14:03:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:03:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:03:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:03:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_08bf8f74-9225-5902-b2d3-8dce4ca2dbfe/08bf8f74-9225-5902-b2d3-8dce4ca2dbfe_image_3.jpg HTTP/1.1" 201 0
2026-03-28 14:03:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FFG22EFZ%252F698271610%252F600') HTTP/1.1" 204 0
2026-03-28 14:03:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FG22EFZ/698271610/600 saved to cache
2026-03-28 14:03:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 08bf8f74-9225-5902-b2d3-8dce4ca2dbfe
2026-03-28 14:03:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:03:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a1fd71390>
2026-03-28 14:03:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:03:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:03:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:03:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_08bf8f74-9225-5902-b2d3-8dce4ca2dbfe/08bf8f74-9225-5902-b2d3-8dce4ca2dbfe_image_1.jpg HTTP/1.1" 201 0
2026-03-28 14:03:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FFG22EFZ%252F698271606%252F600') HTTP/1.1" 204 0
2026-03-28 14:03:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FG22EFZ/698271606/600 saved to cache
2026-03-28 14:03:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 08bf8f74-9225-5902-b2d3-8dce4ca2dbfe
2026-03-28 14:03:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698067986%27 HTTP/1.1" 200 None
2026-03-28 14:03:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698067986 not downloaded yet
2026-03-28 14:03:30 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YM68ZFO/697662482/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=697662482>
2026-03-28 14:03:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698104201%27 HTTP/1.1" 200 None
2026-03-28 14:03:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698104201 not downloaded yet
2026-03-28 14:03:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698067990%27 HTTP/1.1" 200 None
2026-03-28 14:03:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698067990 not downloaded yet
2026-03-28 14:03:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698104224%27 HTTP/1.1" 200 None
2026-03-28 14:03:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698104224 not downloaded yet
2026-03-28 14:03:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698067992%27 HTTP/1.1" 200 None
2026-03-28 14:03:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698067992 not downloaded yet
2026-03-28 14:03:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:03:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c741850>
2026-03-28 14:03:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:03:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:03:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:03:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_16700d5d-3bb0-5d53-97b0-526970b8dd7a/16700d5d-3bb0-5d53-97b0-526970b8dd7a_image_0.jpg HTTP/1.1" 201 0
2026-03-28 14:03:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FYM68ZFO%252F697662470%252F600') HTTP/1.1" 204 0
2026-03-28 14:03:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YM68ZFO/697662470/600 saved to cache
2026-03-28 14:03:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 16700d5d-3bb0-5d53-97b0-526970b8dd7a
2026-03-28 14:03:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:03:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a1fdb5b50>
2026-03-28 14:03:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:03:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:03:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:03:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_08bf8f74-9225-5902-b2d3-8dce4ca2dbfe/08bf8f74-9225-5902-b2d3-8dce4ca2dbfe_image_5.jpg HTTP/1.1" 201 0
2026-03-28 14:03:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FFG22EFZ%252F698271632%252F600') HTTP/1.1" 204 0
2026-03-28 14:03:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FG22EFZ/698271632/600 saved to cache
2026-03-28 14:03:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 08bf8f74-9225-5902-b2d3-8dce4ca2dbfe
2026-03-28 14:03:30 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YM68ZFO/697662488/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=697662488>
2026-03-28 14:03:30 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YM68ZFO/697662492/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=697662492>
2026-03-28 14:03:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YM68ZFO/697662477/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YM68ZFO/42810291?sv=2020-08-04&st=2026-03-28T14%3A03%3A26Z&se=2026-03-28T14%3A28%3A26Z&sr=b&sp=r&sig=arppF1K143T0evTDmxHZrgrIN9Emgox3ISmOQq35b74%3D)
2026-03-28 14:03:30 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YL69MMV/698104132/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=YL69MMV-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-28 14:03:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FG22EFZ/698271612/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/FG22EFZ/42810348?sv=2020-08-04&st=2026-03-28T14%3A03%3A25Z&se=2026-03-28T14%3A28%3A25Z&sr=b&sp=r&sig=znOCBlcX4%2BITNfLLXK1J3VwsbyM08uOiUJYZW5ymtnw%3D)
2026-03-28 14:03:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698104242%27 HTTP/1.1" 200 None
2026-03-28 14:03:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698104242 not downloaded yet
2026-03-28 14:03:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FG22EFZ/698271643/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/FG22EFZ/42810348?sv=2020-08-04&st=2026-03-28T14%3A03%3A25Z&se=2026-03-28T14%3A28%3A25Z&sr=b&sp=r&sig=znOCBlcX4%2BITNfLLXK1J3VwsbyM08uOiUJYZW5ymtnw%3D)
2026-03-28 14:03:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YM68ZFO/697662471/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YM68ZFO/42810291?sv=2020-08-04&st=2026-03-28T14%3A03%3A26Z&se=2026-03-28T14%3A28%3A26Z&sr=b&sp=r&sig=arppF1K143T0evTDmxHZrgrIN9Emgox3ISmOQq35b74%3D)
2026-03-28 14:03:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698067997%27 HTTP/1.1" 200 None
2026-03-28 14:03:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698067997 not downloaded yet
2026-03-28 14:03:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FG22EFZ/698271662/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/FG22EFZ/42810348?sv=2020-08-04&st=2026-03-28T14%3A03%3A25Z&se=2026-03-28T14%3A28%3A25Z&sr=b&sp=r&sig=znOCBlcX4%2BITNfLLXK1J3VwsbyM08uOiUJYZW5ymtnw%3D)
2026-03-28 14:03:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698104257%27 HTTP/1.1" 200 None
2026-03-28 14:03:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698104257 not downloaded yet
2026-03-28 14:03:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698067998%27 HTTP/1.1" 200 None
2026-03-28 14:03:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698067998 not downloaded yet
2026-03-28 14:03:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698104272%27 HTTP/1.1" 200 None
2026-03-28 14:03:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698104272 not downloaded yet
2026-03-28 14:03:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YM68ZFO/697662475/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YM68ZFO/42810291?sv=2020-08-04&st=2026-03-28T14%3A03%3A26Z&se=2026-03-28T14%3A28%3A26Z&sr=b&sp=r&sig=arppF1K143T0evTDmxHZrgrIN9Emgox3ISmOQq35b74%3D)
2026-03-28 14:03:30 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YL69MMV/698104174/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698104174>
2026-03-28 14:03:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698068000%27 HTTP/1.1" 200 None
2026-03-28 14:03:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698068000 not downloaded yet
2026-03-28 14:03:30 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WR21RBV/698067980/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698067980>
2026-03-28 14:03:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:03:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a1fdb5450>
2026-03-28 14:03:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:03:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:03:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:03:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_16700d5d-3bb0-5d53-97b0-526970b8dd7a/16700d5d-3bb0-5d53-97b0-526970b8dd7a_image_3.jpg HTTP/1.1" 201 0
2026-03-28 14:03:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FYM68ZFO%252F697662477%252F600') HTTP/1.1" 204 0
2026-03-28 14:03:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YM68ZFO/697662477/600 saved to cache
2026-03-28 14:03:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 16700d5d-3bb0-5d53-97b0-526970b8dd7a
2026-03-28 14:03:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:03:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c753590>
2026-03-28 14:03:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:03:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:03:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:03:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_08bf8f74-9225-5902-b2d3-8dce4ca2dbfe/08bf8f74-9225-5902-b2d3-8dce4ca2dbfe_image_4.jpg HTTP/1.1" 201 0
2026-03-28 14:03:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FFG22EFZ%252F698271612%252F600') HTTP/1.1" 204 0
2026-03-28 14:03:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FG22EFZ/698271612/600 saved to cache
2026-03-28 14:03:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 08bf8f74-9225-5902-b2d3-8dce4ca2dbfe
2026-03-28 14:03:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YM68ZFO/697662479/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YM68ZFO/42810291?sv=2020-08-04&st=2026-03-28T14%3A03%3A26Z&se=2026-03-28T14%3A28%3A26Z&sr=b&sp=r&sig=arppF1K143T0evTDmxHZrgrIN9Emgox3ISmOQq35b74%3D)
2026-03-28 14:03:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DP19FWW/698227082/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/DP19FWW/42810375?sv=2020-08-04&st=2026-03-28T14%3A01%3A04Z&se=2026-03-28T14%3A26%3A04Z&sr=b&sp=r&sig=DYlHwmmm%2BkuE1QC9GfsRlnyT74V8OO0Bfy5POGMlRcU%3D)
2026-03-28 14:03:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FG22EFZ/698271669/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/FG22EFZ/42810348?sv=2020-08-04&st=2026-03-28T14%3A03%3A25Z&se=2026-03-28T14%3A28%3A25Z&sr=b&sp=r&sig=znOCBlcX4%2BITNfLLXK1J3VwsbyM08uOiUJYZW5ymtnw%3D)
2026-03-28 14:03:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698068008%27 HTTP/1.1" 200 None
2026-03-28 14:03:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698068008 not downloaded yet
2026-03-28 14:03:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YM68ZFO/697662482/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YM68ZFO/42810291?sv=2020-08-04&st=2026-03-28T14%3A03%3A26Z&se=2026-03-28T14%3A28%3A26Z&sr=b&sp=r&sig=arppF1K143T0evTDmxHZrgrIN9Emgox3ISmOQq35b74%3D)
2026-03-28 14:03:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FG22EFZ/698271653/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/FG22EFZ/42810348?sv=2020-08-04&st=2026-03-28T14%3A03%3A25Z&se=2026-03-28T14%3A28%3A25Z&sr=b&sp=r&sig=znOCBlcX4%2BITNfLLXK1J3VwsbyM08uOiUJYZW5ymtnw%3D)
2026-03-28 14:03:30 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:03:30 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:03:30 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:03:30 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:03:30 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:03:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:03:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c890750>
2026-03-28 14:03:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:03:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:03:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:03:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_08bf8f74-9225-5902-b2d3-8dce4ca2dbfe/08bf8f74-9225-5902-b2d3-8dce4ca2dbfe_image_6.jpg HTTP/1.1" 201 0
2026-03-28 14:03:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FFG22EFZ%252F698271643%252F600') HTTP/1.1" 204 0
2026-03-28 14:03:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FG22EFZ/698271643/600 saved to cache
2026-03-28 14:03:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 08bf8f74-9225-5902-b2d3-8dce4ca2dbfe
2026-03-28 14:03:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:03:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c7334d0>
2026-03-28 14:03:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:03:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:03:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:03:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_16700d5d-3bb0-5d53-97b0-526970b8dd7a/16700d5d-3bb0-5d53-97b0-526970b8dd7a_image_1.jpg HTTP/1.1" 201 0
2026-03-28 14:03:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FYM68ZFO%252F697662471%252F600') HTTP/1.1" 204 0
2026-03-28 14:03:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YM68ZFO/697662471/600 saved to cache
2026-03-28 14:03:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 16700d5d-3bb0-5d53-97b0-526970b8dd7a
2026-03-28 14:03:30 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:03:30 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:03:30 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:03:30 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:03:30 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:03:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:03:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c81b250>
2026-03-28 14:03:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:03:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:03:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:03:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_08bf8f74-9225-5902-b2d3-8dce4ca2dbfe/08bf8f74-9225-5902-b2d3-8dce4ca2dbfe_image_8.jpg HTTP/1.1" 201 0
2026-03-28 14:03:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FFG22EFZ%252F698271662%252F600') HTTP/1.1" 204 0
2026-03-28 14:03:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FG22EFZ/698271662/600 saved to cache
2026-03-28 14:03:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 08bf8f74-9225-5902-b2d3-8dce4ca2dbfe
2026-03-28 14:03:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YL69MMV/698104132/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YL69MMV/42809459?sv=2020-08-04&st=2026-03-28T14%3A03%3A28Z&se=2026-03-28T14%3A28%3A28Z&sr=b&sp=r&sig=37dAHykHMzQFv2CL%2F7fhqtM34jervZ3j4WH%2FnrFDC7s%3D)
2026-03-28 14:03:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YM68ZFO/697662492/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YM68ZFO/42810291?sv=2020-08-04&st=2026-03-28T14%3A03%3A26Z&se=2026-03-28T14%3A28%3A26Z&sr=b&sp=r&sig=arppF1K143T0evTDmxHZrgrIN9Emgox3ISmOQq35b74%3D)
2026-03-28 14:03:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YM68ZFO/697662488/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YM68ZFO/42810291?sv=2020-08-04&st=2026-03-28T14%3A03%3A26Z&se=2026-03-28T14%3A28%3A26Z&sr=b&sp=r&sig=arppF1K143T0evTDmxHZrgrIN9Emgox3ISmOQq35b74%3D)
2026-03-28 14:03:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:03:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2d79d790>
2026-03-28 14:03:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:03:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:03:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:03:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_16700d5d-3bb0-5d53-97b0-526970b8dd7a/16700d5d-3bb0-5d53-97b0-526970b8dd7a_image_2.jpg HTTP/1.1" 201 0
2026-03-28 14:03:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FYM68ZFO%252F697662475%252F600') HTTP/1.1" 204 0
2026-03-28 14:03:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YM68ZFO/697662475/600 saved to cache
2026-03-28 14:03:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 16700d5d-3bb0-5d53-97b0-526970b8dd7a
2026-03-28 14:03:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:03:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c68fed0>
2026-03-28 14:03:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:03:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:03:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:03:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_16700d5d-3bb0-5d53-97b0-526970b8dd7a/16700d5d-3bb0-5d53-97b0-526970b8dd7a_image_4.jpg HTTP/1.1" 201 0
2026-03-28 14:03:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FYM68ZFO%252F697662479%252F600') HTTP/1.1" 204 0
2026-03-28 14:03:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YM68ZFO/697662479/600 saved to cache
2026-03-28 14:03:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 16700d5d-3bb0-5d53-97b0-526970b8dd7a
2026-03-28 14:03:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:03:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c4bae10>
2026-03-28 14:03:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:03:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:03:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:03:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4b13d468-b932-5891-9e01-a66081b24d30/4b13d468-b932-5891-9e01-a66081b24d30_image_5.jpg HTTP/1.1" 201 0
2026-03-28 14:03:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FDP19FWW%252F698227082%252F600') HTTP/1.1" 204 0
2026-03-28 14:03:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DP19FWW/698227082/600 saved to cache
2026-03-28 14:03:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 4b13d468-b932-5891-9e01-a66081b24d30
2026-03-28 14:03:30 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:03:30 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:03:30 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:03:30 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:03:30 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:03:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:03:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2d97a2d0>
2026-03-28 14:03:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:03:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:03:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:03:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_08bf8f74-9225-5902-b2d3-8dce4ca2dbfe/08bf8f74-9225-5902-b2d3-8dce4ca2dbfe_image_9.jpg HTTP/1.1" 201 0
2026-03-28 14:03:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FFG22EFZ%252F698271669%252F600') HTTP/1.1" 204 0
2026-03-28 14:03:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FG22EFZ/698271669/600 saved to cache
2026-03-28 14:03:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 08bf8f74-9225-5902-b2d3-8dce4ca2dbfe
2026-03-28 14:03:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:03:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c4b9450>
2026-03-28 14:03:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:03:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:03:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:03:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_16700d5d-3bb0-5d53-97b0-526970b8dd7a/16700d5d-3bb0-5d53-97b0-526970b8dd7a_image_5.jpg HTTP/1.1" 201 0
2026-03-28 14:03:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FYM68ZFO%252F697662482%252F600') HTTP/1.1" 204 0
2026-03-28 14:03:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YM68ZFO/697662482/600 saved to cache
2026-03-28 14:03:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 16700d5d-3bb0-5d53-97b0-526970b8dd7a
2026-03-28 14:03:31 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:03:31 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:03:31 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:03:31 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:03:31 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:03:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:03:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c68d6d0>
2026-03-28 14:03:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:03:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:03:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:03:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_08bf8f74-9225-5902-b2d3-8dce4ca2dbfe/08bf8f74-9225-5902-b2d3-8dce4ca2dbfe_image_7.jpg HTTP/1.1" 201 0
2026-03-28 14:03:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FFG22EFZ%252F698271653%252F600') HTTP/1.1" 204 0
2026-03-28 14:03:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FG22EFZ/698271653/600 saved to cache
2026-03-28 14:03:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 08bf8f74-9225-5902-b2d3-8dce4ca2dbfe
2026-03-28 14:03:31 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 08bf8f74-9225-5902-b2d3-8dce4ca2dbfe, skipping ID generation
2026-03-28 14:03:31 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 08bf8f74-9225-5902-b2d3-8dce4ca2dbfe sending to next pipeline
2026-03-28 14:03:31 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 08bf8f74-9225-5902-b2d3-8dce4ca2dbfe, identifier: FG22%20EFZ
2026-03-28 14:03:31 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 08bf8f74-9225-5902-b2d3-8dce4ca2dbfe with identifier: FG22%20EFZ
2026-03-28 14:03:31 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 08bf8f74-9225-5902-b2d3-8dce4ca2dbfe with identifier: FG22%20EFZ
2026-03-28 14:03:31 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 08bf8f74-9225-5902-b2d3-8dce4ca2dbfe with identifier: FG22%20EFZ to the API
2026-03-28 14:03:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:03:31 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:03:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FG22EFZ/698271653/600>
{'auction_title': '',
'c_o_2_emission_value': 140,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_08bf8f74-9225-5902-b2d3-8dce4ca2dbfe/08bf8f74-9225-5902-b2d3-8dce4ca2dbfe_expert_report_file_bab4dd0e-76f3-473b-83f5-c0a011f21847.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=FG22%20EFZ-GB',
'category': 'Car',
'color': 'black',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.0L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol',
'id': '08bf8f74-9225-5902-b2d3-8dce4ca2dbfe',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'FG22 EFZ',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=FG22%20EFZ&vehicleType=*',
'listing': 'auction',
'location': 'Preston',
'make': 'NISSAN',
'model': 'JUKE',
'odometer': 53030,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 11,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_08bf8f74-9225-5902-b2d3-8dce4ca2dbfe/08bf8f74-9225-5902-b2d3-8dce4ca2dbfe_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 44785,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FG22EFZ/698271601/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_08bf8f74-9225-5902-b2d3-8dce4ca2dbfe/08bf8f74-9225-5902-b2d3-8dce4ca2dbfe_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 45692,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FG22EFZ/698271606/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_08bf8f74-9225-5902-b2d3-8dce4ca2dbfe/08bf8f74-9225-5902-b2d3-8dce4ca2dbfe_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 44835,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FG22EFZ/698271607/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_08bf8f74-9225-5902-b2d3-8dce4ca2dbfe/08bf8f74-9225-5902-b2d3-8dce4ca2dbfe_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 42981,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FG22EFZ/698271610/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_08bf8f74-9225-5902-b2d3-8dce4ca2dbfe/08bf8f74-9225-5902-b2d3-8dce4ca2dbfe_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 41496,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FG22EFZ/698271612/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_08bf8f74-9225-5902-b2d3-8dce4ca2dbfe/08bf8f74-9225-5902-b2d3-8dce4ca2dbfe_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 40181,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FG22EFZ/698271632/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_08bf8f74-9225-5902-b2d3-8dce4ca2dbfe/08bf8f74-9225-5902-b2d3-8dce4ca2dbfe_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 85310,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FG22EFZ/698271643/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_08bf8f74-9225-5902-b2d3-8dce4ca2dbfe/08bf8f74-9225-5902-b2d3-8dce4ca2dbfe_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 75673,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FG22EFZ/698271653/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_08bf8f74-9225-5902-b2d3-8dce4ca2dbfe/08bf8f74-9225-5902-b2d3-8dce4ca2dbfe_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 94762,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FG22EFZ/698271662/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_08bf8f74-9225-5902-b2d3-8dce4ca2dbfe/08bf8f74-9225-5902-b2d3-8dce4ca2dbfe_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 82256,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FG22EFZ/698271669/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-01-01',
'seller_name': None,
'title': 'NISSAN JUKE 1.0 DIG-T 114 TEKNA DCT Hatchback',
'transmission': 'automatic',
'trim': 'DIG-T 114 TEKNA DCT',
'vin': 'SJNFAAF16U1174545',
'year': 2022}
2026-03-28 14:03:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FG22%2520EFZ%27 HTTP/1.1" 200 None
2026-03-28 14:03:31 [bca.uk] INFO: Saving data for FG22%20EFZ: {'created_time': 1774706611.933197, 'last_price_update_time': 1774706611.933213, 'auction_closing_time': 1774864800.0}
2026-03-28 14:03:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='FG22%2520EFZ') HTTP/1.1" 204 0
2026-03-28 14:03:31 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WR21RBV/698067992/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698067992>
2026-03-28 14:03:31 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YL69MMV/698104201/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698104201>
2026-03-28 14:03:31 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YL69MMV/698104242/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698104242>
2026-03-28 14:03:31 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WR21RBV/698067990/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698067990>
2026-03-28 14:03:31 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YL69MMV/698104224/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698104224>
2026-03-28 14:03:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YL69MMV/698104174/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YL69MMV/42809459?sv=2020-08-04&st=2026-03-28T14%3A03%3A28Z&se=2026-03-28T14%3A28%3A28Z&sr=b&sp=r&sig=37dAHykHMzQFv2CL%2F7fhqtM34jervZ3j4WH%2FnrFDC7s%3D)
2026-03-28 14:03:31 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YL69MMV/698104272/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698104272>
2026-03-28 14:03:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WR21RBV/698067980/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/WR21RBV/42810300?sv=2020-08-04&st=2026-03-28T14%3A03%3A28Z&se=2026-03-28T14%3A28%3A28Z&sr=b&sp=r&sig=5eIXJ4C2W5CqH1wkFme5yT36UNTwtzN6aR4WpeBrxbA%3D)
2026-03-28 14:03:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:03:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2de57b50>
2026-03-28 14:03:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:03:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:03:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:03:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3bc89657-c659-5489-9b8d-2c0e3a987c9c/3bc89657-c659-5489-9b8d-2c0e3a987c9c_image_0.jpg HTTP/1.1" 201 0
2026-03-28 14:03:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FYL69MMV%252F698104132%252F600') HTTP/1.1" 204 0
2026-03-28 14:03:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YL69MMV/698104132/600 saved to cache
2026-03-28 14:03:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 3bc89657-c659-5489-9b8d-2c0e3a987c9c
2026-03-28 14:03:32 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:03:32 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:03:32 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:03:32 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:03:32 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:03:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:03:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2de08210>
2026-03-28 14:03:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:03:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:03:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:03:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_16700d5d-3bb0-5d53-97b0-526970b8dd7a/16700d5d-3bb0-5d53-97b0-526970b8dd7a_image_7.jpg HTTP/1.1" 201 0
2026-03-28 14:03:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FYM68ZFO%252F697662492%252F600') HTTP/1.1" 204 0
2026-03-28 14:03:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YM68ZFO/697662492/600 saved to cache
2026-03-28 14:03:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 16700d5d-3bb0-5d53-97b0-526970b8dd7a
2026-03-28 14:03:32 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:03:32 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:03:32 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:03:32 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:03:32 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:03:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:03:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2de54490>
2026-03-28 14:03:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:03:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:03:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:03:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_16700d5d-3bb0-5d53-97b0-526970b8dd7a/16700d5d-3bb0-5d53-97b0-526970b8dd7a_image_6.jpg HTTP/1.1" 201 0
2026-03-28 14:03:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FYM68ZFO%252F697662488%252F600') HTTP/1.1" 204 0
2026-03-28 14:03:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YM68ZFO/697662488/600 saved to cache
2026-03-28 14:03:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 16700d5d-3bb0-5d53-97b0-526970b8dd7a
2026-03-28 14:03:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:03:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c9b6d10>
2026-03-28 14:03:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:03:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:03:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:03:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3bc89657-c659-5489-9b8d-2c0e3a987c9c/3bc89657-c659-5489-9b8d-2c0e3a987c9c_image_3.jpg HTTP/1.1" 201 0
2026-03-28 14:03:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FYL69MMV%252F698104174%252F600') HTTP/1.1" 204 0
2026-03-28 14:03:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YL69MMV/698104174/600 saved to cache
2026-03-28 14:03:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 3bc89657-c659-5489-9b8d-2c0e3a987c9c
2026-03-28 14:03:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:03:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c4ae150>
2026-03-28 14:03:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:03:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:03:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:03:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a29fef22-1343-5214-87a8-25c25aa3608e/a29fef22-1343-5214-87a8-25c25aa3608e_image_1.jpg HTTP/1.1" 201 0
2026-03-28 14:03:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FWR21RBV%252F698067980%252F600') HTTP/1.1" 204 0
2026-03-28 14:03:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WR21RBV/698067980/600 saved to cache
2026-03-28 14:03:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item a29fef22-1343-5214-87a8-25c25aa3608e
2026-03-28 14:03:32 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WR21RBV/698067998/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698067998>
2026-03-28 14:03:32 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WR21RBV/698067986/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698067986>
2026-03-28 14:03:32 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YL69MMV/698104257/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698104257>
2026-03-28 14:03:32 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WR21RBV/698067982/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698067982>
2026-03-28 14:03:32 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YL69MMV/698104187/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698104187>
2026-03-28 14:03:32 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WR21RBV/698067997/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698067997>
2026-03-28 14:03:32 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WR21RBV/698068000/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698068000>
2026-03-28 14:03:32 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WR21RBV/698068008/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698068008>
2026-03-28 14:03:32 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YM68ZFO/697662499/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=697662499>
2026-03-28 14:03:32 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YL69MMV/698104160/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698104160>
2026-03-28 14:03:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YL69MMV/698104242/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YL69MMV/42809459?sv=2020-08-04&st=2026-03-28T14%3A03%3A28Z&se=2026-03-28T14%3A28%3A28Z&sr=b&sp=r&sig=37dAHykHMzQFv2CL%2F7fhqtM34jervZ3j4WH%2FnrFDC7s%3D)
2026-03-28 14:03:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YL69MMV/698104272/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YL69MMV/42809459?sv=2020-08-04&st=2026-03-28T14%3A03%3A28Z&se=2026-03-28T14%3A28%3A28Z&sr=b&sp=r&sig=37dAHykHMzQFv2CL%2F7fhqtM34jervZ3j4WH%2FnrFDC7s%3D)
2026-03-28 14:03:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YL69MMV/698104201/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YL69MMV/42809459?sv=2020-08-04&st=2026-03-28T14%3A03%3A28Z&se=2026-03-28T14%3A28%3A28Z&sr=b&sp=r&sig=37dAHykHMzQFv2CL%2F7fhqtM34jervZ3j4WH%2FnrFDC7s%3D)
2026-03-28 14:03:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WR21RBV/698067992/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/WR21RBV/42810300?sv=2020-08-04&st=2026-03-28T14%3A03%3A28Z&se=2026-03-28T14%3A28%3A28Z&sr=b&sp=r&sig=5eIXJ4C2W5CqH1wkFme5yT36UNTwtzN6aR4WpeBrxbA%3D)
2026-03-28 14:03:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WR21RBV/698067990/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/WR21RBV/42810300?sv=2020-08-04&st=2026-03-28T14%3A03%3A28Z&se=2026-03-28T14%3A28%3A28Z&sr=b&sp=r&sig=5eIXJ4C2W5CqH1wkFme5yT36UNTwtzN6aR4WpeBrxbA%3D)
2026-03-28 14:03:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WR21RBV/698067982/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/WR21RBV/42810300?sv=2020-08-04&st=2026-03-28T14%3A03%3A28Z&se=2026-03-28T14%3A28%3A28Z&sr=b&sp=r&sig=5eIXJ4C2W5CqH1wkFme5yT36UNTwtzN6aR4WpeBrxbA%3D)
2026-03-28 14:03:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WR21RBV/698068008/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/WR21RBV/42810300?sv=2020-08-04&st=2026-03-28T14%3A03%3A28Z&se=2026-03-28T14%3A28%3A28Z&sr=b&sp=r&sig=5eIXJ4C2W5CqH1wkFme5yT36UNTwtzN6aR4WpeBrxbA%3D)
2026-03-28 14:03:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WR21RBV/698067997/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/WR21RBV/42810300?sv=2020-08-04&st=2026-03-28T14%3A03%3A28Z&se=2026-03-28T14%3A28%3A28Z&sr=b&sp=r&sig=5eIXJ4C2W5CqH1wkFme5yT36UNTwtzN6aR4WpeBrxbA%3D)
2026-03-28 14:03:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WR21RBV/698068000/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/WR21RBV/42810300?sv=2020-08-04&st=2026-03-28T14%3A03%3A28Z&se=2026-03-28T14%3A28%3A28Z&sr=b&sp=r&sig=5eIXJ4C2W5CqH1wkFme5yT36UNTwtzN6aR4WpeBrxbA%3D)
2026-03-28 14:03:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YL69MMV/698104257/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YL69MMV/42809459?sv=2020-08-04&st=2026-03-28T14%3A03%3A28Z&se=2026-03-28T14%3A28%3A28Z&sr=b&sp=r&sig=37dAHykHMzQFv2CL%2F7fhqtM34jervZ3j4WH%2FnrFDC7s%3D)
2026-03-28 14:03:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YL69MMV/698104187/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YL69MMV/42809459?sv=2020-08-04&st=2026-03-28T14%3A03%3A28Z&se=2026-03-28T14%3A28%3A28Z&sr=b&sp=r&sig=37dAHykHMzQFv2CL%2F7fhqtM34jervZ3j4WH%2FnrFDC7s%3D)
2026-03-28 14:03:32 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:03:32 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:03:32 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:03:32 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:03:32 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:03:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:03:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2d9df990>
2026-03-28 14:03:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:03:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:03:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:03:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3bc89657-c659-5489-9b8d-2c0e3a987c9c/3bc89657-c659-5489-9b8d-2c0e3a987c9c_image_7.jpg HTTP/1.1" 201 0
2026-03-28 14:03:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FYL69MMV%252F698104242%252F600') HTTP/1.1" 204 0
2026-03-28 14:03:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YL69MMV/698104242/600 saved to cache
2026-03-28 14:03:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 3bc89657-c659-5489-9b8d-2c0e3a987c9c
2026-03-28 14:03:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YL69MMV/698104160/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YL69MMV/42809459?sv=2020-08-04&st=2026-03-28T14%3A03%3A28Z&se=2026-03-28T14%3A28%3A28Z&sr=b&sp=r&sig=37dAHykHMzQFv2CL%2F7fhqtM34jervZ3j4WH%2FnrFDC7s%3D)
2026-03-28 14:03:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WR21RBV/698067986/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/WR21RBV/42810300?sv=2020-08-04&st=2026-03-28T14%3A03%3A28Z&se=2026-03-28T14%3A28%3A28Z&sr=b&sp=r&sig=5eIXJ4C2W5CqH1wkFme5yT36UNTwtzN6aR4WpeBrxbA%3D)
2026-03-28 14:03:33 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WR21RBV/698067976/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=WR21RBV-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-28 14:03:33 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YM68ZFO/697662494/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=697662494>
2026-03-28 14:03:33 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YL69MMV/698104145/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698104145>
2026-03-28 14:03:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YL69MMV/698104224/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YL69MMV/42809459?sv=2020-08-04&st=2026-03-28T14%3A03%3A28Z&se=2026-03-28T14%3A28%3A28Z&sr=b&sp=r&sig=37dAHykHMzQFv2CL%2F7fhqtM34jervZ3j4WH%2FnrFDC7s%3D)
2026-03-28 14:03:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WR21RBV/698067998/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/WR21RBV/42810300?sv=2020-08-04&st=2026-03-28T14%3A03%3A28Z&se=2026-03-28T14%3A28%3A28Z&sr=b&sp=r&sig=5eIXJ4C2W5CqH1wkFme5yT36UNTwtzN6aR4WpeBrxbA%3D)
2026-03-28 14:03:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YM68ZFO/697662499/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YM68ZFO/42810291?sv=2020-08-04&st=2026-03-28T14%3A03%3A26Z&se=2026-03-28T14%3A28%3A26Z&sr=b&sp=r&sig=arppF1K143T0evTDmxHZrgrIN9Emgox3ISmOQq35b74%3D)
2026-03-28 14:03:33 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:03:33 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:03:33 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:03:33 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:03:33 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:03:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:03:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a1fd73110>
2026-03-28 14:03:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:03:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:03:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:03:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3bc89657-c659-5489-9b8d-2c0e3a987c9c/3bc89657-c659-5489-9b8d-2c0e3a987c9c_image_9.jpg HTTP/1.1" 201 0
2026-03-28 14:03:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FYL69MMV%252F698104272%252F600') HTTP/1.1" 204 0
2026-03-28 14:03:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YL69MMV/698104272/600 saved to cache
2026-03-28 14:03:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 3bc89657-c659-5489-9b8d-2c0e3a987c9c
2026-03-28 14:03:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:03:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c8bd390>
2026-03-28 14:03:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:03:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:03:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:03:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3bc89657-c659-5489-9b8d-2c0e3a987c9c/3bc89657-c659-5489-9b8d-2c0e3a987c9c_image_5.jpg HTTP/1.1" 201 0
2026-03-28 14:03:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FYL69MMV%252F698104201%252F600') HTTP/1.1" 204 0
2026-03-28 14:03:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YL69MMV/698104201/600 saved to cache
2026-03-28 14:03:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 3bc89657-c659-5489-9b8d-2c0e3a987c9c
2026-03-28 14:03:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:03:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c5f1850>
2026-03-28 14:03:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:03:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:03:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:03:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a29fef22-1343-5214-87a8-25c25aa3608e/a29fef22-1343-5214-87a8-25c25aa3608e_image_5.jpg HTTP/1.1" 201 0
2026-03-28 14:03:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FWR21RBV%252F698067992%252F600') HTTP/1.1" 204 0
2026-03-28 14:03:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WR21RBV/698067992/600 saved to cache
2026-03-28 14:03:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item a29fef22-1343-5214-87a8-25c25aa3608e
2026-03-28 14:03:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:03:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c3fe710>
2026-03-28 14:03:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:03:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:03:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:03:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a29fef22-1343-5214-87a8-25c25aa3608e/a29fef22-1343-5214-87a8-25c25aa3608e_image_4.jpg HTTP/1.1" 201 0
2026-03-28 14:03:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FWR21RBV%252F698067990%252F600') HTTP/1.1" 204 0
2026-03-28 14:03:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WR21RBV/698067990/600 saved to cache
2026-03-28 14:03:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item a29fef22-1343-5214-87a8-25c25aa3608e
2026-03-28 14:03:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:03:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c677410>
2026-03-28 14:03:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:03:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:03:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:03:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a29fef22-1343-5214-87a8-25c25aa3608e/a29fef22-1343-5214-87a8-25c25aa3608e_image_2.jpg HTTP/1.1" 201 0
2026-03-28 14:03:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FWR21RBV%252F698067982%252F600') HTTP/1.1" 204 0
2026-03-28 14:03:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WR21RBV/698067982/600 saved to cache
2026-03-28 14:03:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item a29fef22-1343-5214-87a8-25c25aa3608e
2026-03-28 14:03:33 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:03:33 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:03:33 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:03:33 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:03:33 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:03:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:03:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c4d2190>
2026-03-28 14:03:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:03:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:03:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:03:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a29fef22-1343-5214-87a8-25c25aa3608e/a29fef22-1343-5214-87a8-25c25aa3608e_image_9.jpg HTTP/1.1" 201 0
2026-03-28 14:03:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FWR21RBV%252F698068008%252F600') HTTP/1.1" 204 0
2026-03-28 14:03:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WR21RBV/698068008/600 saved to cache
2026-03-28 14:03:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item a29fef22-1343-5214-87a8-25c25aa3608e
2026-03-28 14:03:33 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:03:33 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:03:33 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:03:33 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:03:33 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:03:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:03:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c675190>
2026-03-28 14:03:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:03:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:03:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:03:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a29fef22-1343-5214-87a8-25c25aa3608e/a29fef22-1343-5214-87a8-25c25aa3608e_image_6.jpg HTTP/1.1" 201 0
2026-03-28 14:03:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FWR21RBV%252F698067997%252F600') HTTP/1.1" 204 0
2026-03-28 14:03:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WR21RBV/698067997/600 saved to cache
2026-03-28 14:03:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item a29fef22-1343-5214-87a8-25c25aa3608e
2026-03-28 14:03:33 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:03:33 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:03:33 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:03:33 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:03:33 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:03:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:03:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a1fd63e50>
2026-03-28 14:03:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:03:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:03:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:03:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a29fef22-1343-5214-87a8-25c25aa3608e/a29fef22-1343-5214-87a8-25c25aa3608e_image_8.jpg HTTP/1.1" 201 0
2026-03-28 14:03:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FWR21RBV%252F698068000%252F600') HTTP/1.1" 204 0
2026-03-28 14:03:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WR21RBV/698068000/600 saved to cache
2026-03-28 14:03:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item a29fef22-1343-5214-87a8-25c25aa3608e
2026-03-28 14:03:33 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:03:33 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:03:33 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:03:33 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:03:33 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:03:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:03:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2da0e510>
2026-03-28 14:03:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:03:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:03:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:03:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3bc89657-c659-5489-9b8d-2c0e3a987c9c/3bc89657-c659-5489-9b8d-2c0e3a987c9c_image_8.jpg HTTP/1.1" 201 0
2026-03-28 14:03:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FYL69MMV%252F698104257%252F600') HTTP/1.1" 204 0
2026-03-28 14:03:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YL69MMV/698104257/600 saved to cache
2026-03-28 14:03:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 3bc89657-c659-5489-9b8d-2c0e3a987c9c
2026-03-28 14:03:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:03:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c38f050>
2026-03-28 14:03:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:03:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:03:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:03:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3bc89657-c659-5489-9b8d-2c0e3a987c9c/3bc89657-c659-5489-9b8d-2c0e3a987c9c_image_4.jpg HTTP/1.1" 201 0
2026-03-28 14:03:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FYL69MMV%252F698104187%252F600') HTTP/1.1" 204 0
2026-03-28 14:03:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YL69MMV/698104187/600 saved to cache
2026-03-28 14:03:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 3bc89657-c659-5489-9b8d-2c0e3a987c9c
2026-03-28 14:03:33 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EJ13JTO/698540268/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698540268>
2026-03-28 14:03:33 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/OV64PLN/698953427/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698953427>
2026-03-28 14:03:33 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YH13CHD/698786572/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698786572>
2026-03-28 14:03:33 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FY68WNB/698106357/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698106357>
2026-03-28 14:03:33 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VX19OYP/698251071/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698251071>
2026-03-28 14:03:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:03:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a1fef0050>
2026-03-28 14:03:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:03:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:03:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:03:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3bc89657-c659-5489-9b8d-2c0e3a987c9c/3bc89657-c659-5489-9b8d-2c0e3a987c9c_image_2.jpg HTTP/1.1" 201 0
2026-03-28 14:03:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FYL69MMV%252F698104160%252F600') HTTP/1.1" 204 0
2026-03-28 14:03:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YL69MMV/698104160/600 saved to cache
2026-03-28 14:03:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 3bc89657-c659-5489-9b8d-2c0e3a987c9c
2026-03-28 14:03:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:03:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a1fdb1a10>
2026-03-28 14:03:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:03:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:03:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:03:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a29fef22-1343-5214-87a8-25c25aa3608e/a29fef22-1343-5214-87a8-25c25aa3608e_image_3.jpg HTTP/1.1" 201 0
2026-03-28 14:03:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FWR21RBV%252F698067986%252F600') HTTP/1.1" 204 0
2026-03-28 14:03:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WR21RBV/698067986/600 saved to cache
2026-03-28 14:03:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item a29fef22-1343-5214-87a8-25c25aa3608e
2026-03-28 14:03:33 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:03:33 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:03:33 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:03:33 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:03:33 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:03:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:03:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2d677690>
2026-03-28 14:03:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:03:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:03:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:03:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3bc89657-c659-5489-9b8d-2c0e3a987c9c/3bc89657-c659-5489-9b8d-2c0e3a987c9c_image_6.jpg HTTP/1.1" 201 0
2026-03-28 14:03:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FYL69MMV%252F698104224%252F600') HTTP/1.1" 204 0
2026-03-28 14:03:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YL69MMV/698104224/600 saved to cache
2026-03-28 14:03:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 3bc89657-c659-5489-9b8d-2c0e3a987c9c
2026-03-28 14:03:33 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:03:33 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:03:33 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:03:33 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:03:33 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:03:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:03:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2d7a97d0>
2026-03-28 14:03:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:03:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:03:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:03:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a29fef22-1343-5214-87a8-25c25aa3608e/a29fef22-1343-5214-87a8-25c25aa3608e_image_7.jpg HTTP/1.1" 201 0
2026-03-28 14:03:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FWR21RBV%252F698067998%252F600') HTTP/1.1" 204 0
2026-03-28 14:03:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WR21RBV/698067998/600 saved to cache
2026-03-28 14:03:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item a29fef22-1343-5214-87a8-25c25aa3608e
2026-03-28 14:03:33 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:03:33 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:03:33 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:03:33 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:03:33 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:03:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:03:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c584fd0>
2026-03-28 14:03:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:03:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:03:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:03:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_16700d5d-3bb0-5d53-97b0-526970b8dd7a/16700d5d-3bb0-5d53-97b0-526970b8dd7a_image_9.jpg HTTP/1.1" 201 0
2026-03-28 14:03:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FYM68ZFO%252F697662499%252F600') HTTP/1.1" 204 0
2026-03-28 14:03:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YM68ZFO/697662499/600 saved to cache
2026-03-28 14:03:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 16700d5d-3bb0-5d53-97b0-526970b8dd7a
2026-03-28 14:03:33 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KV60ZZA/698934394/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698934394>
2026-03-28 14:03:33 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/X28AVE/698923684/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=X28AVE-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-28 14:03:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WR21RBV/698067976/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/WR21RBV/42810300?sv=2020-08-04&st=2026-03-28T14%3A03%3A28Z&se=2026-03-28T14%3A28%3A28Z&sr=b&sp=r&sig=5eIXJ4C2W5CqH1wkFme5yT36UNTwtzN6aR4WpeBrxbA%3D)
2026-03-28 14:03:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YL69MMV/698104145/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YL69MMV/42809459?sv=2020-08-04&st=2026-03-28T14%3A03%3A28Z&se=2026-03-28T14%3A28%3A28Z&sr=b&sp=r&sig=37dAHykHMzQFv2CL%2F7fhqtM34jervZ3j4WH%2FnrFDC7s%3D)
2026-03-28 14:03:33 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/PY71HPP/42810351?sv=2020-08-04&st=2026-03-28T14%3A03%3A33Z&se=2026-03-28T14%3A28%3A33Z&sr=b&sp=r&sig=VE6%2By8gOfvgKf8XGgsgtB7SRVaoWu2GIM9gpf%2BgtWPI%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=PY71%20HPP-GB>
2026-03-28 14:03:33 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YK67BOU/698928773/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=YK67BOU-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-28 14:03:33 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/HK18KTD/42810169?sv=2020-08-04&st=2026-03-28T14%3A03%3A33Z&se=2026-03-28T14%3A28%3A33Z&sr=b&sp=r&sig=hkLnkSG275tljEq5qfSoK1jC3apnwlGnB%2Bpsv17q5aQ%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=HK18%20KTD-GB>
2026-03-28 14:03:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YM68ZFO/697662494/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YM68ZFO/42810291?sv=2020-08-04&st=2026-03-28T14%3A03%3A26Z&se=2026-03-28T14%3A28%3A26Z&sr=b&sp=r&sig=arppF1K143T0evTDmxHZrgrIN9Emgox3ISmOQq35b74%3D)
2026-03-28 14:03:33 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LR11XWM/697880562/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=697880562>
2026-03-28 14:03:33 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/SC69SYA/42810321?sv=2020-08-04&st=2026-03-28T14%3A03%3A33Z&se=2026-03-28T14%3A28%3A33Z&sr=b&sp=r&sig=pg%2FWEb5rIOUIFGT2mUm39zJu%2F6eH7ZOCdfShXQuFo%2Bo%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=SC69%20SYA-GB>
2026-03-28 14:03:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VX19OYP/698251071/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/VX19OYP/42810376?sv=2020-08-04&st=2026-03-28T14%3A01%3A04Z&se=2026-03-28T14%3A26%3A04Z&sr=b&sp=r&sig=ZoloAWIhiMuraB8%2BrUA7GYd%2BDLx9PxJOBzKxmER1A8U%3D)
2026-03-28 14:03:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/OV64PLN/698953427/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/OV64PLN/42810653?sv=2020-08-04&st=2026-03-28T14%3A01%3A03Z&se=2026-03-28T14%3A26%3A03Z&sr=b&sp=r&sig=APMfuiYXypC%2F8k81EUjJVNUqGlQEUGUldS81rN8I%2FN0%3D)
2026-03-28 14:03:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YH13CHD/698786572/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YH13CHD/42807762?sv=2020-08-04&st=2026-03-28T14%3A01%3A02Z&se=2026-03-28T14%3A26%3A02Z&sr=b&sp=r&sig=Kk3ZnO0H7wXbnR6jzpTNZkeJ9EaoXS3djv9g6kExg8o%3D)
2026-03-28 14:03:33 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RE59BXM/698980927/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698980927>
2026-03-28 14:03:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:03:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c740910>
2026-03-28 14:03:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:03:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:03:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:03:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a29fef22-1343-5214-87a8-25c25aa3608e/a29fef22-1343-5214-87a8-25c25aa3608e_image_0.jpg HTTP/1.1" 201 0
2026-03-28 14:03:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FWR21RBV%252F698067976%252F600') HTTP/1.1" 204 0
2026-03-28 14:03:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WR21RBV/698067976/600 saved to cache
2026-03-28 14:03:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item a29fef22-1343-5214-87a8-25c25aa3608e
2026-03-28 14:03:33 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: a29fef22-1343-5214-87a8-25c25aa3608e, skipping ID generation
2026-03-28 14:03:33 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item a29fef22-1343-5214-87a8-25c25aa3608e sending to next pipeline
2026-03-28 14:03:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: a29fef22-1343-5214-87a8-25c25aa3608e, identifier: WR21%20RBV
2026-03-28 14:03:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: a29fef22-1343-5214-87a8-25c25aa3608e with identifier: WR21%20RBV
2026-03-28 14:03:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: a29fef22-1343-5214-87a8-25c25aa3608e with identifier: WR21%20RBV
2026-03-28 14:03:34 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: a29fef22-1343-5214-87a8-25c25aa3608e with identifier: WR21%20RBV to the API
2026-03-28 14:03:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:03:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:03:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WR21RBV/698067976/600>
{'auction_title': '',
'c_o_2_emission_value': 137,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a29fef22-1343-5214-87a8-25c25aa3608e/a29fef22-1343-5214-87a8-25c25aa3608e_expert_report_file_1e2d58a5-8234-451f-a0ef-9385066a89f7.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=WR21%20RBV-GB',
'category': 'Car',
'color': 'black',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.5L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Diesel',
'id': 'a29fef22-1343-5214-87a8-25c25aa3608e',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'WR21 RBV',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=WR21%20RBV&vehicleType=*',
'listing': 'auction',
'location': 'Paddock Wood',
'make': 'VAUXHALL',
'model': 'GRANDLAND X',
'odometer': 61468,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 11,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a29fef22-1343-5214-87a8-25c25aa3608e/a29fef22-1343-5214-87a8-25c25aa3608e_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 54121,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WR21RBV/698067976/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a29fef22-1343-5214-87a8-25c25aa3608e/a29fef22-1343-5214-87a8-25c25aa3608e_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 53522,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WR21RBV/698067980/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a29fef22-1343-5214-87a8-25c25aa3608e/a29fef22-1343-5214-87a8-25c25aa3608e_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 49792,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WR21RBV/698067982/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a29fef22-1343-5214-87a8-25c25aa3608e/a29fef22-1343-5214-87a8-25c25aa3608e_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 47941,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WR21RBV/698067986/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a29fef22-1343-5214-87a8-25c25aa3608e/a29fef22-1343-5214-87a8-25c25aa3608e_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 46135,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WR21RBV/698067990/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a29fef22-1343-5214-87a8-25c25aa3608e/a29fef22-1343-5214-87a8-25c25aa3608e_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 45332,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WR21RBV/698067992/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a29fef22-1343-5214-87a8-25c25aa3608e/a29fef22-1343-5214-87a8-25c25aa3608e_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 95199,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WR21RBV/698067997/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a29fef22-1343-5214-87a8-25c25aa3608e/a29fef22-1343-5214-87a8-25c25aa3608e_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 70194,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WR21RBV/698067998/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a29fef22-1343-5214-87a8-25c25aa3608e/a29fef22-1343-5214-87a8-25c25aa3608e_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 75962,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WR21RBV/698068000/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a29fef22-1343-5214-87a8-25c25aa3608e/a29fef22-1343-5214-87a8-25c25aa3608e_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 69012,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WR21RBV/698068008/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-01-01',
'seller_name': None,
'title': 'VAUXHALL GRANDLAND X 1.5 TURBO D 130 SRI Hatchback',
'transmission': 'automatic',
'trim': 'TURBO D 130 SRI',
'vin': 'W0VZCYHZ2M6805667',
'year': 2021}
2026-03-28 14:03:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WR21%2520RBV%27 HTTP/1.1" 200 None
2026-03-28 14:03:34 [bca.uk] INFO: Saving data for WR21%20RBV: {'created_time': 1774706614.459588, 'last_price_update_time': 1774706614.459599, 'auction_closing_time': 1774864800.0}
2026-03-28 14:03:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='WR21%2520RBV') HTTP/1.1" 204 0
2026-03-28 14:03:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FY68WNB/698106357/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/FY68WNB/42810373?sv=2020-08-04&st=2026-03-28T14%3A01%3A04Z&se=2026-03-28T14%3A26%3A04Z&sr=b&sp=r&sig=H2pJB0hzNCFCiICFkGnSt1gr2sn1tExob5yrsc4d3Vs%3D)
2026-03-28 14:03:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YK67BOU/698928773/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YK67BOU/42810138?sv=2020-08-04&st=2026-03-28T14%3A01%3A06Z&se=2026-03-28T14%3A26%3A06Z&sr=b&sp=r&sig=lMZ3QjflOWAYgjfCxBohfGqFaZWJDMyvtEvO8nKSM7s%3D)
2026-03-28 14:03:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/X28AVE/698923684/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/X28AVE/42809896?sv=2020-08-04&st=2026-03-28T14%3A01%3A06Z&se=2026-03-28T14%3A26%3A06Z&sr=b&sp=r&sig=AYxkyrr3IbeLdESXjdd9QmNEg4ZiUeF%2B%2BO3v1nuSrfg%3D)
2026-03-28 14:03:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:03:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a1fec42d0>
2026-03-28 14:03:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:03:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:03:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:03:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3bc89657-c659-5489-9b8d-2c0e3a987c9c/3bc89657-c659-5489-9b8d-2c0e3a987c9c_image_1.jpg HTTP/1.1" 201 0
2026-03-28 14:03:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FYL69MMV%252F698104145%252F600') HTTP/1.1" 204 0
2026-03-28 14:03:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YL69MMV/698104145/600 saved to cache
2026-03-28 14:03:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 3bc89657-c659-5489-9b8d-2c0e3a987c9c
2026-03-28 14:03:34 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 3bc89657-c659-5489-9b8d-2c0e3a987c9c, skipping ID generation
2026-03-28 14:03:34 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 3bc89657-c659-5489-9b8d-2c0e3a987c9c sending to next pipeline
2026-03-28 14:03:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 3bc89657-c659-5489-9b8d-2c0e3a987c9c, identifier: YL69%20MMV
2026-03-28 14:03:34 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EA24TKX/698296238/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698296238>
2026-03-28 14:03:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KV60ZZA/698934394/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/KV60ZZA/42810415?sv=2020-08-04&st=2026-03-28T14%3A01%3A03Z&se=2026-03-28T14%3A26%3A03Z&sr=b&sp=r&sig=IuzavW0HE55HWRn715zywGMWMJJZSa9qrno76VZ5d%2FU%3D)
2026-03-28 14:03:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EJ13JTO/698540268/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/EJ13JTO/42810382?sv=2020-08-04&st=2026-03-28T14%3A01%3A03Z&se=2026-03-28T14%3A26%3A03Z&sr=b&sp=r&sig=9n5SmvjaM772xUjZdL0t%2BMeZRNBu1TSQPyTFa%2FZiaIA%3D)
2026-03-28 14:03:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/PY71HPP/42810351?sv=2020-08-04&st=2026-03-28T14%3A03%3A33Z&se=2026-03-28T14%3A28%3A33Z&sr=b&sp=r&sig=VE6%2By8gOfvgKf8XGgsgtB7SRVaoWu2GIM9gpf%2BgtWPI%3D> (referer: https://www.bca.co.uk/)
2026-03-28 14:03:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 3bc89657-c659-5489-9b8d-2c0e3a987c9c with identifier: YL69%20MMV
2026-03-28 14:03:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 3bc89657-c659-5489-9b8d-2c0e3a987c9c with identifier: YL69%20MMV
2026-03-28 14:03:34 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 3bc89657-c659-5489-9b8d-2c0e3a987c9c with identifier: YL69%20MMV to the API
2026-03-28 14:03:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:03:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:03:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YL69MMV/698104145/600>
{'auction_title': '',
'c_o_2_emission_value': 143,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3bc89657-c659-5489-9b8d-2c0e3a987c9c/3bc89657-c659-5489-9b8d-2c0e3a987c9c_expert_report_file_1de3db90-bf83-4896-8af7-0a28c179bbb7.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=YL69%20MMV-GB',
'category': 'Car',
'color': 'black',
'currency': 'GBP',
'doors_number': 5,
'engine': '2.0L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Diesel',
'id': '3bc89657-c659-5489-9b8d-2c0e3a987c9c',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'YL69 MMV',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=YL69%20MMV&vehicleType=*',
'listing': 'auction',
'location': 'Preston',
'make': 'LAND ROVER',
'model': 'R/R EVOQUE',
'odometer': 36168,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 11,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3bc89657-c659-5489-9b8d-2c0e3a987c9c/3bc89657-c659-5489-9b8d-2c0e3a987c9c_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 43119,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YL69MMV/698104132/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3bc89657-c659-5489-9b8d-2c0e3a987c9c/3bc89657-c659-5489-9b8d-2c0e3a987c9c_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 43186,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YL69MMV/698104145/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3bc89657-c659-5489-9b8d-2c0e3a987c9c/3bc89657-c659-5489-9b8d-2c0e3a987c9c_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 43834,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YL69MMV/698104160/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3bc89657-c659-5489-9b8d-2c0e3a987c9c/3bc89657-c659-5489-9b8d-2c0e3a987c9c_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 41645,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YL69MMV/698104174/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3bc89657-c659-5489-9b8d-2c0e3a987c9c/3bc89657-c659-5489-9b8d-2c0e3a987c9c_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 39511,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YL69MMV/698104187/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3bc89657-c659-5489-9b8d-2c0e3a987c9c/3bc89657-c659-5489-9b8d-2c0e3a987c9c_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 36867,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YL69MMV/698104201/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3bc89657-c659-5489-9b8d-2c0e3a987c9c/3bc89657-c659-5489-9b8d-2c0e3a987c9c_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 84705,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YL69MMV/698104224/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3bc89657-c659-5489-9b8d-2c0e3a987c9c/3bc89657-c659-5489-9b8d-2c0e3a987c9c_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 82263,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YL69MMV/698104242/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3bc89657-c659-5489-9b8d-2c0e3a987c9c/3bc89657-c659-5489-9b8d-2c0e3a987c9c_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 85113,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YL69MMV/698104257/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3bc89657-c659-5489-9b8d-2c0e3a987c9c/3bc89657-c659-5489-9b8d-2c0e3a987c9c_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 74533,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YL69MMV/698104272/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-01-01',
'seller_name': None,
'title': 'LAND ROVER R/R EVOQUE 2.0 D150 2WD S Hatchback',
'transmission': 'manual',
'trim': 'D150 2WD S',
'vin': 'SALZB2CN8LH074219',
'year': 2020}
2026-03-28 14:03:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YL69%2520MMV%27 HTTP/1.1" 200 None
2026-03-28 14:03:35 [bca.uk] INFO: Saving data for YL69%20MMV: {'created_time': 1774706615.035603, 'last_price_update_time': 1774706615.035614, 'auction_closing_time': 1774864800.0}
2026-03-28 14:03:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='YL69%2520MMV') HTTP/1.1" 204 0
2026-03-28 14:03:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/HK18KTD/42810169?sv=2020-08-04&st=2026-03-28T14%3A03%3A33Z&se=2026-03-28T14%3A28%3A33Z&sr=b&sp=r&sig=hkLnkSG275tljEq5qfSoK1jC3apnwlGnB%2Bpsv17q5aQ%3D> (referer: https://www.bca.co.uk/)
2026-03-28 14:03:35 [scrapy_zyte_api._params] WARNING: Request <GET https://www.bca.co.uk/api/search?q=&pageSize=100&page=4&sort=MostRecentlyAdded> defines the Zyte API customHttpRequestHeaders parameter, overriding Request.headers. Use Request.headers instead.
2026-03-28 14:03:35 [scrapy_zyte_api._params] WARNING: Request <GET https://www.bca.co.uk/api/search?q=&pageSize=100&page=4&sort=MostRecentlyAdded> defines the Zyte API customHttpRequestHeaders parameter, overriding Request.headers. Use Request.headers instead.
2026-03-28 14:03:35 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 14:03:35 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:03:35 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:03:35 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:03:35 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:03:35 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:03:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:03:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c4ba610>
2026-03-28 14:03:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:03:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:03:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:03:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_16700d5d-3bb0-5d53-97b0-526970b8dd7a/16700d5d-3bb0-5d53-97b0-526970b8dd7a_image_8.jpg HTTP/1.1" 201 0
2026-03-28 14:03:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FYM68ZFO%252F697662494%252F600') HTTP/1.1" 204 0
2026-03-28 14:03:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YM68ZFO/697662494/600 saved to cache
2026-03-28 14:03:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 16700d5d-3bb0-5d53-97b0-526970b8dd7a
2026-03-28 14:03:35 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 16700d5d-3bb0-5d53-97b0-526970b8dd7a, skipping ID generation
2026-03-28 14:03:35 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 16700d5d-3bb0-5d53-97b0-526970b8dd7a sending to next pipeline
2026-03-28 14:03:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 16700d5d-3bb0-5d53-97b0-526970b8dd7a, identifier: YM68%20ZFO
2026-03-28 14:03:35 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:03:35 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:03:35 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:03:35 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:03:35 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:03:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:03:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c400dd0>
2026-03-28 14:03:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:03:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:03:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:03:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b7b36a17-d5d4-5e94-9bbf-8a754ca74b60/b7b36a17-d5d4-5e94-9bbf-8a754ca74b60_image_8.jpg HTTP/1.1" 201 0
2026-03-28 14:03:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FVX19OYP%252F698251071%252F600') HTTP/1.1" 204 0
2026-03-28 14:03:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VX19OYP/698251071/600 saved to cache
2026-03-28 14:03:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item b7b36a17-d5d4-5e94-9bbf-8a754ca74b60
2026-03-28 14:03:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:03:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2d73f9d0>
2026-03-28 14:03:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:03:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:03:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:03:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d75bc751-3167-5395-a067-9fe76cc20a2d/d75bc751-3167-5395-a067-9fe76cc20a2d_image_6.jpg HTTP/1.1" 201 0
2026-03-28 14:03:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FOV64PLN%252F698953427%252F600') HTTP/1.1" 204 0
2026-03-28 14:03:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/OV64PLN/698953427/600 saved to cache
2026-03-28 14:03:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item d75bc751-3167-5395-a067-9fe76cc20a2d
2026-03-28 14:03:35 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:03:35 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:03:35 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:03:35 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:03:35 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:03:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:03:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2d9ddcd0>
2026-03-28 14:03:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:03:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:03:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:03:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dabe1fc4-09bf-52ef-9042-78b5e1d2db10/dabe1fc4-09bf-52ef-9042-78b5e1d2db10_image_7.jpg HTTP/1.1" 201 0
2026-03-28 14:03:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FYH13CHD%252F698786572%252F600') HTTP/1.1" 204 0
2026-03-28 14:03:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YH13CHD/698786572/600 saved to cache
2026-03-28 14:03:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item dabe1fc4-09bf-52ef-9042-78b5e1d2db10
2026-03-28 14:03:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LR11XWM/697880562/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LR11XWM/42810294?sv=2020-08-04&st=2026-03-28T14%3A01%3A05Z&se=2026-03-28T14%3A26%3A05Z&sr=b&sp=r&sig=zHl%2Fkz2fSAoGVBY8ukVZULGVCGKqbTVidyooaEEBPNc%3D)
2026-03-28 14:03:35 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DP19FWW/698227072/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698227072>
2026-03-28 14:03:35 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MJ03HOW/698444382/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698444382>
2026-03-28 14:03:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 16700d5d-3bb0-5d53-97b0-526970b8dd7a with identifier: YM68%20ZFO
2026-03-28 14:03:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 16700d5d-3bb0-5d53-97b0-526970b8dd7a with identifier: YM68%20ZFO
2026-03-28 14:03:35 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 16700d5d-3bb0-5d53-97b0-526970b8dd7a with identifier: YM68%20ZFO to the API
2026-03-28 14:03:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:03:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:03:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YM68ZFO/697662494/600>
{'auction_title': '',
'c_o_2_emission_value': 123,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_16700d5d-3bb0-5d53-97b0-526970b8dd7a/16700d5d-3bb0-5d53-97b0-526970b8dd7a_expert_report_file_f2278f44-b206-40f0-90ed-42a0cccddbe3.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=YM68%20ZFO-GB',
'category': 'Car',
'color': 'black',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.3L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol',
'id': '16700d5d-3bb0-5d53-97b0-526970b8dd7a',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'YM68 ZFO',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=YM68%20ZFO&vehicleType=*',
'listing': 'auction',
'location': 'Paddock Wood',
'make': 'MERCEDES-BENZ',
'model': 'A200',
'odometer': 61305,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 11,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_16700d5d-3bb0-5d53-97b0-526970b8dd7a/16700d5d-3bb0-5d53-97b0-526970b8dd7a_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 53133,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YM68ZFO/697662470/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_16700d5d-3bb0-5d53-97b0-526970b8dd7a/16700d5d-3bb0-5d53-97b0-526970b8dd7a_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 51561,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YM68ZFO/697662471/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_16700d5d-3bb0-5d53-97b0-526970b8dd7a/16700d5d-3bb0-5d53-97b0-526970b8dd7a_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 51136,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YM68ZFO/697662475/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_16700d5d-3bb0-5d53-97b0-526970b8dd7a/16700d5d-3bb0-5d53-97b0-526970b8dd7a_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 48394,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YM68ZFO/697662477/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_16700d5d-3bb0-5d53-97b0-526970b8dd7a/16700d5d-3bb0-5d53-97b0-526970b8dd7a_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 44082,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YM68ZFO/697662479/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_16700d5d-3bb0-5d53-97b0-526970b8dd7a/16700d5d-3bb0-5d53-97b0-526970b8dd7a_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 43724,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YM68ZFO/697662482/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_16700d5d-3bb0-5d53-97b0-526970b8dd7a/16700d5d-3bb0-5d53-97b0-526970b8dd7a_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 101435,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YM68ZFO/697662488/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_16700d5d-3bb0-5d53-97b0-526970b8dd7a/16700d5d-3bb0-5d53-97b0-526970b8dd7a_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 83123,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YM68ZFO/697662492/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_16700d5d-3bb0-5d53-97b0-526970b8dd7a/16700d5d-3bb0-5d53-97b0-526970b8dd7a_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 82512,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YM68ZFO/697662494/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_16700d5d-3bb0-5d53-97b0-526970b8dd7a/16700d5d-3bb0-5d53-97b0-526970b8dd7a_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 82826,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YM68ZFO/697662499/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-01-01',
'seller_name': None,
'title': 'MERCEDES-BENZ A200 1.3 AMG LINE DCT Hatchback',
'transmission': 'automatic',
'trim': 'AMG LINE DCT',
'vin': 'WDD1770872V002388',
'year': 2018}
2026-03-28 14:03:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YM68%2520ZFO%27 HTTP/1.1" 200 None
2026-03-28 14:03:35 [bca.uk] INFO: Saving data for YM68%20ZFO: {'created_time': 1774706615.701477, 'last_price_update_time': 1774706615.701488, 'auction_closing_time': 1774864800.0}
2026-03-28 14:03:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='YM68%2520ZFO') HTTP/1.1" 204 0
2026-03-28 14:03:35 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EJ13JTO/698540250/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698540250>
2026-03-28 14:03:35 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FY68WNB/698106333/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698106333>
2026-03-28 14:03:35 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/OV64PLN/698966003/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698966003>
2026-03-28 14:03:35 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:03:35 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:03:35 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:03:35 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:03:35 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:03:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:03:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c682410>
2026-03-28 14:03:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:03:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:03:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:03:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d8436e02-8218-5d88-bcc5-e01ffac7eb8e/d8436e02-8218-5d88-bcc5-e01ffac7eb8e_image_6.jpg HTTP/1.1" 201 0
2026-03-28 14:03:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FFY68WNB%252F698106357%252F600') HTTP/1.1" 204 0
2026-03-28 14:03:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FY68WNB/698106357/600 saved to cache
2026-03-28 14:03:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item d8436e02-8218-5d88-bcc5-e01ffac7eb8e
2026-03-28 14:03:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:03:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2de4f890>
2026-03-28 14:03:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:03:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:03:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:03:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_561c0b4f-3a2d-562b-bb16-d69244165df3/561c0b4f-3a2d-562b-bb16-d69244165df3_image_0.jpg HTTP/1.1" 201 0
2026-03-28 14:03:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FYK67BOU%252F698928773%252F600') HTTP/1.1" 204 0
2026-03-28 14:03:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YK67BOU/698928773/600 saved to cache
2026-03-28 14:03:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 561c0b4f-3a2d-562b-bb16-d69244165df3
2026-03-28 14:03:35 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 561c0b4f-3a2d-562b-bb16-d69244165df3, skipping ID generation
2026-03-28 14:03:35 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 561c0b4f-3a2d-562b-bb16-d69244165df3 sending to next pipeline
2026-03-28 14:03:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 561c0b4f-3a2d-562b-bb16-d69244165df3, identifier: YK67%20BOU
2026-03-28 14:03:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:03:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c675dd0>
2026-03-28 14:03:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:03:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:03:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:03:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e788d11e-974b-5084-adb6-d49a23c42616/e788d11e-974b-5084-adb6-d49a23c42616_image_0.jpg HTTP/1.1" 201 0
2026-03-28 14:03:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FX28AVE%252F698923684%252F600') HTTP/1.1" 204 0
2026-03-28 14:03:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/X28AVE/698923684/600 saved to cache
2026-03-28 14:03:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item e788d11e-974b-5084-adb6-d49a23c42616
2026-03-28 14:03:35 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: e788d11e-974b-5084-adb6-d49a23c42616, skipping ID generation
2026-03-28 14:03:35 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item e788d11e-974b-5084-adb6-d49a23c42616 sending to next pipeline
2026-03-28 14:03:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: e788d11e-974b-5084-adb6-d49a23c42616, identifier: X28%20AVE
2026-03-28 14:03:36 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:03:36 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:03:36 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:03:36 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:03:36 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:03:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:03:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c171910>
2026-03-28 14:03:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:03:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:03:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:03:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3f54d261-9f82-51f4-9ce3-cc4413b8b6c4/3f54d261-9f82-51f4-9ce3-cc4413b8b6c4_image_8.jpg HTTP/1.1" 201 0
2026-03-28 14:03:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FKV60ZZA%252F698934394%252F600') HTTP/1.1" 204 0
2026-03-28 14:03:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KV60ZZA/698934394/600 saved to cache
2026-03-28 14:03:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 3f54d261-9f82-51f4-9ce3-cc4413b8b6c4
2026-03-28 14:03:36 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:03:36 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:03:36 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:03:36 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:03:36 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:03:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:03:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a1fef1b10>
2026-03-28 14:03:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:03:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:03:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:03:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5be82b2b-6926-5451-8e0e-f3d801ad1cad/5be82b2b-6926-5451-8e0e-f3d801ad1cad_image_6.jpg HTTP/1.1" 201 0
2026-03-28 14:03:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FEJ13JTO%252F698540268%252F600') HTTP/1.1" 204 0
2026-03-28 14:03:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EJ13JTO/698540268/600 saved to cache
2026-03-28 14:03:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 5be82b2b-6926-5451-8e0e-f3d801ad1cad
2026-03-28 14:03:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:03:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a1fdab050>
2026-03-28 14:03:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:03:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:03:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:03:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c02444db-1872-560a-9a4f-c32517c42d55/c02444db-1872-560a-9a4f-c32517c42d55_expert_report_file_6555e351-44f9-48eb-99bc-d9cdff3e0b27.pdf HTTP/1.1" 201 0
2026-03-28 14:03:36 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item c02444db-1872-560a-9a4f-c32517c42d55
2026-03-28 14:03:36 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: c02444db-1872-560a-9a4f-c32517c42d55, skipping ID generation
2026-03-28 14:03:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item c02444db-1872-560a-9a4f-c32517c42d55
2026-03-28 14:03:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DPY71HPP-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-28 14:03:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=PY71HPP-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-28 14:03:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:03:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a1fef27d0>
2026-03-28 14:03:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:03:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:03:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:03:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a5eb24be-0f0d-5d52-8354-e9c746a38f6e/a5eb24be-0f0d-5d52-8354-e9c746a38f6e_expert_report_file_a2775be7-3f58-49a7-a32c-5f4f8a630ff1.pdf HTTP/1.1" 201 0
2026-03-28 14:03:36 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item a5eb24be-0f0d-5d52-8354-e9c746a38f6e
2026-03-28 14:03:36 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: a5eb24be-0f0d-5d52-8354-e9c746a38f6e, skipping ID generation
2026-03-28 14:03:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item a5eb24be-0f0d-5d52-8354-e9c746a38f6e
2026-03-28 14:03:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DHK18KTD-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-28 14:03:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=HK18KTD-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-28 14:03:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RE59BXM/698980927/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/RE59BXM/42810393?sv=2020-08-04&st=2026-03-28T14%3A01%3A02Z&se=2026-03-28T14%3A26%3A02Z&sr=b&sp=r&sig=MksXwVSixqiZ62CEskJ2z5pOaVL%2BuYMKfzx3%2FgepvXw%3D)
2026-03-28 14:03:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 561c0b4f-3a2d-562b-bb16-d69244165df3 with identifier: YK67%20BOU
2026-03-28 14:03:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 561c0b4f-3a2d-562b-bb16-d69244165df3 with identifier: YK67%20BOU
2026-03-28 14:03:36 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 561c0b4f-3a2d-562b-bb16-d69244165df3 with identifier: YK67%20BOU to the API
2026-03-28 14:03:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:03:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:03:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YK67BOU/698928773/600>
{'auction_title': '',
'c_o_2_emission_value': 114,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_561c0b4f-3a2d-562b-bb16-d69244165df3/561c0b4f-3a2d-562b-bb16-d69244165df3_expert_report_file_5126bbe4-0c57-43ee-ad38-9ce95f645122.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=YK67%20BOU-GB',
'category': 'Car',
'color': 'blue',
'currency': 'GBP',
'doors_number': 3,
'engine': '2.0L',
'expiration_date': '2026-03-29T10:00:00Z',
'fuel_type': 'Diesel',
'id': '561c0b4f-3a2d-562b-bb16-d69244165df3',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'YK67 BOU',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=YK67%20BOU&vehicleType=*',
'listing': 'auction',
'location': 'Paddock Wood',
'make': 'BMW',
'model': '118D',
'odometer': 156988,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 11,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_561c0b4f-3a2d-562b-bb16-d69244165df3/561c0b4f-3a2d-562b-bb16-d69244165df3_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 52104,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YK67BOU/698928773/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_561c0b4f-3a2d-562b-bb16-d69244165df3/561c0b4f-3a2d-562b-bb16-d69244165df3_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 51100,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YK67BOU/698928794/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_561c0b4f-3a2d-562b-bb16-d69244165df3/561c0b4f-3a2d-562b-bb16-d69244165df3_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 50409,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YK67BOU/698928817/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_561c0b4f-3a2d-562b-bb16-d69244165df3/561c0b4f-3a2d-562b-bb16-d69244165df3_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 48511,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YK67BOU/698928843/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_561c0b4f-3a2d-562b-bb16-d69244165df3/561c0b4f-3a2d-562b-bb16-d69244165df3_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 46454,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YK67BOU/698928864/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_561c0b4f-3a2d-562b-bb16-d69244165df3/561c0b4f-3a2d-562b-bb16-d69244165df3_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 46020,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YK67BOU/698928881/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_561c0b4f-3a2d-562b-bb16-d69244165df3/561c0b4f-3a2d-562b-bb16-d69244165df3_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 95568,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YK67BOU/698928908/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_561c0b4f-3a2d-562b-bb16-d69244165df3/561c0b4f-3a2d-562b-bb16-d69244165df3_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 65242,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YK67BOU/698928934/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_561c0b4f-3a2d-562b-bb16-d69244165df3/561c0b4f-3a2d-562b-bb16-d69244165df3_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 71152,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YK67BOU/698928964/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_561c0b4f-3a2d-562b-bb16-d69244165df3/561c0b4f-3a2d-562b-bb16-d69244165df3_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 77858,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YK67BOU/698928994/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-01-01',
'seller_name': None,
'title': 'BMW 118D 2.0 M SPORT Hatchback',
'transmission': 'manual',
'trim': 'M SPORT',
'vin': 'WBA1W520705K20331',
'year': 2017}
2026-03-28 14:03:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YK67%2520BOU%27 HTTP/1.1" 200 None
2026-03-28 14:03:36 [bca.uk] INFO: Saving data for YK67%20BOU: {'created_time': 1774706616.56904, 'last_price_update_time': 1774706616.569055, 'auction_closing_time': 1774778400.0}
2026-03-28 14:03:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='YK67%2520BOU') HTTP/1.1" 204 0
2026-03-28 14:03:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: e788d11e-974b-5084-adb6-d49a23c42616 with identifier: X28%20AVE
2026-03-28 14:03:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: e788d11e-974b-5084-adb6-d49a23c42616 with identifier: X28%20AVE
2026-03-28 14:03:36 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: e788d11e-974b-5084-adb6-d49a23c42616 with identifier: X28%20AVE to the API
2026-03-28 14:03:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:03:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:03:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/X28AVE/698923684/600>
{'auction_title': '',
'c_o_2_emission_value': 159,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e788d11e-974b-5084-adb6-d49a23c42616/e788d11e-974b-5084-adb6-d49a23c42616_expert_report_file_c7a29757-1c87-4996-bb5d-156d4871053f.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=X28%20AVE-GB',
'category': 'Car',
'color': 'grey',
'currency': 'GBP',
'doors_number': 2,
'engine': '2.0L',
'expiration_date': '2026-03-29T10:00:00Z',
'fuel_type': 'Petrol',
'id': 'e788d11e-974b-5084-adb6-d49a23c42616',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'X28 AVE',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=X28%20AVE&vehicleType=*',
'listing': 'auction',
'location': 'Walsall',
'make': 'BMW',
'model': 'Z4',
'odometer': 59036,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 12,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e788d11e-974b-5084-adb6-d49a23c42616/e788d11e-974b-5084-adb6-d49a23c42616_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 44639,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/X28AVE/698923684/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e788d11e-974b-5084-adb6-d49a23c42616/e788d11e-974b-5084-adb6-d49a23c42616_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 44681,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/X28AVE/698923705/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e788d11e-974b-5084-adb6-d49a23c42616/e788d11e-974b-5084-adb6-d49a23c42616_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 44269,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/X28AVE/698923722/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e788d11e-974b-5084-adb6-d49a23c42616/e788d11e-974b-5084-adb6-d49a23c42616_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 43516,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/X28AVE/698923736/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e788d11e-974b-5084-adb6-d49a23c42616/e788d11e-974b-5084-adb6-d49a23c42616_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 42117,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/X28AVE/698923746/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e788d11e-974b-5084-adb6-d49a23c42616/e788d11e-974b-5084-adb6-d49a23c42616_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 41684,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/X28AVE/698923758/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e788d11e-974b-5084-adb6-d49a23c42616/e788d11e-974b-5084-adb6-d49a23c42616_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 70010,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/X28AVE/698923783/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e788d11e-974b-5084-adb6-d49a23c42616/e788d11e-974b-5084-adb6-d49a23c42616_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 74124,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/X28AVE/698923798/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e788d11e-974b-5084-adb6-d49a23c42616/e788d11e-974b-5084-adb6-d49a23c42616_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 66239,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/X28AVE/698923819/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e788d11e-974b-5084-adb6-d49a23c42616/e788d11e-974b-5084-adb6-d49a23c42616_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 59154,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/X28AVE/698923832/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2014-01-01',
'seller_name': None,
'title': 'BMW Z4 2.0 SDRIVE 18I M SPORT Roadster',
'transmission': 'manual',
'trim': 'SDRIVE 18I M SPORT',
'vin': 'WBALL12000J643639',
'year': 2014}
2026-03-28 14:03:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27X28%2520AVE%27 HTTP/1.1" 200 None
2026-03-28 14:03:36 [bca.uk] INFO: Saving data for X28%20AVE: {'created_time': 1774706616.922452, 'last_price_update_time': 1774706616.922463, 'auction_closing_time': 1774778400.0}
2026-03-28 14:03:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='X28%2520AVE') HTTP/1.1" 204 0
2026-03-28 14:03:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/SC69SYA/42810321?sv=2020-08-04&st=2026-03-28T14%3A03%3A33Z&se=2026-03-28T14%3A28%3A33Z&sr=b&sp=r&sig=pg%2FWEb5rIOUIFGT2mUm39zJu%2F6eH7ZOCdfShXQuFo%2Bo%3D> (referer: https://www.bca.co.uk/)
2026-03-28 14:03:36 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VX19OYP/698251056/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698251056>
2026-03-28 14:03:36 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KV60ZZA/698934378/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698934378>
2026-03-28 14:03:36 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YH13CHD/698786544/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698786544>
2026-03-28 14:03:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698282707%27 HTTP/1.1" 200 None
2026-03-28 14:03:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698282707 not downloaded yet
2026-03-28 14:03:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D697937961%27 HTTP/1.1" 200 None
2026-03-28 14:03:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=697937961 not downloaded yet
2026-03-28 14:03:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:03:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c68e390>
2026-03-28 14:03:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:03:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:03:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:03:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0b12c0fe-3ab8-5445-ad6b-256ccebc3b9e/0b12c0fe-3ab8-5445-ad6b-256ccebc3b9e_image_2.jpg HTTP/1.1" 201 0
2026-03-28 14:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLR11XWM%252F697880562%252F600') HTTP/1.1" 204 0
2026-03-28 14:03:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LR11XWM/697880562/600 saved to cache
2026-03-28 14:03:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 0b12c0fe-3ab8-5445-ad6b-256ccebc3b9e
2026-03-28 14:03:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EA24TKX/698296238/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/EA24TKX/42810378?sv=2020-08-04&st=2026-03-28T14%3A01%3A05Z&se=2026-03-28T14%3A26%3A05Z&sr=b&sp=r&sig=Ajk9rVQfTHJs3R0cJnmP5VnSS5rSnHfV6UlI7D3mmDQ%3D)
2026-03-28 14:03:37 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RE59BXM/698980881/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698980881>
2026-03-28 14:03:37 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BX06AVC/698920594/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698920594>
2026-03-28 14:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698282708%27 HTTP/1.1" 200 None
2026-03-28 14:03:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698282708 not downloaded yet
2026-03-28 14:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D697937974%27 HTTP/1.1" 200 None
2026-03-28 14:03:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=697937974 not downloaded yet
2026-03-28 14:03:37 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:03:37 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:03:37 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:03:37 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:03:37 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:03:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:03:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2d828a50>
2026-03-28 14:03:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:03:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:03:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:03:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5e732f50-42ac-5666-996c-316bc1354f8d/5e732f50-42ac-5666-996c-316bc1354f8d_image_9.jpg HTTP/1.1" 201 0
2026-03-28 14:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FRE59BXM%252F698980927%252F600') HTTP/1.1" 204 0
2026-03-28 14:03:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RE59BXM/698980927/600 saved to cache
2026-03-28 14:03:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 5e732f50-42ac-5666-996c-316bc1354f8d
2026-03-28 14:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698282709%27 HTTP/1.1" 200 None
2026-03-28 14:03:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698282709 not downloaded yet
2026-03-28 14:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D697937984%27 HTTP/1.1" 200 None
2026-03-28 14:03:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=697937984 not downloaded yet
2026-03-28 14:03:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/OV64PLN/698966003/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/OV64PLN/42810653?sv=2020-08-04&st=2026-03-28T14%3A01%3A03Z&se=2026-03-28T14%3A26%3A03Z&sr=b&sp=r&sig=APMfuiYXypC%2F8k81EUjJVNUqGlQEUGUldS81rN8I%2FN0%3D)
2026-03-28 14:03:37 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LR11XWM/697880544/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=697880544>
2026-03-28 14:03:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DP19FWW/698227072/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/DP19FWW/42810375?sv=2020-08-04&st=2026-03-28T14%3A01%3A04Z&se=2026-03-28T14%3A26%3A04Z&sr=b&sp=r&sig=DYlHwmmm%2BkuE1QC9GfsRlnyT74V8OO0Bfy5POGMlRcU%3D)
2026-03-28 14:03:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EJ13JTO/698540250/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/EJ13JTO/42810382?sv=2020-08-04&st=2026-03-28T14%3A01%3A03Z&se=2026-03-28T14%3A26%3A03Z&sr=b&sp=r&sig=9n5SmvjaM772xUjZdL0t%2BMeZRNBu1TSQPyTFa%2FZiaIA%3D)
2026-03-28 14:03:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MJ03HOW/698444382/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/MJ03HOW/42810316?sv=2020-08-04&st=2026-03-28T14%3A01%3A04Z&se=2026-03-28T14%3A26%3A04Z&sr=b&sp=r&sig=72R4f35YDQDGGwN55srQJ3YRSQrnD%2FGMmCWnMvmfOLc%3D)
2026-03-28 14:03:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FY68WNB/698106333/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/FY68WNB/42810373?sv=2020-08-04&st=2026-03-28T14%3A01%3A04Z&se=2026-03-28T14%3A26%3A04Z&sr=b&sp=r&sig=H2pJB0hzNCFCiICFkGnSt1gr2sn1tExob5yrsc4d3Vs%3D)
2026-03-28 14:03:37 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/NX20NZM/42810603?sv=2020-08-04&st=2026-03-28T14%3A03%3A37Z&se=2026-03-28T14%3A28%3A37Z&sr=b&sp=r&sig=noQVKz9rflNOt5fdZMxrPau22%2Fg%2FxxIMhBlTaw8V7tU%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=NX20%20NZM-GB>
2026-03-28 14:03:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YH13CHD/698786544/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YH13CHD/42807762?sv=2020-08-04&st=2026-03-28T14%3A01%3A02Z&se=2026-03-28T14%3A26%3A02Z&sr=b&sp=r&sig=Kk3ZnO0H7wXbnR6jzpTNZkeJ9EaoXS3djv9g6kExg8o%3D)
2026-03-28 14:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698282710%27 HTTP/1.1" 200 None
2026-03-28 14:03:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698282710 not downloaded yet
2026-03-28 14:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D697937999%27 HTTP/1.1" 200 None
2026-03-28 14:03:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=697937999 not downloaded yet
2026-03-28 14:03:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:03:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2d9bd7d0>
2026-03-28 14:03:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:03:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:03:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:03:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0943e31d-5a39-5fc7-b0f9-f571748a60fc/0943e31d-5a39-5fc7-b0f9-f571748a60fc_expert_report_file_bf2e855e-7ce6-4eeb-a36f-c445d4c78d18.pdf HTTP/1.1" 201 0
2026-03-28 14:03:37 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item 0943e31d-5a39-5fc7-b0f9-f571748a60fc
2026-03-28 14:03:37 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 0943e31d-5a39-5fc7-b0f9-f571748a60fc, skipping ID generation
2026-03-28 14:03:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 0943e31d-5a39-5fc7-b0f9-f571748a60fc
2026-03-28 14:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DSC69SYA-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-28 14:03:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=SC69SYA-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-28 14:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698282712%27 HTTP/1.1" 200 None
2026-03-28 14:03:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698282712 not downloaded yet
2026-03-28 14:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D697938008%27 HTTP/1.1" 200 None
2026-03-28 14:03:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=697938008 not downloaded yet
2026-03-28 14:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698556138%27 HTTP/1.1" 200 None
2026-03-28 14:03:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698556138 not downloaded yet
2026-03-28 14:03:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:03:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c89aed0>
2026-03-28 14:03:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:03:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:03:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:03:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a936dd22-4905-520e-8ef4-c3c73c56eba4/a936dd22-4905-520e-8ef4-c3c73c56eba4_image_2.jpg HTTP/1.1" 201 0
2026-03-28 14:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FEA24TKX%252F698296238%252F600') HTTP/1.1" 204 0
2026-03-28 14:03:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EA24TKX/698296238/600 saved to cache
2026-03-28 14:03:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item a936dd22-4905-520e-8ef4-c3c73c56eba4
2026-03-28 14:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698282715%27 HTTP/1.1" 200 None
2026-03-28 14:03:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698282715 not downloaded yet
2026-03-28 14:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D697938025%27 HTTP/1.1" 200 None
2026-03-28 14:03:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=697938025 not downloaded yet
2026-03-28 14:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698556153%27 HTTP/1.1" 200 None
2026-03-28 14:03:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698556153 not downloaded yet
2026-03-28 14:03:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VX19OYP/698251056/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/VX19OYP/42810376?sv=2020-08-04&st=2026-03-28T14%3A01%3A04Z&se=2026-03-28T14%3A26%3A04Z&sr=b&sp=r&sig=ZoloAWIhiMuraB8%2BrUA7GYd%2BDLx9PxJOBzKxmER1A8U%3D)
2026-03-28 14:03:37 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PY71HPP/698282706/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=PY71HPP-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-28 14:03:37 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EA24TKX/698296235/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698296235>
2026-03-28 14:03:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KV60ZZA/698934378/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/KV60ZZA/42810415?sv=2020-08-04&st=2026-03-28T14%3A01%3A03Z&se=2026-03-28T14%3A26%3A03Z&sr=b&sp=r&sig=IuzavW0HE55HWRn715zywGMWMJJZSa9qrno76VZ5d%2FU%3D)
2026-03-28 14:03:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:03:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2d97a510>
2026-03-28 14:03:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:03:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:03:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:03:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d75bc751-3167-5395-a067-9fe76cc20a2d/d75bc751-3167-5395-a067-9fe76cc20a2d_image_5.jpg HTTP/1.1" 201 0
2026-03-28 14:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FOV64PLN%252F698966003%252F600') HTTP/1.1" 204 0
2026-03-28 14:03:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/OV64PLN/698966003/600 saved to cache
2026-03-28 14:03:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item d75bc751-3167-5395-a067-9fe76cc20a2d
2026-03-28 14:03:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:03:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a1ff51450>
2026-03-28 14:03:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:03:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:03:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:03:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4b13d468-b932-5891-9e01-a66081b24d30/4b13d468-b932-5891-9e01-a66081b24d30_image_4.jpg HTTP/1.1" 201 0
2026-03-28 14:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FDP19FWW%252F698227072%252F600') HTTP/1.1" 204 0
2026-03-28 14:03:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DP19FWW/698227072/600 saved to cache
2026-03-28 14:03:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 4b13d468-b932-5891-9e01-a66081b24d30
2026-03-28 14:03:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:03:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c105a90>
2026-03-28 14:03:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:03:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:03:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:03:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5be82b2b-6926-5451-8e0e-f3d801ad1cad/5be82b2b-6926-5451-8e0e-f3d801ad1cad_image_5.jpg HTTP/1.1" 201 0
2026-03-28 14:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FEJ13JTO%252F698540250%252F600') HTTP/1.1" 204 0
2026-03-28 14:03:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EJ13JTO/698540250/600 saved to cache
2026-03-28 14:03:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 5be82b2b-6926-5451-8e0e-f3d801ad1cad
2026-03-28 14:03:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:03:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c451850>
2026-03-28 14:03:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:03:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:03:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:03:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b75153fa-8bbc-5e83-87eb-81edd908fcda/b75153fa-8bbc-5e83-87eb-81edd908fcda_image_3.jpg HTTP/1.1" 201 0
2026-03-28 14:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FMJ03HOW%252F698444382%252F600') HTTP/1.1" 204 0
2026-03-28 14:03:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MJ03HOW/698444382/600 saved to cache
2026-03-28 14:03:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item b75153fa-8bbc-5e83-87eb-81edd908fcda
2026-03-28 14:03:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:03:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c84fcd0>
2026-03-28 14:03:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:03:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:03:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:03:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d8436e02-8218-5d88-bcc5-e01ffac7eb8e/d8436e02-8218-5d88-bcc5-e01ffac7eb8e_image_5.jpg HTTP/1.1" 201 0
2026-03-28 14:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FFY68WNB%252F698106333%252F600') HTTP/1.1" 204 0
2026-03-28 14:03:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FY68WNB/698106333/600 saved to cache
2026-03-28 14:03:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item d8436e02-8218-5d88-bcc5-e01ffac7eb8e
2026-03-28 14:03:37 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:03:37 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:03:37 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:03:37 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:03:37 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:03:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:03:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a1fedf290>
2026-03-28 14:03:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:03:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:03:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:03:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dabe1fc4-09bf-52ef-9042-78b5e1d2db10/dabe1fc4-09bf-52ef-9042-78b5e1d2db10_image_6.jpg HTTP/1.1" 201 0
2026-03-28 14:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FYH13CHD%252F698786544%252F600') HTTP/1.1" 204 0
2026-03-28 14:03:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YH13CHD/698786544/600 saved to cache
2026-03-28 14:03:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item dabe1fc4-09bf-52ef-9042-78b5e1d2db10
2026-03-28 14:03:37 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HK18KTD/697937949/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=HK18KTD-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-28 14:03:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RE59BXM/698980881/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/RE59BXM/42810393?sv=2020-08-04&st=2026-03-28T14%3A01%3A02Z&se=2026-03-28T14%3A26%3A02Z&sr=b&sp=r&sig=MksXwVSixqiZ62CEskJ2z5pOaVL%2BuYMKfzx3%2FgepvXw%3D)
2026-03-28 14:03:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BX06AVC/698920594/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/BX06AVC/42809716?sv=2020-08-04&st=2026-03-28T14%3A01%3A02Z&se=2026-03-28T14%3A26%3A02Z&sr=b&sp=r&sig=977AimHC9Bz1l7hKD9ZmlbFuhdYPzzwcOGUBuBpHaxA%3D)
2026-03-28 14:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698282718%27 HTTP/1.1" 200 None
2026-03-28 14:03:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698282718 not downloaded yet
2026-03-28 14:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D697938040%27 HTTP/1.1" 200 None
2026-03-28 14:03:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=697938040 not downloaded yet
2026-03-28 14:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698556164%27 HTTP/1.1" 200 None
2026-03-28 14:03:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698556164 not downloaded yet
2026-03-28 14:03:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/NX20NZM/42810603?sv=2020-08-04&st=2026-03-28T14%3A03%3A37Z&se=2026-03-28T14%3A28%3A37Z&sr=b&sp=r&sig=noQVKz9rflNOt5fdZMxrPau22%2Fg%2FxxIMhBlTaw8V7tU%3D> (referer: https://www.bca.co.uk/)
2026-03-28 14:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698282721%27 HTTP/1.1" 200 None
2026-03-28 14:03:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698282721 not downloaded yet
2026-03-28 14:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D697938058%27 HTTP/1.1" 200 None
2026-03-28 14:03:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=697938058 not downloaded yet
2026-03-28 14:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698556175%27 HTTP/1.1" 200 None
2026-03-28 14:03:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698556175 not downloaded yet
2026-03-28 14:03:37 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:03:37 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:03:37 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:03:37 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:03:37 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:03:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:03:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c9dd7d0>
2026-03-28 14:03:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:03:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:03:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:03:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b7b36a17-d5d4-5e94-9bbf-8a754ca74b60/b7b36a17-d5d4-5e94-9bbf-8a754ca74b60_image_7.jpg HTTP/1.1" 201 0
2026-03-28 14:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FVX19OYP%252F698251056%252F600') HTTP/1.1" 204 0
2026-03-28 14:03:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VX19OYP/698251056/600 saved to cache
2026-03-28 14:03:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item b7b36a17-d5d4-5e94-9bbf-8a754ca74b60
2026-03-28 14:03:37 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:03:37 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:03:37 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:03:37 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:03:37 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:03:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:03:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2d73db90>
2026-03-28 14:03:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:03:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:03:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:03:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3f54d261-9f82-51f4-9ce3-cc4413b8b6c4/3f54d261-9f82-51f4-9ce3-cc4413b8b6c4_image_7.jpg HTTP/1.1" 201 0
2026-03-28 14:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FKV60ZZA%252F698934378%252F600') HTTP/1.1" 204 0
2026-03-28 14:03:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KV60ZZA/698934378/600 saved to cache
2026-03-28 14:03:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 3f54d261-9f82-51f4-9ce3-cc4413b8b6c4
2026-03-28 14:03:38 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HK18KTD/697937974/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=697937974>
2026-03-28 14:03:38 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HK18KTD/697937984/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=697937984>
2026-03-28 14:03:38 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PY71HPP/698282709/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698282709>
2026-03-28 14:03:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LR11XWM/697880544/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LR11XWM/42810294?sv=2020-08-04&st=2026-03-28T14%3A01%3A05Z&se=2026-03-28T14%3A26%3A05Z&sr=b&sp=r&sig=zHl%2Fkz2fSAoGVBY8ukVZULGVCGKqbTVidyooaEEBPNc%3D)
2026-03-28 14:03:38 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HK18KTD/697937961/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=697937961>
2026-03-28 14:03:38 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PY71HPP/698282707/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698282707>
2026-03-28 14:03:38 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PY71HPP/698282708/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698282708>
2026-03-28 14:03:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698282722%27 HTTP/1.1" 200 None
2026-03-28 14:03:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698282722 not downloaded yet
2026-03-28 14:03:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D697938073%27 HTTP/1.1" 200 None
2026-03-28 14:03:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=697938073 not downloaded yet
2026-03-28 14:03:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698556191%27 HTTP/1.1" 200 None
2026-03-28 14:03:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698556191 not downloaded yet
2026-03-28 14:03:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698556208%27 HTTP/1.1" 200 None
2026-03-28 14:03:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698556208 not downloaded yet
2026-03-28 14:03:38 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:03:38 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:03:38 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:03:38 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:03:38 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:03:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:03:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2d65fd50>
2026-03-28 14:03:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:03:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:03:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:03:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5e732f50-42ac-5666-996c-316bc1354f8d/5e732f50-42ac-5666-996c-316bc1354f8d_image_8.jpg HTTP/1.1" 201 0
2026-03-28 14:03:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FRE59BXM%252F698980881%252F600') HTTP/1.1" 204 0
2026-03-28 14:03:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RE59BXM/698980881/600 saved to cache
2026-03-28 14:03:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 5e732f50-42ac-5666-996c-316bc1354f8d
2026-03-28 14:03:38 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:03:38 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:03:38 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:03:38 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:03:38 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:03:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:03:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2d9858d0>
2026-03-28 14:03:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:03:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:03:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:03:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7086d3db-bd6a-5ab0-9b74-8f1cf370adf4/7086d3db-bd6a-5ab0-9b74-8f1cf370adf4_image_9.jpg HTTP/1.1" 201 0
2026-03-28 14:03:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FBX06AVC%252F698920594%252F600') HTTP/1.1" 204 0
2026-03-28 14:03:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BX06AVC/698920594/600 saved to cache
2026-03-28 14:03:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 7086d3db-bd6a-5ab0-9b74-8f1cf370adf4
2026-03-28 14:03:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:03:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c4fcdd0>
2026-03-28 14:03:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:03:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:03:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:03:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_24a9472e-5aa6-51b8-909f-9ce395651227/24a9472e-5aa6-51b8-909f-9ce395651227_expert_report_file_ecf944a5-1e15-4afb-b01d-85e1c008dd67.pdf HTTP/1.1" 201 0
2026-03-28 14:03:38 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item 24a9472e-5aa6-51b8-909f-9ce395651227
2026-03-28 14:03:38 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 24a9472e-5aa6-51b8-909f-9ce395651227, skipping ID generation
2026-03-28 14:03:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 24a9472e-5aa6-51b8-909f-9ce395651227
2026-03-28 14:03:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DNX20NZM-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-28 14:03:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=NX20NZM-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-28 14:03:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EA24TKX/698296235/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/EA24TKX/42810378?sv=2020-08-04&st=2026-03-28T14%3A01%3A05Z&se=2026-03-28T14%3A26%3A05Z&sr=b&sp=r&sig=Ajk9rVQfTHJs3R0cJnmP5VnSS5rSnHfV6UlI7D3mmDQ%3D)
2026-03-28 14:03:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698556222%27 HTTP/1.1" 200 None
2026-03-28 14:03:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698556222 not downloaded yet
2026-03-28 14:03:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HK18KTD/697937949/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/HK18KTD/42810169?sv=2020-08-04&st=2026-03-28T14%3A03%3A33Z&se=2026-03-28T14%3A28%3A33Z&sr=b&sp=r&sig=hkLnkSG275tljEq5qfSoK1jC3apnwlGnB%2Bpsv17q5aQ%3D)
2026-03-28 14:03:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PY71HPP/698282706/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/PY71HPP/42810351?sv=2020-08-04&st=2026-03-28T14%3A03%3A33Z&se=2026-03-28T14%3A28%3A33Z&sr=b&sp=r&sig=VE6%2By8gOfvgKf8XGgsgtB7SRVaoWu2GIM9gpf%2BgtWPI%3D)
2026-03-28 14:03:38 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SC69SYA/698556138/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698556138>
2026-03-28 14:03:38 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HK18KTD/697938008/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=697938008>
2026-03-28 14:03:38 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HK18KTD/697938025/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=697938025>
2026-03-28 14:03:38 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SC69SYA/698556164/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698556164>
2026-03-28 14:03:38 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SC69SYA/698556153/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698556153>
2026-03-28 14:03:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698970550%27 HTTP/1.1" 200 None
2026-03-28 14:03:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698970550 not downloaded yet
2026-03-28 14:03:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698556237%27 HTTP/1.1" 200 None
2026-03-28 14:03:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698556237 not downloaded yet
2026-03-28 14:03:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698953115%27 HTTP/1.1" 200 None
2026-03-28 14:03:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698953115 not downloaded yet
2026-03-28 14:03:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698556249%27 HTTP/1.1" 200 None
2026-03-28 14:03:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698556249 not downloaded yet
2026-03-28 14:03:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:03:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c5e39d0>
2026-03-28 14:03:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:03:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:03:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:03:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0b12c0fe-3ab8-5445-ad6b-256ccebc3b9e/0b12c0fe-3ab8-5445-ad6b-256ccebc3b9e_image_1.jpg HTTP/1.1" 201 0
2026-03-28 14:03:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLR11XWM%252F697880544%252F600') HTTP/1.1" 204 0
2026-03-28 14:03:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LR11XWM/697880544/600 saved to cache
2026-03-28 14:03:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 0b12c0fe-3ab8-5445-ad6b-256ccebc3b9e
2026-03-28 14:03:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698970557%27 HTTP/1.1" 200 None
2026-03-28 14:03:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698970557 not downloaded yet
2026-03-28 14:03:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PY71HPP/698282708/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/PY71HPP/42810351?sv=2020-08-04&st=2026-03-28T14%3A03%3A33Z&se=2026-03-28T14%3A28%3A33Z&sr=b&sp=r&sig=VE6%2By8gOfvgKf8XGgsgtB7SRVaoWu2GIM9gpf%2BgtWPI%3D)
2026-03-28 14:03:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HK18KTD/697937974/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/HK18KTD/42810169?sv=2020-08-04&st=2026-03-28T14%3A03%3A33Z&se=2026-03-28T14%3A28%3A33Z&sr=b&sp=r&sig=hkLnkSG275tljEq5qfSoK1jC3apnwlGnB%2Bpsv17q5aQ%3D)
2026-03-28 14:03:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SC69SYA/698556153/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/SC69SYA/42810321?sv=2020-08-04&st=2026-03-28T14%3A03%3A33Z&se=2026-03-28T14%3A28%3A33Z&sr=b&sp=r&sig=pg%2FWEb5rIOUIFGT2mUm39zJu%2F6eH7ZOCdfShXQuFo%2Bo%3D)
2026-03-28 14:03:38 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SC69SYA/698556175/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698556175>
2026-03-28 14:03:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PY71HPP/698282707/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/PY71HPP/42810351?sv=2020-08-04&st=2026-03-28T14%3A03%3A33Z&se=2026-03-28T14%3A28%3A33Z&sr=b&sp=r&sig=VE6%2By8gOfvgKf8XGgsgtB7SRVaoWu2GIM9gpf%2BgtWPI%3D)
2026-03-28 14:03:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PY71HPP/698282709/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/PY71HPP/42810351?sv=2020-08-04&st=2026-03-28T14%3A03%3A33Z&se=2026-03-28T14%3A28%3A33Z&sr=b&sp=r&sig=VE6%2By8gOfvgKf8XGgsgtB7SRVaoWu2GIM9gpf%2BgtWPI%3D)
2026-03-28 14:03:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698953131%27 HTTP/1.1" 200 None
2026-03-28 14:03:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698953131 not downloaded yet
2026-03-28 14:03:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698970573%27 HTTP/1.1" 200 None
2026-03-28 14:03:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698970573 not downloaded yet
2026-03-28 14:03:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:03:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2d73fcd0>
2026-03-28 14:03:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:03:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:03:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:03:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a936dd22-4905-520e-8ef4-c3c73c56eba4/a936dd22-4905-520e-8ef4-c3c73c56eba4_image_1.jpg HTTP/1.1" 201 0
2026-03-28 14:03:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FEA24TKX%252F698296235%252F600') HTTP/1.1" 204 0
2026-03-28 14:03:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EA24TKX/698296235/600 saved to cache
2026-03-28 14:03:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item a936dd22-4905-520e-8ef4-c3c73c56eba4
2026-03-28 14:03:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:03:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c4017d0>
2026-03-28 14:03:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:03:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:03:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:03:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a5eb24be-0f0d-5d52-8354-e9c746a38f6e/a5eb24be-0f0d-5d52-8354-e9c746a38f6e_image_0.jpg HTTP/1.1" 201 0
2026-03-28 14:03:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FHK18KTD%252F697937949%252F600') HTTP/1.1" 204 0
2026-03-28 14:03:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HK18KTD/697937949/600 saved to cache
2026-03-28 14:03:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item a5eb24be-0f0d-5d52-8354-e9c746a38f6e
2026-03-28 14:03:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:03:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a1fec5d90>
2026-03-28 14:03:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:03:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:03:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:03:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c02444db-1872-560a-9a4f-c32517c42d55/c02444db-1872-560a-9a4f-c32517c42d55_image_0.jpg HTTP/1.1" 201 0
2026-03-28 14:03:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FPY71HPP%252F698282706%252F600') HTTP/1.1" 204 0
2026-03-28 14:03:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PY71HPP/698282706/600 saved to cache
2026-03-28 14:03:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item c02444db-1872-560a-9a4f-c32517c42d55
2026-03-28 14:03:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HK18KTD/697937984/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/HK18KTD/42810169?sv=2020-08-04&st=2026-03-28T14%3A03%3A33Z&se=2026-03-28T14%3A28%3A33Z&sr=b&sp=r&sig=hkLnkSG275tljEq5qfSoK1jC3apnwlGnB%2Bpsv17q5aQ%3D)
2026-03-28 14:03:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HK18KTD/697937961/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/HK18KTD/42810169?sv=2020-08-04&st=2026-03-28T14%3A03%3A33Z&se=2026-03-28T14%3A28%3A33Z&sr=b&sp=r&sig=hkLnkSG275tljEq5qfSoK1jC3apnwlGnB%2Bpsv17q5aQ%3D)
2026-03-28 14:03:38 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SC69SYA/698556208/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698556208>
2026-03-28 14:03:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SC69SYA/698556138/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/SC69SYA/42810321?sv=2020-08-04&st=2026-03-28T14%3A03%3A33Z&se=2026-03-28T14%3A28%3A33Z&sr=b&sp=r&sig=pg%2FWEb5rIOUIFGT2mUm39zJu%2F6eH7ZOCdfShXQuFo%2Bo%3D)
2026-03-28 14:03:38 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NX20NZM/698970532/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=NX20NZM-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-28 14:03:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SC69SYA/698556164/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/SC69SYA/42810321?sv=2020-08-04&st=2026-03-28T14%3A03%3A33Z&se=2026-03-28T14%3A28%3A33Z&sr=b&sp=r&sig=pg%2FWEb5rIOUIFGT2mUm39zJu%2F6eH7ZOCdfShXQuFo%2Bo%3D)
2026-03-28 14:03:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HK18KTD/697938008/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/HK18KTD/42810169?sv=2020-08-04&st=2026-03-28T14%3A03%3A33Z&se=2026-03-28T14%3A28%3A33Z&sr=b&sp=r&sig=hkLnkSG275tljEq5qfSoK1jC3apnwlGnB%2Bpsv17q5aQ%3D)
2026-03-28 14:03:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698953146%27 HTTP/1.1" 200 None
2026-03-28 14:03:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698953146 not downloaded yet
2026-03-28 14:03:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HK18KTD/697938025/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/HK18KTD/42810169?sv=2020-08-04&st=2026-03-28T14%3A03%3A33Z&se=2026-03-28T14%3A28%3A33Z&sr=b&sp=r&sig=hkLnkSG275tljEq5qfSoK1jC3apnwlGnB%2Bpsv17q5aQ%3D)
2026-03-28 14:03:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698970588%27 HTTP/1.1" 200 None
2026-03-28 14:03:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698970588 not downloaded yet
2026-03-28 14:03:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:03:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c38fa90>
2026-03-28 14:03:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:03:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:03:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:03:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c02444db-1872-560a-9a4f-c32517c42d55/c02444db-1872-560a-9a4f-c32517c42d55_image_2.jpg HTTP/1.1" 201 0
2026-03-28 14:03:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FPY71HPP%252F698282708%252F600') HTTP/1.1" 204 0
2026-03-28 14:03:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PY71HPP/698282708/600 saved to cache
2026-03-28 14:03:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item c02444db-1872-560a-9a4f-c32517c42d55
2026-03-28 14:03:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:03:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2de0ffd0>
2026-03-28 14:03:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:03:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:03:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:03:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a5eb24be-0f0d-5d52-8354-e9c746a38f6e/a5eb24be-0f0d-5d52-8354-e9c746a38f6e_image_2.jpg HTTP/1.1" 201 0
2026-03-28 14:03:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FHK18KTD%252F697937974%252F600') HTTP/1.1" 204 0
2026-03-28 14:03:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HK18KTD/697937974/600 saved to cache
2026-03-28 14:03:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item a5eb24be-0f0d-5d52-8354-e9c746a38f6e
2026-03-28 14:03:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:03:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c4a7250>
2026-03-28 14:03:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:03:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:03:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:03:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0943e31d-5a39-5fc7-b0f9-f571748a60fc/0943e31d-5a39-5fc7-b0f9-f571748a60fc_image_2.jpg HTTP/1.1" 201 0
2026-03-28 14:03:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FSC69SYA%252F698556153%252F600') HTTP/1.1" 204 0
2026-03-28 14:03:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SC69SYA/698556153/600 saved to cache
2026-03-28 14:03:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 0943e31d-5a39-5fc7-b0f9-f571748a60fc
2026-03-28 14:03:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:03:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2ca82310>
2026-03-28 14:03:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:03:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:03:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:03:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c02444db-1872-560a-9a4f-c32517c42d55/c02444db-1872-560a-9a4f-c32517c42d55_image_1.jpg HTTP/1.1" 201 0
2026-03-28 14:03:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FPY71HPP%252F698282707%252F600') HTTP/1.1" 204 0
2026-03-28 14:03:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PY71HPP/698282707/600 saved to cache
2026-03-28 14:03:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item c02444db-1872-560a-9a4f-c32517c42d55
2026-03-28 14:03:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:03:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c453290>
2026-03-28 14:03:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:03:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:03:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:03:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c02444db-1872-560a-9a4f-c32517c42d55/c02444db-1872-560a-9a4f-c32517c42d55_image_3.jpg HTTP/1.1" 201 0
2026-03-28 14:03:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FPY71HPP%252F698282709%252F600') HTTP/1.1" 204 0
2026-03-28 14:03:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PY71HPP/698282709/600 saved to cache
2026-03-28 14:03:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item c02444db-1872-560a-9a4f-c32517c42d55
2026-03-28 14:03:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698953162%27 HTTP/1.1" 200 None
2026-03-28 14:03:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698953162 not downloaded yet
2026-03-28 14:03:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NX20NZM/698970532/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/NX20NZM/42810603?sv=2020-08-04&st=2026-03-28T14%3A03%3A37Z&se=2026-03-28T14%3A28%3A37Z&sr=b&sp=r&sig=noQVKz9rflNOt5fdZMxrPau22%2Fg%2FxxIMhBlTaw8V7tU%3D)
2026-03-28 14:03:38 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SC69SYA/698556191/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698556191>
2026-03-28 14:03:38 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SC69SYA/698556237/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698556237>
2026-03-28 14:03:38 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SC69SYA/698556222/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698556222>
2026-03-28 14:03:38 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SC69SYA/698556249/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698556249>
2026-03-28 14:03:38 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NX20NZM/698970550/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698970550>
2026-03-28 14:03:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SC69SYA/698556175/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/SC69SYA/42810321?sv=2020-08-04&st=2026-03-28T14%3A03%3A33Z&se=2026-03-28T14%3A28%3A33Z&sr=b&sp=r&sig=pg%2FWEb5rIOUIFGT2mUm39zJu%2F6eH7ZOCdfShXQuFo%2Bo%3D)
2026-03-28 14:03:38 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NX20NZM/698953115/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698953115>
2026-03-28 14:03:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698970604%27 HTTP/1.1" 200 None
2026-03-28 14:03:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698970604 not downloaded yet
2026-03-28 14:03:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:03:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c8e0450>
2026-03-28 14:03:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:03:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:03:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:03:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a5eb24be-0f0d-5d52-8354-e9c746a38f6e/a5eb24be-0f0d-5d52-8354-e9c746a38f6e_image_3.jpg HTTP/1.1" 201 0
2026-03-28 14:03:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FHK18KTD%252F697937984%252F600') HTTP/1.1" 204 0
2026-03-28 14:03:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HK18KTD/697937984/600 saved to cache
2026-03-28 14:03:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item a5eb24be-0f0d-5d52-8354-e9c746a38f6e
2026-03-28 14:03:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:03:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c450250>
2026-03-28 14:03:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:03:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:03:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:03:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a5eb24be-0f0d-5d52-8354-e9c746a38f6e/a5eb24be-0f0d-5d52-8354-e9c746a38f6e_image_1.jpg HTTP/1.1" 201 0
2026-03-28 14:03:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FHK18KTD%252F697937961%252F600') HTTP/1.1" 204 0
2026-03-28 14:03:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HK18KTD/697937961/600 saved to cache
2026-03-28 14:03:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item a5eb24be-0f0d-5d52-8354-e9c746a38f6e
2026-03-28 14:03:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:03:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a1fd347d0>
2026-03-28 14:03:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:03:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:03:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:03:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0943e31d-5a39-5fc7-b0f9-f571748a60fc/0943e31d-5a39-5fc7-b0f9-f571748a60fc_image_1.jpg HTTP/1.1" 201 0
2026-03-28 14:03:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FSC69SYA%252F698556138%252F600') HTTP/1.1" 204 0
2026-03-28 14:03:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SC69SYA/698556138/600 saved to cache
2026-03-28 14:03:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 0943e31d-5a39-5fc7-b0f9-f571748a60fc
2026-03-28 14:03:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:03:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c403dd0>
2026-03-28 14:03:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:03:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:03:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:03:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0943e31d-5a39-5fc7-b0f9-f571748a60fc/0943e31d-5a39-5fc7-b0f9-f571748a60fc_image_3.jpg HTTP/1.1" 201 0
2026-03-28 14:03:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FSC69SYA%252F698556164%252F600') HTTP/1.1" 204 0
2026-03-28 14:03:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SC69SYA/698556164/600 saved to cache
2026-03-28 14:03:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 0943e31d-5a39-5fc7-b0f9-f571748a60fc
2026-03-28 14:03:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:03:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c862d50>
2026-03-28 14:03:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:03:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:03:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:03:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a5eb24be-0f0d-5d52-8354-e9c746a38f6e/a5eb24be-0f0d-5d52-8354-e9c746a38f6e_image_5.jpg HTTP/1.1" 201 0
2026-03-28 14:03:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FHK18KTD%252F697938008%252F600') HTTP/1.1" 204 0
2026-03-28 14:03:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HK18KTD/697938008/600 saved to cache
2026-03-28 14:03:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item a5eb24be-0f0d-5d52-8354-e9c746a38f6e
2026-03-28 14:03:39 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:03:39 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:03:39 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:03:39 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:03:39 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:03:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:03:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2d78e250>
2026-03-28 14:03:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:03:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:03:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:03:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a5eb24be-0f0d-5d52-8354-e9c746a38f6e/a5eb24be-0f0d-5d52-8354-e9c746a38f6e_image_6.jpg HTTP/1.1" 201 0
2026-03-28 14:03:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FHK18KTD%252F697938025%252F600') HTTP/1.1" 204 0
2026-03-28 14:03:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HK18KTD/697938025/600 saved to cache
2026-03-28 14:03:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item a5eb24be-0f0d-5d52-8354-e9c746a38f6e
2026-03-28 14:03:39 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HK18KTD/697938058/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=697938058>
2026-03-28 14:03:39 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NX20NZM/698953131/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698953131>
2026-03-28 14:03:39 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HK18KTD/697938073/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=697938073>
2026-03-28 14:03:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NX20NZM/698953115/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/NX20NZM/42810603?sv=2020-08-04&st=2026-03-28T14%3A03%3A37Z&se=2026-03-28T14%3A28%3A37Z&sr=b&sp=r&sig=noQVKz9rflNOt5fdZMxrPau22%2Fg%2FxxIMhBlTaw8V7tU%3D)
2026-03-28 14:03:39 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NX20NZM/698970573/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698970573>
2026-03-28 14:03:39 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NX20NZM/698970557/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698970557>
2026-03-28 14:03:39 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PY71HPP/698282722/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698282722>
2026-03-28 14:03:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SC69SYA/698556208/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/SC69SYA/42810321?sv=2020-08-04&st=2026-03-28T14%3A03%3A33Z&se=2026-03-28T14%3A28%3A33Z&sr=b&sp=r&sig=pg%2FWEb5rIOUIFGT2mUm39zJu%2F6eH7ZOCdfShXQuFo%2Bo%3D)
2026-03-28 14:03:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:03:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2d78c190>
2026-03-28 14:03:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:03:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:03:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:03:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_24a9472e-5aa6-51b8-909f-9ce395651227/24a9472e-5aa6-51b8-909f-9ce395651227_image_0.jpg HTTP/1.1" 201 0
2026-03-28 14:03:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FNX20NZM%252F698970532%252F600') HTTP/1.1" 204 0
2026-03-28 14:03:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NX20NZM/698970532/600 saved to cache
2026-03-28 14:03:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 24a9472e-5aa6-51b8-909f-9ce395651227
2026-03-28 14:03:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:03:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2ca0fd10>
2026-03-28 14:03:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:03:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:03:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:03:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0943e31d-5a39-5fc7-b0f9-f571748a60fc/0943e31d-5a39-5fc7-b0f9-f571748a60fc_image_4.jpg HTTP/1.1" 201 0
2026-03-28 14:03:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FSC69SYA%252F698556175%252F600') HTTP/1.1" 204 0
2026-03-28 14:03:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SC69SYA/698556175/600 saved to cache
2026-03-28 14:03:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 0943e31d-5a39-5fc7-b0f9-f571748a60fc
2026-03-28 14:03:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NX20NZM/698970550/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/NX20NZM/42810603?sv=2020-08-04&st=2026-03-28T14%3A03%3A37Z&se=2026-03-28T14%3A28%3A37Z&sr=b&sp=r&sig=noQVKz9rflNOt5fdZMxrPau22%2Fg%2FxxIMhBlTaw8V7tU%3D)
2026-03-28 14:03:39 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NX20NZM/698970588/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698970588>
2026-03-28 14:03:39 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NX20NZM/698953146/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698953146>
2026-03-28 14:03:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SC69SYA/698556237/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/SC69SYA/42810321?sv=2020-08-04&st=2026-03-28T14%3A03%3A33Z&se=2026-03-28T14%3A28%3A33Z&sr=b&sp=r&sig=pg%2FWEb5rIOUIFGT2mUm39zJu%2F6eH7ZOCdfShXQuFo%2Bo%3D)
2026-03-28 14:03:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:03:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c5e9c50>
2026-03-28 14:03:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:03:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:03:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:03:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_24a9472e-5aa6-51b8-909f-9ce395651227/24a9472e-5aa6-51b8-909f-9ce395651227_image_2.jpg HTTP/1.1" 201 0
2026-03-28 14:03:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FNX20NZM%252F698953115%252F600') HTTP/1.1" 204 0
2026-03-28 14:03:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NX20NZM/698953115/600 saved to cache
2026-03-28 14:03:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 24a9472e-5aa6-51b8-909f-9ce395651227
2026-03-28 14:03:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SC69SYA/698556191/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/SC69SYA/42810321?sv=2020-08-04&st=2026-03-28T14%3A03%3A33Z&se=2026-03-28T14%3A28%3A33Z&sr=b&sp=r&sig=pg%2FWEb5rIOUIFGT2mUm39zJu%2F6eH7ZOCdfShXQuFo%2Bo%3D)
2026-03-28 14:03:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SC69SYA/698556222/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/SC69SYA/42810321?sv=2020-08-04&st=2026-03-28T14%3A03%3A33Z&se=2026-03-28T14%3A28%3A33Z&sr=b&sp=r&sig=pg%2FWEb5rIOUIFGT2mUm39zJu%2F6eH7ZOCdfShXQuFo%2Bo%3D)
2026-03-28 14:03:39 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:03:39 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:03:39 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:03:39 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:03:39 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:03:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:03:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c4afd50>
2026-03-28 14:03:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:03:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:03:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:03:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0943e31d-5a39-5fc7-b0f9-f571748a60fc/0943e31d-5a39-5fc7-b0f9-f571748a60fc_image_6.jpg HTTP/1.1" 201 0
2026-03-28 14:03:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FSC69SYA%252F698556208%252F600') HTTP/1.1" 204 0
2026-03-28 14:03:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SC69SYA/698556208/600 saved to cache
2026-03-28 14:03:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 0943e31d-5a39-5fc7-b0f9-f571748a60fc
2026-03-28 14:03:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NX20NZM/698953131/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/NX20NZM/42810603?sv=2020-08-04&st=2026-03-28T14%3A03%3A37Z&se=2026-03-28T14%3A28%3A37Z&sr=b&sp=r&sig=noQVKz9rflNOt5fdZMxrPau22%2Fg%2FxxIMhBlTaw8V7tU%3D)
2026-03-28 14:03:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SC69SYA/698556249/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/SC69SYA/42810321?sv=2020-08-04&st=2026-03-28T14%3A03%3A33Z&se=2026-03-28T14%3A28%3A33Z&sr=b&sp=r&sig=pg%2FWEb5rIOUIFGT2mUm39zJu%2F6eH7ZOCdfShXQuFo%2Bo%3D)
2026-03-28 14:03:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HK18KTD/697938073/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/HK18KTD/42810169?sv=2020-08-04&st=2026-03-28T14%3A03%3A33Z&se=2026-03-28T14%3A28%3A33Z&sr=b&sp=r&sig=hkLnkSG275tljEq5qfSoK1jC3apnwlGnB%2Bpsv17q5aQ%3D)
2026-03-28 14:03:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:03:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c9d7c10>
2026-03-28 14:03:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:03:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:03:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:03:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_24a9472e-5aa6-51b8-909f-9ce395651227/24a9472e-5aa6-51b8-909f-9ce395651227_image_1.jpg HTTP/1.1" 201 0
2026-03-28 14:03:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FNX20NZM%252F698970550%252F600') HTTP/1.1" 204 0
2026-03-28 14:03:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NX20NZM/698970550/600 saved to cache
2026-03-28 14:03:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 24a9472e-5aa6-51b8-909f-9ce395651227
2026-03-28 14:03:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PY71HPP/698282722/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/PY71HPP/42810351?sv=2020-08-04&st=2026-03-28T14%3A03%3A33Z&se=2026-03-28T14%3A28%3A33Z&sr=b&sp=r&sig=VE6%2By8gOfvgKf8XGgsgtB7SRVaoWu2GIM9gpf%2BgtWPI%3D)
2026-03-28 14:03:39 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NX20NZM/698970604/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698970604>
2026-03-28 14:03:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NX20NZM/698970573/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/NX20NZM/42810603?sv=2020-08-04&st=2026-03-28T14%3A03%3A37Z&se=2026-03-28T14%3A28%3A37Z&sr=b&sp=r&sig=noQVKz9rflNOt5fdZMxrPau22%2Fg%2FxxIMhBlTaw8V7tU%3D)
2026-03-28 14:03:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HK18KTD/697938058/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/HK18KTD/42810169?sv=2020-08-04&st=2026-03-28T14%3A03%3A33Z&se=2026-03-28T14%3A28%3A33Z&sr=b&sp=r&sig=hkLnkSG275tljEq5qfSoK1jC3apnwlGnB%2Bpsv17q5aQ%3D)
2026-03-28 14:03:39 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:03:39 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:03:39 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:03:39 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:03:39 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:03:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:03:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c4ba0d0>
2026-03-28 14:03:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:03:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:03:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:03:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0943e31d-5a39-5fc7-b0f9-f571748a60fc/0943e31d-5a39-5fc7-b0f9-f571748a60fc_image_8.jpg HTTP/1.1" 201 0
2026-03-28 14:03:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FSC69SYA%252F698556237%252F600') HTTP/1.1" 204 0
2026-03-28 14:03:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SC69SYA/698556237/600 saved to cache
2026-03-28 14:03:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 0943e31d-5a39-5fc7-b0f9-f571748a60fc
2026-03-28 14:03:39 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NX20NZM/698953162/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698953162>
2026-03-28 14:03:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NX20NZM/698970557/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/NX20NZM/42810603?sv=2020-08-04&st=2026-03-28T14%3A03%3A37Z&se=2026-03-28T14%3A28%3A37Z&sr=b&sp=r&sig=noQVKz9rflNOt5fdZMxrPau22%2Fg%2FxxIMhBlTaw8V7tU%3D)
2026-03-28 14:03:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:03:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2d684310>
2026-03-28 14:03:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:03:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:03:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:03:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0943e31d-5a39-5fc7-b0f9-f571748a60fc/0943e31d-5a39-5fc7-b0f9-f571748a60fc_image_5.jpg HTTP/1.1" 201 0
2026-03-28 14:03:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FSC69SYA%252F698556191%252F600') HTTP/1.1" 204 0
2026-03-28 14:03:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SC69SYA/698556191/600 saved to cache
2026-03-28 14:03:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 0943e31d-5a39-5fc7-b0f9-f571748a60fc
2026-03-28 14:03:39 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:03:39 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:03:39 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:03:39 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:03:39 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:03:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:03:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c628bd0>
2026-03-28 14:03:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:03:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:03:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:03:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0943e31d-5a39-5fc7-b0f9-f571748a60fc/0943e31d-5a39-5fc7-b0f9-f571748a60fc_image_7.jpg HTTP/1.1" 201 0
2026-03-28 14:03:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FSC69SYA%252F698556222%252F600') HTTP/1.1" 204 0
2026-03-28 14:03:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SC69SYA/698556222/600 saved to cache
2026-03-28 14:03:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 0943e31d-5a39-5fc7-b0f9-f571748a60fc
2026-03-28 14:03:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NX20NZM/698970588/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/NX20NZM/42810603?sv=2020-08-04&st=2026-03-28T14%3A03%3A37Z&se=2026-03-28T14%3A28%3A37Z&sr=b&sp=r&sig=noQVKz9rflNOt5fdZMxrPau22%2Fg%2FxxIMhBlTaw8V7tU%3D)
2026-03-28 14:03:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NX20NZM/698953146/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/NX20NZM/42810603?sv=2020-08-04&st=2026-03-28T14%3A03%3A37Z&se=2026-03-28T14%3A28%3A37Z&sr=b&sp=r&sig=noQVKz9rflNOt5fdZMxrPau22%2Fg%2FxxIMhBlTaw8V7tU%3D)
2026-03-28 14:03:39 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PY71HPP/698282718/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698282718>
2026-03-28 14:03:39 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PY71HPP/698282715/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698282715>
2026-03-28 14:03:39 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HK18KTD/697938040/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=697938040>
2026-03-28 14:03:39 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PY71HPP/698282721/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698282721>
2026-03-28 14:03:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:03:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c505a10>
2026-03-28 14:03:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:03:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:03:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:03:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_24a9472e-5aa6-51b8-909f-9ce395651227/24a9472e-5aa6-51b8-909f-9ce395651227_image_4.jpg HTTP/1.1" 201 0
2026-03-28 14:03:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FNX20NZM%252F698953131%252F600') HTTP/1.1" 204 0
2026-03-28 14:03:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NX20NZM/698953131/600 saved to cache
2026-03-28 14:03:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 24a9472e-5aa6-51b8-909f-9ce395651227
2026-03-28 14:03:39 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:03:39 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:03:39 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:03:39 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:03:39 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:03:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:03:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a3008de10>
2026-03-28 14:03:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:03:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:03:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:03:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0943e31d-5a39-5fc7-b0f9-f571748a60fc/0943e31d-5a39-5fc7-b0f9-f571748a60fc_image_9.jpg HTTP/1.1" 201 0
2026-03-28 14:03:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FSC69SYA%252F698556249%252F600') HTTP/1.1" 204 0
2026-03-28 14:03:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SC69SYA/698556249/600 saved to cache
2026-03-28 14:03:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 0943e31d-5a39-5fc7-b0f9-f571748a60fc
2026-03-28 14:03:39 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:03:39 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:03:39 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:03:39 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:03:39 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:03:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:03:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a1fd5b3d0>
2026-03-28 14:03:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:03:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:03:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:03:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a5eb24be-0f0d-5d52-8354-e9c746a38f6e/a5eb24be-0f0d-5d52-8354-e9c746a38f6e_image_9.jpg HTTP/1.1" 201 0
2026-03-28 14:03:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FHK18KTD%252F697938073%252F600') HTTP/1.1" 204 0
2026-03-28 14:03:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HK18KTD/697938073/600 saved to cache
2026-03-28 14:03:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item a5eb24be-0f0d-5d52-8354-e9c746a38f6e
2026-03-28 14:03:39 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:03:39 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:03:39 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:03:39 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:03:39 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:03:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:03:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a1fd5ab90>
2026-03-28 14:03:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:03:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:03:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:03:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c02444db-1872-560a-9a4f-c32517c42d55/c02444db-1872-560a-9a4f-c32517c42d55_image_9.jpg HTTP/1.1" 201 0
2026-03-28 14:03:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FPY71HPP%252F698282722%252F600') HTTP/1.1" 204 0
2026-03-28 14:03:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PY71HPP/698282722/600 saved to cache
2026-03-28 14:03:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item c02444db-1872-560a-9a4f-c32517c42d55
2026-03-28 14:03:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:03:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2de0fd10>
2026-03-28 14:03:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:03:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:03:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:03:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_24a9472e-5aa6-51b8-909f-9ce395651227/24a9472e-5aa6-51b8-909f-9ce395651227_image_5.jpg HTTP/1.1" 201 0
2026-03-28 14:03:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FNX20NZM%252F698970573%252F600') HTTP/1.1" 204 0
2026-03-28 14:03:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NX20NZM/698970573/600 saved to cache
2026-03-28 14:03:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 24a9472e-5aa6-51b8-909f-9ce395651227
2026-03-28 14:03:39 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:03:39 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:03:39 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:03:39 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:03:39 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:03:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:03:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c67aa90>
2026-03-28 14:03:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:03:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:03:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:03:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a5eb24be-0f0d-5d52-8354-e9c746a38f6e/a5eb24be-0f0d-5d52-8354-e9c746a38f6e_image_8.jpg HTTP/1.1" 201 0
2026-03-28 14:03:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FHK18KTD%252F697938058%252F600') HTTP/1.1" 204 0
2026-03-28 14:03:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HK18KTD/697938058/600 saved to cache
2026-03-28 14:03:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item a5eb24be-0f0d-5d52-8354-e9c746a38f6e
2026-03-28 14:03:39 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PY71HPP/698282712/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698282712>
2026-03-28 14:03:39 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SC69SYA/698556127/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=SC69SYA-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-28 14:03:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NX20NZM/698953162/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/NX20NZM/42810603?sv=2020-08-04&st=2026-03-28T14%3A03%3A37Z&se=2026-03-28T14%3A28%3A37Z&sr=b&sp=r&sig=noQVKz9rflNOt5fdZMxrPau22%2Fg%2FxxIMhBlTaw8V7tU%3D)
2026-03-28 14:03:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NX20NZM/698970604/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/NX20NZM/42810603?sv=2020-08-04&st=2026-03-28T14%3A03%3A37Z&se=2026-03-28T14%3A28%3A37Z&sr=b&sp=r&sig=noQVKz9rflNOt5fdZMxrPau22%2Fg%2FxxIMhBlTaw8V7tU%3D)
2026-03-28 14:03:39 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MJ03HOW/698444377/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698444377>
2026-03-28 14:03:39 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HK18KTD/697937999/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=697937999>
2026-03-28 14:03:39 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DP19FWW/698227066/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698227066>
2026-03-28 14:03:39 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PY71HPP/698282710/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698282710>
2026-03-28 14:03:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.bca.co.uk/api/search?q=&pageSize=100&page=4&sort=MostRecentlyAdded> (referer: https://www.bca.co.uk/search) ['zyte-api']
2026-03-28 14:03:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:03:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c7155d0>
2026-03-28 14:03:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:03:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:03:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:03:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_24a9472e-5aa6-51b8-909f-9ce395651227/24a9472e-5aa6-51b8-909f-9ce395651227_image_3.jpg HTTP/1.1" 201 0
2026-03-28 14:03:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FNX20NZM%252F698970557%252F600') HTTP/1.1" 204 0
2026-03-28 14:03:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NX20NZM/698970557/600 saved to cache
2026-03-28 14:03:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 24a9472e-5aa6-51b8-909f-9ce395651227
2026-03-28 14:03:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:03:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c5e2590>
2026-03-28 14:03:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:03:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:03:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:03:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_24a9472e-5aa6-51b8-909f-9ce395651227/24a9472e-5aa6-51b8-909f-9ce395651227_image_7.jpg HTTP/1.1" 201 0
2026-03-28 14:03:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FNX20NZM%252F698970588%252F600') HTTP/1.1" 204 0
2026-03-28 14:03:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NX20NZM/698970588/600 saved to cache
2026-03-28 14:03:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 24a9472e-5aa6-51b8-909f-9ce395651227
2026-03-28 14:03:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:03:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a1ff2c790>
2026-03-28 14:03:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:03:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:03:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:03:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_24a9472e-5aa6-51b8-909f-9ce395651227/24a9472e-5aa6-51b8-909f-9ce395651227_image_6.jpg HTTP/1.1" 201 0
2026-03-28 14:03:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FNX20NZM%252F698953146%252F600') HTTP/1.1" 204 0
2026-03-28 14:03:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NX20NZM/698953146/600 saved to cache
2026-03-28 14:03:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 24a9472e-5aa6-51b8-909f-9ce395651227
2026-03-28 14:03:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:03:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c6f0fd0>
2026-03-28 14:03:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:03:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:03:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:03:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_24a9472e-5aa6-51b8-909f-9ce395651227/24a9472e-5aa6-51b8-909f-9ce395651227_image_8.jpg HTTP/1.1" 201 0
2026-03-28 14:03:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FNX20NZM%252F698953162%252F600') HTTP/1.1" 204 0
2026-03-28 14:03:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NX20NZM/698953162/600 saved to cache
2026-03-28 14:03:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 24a9472e-5aa6-51b8-909f-9ce395651227
2026-03-28 14:03:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:03:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2de56410>
2026-03-28 14:03:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:03:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:03:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:03:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_24a9472e-5aa6-51b8-909f-9ce395651227/24a9472e-5aa6-51b8-909f-9ce395651227_image_9.jpg HTTP/1.1" 201 0
2026-03-28 14:03:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FNX20NZM%252F698970604%252F600') HTTP/1.1" 204 0
2026-03-28 14:03:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NX20NZM/698970604/600 saved to cache
2026-03-28 14:03:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 24a9472e-5aa6-51b8-909f-9ce395651227
2026-03-28 14:03:39 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 24a9472e-5aa6-51b8-909f-9ce395651227, skipping ID generation
2026-03-28 14:03:39 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 24a9472e-5aa6-51b8-909f-9ce395651227 sending to next pipeline
2026-03-28 14:03:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 24a9472e-5aa6-51b8-909f-9ce395651227, identifier: NX20%20NZM
2026-03-28 14:03:40 [bca.uk] INFO: Total items found: 100
2026-03-28 14:03:40 [bca.uk] INFO: Requesting URL: https://www.bca.co.uk/api/search?q=&pageSize=100&page=5&sort=MostRecentlyAdded
2026-03-28 14:03:40 [bca.uk] INFO: Sending search API request with Bearer token (length=1492)
2026-03-28 14:03:40 [scrapy_zyte_api._params] WARNING: Request <GET https://www.bca.co.uk/api/search?q=&pageSize=100&page=5&sort=MostRecentlyAdded> defines the Zyte API customHttpRequestHeaders parameter, overriding Request.headers. Use Request.headers instead.
2026-03-28 14:03:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 24a9472e-5aa6-51b8-909f-9ce395651227 with identifier: NX20%20NZM
2026-03-28 14:03:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 24a9472e-5aa6-51b8-909f-9ce395651227 with identifier: NX20%20NZM
2026-03-28 14:03:40 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 24a9472e-5aa6-51b8-909f-9ce395651227 with identifier: NX20%20NZM to the API
2026-03-28 14:03:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:03:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:03:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NX20NZM/698970604/600>
{'auction_title': '',
'c_o_2_emission_value': 140,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_24a9472e-5aa6-51b8-909f-9ce395651227/24a9472e-5aa6-51b8-909f-9ce395651227_expert_report_file_ecf944a5-1e15-4afb-b01d-85e1c008dd67.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=NX20%20NZM-GB',
'category': 'Car',
'color': 'black',
'currency': 'GBP',
'doors_number': 5,
'engine': '2.0L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Diesel',
'id': '24a9472e-5aa6-51b8-909f-9ce395651227',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'NX20 NZM',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=NX20%20NZM&vehicleType=*',
'listing': 'auction',
'location': 'Paddock Wood',
'make': 'LAND ROVER',
'model': 'DISCOVERY SPORT',
'odometer': 52861,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 16,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_24a9472e-5aa6-51b8-909f-9ce395651227/24a9472e-5aa6-51b8-909f-9ce395651227_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 49089,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NX20NZM/698970532/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_24a9472e-5aa6-51b8-909f-9ce395651227/24a9472e-5aa6-51b8-909f-9ce395651227_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 47303,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NX20NZM/698970550/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_24a9472e-5aa6-51b8-909f-9ce395651227/24a9472e-5aa6-51b8-909f-9ce395651227_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 52842,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NX20NZM/698953115/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_24a9472e-5aa6-51b8-909f-9ce395651227/24a9472e-5aa6-51b8-909f-9ce395651227_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 44323,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NX20NZM/698970557/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_24a9472e-5aa6-51b8-909f-9ce395651227/24a9472e-5aa6-51b8-909f-9ce395651227_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 49901,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NX20NZM/698953131/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_24a9472e-5aa6-51b8-909f-9ce395651227/24a9472e-5aa6-51b8-909f-9ce395651227_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 42932,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NX20NZM/698970573/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_24a9472e-5aa6-51b8-909f-9ce395651227/24a9472e-5aa6-51b8-909f-9ce395651227_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 48357,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NX20NZM/698953146/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_24a9472e-5aa6-51b8-909f-9ce395651227/24a9472e-5aa6-51b8-909f-9ce395651227_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 40082,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NX20NZM/698970588/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_24a9472e-5aa6-51b8-909f-9ce395651227/24a9472e-5aa6-51b8-909f-9ce395651227_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 46878,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NX20NZM/698953162/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_24a9472e-5aa6-51b8-909f-9ce395651227/24a9472e-5aa6-51b8-909f-9ce395651227_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 40027,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NX20NZM/698970604/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-01-01',
'seller_name': None,
'title': 'LAND ROVER DISCOVERY SPORT 2.0 D150 2WD (5ST) StationWagon',
'transmission': 'manual',
'trim': 'D150 2WD (5ST)',
'vin': 'SALCB2CN3LH862606',
'year': 2020}
2026-03-28 14:03:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27NX20%2520NZM%27 HTTP/1.1" 200 None
2026-03-28 14:03:41 [bca.uk] INFO: Saving data for NX20%20NZM: {'created_time': 1774706621.026302, 'last_price_update_time': 1774706621.026313, 'auction_closing_time': 1774864800.0}
2026-03-28 14:03:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='NX20%2520NZM') HTTP/1.1" 204 0
2026-03-28 14:03:41 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FY68WNB/698106324/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698106324>
2026-03-28 14:03:41 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/OV64PLN/698953411/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698953411>
2026-03-28 14:03:41 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EJ13JTO/698540241/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698540241>
2026-03-28 14:03:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HK18KTD/697938040/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/HK18KTD/42810169?sv=2020-08-04&st=2026-03-28T14%3A03%3A33Z&se=2026-03-28T14%3A28%3A33Z&sr=b&sp=r&sig=hkLnkSG275tljEq5qfSoK1jC3apnwlGnB%2Bpsv17q5aQ%3D)
2026-03-28 14:03:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PY71HPP/698282710/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/PY71HPP/42810351?sv=2020-08-04&st=2026-03-28T14%3A03%3A33Z&se=2026-03-28T14%3A28%3A33Z&sr=b&sp=r&sig=VE6%2By8gOfvgKf8XGgsgtB7SRVaoWu2GIM9gpf%2BgtWPI%3D)
2026-03-28 14:03:41 [bca.uk] INFO: Found listing with ID: FE19%20XYC
2026-03-28 14:03:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FE19%2520XYC%27 HTTP/1.1" 200 None
2026-03-28 14:03:41 [bca.uk] INFO: Scrape type for FE19%20XYC: 0
2026-03-28 14:03:41 [bca.uk] INFO: Found listing with ID: KU19%20CFH
2026-03-28 14:03:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KU19%2520CFH%27 HTTP/1.1" 200 None
2026-03-28 14:03:41 [bca.uk] INFO: Scrape type for KU19%20CFH: 1
2026-03-28 14:03:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b6d51688-b23c-5016-a794-ddfbf11c9378 with identifier: KU19%20CFH
2026-03-28 14:03:41 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item b6d51688-b23c-5016-a794-ddfbf11c9378
2026-03-28 14:03:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PY71HPP/698282721/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/PY71HPP/42810351?sv=2020-08-04&st=2026-03-28T14%3A03%3A33Z&se=2026-03-28T14%3A28%3A33Z&sr=b&sp=r&sig=VE6%2By8gOfvgKf8XGgsgtB7SRVaoWu2GIM9gpf%2BgtWPI%3D)
2026-03-28 14:03:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PY71HPP/698282718/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/PY71HPP/42810351?sv=2020-08-04&st=2026-03-28T14%3A03%3A33Z&se=2026-03-28T14%3A28%3A33Z&sr=b&sp=r&sig=VE6%2By8gOfvgKf8XGgsgtB7SRVaoWu2GIM9gpf%2BgtWPI%3D)
2026-03-28 14:03:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PY71HPP/698282715/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/PY71HPP/42810351?sv=2020-08-04&st=2026-03-28T14%3A03%3A33Z&se=2026-03-28T14%3A28%3A33Z&sr=b&sp=r&sig=VE6%2By8gOfvgKf8XGgsgtB7SRVaoWu2GIM9gpf%2BgtWPI%3D)
2026-03-28 14:03:41 [scrapy_zyte_api._params] WARNING: Request <GET https://www.bca.co.uk/api/search?q=&pageSize=100&page=5&sort=MostRecentlyAdded> defines the Zyte API customHttpRequestHeaders parameter, overriding Request.headers. Use Request.headers instead.
2026-03-28 14:03:41 [scrapy_zyte_api._params] WARNING: Request <GET https://www.bca.co.uk/api/search?q=&pageSize=100&page=5&sort=MostRecentlyAdded> defines the Zyte API customHttpRequestHeaders parameter, overriding Request.headers. Use Request.headers instead.
2026-03-28 14:03:41 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 14:03:41 [bca.uk] INFO: Found listing with ID: CA19%20UTE
2026-03-28 14:03:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27CA19%2520UTE%27 HTTP/1.1" 200 None
2026-03-28 14:03:41 [bca.uk] INFO: Scrape type for CA19%20UTE: 0
2026-03-28 14:03:41 [bca.uk] INFO: Found listing with ID: CK18%20AOC
2026-03-28 14:03:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27CK18%2520AOC%27 HTTP/1.1" 200 None
2026-03-28 14:03:41 [bca.uk] INFO: Scrape type for CK18%20AOC: 2
2026-03-28 14:03:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 77713015-1cd1-57e4-833d-9e8195003af4 with identifier: CK18%20AOC
2026-03-28 14:03:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 77713015-1cd1-57e4-833d-9e8195003af4 with scrape type 2
2026-03-28 14:03:41 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 77713015-1cd1-57e4-833d-9e8195003af4 with scrape type 2
2026-03-28 14:03:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 77713015-1cd1-57e4-833d-9e8195003af4, identifier: CK18%20AOC
2026-03-28 14:03:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 77713015-1cd1-57e4-833d-9e8195003af4 with identifier: CK18%20AOC
2026-03-28 14:03:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 77713015-1cd1-57e4-833d-9e8195003af4 with identifier: CK18%20AOC
2026-03-28 14:03:41 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 77713015-1cd1-57e4-833d-9e8195003af4 with identifier: CK18%20AOC to the API
2026-03-28 14:03:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:03:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:03:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=4&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 169,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=CK18%20AOC-GB',
'category': 'Car',
'color': 'silver',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.6L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol',
'id': '77713015-1cd1-57e4-833d-9e8195003af4',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'CK18 AOC',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=CK18%20AOC&vehicleType=*',
'listing': 'auction',
'location': 'Bristol',
'make': 'KIA',
'model': 'SPORTAGE',
'odometer': 65368,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-01-01',
'seller_name': None,
'title': 'KIA SPORTAGE 1.6 T GDI GT-LINE StationWagon',
'transmission': 'manual',
'trim': 'T GDI GT-LINE',
'vin': 'U5YPK816LJL540601',
'year': 2018}
2026-03-28 14:03:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27CK18%2520AOC%27 HTTP/1.1" 200 None
2026-03-28 14:03:41 [bca.uk] INFO: Saving data for CK18%20AOC: {'auction_closing_time': 1774864800.0, 'created_time': 1774477594.222833, 'last_price_update_time': 1774706621.690531}
2026-03-28 14:03:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='CK18%2520AOC') HTTP/1.1" 204 0
2026-03-28 14:03:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MJ03HOW/698444377/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/MJ03HOW/42810316?sv=2020-08-04&st=2026-03-28T14%3A01%3A04Z&se=2026-03-28T14%3A26%3A04Z&sr=b&sp=r&sig=72R4f35YDQDGGwN55srQJ3YRSQrnD%2FGMmCWnMvmfOLc%3D)
2026-03-28 14:03:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SC69SYA/698556127/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/SC69SYA/42810321?sv=2020-08-04&st=2026-03-28T14%3A03%3A33Z&se=2026-03-28T14%3A28%3A33Z&sr=b&sp=r&sig=pg%2FWEb5rIOUIFGT2mUm39zJu%2F6eH7ZOCdfShXQuFo%2Bo%3D)
2026-03-28 14:03:41 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VX19OYP/698251041/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698251041>
2026-03-28 14:03:41 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YH13CHD/698786525/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698786525>
2026-03-28 14:03:41 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KV60ZZA/698934365/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698934365>
2026-03-28 14:03:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PY71HPP/698282712/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/PY71HPP/42810351?sv=2020-08-04&st=2026-03-28T14%3A03%3A33Z&se=2026-03-28T14%3A28%3A33Z&sr=b&sp=r&sig=VE6%2By8gOfvgKf8XGgsgtB7SRVaoWu2GIM9gpf%2BgtWPI%3D)
2026-03-28 14:03:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DP19FWW/698227066/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/DP19FWW/42810375?sv=2020-08-04&st=2026-03-28T14%3A01%3A04Z&se=2026-03-28T14%3A26%3A04Z&sr=b&sp=r&sig=DYlHwmmm%2BkuE1QC9GfsRlnyT74V8OO0Bfy5POGMlRcU%3D)
2026-03-28 14:03:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HK18KTD/697937999/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/HK18KTD/42810169?sv=2020-08-04&st=2026-03-28T14%3A03%3A33Z&se=2026-03-28T14%3A28%3A33Z&sr=b&sp=r&sig=hkLnkSG275tljEq5qfSoK1jC3apnwlGnB%2Bpsv17q5aQ%3D)
2026-03-28 14:03:41 [bca.uk] INFO: Found listing with ID: FV17%20TYW
2026-03-28 14:03:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FV17%2520TYW%27 HTTP/1.1" 200 None
2026-03-28 14:03:41 [bca.uk] INFO: Scrape type for FV17%20TYW: 1
2026-03-28 14:03:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d7b30cd7-3fb2-520c-9629-4539584c6e2c with identifier: FV17%20TYW
2026-03-28 14:03:41 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item d7b30cd7-3fb2-520c-9629-4539584c6e2c
2026-03-28 14:03:41 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:03:41 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:03:41 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:03:41 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:03:41 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:03:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:03:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c6c64d0>
2026-03-28 14:03:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:03:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:03:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:03:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a5eb24be-0f0d-5d52-8354-e9c746a38f6e/a5eb24be-0f0d-5d52-8354-e9c746a38f6e_image_7.jpg HTTP/1.1" 201 0
2026-03-28 14:03:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FHK18KTD%252F697938040%252F600') HTTP/1.1" 204 0
2026-03-28 14:03:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HK18KTD/697938040/600 saved to cache
2026-03-28 14:03:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item a5eb24be-0f0d-5d52-8354-e9c746a38f6e
2026-03-28 14:03:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:03:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c6e4110>
2026-03-28 14:03:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:03:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:03:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:03:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c02444db-1872-560a-9a4f-c32517c42d55/c02444db-1872-560a-9a4f-c32517c42d55_image_4.jpg HTTP/1.1" 201 0
2026-03-28 14:03:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FPY71HPP%252F698282710%252F600') HTTP/1.1" 204 0
2026-03-28 14:03:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PY71HPP/698282710/600 saved to cache
2026-03-28 14:03:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item c02444db-1872-560a-9a4f-c32517c42d55
2026-03-28 14:03:41 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:03:41 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:03:41 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:03:41 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:03:41 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:03:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:03:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c620cd0>
2026-03-28 14:03:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:03:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:03:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:03:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c02444db-1872-560a-9a4f-c32517c42d55/c02444db-1872-560a-9a4f-c32517c42d55_image_8.jpg HTTP/1.1" 201 0
2026-03-28 14:03:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FPY71HPP%252F698282721%252F600') HTTP/1.1" 204 0
2026-03-28 14:03:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PY71HPP/698282721/600 saved to cache
2026-03-28 14:03:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item c02444db-1872-560a-9a4f-c32517c42d55
2026-03-28 14:03:41 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:03:41 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:03:41 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:03:41 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:03:41 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:03:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:03:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c621a90>
2026-03-28 14:03:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:03:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:03:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:03:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c02444db-1872-560a-9a4f-c32517c42d55/c02444db-1872-560a-9a4f-c32517c42d55_image_7.jpg HTTP/1.1" 201 0
2026-03-28 14:03:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FPY71HPP%252F698282718%252F600') HTTP/1.1" 204 0
2026-03-28 14:03:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PY71HPP/698282718/600 saved to cache
2026-03-28 14:03:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item c02444db-1872-560a-9a4f-c32517c42d55
2026-03-28 14:03:41 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:03:41 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:03:41 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:03:41 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:03:41 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:03:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:03:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c844e10>
2026-03-28 14:03:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:03:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:03:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:03:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c02444db-1872-560a-9a4f-c32517c42d55/c02444db-1872-560a-9a4f-c32517c42d55_image_6.jpg HTTP/1.1" 201 0
2026-03-28 14:03:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FPY71HPP%252F698282715%252F600') HTTP/1.1" 204 0
2026-03-28 14:03:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PY71HPP/698282715/600 saved to cache
2026-03-28 14:03:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item c02444db-1872-560a-9a4f-c32517c42d55
2026-03-28 14:03:42 [bca.uk] INFO: Found listing with ID: FY66%20OTD
2026-03-28 14:03:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FY66%2520OTD%27 HTTP/1.1" 200 None
2026-03-28 14:03:42 [bca.uk] INFO: Scrape type for FY66%20OTD: 1
2026-03-28 14:03:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 40999011-32af-5ad3-a840-4cb8242ff02a with identifier: FY66%20OTD
2026-03-28 14:03:42 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 40999011-32af-5ad3-a840-4cb8242ff02a
2026-03-28 14:03:42 [bca.uk] INFO: Found listing with ID: GJ65%20TYV
2026-03-28 14:03:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GJ65%2520TYV%27 HTTP/1.1" 200 None
2026-03-28 14:03:42 [bca.uk] INFO: Scrape type for GJ65%20TYV: 2
2026-03-28 14:03:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 364a76e5-5796-5f9e-926c-453a5ccc6978 with identifier: GJ65%20TYV
2026-03-28 14:03:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 364a76e5-5796-5f9e-926c-453a5ccc6978 with scrape type 2
2026-03-28 14:03:42 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 364a76e5-5796-5f9e-926c-453a5ccc6978 with scrape type 2
2026-03-28 14:03:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 364a76e5-5796-5f9e-926c-453a5ccc6978, identifier: GJ65%20TYV
2026-03-28 14:03:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:03:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2ca83ed0>
2026-03-28 14:03:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:03:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:03:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:03:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b75153fa-8bbc-5e83-87eb-81edd908fcda/b75153fa-8bbc-5e83-87eb-81edd908fcda_image_2.jpg HTTP/1.1" 201 0
2026-03-28 14:03:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FMJ03HOW%252F698444377%252F600') HTTP/1.1" 204 0
2026-03-28 14:03:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MJ03HOW/698444377/600 saved to cache
2026-03-28 14:03:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item b75153fa-8bbc-5e83-87eb-81edd908fcda
2026-03-28 14:03:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:03:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c702910>
2026-03-28 14:03:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:03:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:03:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:03:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0943e31d-5a39-5fc7-b0f9-f571748a60fc/0943e31d-5a39-5fc7-b0f9-f571748a60fc_image_0.jpg HTTP/1.1" 201 0
2026-03-28 14:03:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FSC69SYA%252F698556127%252F600') HTTP/1.1" 204 0
2026-03-28 14:03:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SC69SYA/698556127/600 saved to cache
2026-03-28 14:03:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 0943e31d-5a39-5fc7-b0f9-f571748a60fc
2026-03-28 14:03:42 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 0943e31d-5a39-5fc7-b0f9-f571748a60fc, skipping ID generation
2026-03-28 14:03:42 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 0943e31d-5a39-5fc7-b0f9-f571748a60fc sending to next pipeline
2026-03-28 14:03:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 0943e31d-5a39-5fc7-b0f9-f571748a60fc, identifier: SC69%20SYA
2026-03-28 14:03:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:03:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c9f9e90>
2026-03-28 14:03:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:03:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:03:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:03:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c02444db-1872-560a-9a4f-c32517c42d55/c02444db-1872-560a-9a4f-c32517c42d55_image_5.jpg HTTP/1.1" 201 0
2026-03-28 14:03:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FPY71HPP%252F698282712%252F600') HTTP/1.1" 204 0
2026-03-28 14:03:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PY71HPP/698282712/600 saved to cache
2026-03-28 14:03:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item c02444db-1872-560a-9a4f-c32517c42d55
2026-03-28 14:03:42 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: c02444db-1872-560a-9a4f-c32517c42d55, skipping ID generation
2026-03-28 14:03:42 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item c02444db-1872-560a-9a4f-c32517c42d55 sending to next pipeline
2026-03-28 14:03:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: c02444db-1872-560a-9a4f-c32517c42d55, identifier: PY71%20HPP
2026-03-28 14:03:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:03:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c9b0c50>
2026-03-28 14:03:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:03:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:03:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:03:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4b13d468-b932-5891-9e01-a66081b24d30/4b13d468-b932-5891-9e01-a66081b24d30_image_3.jpg HTTP/1.1" 201 0
2026-03-28 14:03:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FDP19FWW%252F698227066%252F600') HTTP/1.1" 204 0
2026-03-28 14:03:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DP19FWW/698227066/600 saved to cache
2026-03-28 14:03:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 4b13d468-b932-5891-9e01-a66081b24d30
2026-03-28 14:03:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:03:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c92c950>
2026-03-28 14:03:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:03:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:03:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:03:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a5eb24be-0f0d-5d52-8354-e9c746a38f6e/a5eb24be-0f0d-5d52-8354-e9c746a38f6e_image_4.jpg HTTP/1.1" 201 0
2026-03-28 14:03:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FHK18KTD%252F697937999%252F600') HTTP/1.1" 204 0
2026-03-28 14:03:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HK18KTD/697937999/600 saved to cache
2026-03-28 14:03:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item a5eb24be-0f0d-5d52-8354-e9c746a38f6e
2026-03-28 14:03:42 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: a5eb24be-0f0d-5d52-8354-e9c746a38f6e, skipping ID generation
2026-03-28 14:03:42 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item a5eb24be-0f0d-5d52-8354-e9c746a38f6e sending to next pipeline
2026-03-28 14:03:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: a5eb24be-0f0d-5d52-8354-e9c746a38f6e, identifier: HK18%20KTD
2026-03-28 14:03:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 364a76e5-5796-5f9e-926c-453a5ccc6978 with identifier: GJ65%20TYV
2026-03-28 14:03:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 364a76e5-5796-5f9e-926c-453a5ccc6978 with identifier: GJ65%20TYV
2026-03-28 14:03:42 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 364a76e5-5796-5f9e-926c-453a5ccc6978 with identifier: GJ65%20TYV to the API
2026-03-28 14:03:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:03:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:03:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=4&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 139,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=GJ65%20TYV-GB',
'category': 'Car',
'color': 'red',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.4L',
'expiration_date': '2026-03-29T10:00:00Z',
'fuel_type': 'Petrol',
'id': '364a76e5-5796-5f9e-926c-453a5ccc6978',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'GJ65 TYV',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=GJ65%20TYV&vehicleType=*',
'listing': 'auction',
'location': 'Bristol',
'make': 'FIAT',
'model': '500X',
'odometer': 73769,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-01-01',
'seller_name': None,
'title': 'FIAT 500X 1.4 M/AIR 140 LOUNGE Hatchback',
'transmission': 'manual',
'trim': 'M/AIR 140 LOUNGE',
'vin': 'ZFA3340000P358952',
'year': 2015}
2026-03-28 14:03:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GJ65%2520TYV%27 HTTP/1.1" 200 None
2026-03-28 14:03:43 [bca.uk] INFO: Saving data for GJ65%20TYV: {'auction_closing_time': 1774778400.0, 'created_time': 1774563325.444815, 'last_price_update_time': 1774706623.97452}
2026-03-28 14:03:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='GJ65%2520TYV') HTTP/1.1" 204 0
2026-03-28 14:03:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 0943e31d-5a39-5fc7-b0f9-f571748a60fc with identifier: SC69%20SYA
2026-03-28 14:03:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 0943e31d-5a39-5fc7-b0f9-f571748a60fc with identifier: SC69%20SYA
2026-03-28 14:03:44 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 0943e31d-5a39-5fc7-b0f9-f571748a60fc with identifier: SC69%20SYA to the API
2026-03-28 14:03:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:03:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:03:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SC69SYA/698556127/600>
{'auction_title': '',
'c_o_2_emission_value': 124,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0943e31d-5a39-5fc7-b0f9-f571748a60fc/0943e31d-5a39-5fc7-b0f9-f571748a60fc_expert_report_file_bf2e855e-7ce6-4eeb-a36f-c445d4c78d18.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=SC69%20SYA-GB',
'category': 'Car',
'color': 'black',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.3L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol',
'id': '0943e31d-5a39-5fc7-b0f9-f571748a60fc',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'SC69 SYA',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=SC69%20SYA&vehicleType=*',
'listing': 'auction',
'location': 'Paddock Wood',
'make': 'MERCEDES-BENZ',
'model': 'A200',
'odometer': 32206,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 11,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0943e31d-5a39-5fc7-b0f9-f571748a60fc/0943e31d-5a39-5fc7-b0f9-f571748a60fc_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 54212,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SC69SYA/698556127/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0943e31d-5a39-5fc7-b0f9-f571748a60fc/0943e31d-5a39-5fc7-b0f9-f571748a60fc_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 52931,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SC69SYA/698556138/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0943e31d-5a39-5fc7-b0f9-f571748a60fc/0943e31d-5a39-5fc7-b0f9-f571748a60fc_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 52781,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SC69SYA/698556153/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0943e31d-5a39-5fc7-b0f9-f571748a60fc/0943e31d-5a39-5fc7-b0f9-f571748a60fc_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 49124,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SC69SYA/698556164/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0943e31d-5a39-5fc7-b0f9-f571748a60fc/0943e31d-5a39-5fc7-b0f9-f571748a60fc_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 44877,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SC69SYA/698556175/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0943e31d-5a39-5fc7-b0f9-f571748a60fc/0943e31d-5a39-5fc7-b0f9-f571748a60fc_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 45357,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SC69SYA/698556191/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0943e31d-5a39-5fc7-b0f9-f571748a60fc/0943e31d-5a39-5fc7-b0f9-f571748a60fc_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 101270,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SC69SYA/698556208/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0943e31d-5a39-5fc7-b0f9-f571748a60fc/0943e31d-5a39-5fc7-b0f9-f571748a60fc_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 81390,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SC69SYA/698556222/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0943e31d-5a39-5fc7-b0f9-f571748a60fc/0943e31d-5a39-5fc7-b0f9-f571748a60fc_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 88373,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SC69SYA/698556237/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0943e31d-5a39-5fc7-b0f9-f571748a60fc/0943e31d-5a39-5fc7-b0f9-f571748a60fc_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 93635,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SC69SYA/698556249/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-01-01',
'seller_name': None,
'title': 'MERCEDES-BENZ A200 1.3 AMG LINE PREMIUM DCT Hatchback',
'transmission': 'automatic',
'trim': 'AMG LINE PREMIUM DCT',
'vin': 'WDD1770872N105814',
'year': 2019}
2026-03-28 14:03:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SC69%2520SYA%27 HTTP/1.1" 200 None
2026-03-28 14:03:44 [bca.uk] INFO: Saving data for SC69%20SYA: {'created_time': 1774706624.365252, 'last_price_update_time': 1774706624.365264, 'auction_closing_time': 1774864800.0}
2026-03-28 14:03:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='SC69%2520SYA') HTTP/1.1" 204 0
2026-03-28 14:03:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: c02444db-1872-560a-9a4f-c32517c42d55 with identifier: PY71%20HPP
2026-03-28 14:03:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: c02444db-1872-560a-9a4f-c32517c42d55 with identifier: PY71%20HPP
2026-03-28 14:03:44 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: c02444db-1872-560a-9a4f-c32517c42d55 with identifier: PY71%20HPP to the API
2026-03-28 14:03:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:03:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:03:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PY71HPP/698282712/600>
{'auction_title': '',
'c_o_2_emission_value': 126,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c02444db-1872-560a-9a4f-c32517c42d55/c02444db-1872-560a-9a4f-c32517c42d55_expert_report_file_6555e351-44f9-48eb-99bc-d9cdff3e0b27.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=PY71%20HPP-GB',
'category': 'Car',
'color': 'silver',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.0L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol',
'id': 'c02444db-1872-560a-9a4f-c32517c42d55',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'PY71 HPP',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=PY71%20HPP&vehicleType=*',
'listing': 'auction',
'location': 'Preston',
'make': 'NISSAN',
'model': 'MICRA',
'odometer': 16401,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 11,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c02444db-1872-560a-9a4f-c32517c42d55/c02444db-1872-560a-9a4f-c32517c42d55_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 43582,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PY71HPP/698282706/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c02444db-1872-560a-9a4f-c32517c42d55/c02444db-1872-560a-9a4f-c32517c42d55_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 43759,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PY71HPP/698282707/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c02444db-1872-560a-9a4f-c32517c42d55/c02444db-1872-560a-9a4f-c32517c42d55_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 43813,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PY71HPP/698282708/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c02444db-1872-560a-9a4f-c32517c42d55/c02444db-1872-560a-9a4f-c32517c42d55_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 41416,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PY71HPP/698282709/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c02444db-1872-560a-9a4f-c32517c42d55/c02444db-1872-560a-9a4f-c32517c42d55_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 41747,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PY71HPP/698282710/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c02444db-1872-560a-9a4f-c32517c42d55/c02444db-1872-560a-9a4f-c32517c42d55_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 40767,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PY71HPP/698282712/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c02444db-1872-560a-9a4f-c32517c42d55/c02444db-1872-560a-9a4f-c32517c42d55_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 76205,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PY71HPP/698282715/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c02444db-1872-560a-9a4f-c32517c42d55/c02444db-1872-560a-9a4f-c32517c42d55_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 70923,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PY71HPP/698282718/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c02444db-1872-560a-9a4f-c32517c42d55/c02444db-1872-560a-9a4f-c32517c42d55_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 84694,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PY71HPP/698282721/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c02444db-1872-560a-9a4f-c32517c42d55/c02444db-1872-560a-9a4f-c32517c42d55_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 81862,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PY71HPP/698282722/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-01-01',
'seller_name': None,
'title': 'NISSAN MICRA 1.0 IG-T 92 TEKNA Hatchback',
'transmission': 'manual',
'trim': 'IG-T 92 TEKNA',
'vin': 'VNVK1400X68761779',
'year': 2022}
2026-03-28 14:03:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27PY71%2520HPP%27 HTTP/1.1" 200 None
2026-03-28 14:03:44 [bca.uk] INFO: Saving data for PY71%20HPP: {'created_time': 1774706624.770789, 'last_price_update_time': 1774706624.770803, 'auction_closing_time': 1774864800.0}
2026-03-28 14:03:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='PY71%2520HPP') HTTP/1.1" 204 0
2026-03-28 14:03:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: a5eb24be-0f0d-5d52-8354-e9c746a38f6e with identifier: HK18%20KTD
2026-03-28 14:03:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: a5eb24be-0f0d-5d52-8354-e9c746a38f6e with identifier: HK18%20KTD
2026-03-28 14:03:44 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: a5eb24be-0f0d-5d52-8354-e9c746a38f6e with identifier: HK18%20KTD to the API
2026-03-28 14:03:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:03:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:03:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HK18KTD/697937999/600>
{'auction_title': '',
'c_o_2_emission_value': 165,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a5eb24be-0f0d-5d52-8354-e9c746a38f6e/a5eb24be-0f0d-5d52-8354-e9c746a38f6e_expert_report_file_a2775be7-3f58-49a7-a32c-5f4f8a630ff1.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=HK18%20KTD-GB',
'category': 'Car',
'color': 'white',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.6L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol',
'id': 'a5eb24be-0f0d-5d52-8354-e9c746a38f6e',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'HK18 KTD',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=HK18%20KTD&vehicleType=*',
'listing': 'auction',
'location': 'Leeds',
'make': 'HYUNDAI',
'model': 'TUCSON',
'odometer': 49383,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 11,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a5eb24be-0f0d-5d52-8354-e9c746a38f6e/a5eb24be-0f0d-5d52-8354-e9c746a38f6e_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 41437,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HK18KTD/697937949/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a5eb24be-0f0d-5d52-8354-e9c746a38f6e/a5eb24be-0f0d-5d52-8354-e9c746a38f6e_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 40943,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HK18KTD/697937961/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a5eb24be-0f0d-5d52-8354-e9c746a38f6e/a5eb24be-0f0d-5d52-8354-e9c746a38f6e_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 39654,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HK18KTD/697937974/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a5eb24be-0f0d-5d52-8354-e9c746a38f6e/a5eb24be-0f0d-5d52-8354-e9c746a38f6e_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 38487,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HK18KTD/697937984/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a5eb24be-0f0d-5d52-8354-e9c746a38f6e/a5eb24be-0f0d-5d52-8354-e9c746a38f6e_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 38862,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HK18KTD/697937999/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a5eb24be-0f0d-5d52-8354-e9c746a38f6e/a5eb24be-0f0d-5d52-8354-e9c746a38f6e_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 37257,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HK18KTD/697938008/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a5eb24be-0f0d-5d52-8354-e9c746a38f6e/a5eb24be-0f0d-5d52-8354-e9c746a38f6e_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 66907,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HK18KTD/697938025/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a5eb24be-0f0d-5d52-8354-e9c746a38f6e/a5eb24be-0f0d-5d52-8354-e9c746a38f6e_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 62079,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HK18KTD/697938040/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a5eb24be-0f0d-5d52-8354-e9c746a38f6e/a5eb24be-0f0d-5d52-8354-e9c746a38f6e_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 73777,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HK18KTD/697938058/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a5eb24be-0f0d-5d52-8354-e9c746a38f6e/a5eb24be-0f0d-5d52-8354-e9c746a38f6e_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 74195,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HK18KTD/697938073/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-01-01',
'seller_name': None,
'title': 'HYUNDAI TUCSON 1.6 T-GDI 177 2WD GO SE DCT StationWagon',
'transmission': 'automatic',
'trim': 'T-GDI 177 2WD GO SE DCT',
'vin': 'TMAJ3812VJJ626952',
'year': 2018}
2026-03-28 14:03:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27HK18%2520KTD%27 HTTP/1.1" 200 None
2026-03-28 14:03:45 [bca.uk] INFO: Saving data for HK18%20KTD: {'created_time': 1774706625.224774, 'last_price_update_time': 1774706625.224789, 'auction_closing_time': 1774864800.0}
2026-03-28 14:03:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='HK18%2520KTD') HTTP/1.1" 204 0
2026-03-28 14:03:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/OV64PLN/698953411/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/OV64PLN/42810653?sv=2020-08-04&st=2026-03-28T14%3A01%3A03Z&se=2026-03-28T14%3A26%3A03Z&sr=b&sp=r&sig=APMfuiYXypC%2F8k81EUjJVNUqGlQEUGUldS81rN8I%2FN0%3D)
2026-03-28 14:03:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FY68WNB/698106324/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/FY68WNB/42810373?sv=2020-08-04&st=2026-03-28T14%3A01%3A04Z&se=2026-03-28T14%3A26%3A04Z&sr=b&sp=r&sig=H2pJB0hzNCFCiICFkGnSt1gr2sn1tExob5yrsc4d3Vs%3D)
2026-03-28 14:03:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EJ13JTO/698540241/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/EJ13JTO/42810382?sv=2020-08-04&st=2026-03-28T14%3A01%3A03Z&se=2026-03-28T14%3A26%3A03Z&sr=b&sp=r&sig=9n5SmvjaM772xUjZdL0t%2BMeZRNBu1TSQPyTFa%2FZiaIA%3D)
2026-03-28 14:03:45 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/DA21SOU/42810340?sv=2020-08-04&st=2026-03-28T14%3A03%3A42Z&se=2026-03-28T14%3A28%3A42Z&sr=b&sp=r&sig=6%2F4a%2BWc9n6QD4YiOi5mt3dZkPnMZj%2Bfh7208k4Rd3hI%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=DA21%20SOU-GB>
2026-03-28 14:03:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KV60ZZA/698934365/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/KV60ZZA/42810415?sv=2020-08-04&st=2026-03-28T14%3A01%3A03Z&se=2026-03-28T14%3A26%3A03Z&sr=b&sp=r&sig=IuzavW0HE55HWRn715zywGMWMJJZSa9qrno76VZ5d%2FU%3D)
2026-03-28 14:03:45 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LN68RBY/42809684?sv=2020-08-04&st=2026-03-28T14%3A03%3A42Z&se=2026-03-28T14%3A28%3A42Z&sr=b&sp=r&sig=aIYqAxiZsHZDOcTozI0zzgpiaCRiEseqbYSKBZyhWQ4%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=LN68%20RBY-GB>
2026-03-28 14:03:45 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RE59BXM/698980842/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698980842>
2026-03-28 14:03:45 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BX06AVC/698920585/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698920585>
2026-03-28 14:03:45 [bca.uk] INFO: Found listing with ID: NL64%20KGO
2026-03-28 14:03:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27NL64%2520KGO%27 HTTP/1.1" 200 None
2026-03-28 14:03:45 [bca.uk] INFO: Scrape type for NL64%20KGO: 1
2026-03-28 14:03:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0c3c3ab5-91e6-5450-9be7-ee521ca8a766 with identifier: NL64%20KGO
2026-03-28 14:03:45 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 0c3c3ab5-91e6-5450-9be7-ee521ca8a766
2026-03-28 14:03:45 [bca.uk] INFO: Found listing with ID: OY67%20JPV
2026-03-28 14:03:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27OY67%2520JPV%27 HTTP/1.1" 200 None
2026-03-28 14:03:45 [bca.uk] INFO: Scrape type for OY67%20JPV: 1
2026-03-28 14:03:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7708aee7-65e8-597e-aa3d-426819c9c319 with identifier: OY67%20JPV
2026-03-28 14:03:45 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 7708aee7-65e8-597e-aa3d-426819c9c319
2026-03-28 14:03:45 [bca.uk] INFO: Found listing with ID: WV16%20UWB
2026-03-28 14:03:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WV16%2520UWB%27 HTTP/1.1" 200 None
2026-03-28 14:03:45 [bca.uk] INFO: Scrape type for WV16%20UWB: 1
2026-03-28 14:03:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 214771ac-26f4-5760-a178-e14681ff06b8 with identifier: WV16%20UWB
2026-03-28 14:03:45 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 214771ac-26f4-5760-a178-e14681ff06b8
2026-03-28 14:03:45 [bca.uk] INFO: Found listing with ID: MT65%20UJH
2026-03-28 14:03:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MT65%2520UJH%27 HTTP/1.1" 200 None
2026-03-28 14:03:45 [bca.uk] INFO: Scrape type for MT65%20UJH: 2
2026-03-28 14:03:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bf798534-a88a-5039-af13-7bc9b2fd962b with identifier: MT65%20UJH
2026-03-28 14:03:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bf798534-a88a-5039-af13-7bc9b2fd962b with scrape type 2
2026-03-28 14:03:45 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item bf798534-a88a-5039-af13-7bc9b2fd962b with scrape type 2
2026-03-28 14:03:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: bf798534-a88a-5039-af13-7bc9b2fd962b, identifier: MT65%20UJH
2026-03-28 14:03:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: bf798534-a88a-5039-af13-7bc9b2fd962b with identifier: MT65%20UJH
2026-03-28 14:03:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: bf798534-a88a-5039-af13-7bc9b2fd962b with identifier: MT65%20UJH
2026-03-28 14:03:45 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: bf798534-a88a-5039-af13-7bc9b2fd962b with identifier: MT65%20UJH to the API
2026-03-28 14:03:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:03:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:03:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=4&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 150,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=MT65%20UJH-GB',
'category': 'Car',
'color': 'black',
'currency': 'GBP',
'doors_number': 5,
'engine': '2.2L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Diesel',
'id': 'bf798534-a88a-5039-af13-7bc9b2fd962b',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'MT65 UJH',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=MT65%20UJH&vehicleType=*',
'listing': 'auction',
'location': 'Bristol',
'make': 'JEEP',
'model': 'CHEROKEE',
'odometer': 76875,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-01-01',
'seller_name': None,
'title': 'JEEP CHEROKEE 2.2 M/JET 200 4WD LIMITED StationWagon',
'transmission': 'automatic',
'trim': 'M/JET 200 4WD LIMITED',
'vin': '1C4PJMHU2FW783063',
'year': 2015}
2026-03-28 14:03:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MT65%2520UJH%27 HTTP/1.1" 200 None
2026-03-28 14:03:45 [bca.uk] INFO: Saving data for MT65%20UJH: {'auction_closing_time': 1774864800.0, 'created_time': 1774562599.096218, 'last_price_update_time': 1774706625.783132}
2026-03-28 14:03:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='MT65%2520UJH') HTTP/1.1" 204 0
2026-03-28 14:03:45 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DP19FWW/698227061/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698227061>
2026-03-28 14:03:45 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MJ03HOW/698444370/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698444370>
2026-03-28 14:03:45 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EA24TKX/698296229/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=EA24TKX-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-28 14:03:45 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LR11XWM/697880518/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=LR11XWM-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-28 14:03:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YH13CHD/698786525/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YH13CHD/42807762?sv=2020-08-04&st=2026-03-28T14%3A01%3A02Z&se=2026-03-28T14%3A26%3A02Z&sr=b&sp=r&sig=Kk3ZnO0H7wXbnR6jzpTNZkeJ9EaoXS3djv9g6kExg8o%3D)
2026-03-28 14:03:45 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/KU19CFH/42809756?sv=2020-08-04&st=2026-03-28T14%3A03%3A45Z&se=2026-03-28T14%3A28%3A45Z&sr=b&sp=r&sig=1G7eR4FaPr%2BtRdJKW3arikyQmOCuk26xvavIORXr6y8%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=KU19%20CFH-GB>
2026-03-28 14:03:45 [bca.uk] INFO: Found listing with ID: X11%20BBM
2026-03-28 14:03:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27X11%2520BBM%27 HTTP/1.1" 200 None
2026-03-28 14:03:45 [bca.uk] INFO: Scrape type for X11%20BBM: 1
2026-03-28 14:03:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6f52ae88-a710-5999-b75b-294cfedaf6f8 with identifier: X11%20BBM
2026-03-28 14:03:45 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 6f52ae88-a710-5999-b75b-294cfedaf6f8
2026-03-28 14:03:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BX06AVC/698920585/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/BX06AVC/42809716?sv=2020-08-04&st=2026-03-28T14%3A01%3A02Z&se=2026-03-28T14%3A26%3A02Z&sr=b&sp=r&sig=977AimHC9Bz1l7hKD9ZmlbFuhdYPzzwcOGUBuBpHaxA%3D)
2026-03-28 14:03:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VX19OYP/698251041/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/VX19OYP/42810376?sv=2020-08-04&st=2026-03-28T14%3A01%3A04Z&se=2026-03-28T14%3A26%3A04Z&sr=b&sp=r&sig=ZoloAWIhiMuraB8%2BrUA7GYd%2BDLx9PxJOBzKxmER1A8U%3D)
2026-03-28 14:03:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.bca.co.uk/api/search?q=&pageSize=100&page=5&sort=MostRecentlyAdded> (referer: https://www.bca.co.uk/search) ['zyte-api']
2026-03-28 14:03:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:03:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2d945b50>
2026-03-28 14:03:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:03:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:03:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:03:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d75bc751-3167-5395-a067-9fe76cc20a2d/d75bc751-3167-5395-a067-9fe76cc20a2d_image_4.jpg HTTP/1.1" 201 0
2026-03-28 14:03:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FOV64PLN%252F698953411%252F600') HTTP/1.1" 204 0
2026-03-28 14:03:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/OV64PLN/698953411/600 saved to cache
2026-03-28 14:03:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item d75bc751-3167-5395-a067-9fe76cc20a2d
2026-03-28 14:03:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:03:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c3a2750>
2026-03-28 14:03:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:03:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:03:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:03:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d8436e02-8218-5d88-bcc5-e01ffac7eb8e/d8436e02-8218-5d88-bcc5-e01ffac7eb8e_image_4.jpg HTTP/1.1" 201 0
2026-03-28 14:03:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FFY68WNB%252F698106324%252F600') HTTP/1.1" 204 0
2026-03-28 14:03:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FY68WNB/698106324/600 saved to cache
2026-03-28 14:03:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item d8436e02-8218-5d88-bcc5-e01ffac7eb8e
2026-03-28 14:03:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:03:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2d902b50>
2026-03-28 14:03:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:03:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:03:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:03:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5be82b2b-6926-5451-8e0e-f3d801ad1cad/5be82b2b-6926-5451-8e0e-f3d801ad1cad_image_4.jpg HTTP/1.1" 201 0
2026-03-28 14:03:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FEJ13JTO%252F698540241%252F600') HTTP/1.1" 204 0
2026-03-28 14:03:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EJ13JTO/698540241/600 saved to cache
2026-03-28 14:03:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 5be82b2b-6926-5451-8e0e-f3d801ad1cad
2026-03-28 14:03:46 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:03:46 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:03:46 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:03:46 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:03:46 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:03:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:03:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2d945a90>
2026-03-28 14:03:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:03:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:03:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:03:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3f54d261-9f82-51f4-9ce3-cc4413b8b6c4/3f54d261-9f82-51f4-9ce3-cc4413b8b6c4_image_6.jpg HTTP/1.1" 201 0
2026-03-28 14:03:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FKV60ZZA%252F698934365%252F600') HTTP/1.1" 204 0
2026-03-28 14:03:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KV60ZZA/698934365/600 saved to cache
2026-03-28 14:03:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 3f54d261-9f82-51f4-9ce3-cc4413b8b6c4
2026-03-28 14:03:46 [bca.uk] INFO: Found listing with ID: DF12%20VWL
2026-03-28 14:03:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DF12%2520VWL%27 HTTP/1.1" 200 None
2026-03-28 14:03:46 [bca.uk] INFO: Scrape type for DF12%20VWL: 1
2026-03-28 14:03:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 40991700-d0e5-5255-930d-6ca8fe3c072d with identifier: DF12%20VWL
2026-03-28 14:03:46 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 40991700-d0e5-5255-930d-6ca8fe3c072d
2026-03-28 14:03:46 [bca.uk] INFO: Found listing with ID: KV16%20LDZ
2026-03-28 14:03:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KV16%2520LDZ%27 HTTP/1.1" 200 None
2026-03-28 14:03:46 [bca.uk] INFO: Scrape type for KV16%20LDZ: 1
2026-03-28 14:03:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8b90222e-e04a-5b27-ab41-392150aadde5 with identifier: KV16%20LDZ
2026-03-28 14:03:46 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 8b90222e-e04a-5b27-ab41-392150aadde5
2026-03-28 14:03:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:03:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2d902110>
2026-03-28 14:03:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:03:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:03:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:03:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dabe1fc4-09bf-52ef-9042-78b5e1d2db10/dabe1fc4-09bf-52ef-9042-78b5e1d2db10_image_5.jpg HTTP/1.1" 201 0
2026-03-28 14:03:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FYH13CHD%252F698786525%252F600') HTTP/1.1" 204 0
2026-03-28 14:03:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YH13CHD/698786525/600 saved to cache
2026-03-28 14:03:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item dabe1fc4-09bf-52ef-9042-78b5e1d2db10
2026-03-28 14:03:46 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:03:46 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:03:46 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:03:46 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:03:46 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:03:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:03:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2d951950>
2026-03-28 14:03:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:03:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:03:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:03:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7086d3db-bd6a-5ab0-9b74-8f1cf370adf4/7086d3db-bd6a-5ab0-9b74-8f1cf370adf4_image_8.jpg HTTP/1.1" 201 0
2026-03-28 14:03:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FBX06AVC%252F698920585%252F600') HTTP/1.1" 204 0
2026-03-28 14:03:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BX06AVC/698920585/600 saved to cache
2026-03-28 14:03:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 7086d3db-bd6a-5ab0-9b74-8f1cf370adf4
2026-03-28 14:03:46 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:03:46 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:03:46 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:03:46 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:03:46 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:03:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:03:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c775890>
2026-03-28 14:03:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:03:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:03:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:03:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b7b36a17-d5d4-5e94-9bbf-8a754ca74b60/b7b36a17-d5d4-5e94-9bbf-8a754ca74b60_image_6.jpg HTTP/1.1" 201 0
2026-03-28 14:03:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FVX19OYP%252F698251041%252F600') HTTP/1.1" 204 0
2026-03-28 14:03:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VX19OYP/698251041/600 saved to cache
2026-03-28 14:03:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item b7b36a17-d5d4-5e94-9bbf-8a754ca74b60
2026-03-28 14:03:46 [bca.uk] INFO: Total items found: 100
2026-03-28 14:03:46 [bca.uk] INFO: Requesting URL: https://www.bca.co.uk/api/search?q=&pageSize=100&page=6&sort=MostRecentlyAdded
2026-03-28 14:03:46 [bca.uk] INFO: Sending search API request with Bearer token (length=1492)
2026-03-28 14:03:46 [scrapy_zyte_api._params] WARNING: Request <GET https://www.bca.co.uk/api/search?q=&pageSize=100&page=6&sort=MostRecentlyAdded> defines the Zyte API customHttpRequestHeaders parameter, overriding Request.headers. Use Request.headers instead.
2026-03-28 14:03:46 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FY68WNB/698106313/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698106313>
2026-03-28 14:03:46 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/OV64PLN/698965996/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698965996>
2026-03-28 14:03:46 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/FV17TYW/42807142?sv=2020-08-04&st=2026-03-28T14%3A03%3A46Z&se=2026-03-28T14%3A28%3A46Z&sr=b&sp=r&sig=3LbtNEGnFqYV4bS0F0%2BmsB%2FgfFSYLdditNDmvy7kudU%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=FV17%20TYW-GB>
2026-03-28 14:03:46 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/FY66OTD/42794791?sv=2020-08-04&st=2026-03-28T14%3A03%3A46Z&se=2026-03-28T14%3A28%3A46Z&sr=b&sp=r&sig=nyWr7cManqycrjqVh9Sq0fegCWU0XCSire1eKcJWKLA%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=FY66%20OTD-GB>
2026-03-28 14:03:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RE59BXM/698980842/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/RE59BXM/42810393?sv=2020-08-04&st=2026-03-28T14%3A01%3A02Z&se=2026-03-28T14%3A26%3A02Z&sr=b&sp=r&sig=MksXwVSixqiZ62CEskJ2z5pOaVL%2BuYMKfzx3%2FgepvXw%3D)
2026-03-28 14:03:46 [bca.uk] INFO: Found listing with ID: LT64%20YTO
2026-03-28 14:03:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LT64%2520YTO%27 HTTP/1.1" 200 None
2026-03-28 14:03:46 [bca.uk] INFO: Scrape type for LT64%20YTO: 2
2026-03-28 14:03:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1f472b40-f94f-54f5-ac10-c3e31a69396b with identifier: LT64%20YTO
2026-03-28 14:03:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1f472b40-f94f-54f5-ac10-c3e31a69396b with scrape type 2
2026-03-28 14:03:46 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1f472b40-f94f-54f5-ac10-c3e31a69396b with scrape type 2
2026-03-28 14:03:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 1f472b40-f94f-54f5-ac10-c3e31a69396b, identifier: LT64%20YTO
2026-03-28 14:03:46 [bca.uk] INFO: Found listing with ID: NH17%20THH
2026-03-28 14:03:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27NH17%2520THH%27 HTTP/1.1" 200 None
2026-03-28 14:03:46 [bca.uk] INFO: Scrape type for NH17%20THH: 2
2026-03-28 14:03:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 94b2e979-f2e3-5718-b38a-c514d4bcdbd7 with identifier: NH17%20THH
2026-03-28 14:03:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 94b2e979-f2e3-5718-b38a-c514d4bcdbd7 with scrape type 2
2026-03-28 14:03:46 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 94b2e979-f2e3-5718-b38a-c514d4bcdbd7 with scrape type 2
2026-03-28 14:03:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 94b2e979-f2e3-5718-b38a-c514d4bcdbd7, identifier: NH17%20THH
2026-03-28 14:03:46 [scrapy_zyte_api._params] WARNING: Request <GET https://www.bca.co.uk/api/search?q=&pageSize=100&page=6&sort=MostRecentlyAdded> defines the Zyte API customHttpRequestHeaders parameter, overriding Request.headers. Use Request.headers instead.
2026-03-28 14:03:46 [scrapy_zyte_api._params] WARNING: Request <GET https://www.bca.co.uk/api/search?q=&pageSize=100&page=6&sort=MostRecentlyAdded> defines the Zyte API customHttpRequestHeaders parameter, overriding Request.headers. Use Request.headers instead.
2026-03-28 14:03:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 1f472b40-f94f-54f5-ac10-c3e31a69396b with identifier: LT64%20YTO
2026-03-28 14:03:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 1f472b40-f94f-54f5-ac10-c3e31a69396b with identifier: LT64%20YTO
2026-03-28 14:03:46 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 1f472b40-f94f-54f5-ac10-c3e31a69396b with identifier: LT64%20YTO to the API
2026-03-28 14:03:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:03:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:03:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=4&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 99,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=LT64%20YTO-GB',
'category': 'Car',
'color': 'black',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.5L',
'expiration_date': '2026-03-29T10:00:00Z',
'fuel_type': 'Diesel',
'id': '1f472b40-f94f-54f5-ac10-c3e31a69396b',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'LT64 YTO',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=LT64%20YTO&vehicleType=*',
'listing': 'auction',
'location': 'Bristol',
'make': 'NISSAN',
'model': 'QASHQAI',
'odometer': 159946,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2014-01-01',
'seller_name': None,
'title': 'NISSAN QASHQAI 1.5 DCI 110 TEKNA Hatchback',
'transmission': 'manual',
'trim': 'DCI 110 TEKNA',
'vin': 'SJNFAAJ11U1186339',
'year': 2014}
2026-03-28 14:03:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LT64%2520YTO%27 HTTP/1.1" 200 None
2026-03-28 14:03:47 [bca.uk] INFO: Saving data for LT64%20YTO: {'auction_closing_time': 1774778400.0, 'created_time': 1774563442.345744, 'last_price_update_time': 1774706627.843285}
2026-03-28 14:03:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='LT64%2520YTO') HTTP/1.1" 204 0
2026-03-28 14:03:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 94b2e979-f2e3-5718-b38a-c514d4bcdbd7 with identifier: NH17%20THH
2026-03-28 14:03:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 94b2e979-f2e3-5718-b38a-c514d4bcdbd7 with identifier: NH17%20THH
2026-03-28 14:03:47 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 94b2e979-f2e3-5718-b38a-c514d4bcdbd7 with identifier: NH17%20THH to the API
2026-03-28 14:03:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:03:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:03:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=5&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 139,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=NH17%20THH-GB',
'category': 'Car',
'color': 'grey',
'currency': 'GBP',
'doors_number': 5,
'engine': '2.0L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Diesel',
'id': '94b2e979-f2e3-5718-b38a-c514d4bcdbd7',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'NH17 THH',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=NH17%20THH&vehicleType=*',
'listing': 'auction',
'location': 'Blackbushe',
'make': 'LAND ROVER',
'model': 'DISCOVERY SPORT',
'odometer': 84816,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-01-01',
'seller_name': None,
'title': 'LAND ROVER DISCOVERY SPORT 2.0 TD4 180 HSE StationWagon',
'transmission': 'automatic',
'trim': 'TD4 180 HSE',
'vin': 'SALCA2AN6HH685028',
'year': 2017}
2026-03-28 14:03:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27NH17%2520THH%27 HTTP/1.1" 200 None
2026-03-28 14:03:48 [bca.uk] INFO: Saving data for NH17%20THH: {'auction_closing_time': 1774864800.0, 'created_time': 1774562557.094574, 'last_price_update_time': 1774706628.205364}
2026-03-28 14:03:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='NH17%2520THH') HTTP/1.1" 204 0
2026-03-28 14:03:48 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 14:03:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/KU19CFH/42809756?sv=2020-08-04&st=2026-03-28T14%3A03%3A45Z&se=2026-03-28T14%3A28%3A45Z&sr=b&sp=r&sig=1G7eR4FaPr%2BtRdJKW3arikyQmOCuk26xvavIORXr6y8%3D> (referer: https://www.bca.co.uk/)
2026-03-28 14:03:48 [bca.uk] INFO: Found listing with ID: WU19%20VDC
2026-03-28 14:03:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WU19%2520VDC%27 HTTP/1.1" 200 None
2026-03-28 14:03:48 [bca.uk] INFO: Scrape type for WU19%20VDC: 1
2026-03-28 14:03:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2c7ab10e-203f-5d5d-b669-d394e3cfab8d with identifier: WU19%20VDC
2026-03-28 14:03:48 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 2c7ab10e-203f-5d5d-b669-d394e3cfab8d
2026-03-28 14:03:48 [bca.uk] INFO: Found listing with ID: BV61%20MVO
2026-03-28 14:03:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BV61%2520MVO%27 HTTP/1.1" 200 None
2026-03-28 14:03:48 [bca.uk] INFO: Scrape type for BV61%20MVO: 1
2026-03-28 14:03:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6665ad2b-5db8-5cb5-8575-3440dfdc3f0c with identifier: BV61%20MVO
2026-03-28 14:03:48 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 6665ad2b-5db8-5cb5-8575-3440dfdc3f0c
2026-03-28 14:03:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/DA21SOU/42810340?sv=2020-08-04&st=2026-03-28T14%3A03%3A42Z&se=2026-03-28T14%3A28%3A42Z&sr=b&sp=r&sig=6%2F4a%2BWc9n6QD4YiOi5mt3dZkPnMZj%2Bfh7208k4Rd3hI%3D> (referer: https://www.bca.co.uk/)
2026-03-28 14:03:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LN68RBY/42809684?sv=2020-08-04&st=2026-03-28T14%3A03%3A42Z&se=2026-03-28T14%3A28%3A42Z&sr=b&sp=r&sig=aIYqAxiZsHZDOcTozI0zzgpiaCRiEseqbYSKBZyhWQ4%3D> (referer: https://www.bca.co.uk/)
2026-03-28 14:03:48 [bca.uk] INFO: Found listing with ID: SD60%20WDX
2026-03-28 14:03:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SD60%2520WDX%27 HTTP/1.1" 200 None
2026-03-28 14:03:48 [bca.uk] INFO: Scrape type for SD60%20WDX: 0
2026-03-28 14:03:48 [bca.uk] INFO: Found listing with ID: WF63%20UPT
2026-03-28 14:03:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WF63%2520UPT%27 HTTP/1.1" 200 None
2026-03-28 14:03:48 [bca.uk] INFO: Scrape type for WF63%20UPT: 0
2026-03-28 14:03:48 [bca.uk] INFO: Found listing with ID: WJ15%20OHN
2026-03-28 14:03:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WJ15%2520OHN%27 HTTP/1.1" 200 None
2026-03-28 14:03:48 [bca.uk] INFO: Scrape type for WJ15%20OHN: 2
2026-03-28 14:03:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d4dde454-d949-5f79-bd5a-ce38fcc3545a with identifier: WJ15%20OHN
2026-03-28 14:03:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d4dde454-d949-5f79-bd5a-ce38fcc3545a with scrape type 2
2026-03-28 14:03:48 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d4dde454-d949-5f79-bd5a-ce38fcc3545a with scrape type 2
2026-03-28 14:03:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: d4dde454-d949-5f79-bd5a-ce38fcc3545a, identifier: WJ15%20OHN
2026-03-28 14:03:48 [bca.uk] INFO: Found listing with ID: LK64%20NEJ
2026-03-28 14:03:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LK64%2520NEJ%27 HTTP/1.1" 200 None
2026-03-28 14:03:48 [bca.uk] INFO: Scrape type for LK64%20NEJ: 1
2026-03-28 14:03:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bb105475-65fd-5601-86d0-a8590c56bf0b with identifier: LK64%20NEJ
2026-03-28 14:03:48 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item bb105475-65fd-5601-86d0-a8590c56bf0b
2026-03-28 14:03:48 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:03:48 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:03:48 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:03:48 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:03:48 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:03:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:03:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2d950650>
2026-03-28 14:03:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:03:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:03:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:03:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5e732f50-42ac-5666-996c-316bc1354f8d/5e732f50-42ac-5666-996c-316bc1354f8d_image_7.jpg HTTP/1.1" 201 0
2026-03-28 14:03:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FRE59BXM%252F698980842%252F600') HTTP/1.1" 204 0
2026-03-28 14:03:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RE59BXM/698980842/600 saved to cache
2026-03-28 14:03:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 5e732f50-42ac-5666-996c-316bc1354f8d
2026-03-28 14:03:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: d4dde454-d949-5f79-bd5a-ce38fcc3545a with identifier: WJ15%20OHN
2026-03-28 14:03:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: d4dde454-d949-5f79-bd5a-ce38fcc3545a with identifier: WJ15%20OHN
2026-03-28 14:03:48 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: d4dde454-d949-5f79-bd5a-ce38fcc3545a with identifier: WJ15%20OHN to the API
2026-03-28 14:03:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:03:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:03:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=4&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 124,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=WJ15%20OHN-GB',
'category': 'Car',
'color': 'black',
'currency': 'GBP',
'doors_number': 5,
'engine': '0.9L',
'expiration_date': '2026-03-29T10:00:00Z',
'fuel_type': 'Petrol',
'id': 'd4dde454-d949-5f79-bd5a-ce38fcc3545a',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'WJ15 OHN',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=WJ15%20OHN&vehicleType=*',
'listing': 'auction',
'location': 'Bridgwater',
'make': 'DACIA',
'model': 'SANDERO STEPWAY',
'odometer': 81627,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-01-01',
'seller_name': None,
'title': 'DACIA SANDERO STEPWAY 0.9 TCE 90 LAUREATE Hatchback',
'transmission': 'manual',
'trim': 'TCE 90 LAUREATE',
'vin': 'UU15SDAAC52473084',
'year': 2015}
2026-03-28 14:03:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WJ15%2520OHN%27 HTTP/1.1" 200 None
2026-03-28 14:03:49 [bca.uk] INFO: Saving data for WJ15%20OHN: {'auction_closing_time': 1774778400.0, 'created_time': 1774130567.724976, 'last_price_update_time': 1774706629.554577}
2026-03-28 14:03:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='WJ15%2520OHN') HTTP/1.1" 204 0
2026-03-28 14:03:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DP19FWW/698227061/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/DP19FWW/42810375?sv=2020-08-04&st=2026-03-28T14%3A01%3A04Z&se=2026-03-28T14%3A26%3A04Z&sr=b&sp=r&sig=DYlHwmmm%2BkuE1QC9GfsRlnyT74V8OO0Bfy5POGMlRcU%3D)
2026-03-28 14:03:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EA24TKX/698296229/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/EA24TKX/42810378?sv=2020-08-04&st=2026-03-28T14%3A01%3A05Z&se=2026-03-28T14%3A26%3A05Z&sr=b&sp=r&sig=Ajk9rVQfTHJs3R0cJnmP5VnSS5rSnHfV6UlI7D3mmDQ%3D)
2026-03-28 14:03:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LR11XWM/697880518/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LR11XWM/42810294?sv=2020-08-04&st=2026-03-28T14%3A01%3A05Z&se=2026-03-28T14%3A26%3A05Z&sr=b&sp=r&sig=zHl%2Fkz2fSAoGVBY8ukVZULGVCGKqbTVidyooaEEBPNc%3D)
2026-03-28 14:03:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MJ03HOW/698444370/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/MJ03HOW/42810316?sv=2020-08-04&st=2026-03-28T14%3A01%3A04Z&se=2026-03-28T14%3A26%3A04Z&sr=b&sp=r&sig=72R4f35YDQDGGwN55srQJ3YRSQrnD%2FGMmCWnMvmfOLc%3D)
2026-03-28 14:03:49 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/OY67JPV/42810048?sv=2020-08-04&st=2026-03-28T14%3A03%3A48Z&se=2026-03-28T14%3A28%3A48Z&sr=b&sp=r&sig=3IQnxpRCaMGCrWPQZylbi%2BiY%2FkfXKw1FEE36W3dpRwo%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=OY67%20JPV-GB>
2026-03-28 14:03:49 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/WV16UWB/42797605?sv=2020-08-04&st=2026-03-28T14%3A03%3A48Z&se=2026-03-28T14%3A28%3A48Z&sr=b&sp=r&sig=tZmKWGpA7mZ9Rie4bcnpNzrMU30KCOw%2BfaCUNgMn820%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=WV16%20UWB-GB>
2026-03-28 14:03:49 [bca.uk] INFO: Found listing with ID: WJ62%20BLV
2026-03-28 14:03:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WJ62%2520BLV%27 HTTP/1.1" 200 None
2026-03-28 14:03:49 [bca.uk] INFO: Scrape type for WJ62%20BLV: 2
2026-03-28 14:03:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b8d0df8e-a22f-59c8-b618-54bb52aa1c0f with identifier: WJ62%20BLV
2026-03-28 14:03:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b8d0df8e-a22f-59c8-b618-54bb52aa1c0f with scrape type 2
2026-03-28 14:03:49 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b8d0df8e-a22f-59c8-b618-54bb52aa1c0f with scrape type 2
2026-03-28 14:03:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: b8d0df8e-a22f-59c8-b618-54bb52aa1c0f, identifier: WJ62%20BLV
2026-03-28 14:03:49 [bca.uk] INFO: Found listing with ID: CK18%20AEJ
2026-03-28 14:03:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27CK18%2520AEJ%27 HTTP/1.1" 200 None
2026-03-28 14:03:49 [bca.uk] INFO: Scrape type for CK18%20AEJ: 1
2026-03-28 14:03:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 954e7a8e-294d-583e-8576-18c9af402ec0 with identifier: CK18%20AEJ
2026-03-28 14:03:49 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 954e7a8e-294d-583e-8576-18c9af402ec0
2026-03-28 14:03:49 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/NL64KGO/42810049?sv=2020-08-04&st=2026-03-28T14%3A03%3A48Z&se=2026-03-28T14%3A28%3A48Z&sr=b&sp=r&sig=GCr8gvM5cBzuZAr6Na7pdcamsQO4tFs2xqxAknQovkg%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=NL64%20KGO-GB>
2026-03-28 14:03:49 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/X11BBM/42809514?sv=2020-08-04&st=2026-03-28T14%3A03%3A48Z&se=2026-03-28T14%3A28%3A48Z&sr=b&sp=r&sig=iFv2U%2F%2BmiJcqZ%2BPwwi1Pjq9aw6DZNzQsG5k9GNFr4Nw%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=X11%20BBM-GB>
2026-03-28 14:03:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: b8d0df8e-a22f-59c8-b618-54bb52aa1c0f with identifier: WJ62%20BLV
2026-03-28 14:03:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: b8d0df8e-a22f-59c8-b618-54bb52aa1c0f with identifier: WJ62%20BLV
2026-03-28 14:03:49 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: b8d0df8e-a22f-59c8-b618-54bb52aa1c0f with identifier: WJ62%20BLV to the API
2026-03-28 14:03:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:03:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:03:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=4&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 119,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=WJ62%20BLV-GB',
'category': 'Car',
'color': 'red',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.6L',
'expiration_date': '2026-03-29T10:00:00Z',
'fuel_type': 'Diesel',
'id': 'b8d0df8e-a22f-59c8-b618-54bb52aa1c0f',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'WJ62 BLV',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=WJ62%20BLV&vehicleType=*',
'listing': 'auction',
'location': 'Bridgwater',
'make': 'VOLKSWAGEN',
'model': 'GOLF',
'odometer': 82785,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2012-01-01',
'seller_name': None,
'title': 'VOLKSWAGEN GOLF 1.6 TDI 105 MATCH Hatchback',
'transmission': 'manual',
'trim': 'TDI 105 MATCH',
'vin': 'WVWZZZ1KZDP012865',
'year': 2012}
2026-03-28 14:03:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WJ62%2520BLV%27 HTTP/1.1" 200 None
2026-03-28 14:03:50 [bca.uk] INFO: Saving data for WJ62%20BLV: {'auction_closing_time': 1774778400.0, 'created_time': 1774610885.078578, 'last_price_update_time': 1774706630.098676}
2026-03-28 14:03:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='WJ62%2520BLV') HTTP/1.1" 204 0
2026-03-28 14:03:50 [bca.uk] INFO: Found listing with ID: WK54%20WFB
2026-03-28 14:03:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WK54%2520WFB%27 HTTP/1.1" 200 None
2026-03-28 14:03:50 [bca.uk] INFO: Scrape type for WK54%20WFB: 0
2026-03-28 14:03:50 [bca.uk] INFO: Found listing with ID: WV09%20BNK
2026-03-28 14:03:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WV09%2520BNK%27 HTTP/1.1" 200 None
2026-03-28 14:03:50 [bca.uk] INFO: Scrape type for WV09%20BNK: 0
2026-03-28 14:03:50 [bca.uk] INFO: Found listing with ID: YE09%20XVV
2026-03-28 14:03:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YE09%2520XVV%27 HTTP/1.1" 200 None
2026-03-28 14:03:50 [bca.uk] INFO: Scrape type for YE09%20XVV: 0
2026-03-28 14:03:50 [bca.uk] INFO: Found listing with ID: YW63%20BYJ
2026-03-28 14:03:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YW63%2520BYJ%27 HTTP/1.1" 200 None
2026-03-28 14:03:50 [bca.uk] INFO: Scrape type for YW63%20BYJ: 0
2026-03-28 14:03:50 [bca.uk] INFO: Found listing with ID: LR14%20NKS
2026-03-28 14:03:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LR14%2520NKS%27 HTTP/1.1" 200 None
2026-03-28 14:03:50 [bca.uk] INFO: Scrape type for LR14%20NKS: 0
2026-03-28 14:03:50 [bca.uk] INFO: Found listing with ID: LX15%20SYU
2026-03-28 14:03:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LX15%2520SYU%27 HTTP/1.1" 200 None
2026-03-28 14:03:50 [bca.uk] INFO: Scrape type for LX15%20SYU: 0
2026-03-28 14:03:50 [bca.uk] INFO: Found listing with ID: NA09%20EFW
2026-03-28 14:03:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27NA09%2520EFW%27 HTTP/1.1" 200 None
2026-03-28 14:03:50 [bca.uk] INFO: Scrape type for NA09%20EFW: 0
2026-03-28 14:03:50 [bca.uk] INFO: Found listing with ID: NJ11%20XCC
2026-03-28 14:03:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27NJ11%2520XCC%27 HTTP/1.1" 200 None
2026-03-28 14:03:50 [bca.uk] INFO: Scrape type for NJ11%20XCC: 0
2026-03-28 14:03:50 [bca.uk] INFO: Found listing with ID: NX59%20VNB
2026-03-28 14:03:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27NX59%2520VNB%27 HTTP/1.1" 200 None
2026-03-28 14:03:50 [bca.uk] INFO: Scrape type for NX59%20VNB: 0
2026-03-28 14:03:50 [bca.uk] INFO: Found listing with ID: OFZ%205008
2026-03-28 14:03:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27OFZ%25205008%27 HTTP/1.1" 200 None
2026-03-28 14:03:50 [bca.uk] INFO: Scrape type for OFZ%205008: 0
2026-03-28 14:03:50 [bca.uk] INFO: Found listing with ID: OW53%20UMO
2026-03-28 14:03:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27OW53%2520UMO%27 HTTP/1.1" 200 None
2026-03-28 14:03:50 [bca.uk] INFO: Scrape type for OW53%20UMO: 0
2026-03-28 14:03:50 [bca.uk] INFO: Found listing with ID: PY10%20BSO
2026-03-28 14:03:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27PY10%2520BSO%27 HTTP/1.1" 200 None
2026-03-28 14:03:50 [bca.uk] INFO: Scrape type for PY10%20BSO: 0
2026-03-28 14:03:50 [bca.uk] INFO: Found listing with ID: RJ11%20YBG
2026-03-28 14:03:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27RJ11%2520YBG%27 HTTP/1.1" 200 None
2026-03-28 14:03:50 [bca.uk] INFO: Scrape type for RJ11%20YBG: 0
2026-03-28 14:03:50 [bca.uk] INFO: Found listing with ID: RV11%20NYX
2026-03-28 14:03:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27RV11%2520NYX%27 HTTP/1.1" 200 None
2026-03-28 14:03:50 [bca.uk] INFO: Scrape type for RV11%20NYX: 0
2026-03-28 14:03:50 [bca.uk] INFO: Found listing with ID: SB65%20EOJ
2026-03-28 14:03:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SB65%2520EOJ%27 HTTP/1.1" 200 None
2026-03-28 14:03:50 [bca.uk] INFO: Scrape type for SB65%20EOJ: 0
2026-03-28 14:03:50 [bca.uk] INFO: Found listing with ID: AG59%20CWP
2026-03-28 14:03:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27AG59%2520CWP%27 HTTP/1.1" 200 None
2026-03-28 14:03:50 [bca.uk] INFO: Scrape type for AG59%20CWP: 1
2026-03-28 14:03:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3fd8400f-8e11-553b-b00c-1b463510f5f0 with identifier: AG59%20CWP
2026-03-28 14:03:50 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 3fd8400f-8e11-553b-b00c-1b463510f5f0
2026-03-28 14:03:50 [bca.uk] INFO: Found listing with ID: BD57%20PJJ
2026-03-28 14:03:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BD57%2520PJJ%27 HTTP/1.1" 200 None
2026-03-28 14:03:50 [bca.uk] INFO: Scrape type for BD57%20PJJ: 1
2026-03-28 14:03:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 47a55e74-7e18-57ad-827f-224915a41c24 with identifier: BD57%20PJJ
2026-03-28 14:03:50 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 47a55e74-7e18-57ad-827f-224915a41c24
2026-03-28 14:03:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/OV64PLN/698965996/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/OV64PLN/42810653?sv=2020-08-04&st=2026-03-28T14%3A01%3A03Z&se=2026-03-28T14%3A26%3A03Z&sr=b&sp=r&sig=APMfuiYXypC%2F8k81EUjJVNUqGlQEUGUldS81rN8I%2FN0%3D)
2026-03-28 14:03:50 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/KV16LDZ/42797857?sv=2020-08-04&st=2026-03-28T14%3A03%3A49Z&se=2026-03-28T14%3A28%3A49Z&sr=b&sp=r&sig=7pGIWvim4gxli5cifd615Lw7Q0s6ljm9z8msDK3x6Js%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=KV16%20LDZ-GB>
2026-03-28 14:03:50 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/BV61MVO/42809949?sv=2020-08-04&st=2026-03-28T14%3A03%3A49Z&se=2026-03-28T14%3A28%3A49Z&sr=b&sp=r&sig=PJNKzVVeJy1FKQt32eUXNOOsoTV6pqchYxeSDnPTh7w%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=BV61%20MVO-GB>
2026-03-28 14:03:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FY68WNB/698106313/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/FY68WNB/42810373?sv=2020-08-04&st=2026-03-28T14%3A01%3A04Z&se=2026-03-28T14%3A26%3A04Z&sr=b&sp=r&sig=H2pJB0hzNCFCiICFkGnSt1gr2sn1tExob5yrsc4d3Vs%3D)
2026-03-28 14:03:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:03:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a1fd503d0>
2026-03-28 14:03:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:03:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:03:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:03:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b6d51688-b23c-5016-a794-ddfbf11c9378/b6d51688-b23c-5016-a794-ddfbf11c9378_expert_report_file_076e3934-d7eb-41fc-91c5-cadcc7c01c30.pdf HTTP/1.1" 201 0
2026-03-28 14:03:50 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item b6d51688-b23c-5016-a794-ddfbf11c9378
2026-03-28 14:03:50 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: b6d51688-b23c-5016-a794-ddfbf11c9378, skipping ID generation
2026-03-28 14:03:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item b6d51688-b23c-5016-a794-ddfbf11c9378
2026-03-28 14:03:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DKU19CFH-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-28 14:03:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=KU19CFH-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-28 14:03:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:03:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c9ac290>
2026-03-28 14:03:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:03:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:03:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:03:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1534762c-5952-5a28-84f7-7b27016558ac/1534762c-5952-5a28-84f7-7b27016558ac_expert_report_file_fd2fad32-cf81-4f02-85a0-726357d13185.pdf HTTP/1.1" 201 0
2026-03-28 14:03:50 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item 1534762c-5952-5a28-84f7-7b27016558ac
2026-03-28 14:03:50 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 1534762c-5952-5a28-84f7-7b27016558ac, skipping ID generation
2026-03-28 14:03:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 1534762c-5952-5a28-84f7-7b27016558ac
2026-03-28 14:03:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DDA21SOU-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-28 14:03:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=DA21SOU-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-28 14:03:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:03:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2d9bed50>
2026-03-28 14:03:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:03:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:03:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:03:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_04fa14f2-714c-5033-a1fe-bd0c784e7d7e/04fa14f2-714c-5033-a1fe-bd0c784e7d7e_expert_report_file_1b0f9ceb-b64c-4867-a892-946ed6b33dd6.pdf HTTP/1.1" 201 0
2026-03-28 14:03:50 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item 04fa14f2-714c-5033-a1fe-bd0c784e7d7e
2026-03-28 14:03:50 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 04fa14f2-714c-5033-a1fe-bd0c784e7d7e, skipping ID generation
2026-03-28 14:03:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 04fa14f2-714c-5033-a1fe-bd0c784e7d7e
2026-03-28 14:03:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DLN68RBY-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-28 14:03:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=LN68RBY-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-28 14:03:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:03:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c798850>
2026-03-28 14:03:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:03:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:03:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:03:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4b13d468-b932-5891-9e01-a66081b24d30/4b13d468-b932-5891-9e01-a66081b24d30_image_2.jpg HTTP/1.1" 201 0
2026-03-28 14:03:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FDP19FWW%252F698227061%252F600') HTTP/1.1" 204 0
2026-03-28 14:03:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DP19FWW/698227061/600 saved to cache
2026-03-28 14:03:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 4b13d468-b932-5891-9e01-a66081b24d30
2026-03-28 14:03:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:03:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c504b10>
2026-03-28 14:03:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:03:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:03:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:03:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a936dd22-4905-520e-8ef4-c3c73c56eba4/a936dd22-4905-520e-8ef4-c3c73c56eba4_image_0.jpg HTTP/1.1" 201 0
2026-03-28 14:03:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FEA24TKX%252F698296229%252F600') HTTP/1.1" 204 0
2026-03-28 14:03:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EA24TKX/698296229/600 saved to cache
2026-03-28 14:03:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item a936dd22-4905-520e-8ef4-c3c73c56eba4
2026-03-28 14:03:50 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: a936dd22-4905-520e-8ef4-c3c73c56eba4, skipping ID generation
2026-03-28 14:03:50 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item a936dd22-4905-520e-8ef4-c3c73c56eba4 sending to next pipeline
2026-03-28 14:03:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: a936dd22-4905-520e-8ef4-c3c73c56eba4, identifier: EA24%20TKX
2026-03-28 14:03:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:03:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c7b47d0>
2026-03-28 14:03:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:03:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:03:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:03:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0b12c0fe-3ab8-5445-ad6b-256ccebc3b9e/0b12c0fe-3ab8-5445-ad6b-256ccebc3b9e_image_0.jpg HTTP/1.1" 201 0
2026-03-28 14:03:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLR11XWM%252F697880518%252F600') HTTP/1.1" 204 0
2026-03-28 14:03:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LR11XWM/697880518/600 saved to cache
2026-03-28 14:03:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 0b12c0fe-3ab8-5445-ad6b-256ccebc3b9e
2026-03-28 14:03:50 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 0b12c0fe-3ab8-5445-ad6b-256ccebc3b9e, skipping ID generation
2026-03-28 14:03:50 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 0b12c0fe-3ab8-5445-ad6b-256ccebc3b9e sending to next pipeline
2026-03-28 14:03:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 0b12c0fe-3ab8-5445-ad6b-256ccebc3b9e, identifier: LR11%20XWM
2026-03-28 14:03:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:03:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a1fd3a850>
2026-03-28 14:03:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:03:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:03:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:03:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b75153fa-8bbc-5e83-87eb-81edd908fcda/b75153fa-8bbc-5e83-87eb-81edd908fcda_image_1.jpg HTTP/1.1" 201 0
2026-03-28 14:03:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FMJ03HOW%252F698444370%252F600') HTTP/1.1" 204 0
2026-03-28 14:03:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MJ03HOW/698444370/600 saved to cache
2026-03-28 14:03:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item b75153fa-8bbc-5e83-87eb-81edd908fcda
2026-03-28 14:03:51 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/WU19VDC/42792335?sv=2020-08-04&st=2026-03-28T14%3A03%3A50Z&se=2026-03-28T14%3A28%3A50Z&sr=b&sp=r&sig=Mqd3JjFAqa%2F7fy72g8Zcx8u%2F7XgFrycUpKRkPg1JOjA%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=WU19%20VDC-GB>
2026-03-28 14:03:51 [bca.uk] INFO: Found listing with ID: CK12%20BZG
2026-03-28 14:03:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27CK12%2520BZG%27 HTTP/1.1" 200 None
2026-03-28 14:03:51 [bca.uk] INFO: Scrape type for CK12%20BZG: 0
2026-03-28 14:03:51 [bca.uk] INFO: Found listing with ID: CX13%20HWB
2026-03-28 14:03:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27CX13%2520HWB%27 HTTP/1.1" 200 None
2026-03-28 14:03:51 [bca.uk] INFO: Scrape type for CX13%20HWB: 0
2026-03-28 14:03:51 [bca.uk] INFO: Found listing with ID: FG12%20CXF
2026-03-28 14:03:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FG12%2520CXF%27 HTTP/1.1" 200 None
2026-03-28 14:03:51 [bca.uk] INFO: Scrape type for FG12%20CXF: 0
2026-03-28 14:03:51 [bca.uk] INFO: Found listing with ID: LD12%20SWY
2026-03-28 14:03:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LD12%2520SWY%27 HTTP/1.1" 200 None
2026-03-28 14:03:51 [bca.uk] INFO: Scrape type for LD12%20SWY: 0
2026-03-28 14:03:51 [bca.uk] INFO: Found listing with ID: SH68%20XUL
2026-03-28 14:03:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SH68%2520XUL%27 HTTP/1.1" 200 None
2026-03-28 14:03:51 [bca.uk] INFO: Scrape type for SH68%20XUL: 1
2026-03-28 14:03:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4187704f-bf30-5031-9587-f1429d196ce0 with identifier: SH68%20XUL
2026-03-28 14:03:51 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 4187704f-bf30-5031-9587-f1429d196ce0
2026-03-28 14:03:51 [bca.uk] INFO: Found listing with ID: BP67%20XDB
2026-03-28 14:03:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BP67%2520XDB%27 HTTP/1.1" 200 None
2026-03-28 14:03:51 [bca.uk] INFO: Scrape type for BP67%20XDB: 1
2026-03-28 14:03:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 090813ec-adc2-5b7f-923f-58bcb47db483 with identifier: BP67%20XDB
2026-03-28 14:03:51 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 090813ec-adc2-5b7f-923f-58bcb47db483
2026-03-28 14:03:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: a936dd22-4905-520e-8ef4-c3c73c56eba4 with identifier: EA24%20TKX
2026-03-28 14:03:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: a936dd22-4905-520e-8ef4-c3c73c56eba4 with identifier: EA24%20TKX
2026-03-28 14:03:51 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: a936dd22-4905-520e-8ef4-c3c73c56eba4 with identifier: EA24%20TKX to the API
2026-03-28 14:03:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:03:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:03:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EA24TKX/698296229/600>
{'auction_title': '',
'c_o_2_emission_value': 125,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a936dd22-4905-520e-8ef4-c3c73c56eba4/a936dd22-4905-520e-8ef4-c3c73c56eba4_expert_report_file_931472ff-e8a5-4528-96ee-0cd863dcf8eb.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=EA24%20TKX-GB',
'category': 'Car',
'color': 'red',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.0L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol',
'id': 'a936dd22-4905-520e-8ef4-c3c73c56eba4',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'EA24 TKX',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=EA24%20TKX&vehicleType=*',
'listing': 'auction',
'location': 'Walsall',
'make': 'HYUNDAI',
'model': 'I10',
'odometer': 12863,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 11,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a936dd22-4905-520e-8ef4-c3c73c56eba4/a936dd22-4905-520e-8ef4-c3c73c56eba4_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 44078,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EA24TKX/698296229/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a936dd22-4905-520e-8ef4-c3c73c56eba4/a936dd22-4905-520e-8ef4-c3c73c56eba4_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 45140,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EA24TKX/698296235/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a936dd22-4905-520e-8ef4-c3c73c56eba4/a936dd22-4905-520e-8ef4-c3c73c56eba4_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 43388,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EA24TKX/698296238/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a936dd22-4905-520e-8ef4-c3c73c56eba4/a936dd22-4905-520e-8ef4-c3c73c56eba4_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 42164,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EA24TKX/698296242/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a936dd22-4905-520e-8ef4-c3c73c56eba4/a936dd22-4905-520e-8ef4-c3c73c56eba4_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 40548,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EA24TKX/698296251/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a936dd22-4905-520e-8ef4-c3c73c56eba4/a936dd22-4905-520e-8ef4-c3c73c56eba4_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 40665,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EA24TKX/698296254/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a936dd22-4905-520e-8ef4-c3c73c56eba4/a936dd22-4905-520e-8ef4-c3c73c56eba4_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 84202,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EA24TKX/698296262/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a936dd22-4905-520e-8ef4-c3c73c56eba4/a936dd22-4905-520e-8ef4-c3c73c56eba4_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 56160,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EA24TKX/698296270/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a936dd22-4905-520e-8ef4-c3c73c56eba4/a936dd22-4905-520e-8ef4-c3c73c56eba4_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 80315,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EA24TKX/698296274/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a936dd22-4905-520e-8ef4-c3c73c56eba4/a936dd22-4905-520e-8ef4-c3c73c56eba4_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 65842,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EA24TKX/698296277/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2024-01-01',
'seller_name': None,
'title': 'HYUNDAI I10 1.0 MPI PREMIUM Hatchback',
'transmission': 'automatic',
'trim': 'MPI PREMIUM',
'vin': 'NLHDR51C6RZ267835',
'year': 2024}
2026-03-28 14:03:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27EA24%2520TKX%27 HTTP/1.1" 200 None
2026-03-28 14:03:51 [bca.uk] INFO: Saving data for EA24%20TKX: {'created_time': 1774706631.475329, 'last_price_update_time': 1774706631.475342, 'auction_closing_time': 1774864800.0}
2026-03-28 14:03:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='EA24%2520TKX') HTTP/1.1" 204 0
2026-03-28 14:03:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 0b12c0fe-3ab8-5445-ad6b-256ccebc3b9e with identifier: LR11%20XWM
2026-03-28 14:03:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 0b12c0fe-3ab8-5445-ad6b-256ccebc3b9e with identifier: LR11%20XWM
2026-03-28 14:03:51 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 0b12c0fe-3ab8-5445-ad6b-256ccebc3b9e with identifier: LR11%20XWM to the API
2026-03-28 14:03:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:03:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:03:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LR11XWM/697880518/600>
{'auction_title': '',
'c_o_2_emission_value': 195,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0b12c0fe-3ab8-5445-ad6b-256ccebc3b9e/0b12c0fe-3ab8-5445-ad6b-256ccebc3b9e_expert_report_file_d950e954-40ad-4176-871c-63bc52c2ab0f.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=LR11%20XWM-GB',
'category': 'Car',
'color': 'black',
'currency': 'GBP',
'doors_number': 5,
'engine': '2.2L',
'expiration_date': '2026-03-29T10:00:00Z',
'fuel_type': 'Diesel',
'id': '0b12c0fe-3ab8-5445-ad6b-256ccebc3b9e',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'LR11 XWM',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=LR11%20XWM&vehicleType=*',
'listing': 'auction',
'location': 'Paddock Wood',
'make': 'HONDA',
'model': 'CR-V',
'odometer': 151294,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 11,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0b12c0fe-3ab8-5445-ad6b-256ccebc3b9e/0b12c0fe-3ab8-5445-ad6b-256ccebc3b9e_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 52167,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LR11XWM/697880518/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0b12c0fe-3ab8-5445-ad6b-256ccebc3b9e/0b12c0fe-3ab8-5445-ad6b-256ccebc3b9e_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 51649,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LR11XWM/697880544/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0b12c0fe-3ab8-5445-ad6b-256ccebc3b9e/0b12c0fe-3ab8-5445-ad6b-256ccebc3b9e_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 49851,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LR11XWM/697880562/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0b12c0fe-3ab8-5445-ad6b-256ccebc3b9e/0b12c0fe-3ab8-5445-ad6b-256ccebc3b9e_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 47478,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LR11XWM/697880578/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0b12c0fe-3ab8-5445-ad6b-256ccebc3b9e/0b12c0fe-3ab8-5445-ad6b-256ccebc3b9e_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 45926,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LR11XWM/697880599/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0b12c0fe-3ab8-5445-ad6b-256ccebc3b9e/0b12c0fe-3ab8-5445-ad6b-256ccebc3b9e_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 45129,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LR11XWM/697880617/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0b12c0fe-3ab8-5445-ad6b-256ccebc3b9e/0b12c0fe-3ab8-5445-ad6b-256ccebc3b9e_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 98952,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LR11XWM/697880656/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0b12c0fe-3ab8-5445-ad6b-256ccebc3b9e/0b12c0fe-3ab8-5445-ad6b-256ccebc3b9e_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 88160,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LR11XWM/697880683/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0b12c0fe-3ab8-5445-ad6b-256ccebc3b9e/0b12c0fe-3ab8-5445-ad6b-256ccebc3b9e_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 98093,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LR11XWM/697880714/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0b12c0fe-3ab8-5445-ad6b-256ccebc3b9e/0b12c0fe-3ab8-5445-ad6b-256ccebc3b9e_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 77291,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LR11XWM/697880795/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2011-01-01',
'seller_name': None,
'title': 'HONDA CR-V 2.2 I-DTEC EX Estate',
'transmission': 'automatic',
'trim': 'I-DTEC EX',
'vin': 'SHSRE6870BU008503',
'year': 2011}
2026-03-28 14:03:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LR11%2520XWM%27 HTTP/1.1" 200 None
2026-03-28 14:03:52 [bca.uk] INFO: Saving data for LR11%20XWM: {'created_time': 1774706632.016031, 'last_price_update_time': 1774706632.016044, 'auction_closing_time': 1774778400.0}
2026-03-28 14:03:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='LR11%2520XWM') HTTP/1.1" 204 0
2026-03-28 14:03:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/FV17TYW/42807142?sv=2020-08-04&st=2026-03-28T14%3A03%3A46Z&se=2026-03-28T14%3A28%3A46Z&sr=b&sp=r&sig=3LbtNEGnFqYV4bS0F0%2BmsB%2FgfFSYLdditNDmvy7kudU%3D> (referer: https://www.bca.co.uk/)
2026-03-28 14:03:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D697551160%27 HTTP/1.1" 200 None
2026-03-28 14:03:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=697551160 not downloaded yet
2026-03-28 14:03:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D697887976%27 HTTP/1.1" 200 None
2026-03-28 14:03:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=697887976 not downloaded yet
2026-03-28 14:03:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698920145%27 HTTP/1.1" 200 None
2026-03-28 14:03:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698920145 not downloaded yet
2026-03-28 14:03:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/FY66OTD/42794791?sv=2020-08-04&st=2026-03-28T14%3A03%3A46Z&se=2026-03-28T14%3A28%3A46Z&sr=b&sp=r&sig=nyWr7cManqycrjqVh9Sq0fegCWU0XCSire1eKcJWKLA%3D> (referer: https://www.bca.co.uk/)
2026-03-28 14:03:52 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EJ13JTO/698540235/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698540235>
2026-03-28 14:03:52 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/DF12VWL/42797174?sv=2020-08-04&st=2026-03-28T14%3A03%3A51Z&se=2026-03-28T14%3A28%3A51Z&sr=b&sp=r&sig=0mRjBtvz6tka1D82qBQ3%2FRs63GOtrqyuAG7vdnh5S9c%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=DF12%20VWL-GB>
2026-03-28 14:03:52 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LK64NEJ/42810513?sv=2020-08-04&st=2026-03-28T14%3A03%3A51Z&se=2026-03-28T14%3A28%3A51Z&sr=b&sp=r&sig=dZi6EyBOQ2GoK8knfBZtxM9S6O3yD8ghOm4nMLyaJjo%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=LK64%20NEJ-GB>
2026-03-28 14:03:52 [bca.uk] INFO: Found listing with ID: KW73%20VTL
2026-03-28 14:03:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KW73%2520VTL%27 HTTP/1.1" 200 None
2026-03-28 14:03:52 [bca.uk] INFO: Scrape type for KW73%20VTL: 0
2026-03-28 14:03:52 [bca.uk] INFO: Found listing with ID: MC19%20ONF
2026-03-28 14:03:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MC19%2520ONF%27 HTTP/1.1" 200 None
2026-03-28 14:03:52 [bca.uk] INFO: Scrape type for MC19%20ONF: 1
2026-03-28 14:03:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3cb9544d-cc57-5f0e-8fc5-e986b790158d with identifier: MC19%20ONF
2026-03-28 14:03:52 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 3cb9544d-cc57-5f0e-8fc5-e986b790158d
2026-03-28 14:03:52 [bca.uk] INFO: Found listing with ID: KM11%20UUD
2026-03-28 14:03:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KM11%2520UUD%27 HTTP/1.1" 200 None
2026-03-28 14:03:52 [bca.uk] INFO: Scrape type for KM11%20UUD: 1
2026-03-28 14:03:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7ba82627-3d66-5970-bb5d-b19d751b9eb4 with identifier: KM11%20UUD
2026-03-28 14:03:52 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 7ba82627-3d66-5970-bb5d-b19d751b9eb4
2026-03-28 14:03:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D697551170%27 HTTP/1.1" 200 None
2026-03-28 14:03:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=697551170 not downloaded yet
2026-03-28 14:03:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D697887981%27 HTTP/1.1" 200 None
2026-03-28 14:03:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=697887981 not downloaded yet
2026-03-28 14:03:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698920178%27 HTTP/1.1" 200 None
2026-03-28 14:03:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698920178 not downloaded yet
2026-03-28 14:03:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/OY67JPV/42810048?sv=2020-08-04&st=2026-03-28T14%3A03%3A48Z&se=2026-03-28T14%3A28%3A48Z&sr=b&sp=r&sig=3IQnxpRCaMGCrWPQZylbi%2BiY%2FkfXKw1FEE36W3dpRwo%3D> (referer: https://www.bca.co.uk/)
2026-03-28 14:03:52 [bca.uk] INFO: Found listing with ID: WF20%20RYP
2026-03-28 14:03:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WF20%2520RYP%27 HTTP/1.1" 200 None
2026-03-28 14:03:52 [bca.uk] INFO: Scrape type for WF20%20RYP: 1
2026-03-28 14:03:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1ca681d6-7a67-5d2d-a0c5-27df3db113a3 with identifier: WF20%20RYP
2026-03-28 14:03:52 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 1ca681d6-7a67-5d2d-a0c5-27df3db113a3
2026-03-28 14:03:52 [bca.uk] INFO: Found listing with ID: KV59%20HZE
2026-03-28 14:03:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KV59%2520HZE%27 HTTP/1.1" 200 None
2026-03-28 14:03:52 [bca.uk] INFO: Scrape type for KV59%20HZE: 1
2026-03-28 14:03:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 262c2820-3509-559a-9487-89979bd53e4b with identifier: KV59%20HZE
2026-03-28 14:03:52 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 262c2820-3509-559a-9487-89979bd53e4b
2026-03-28 14:03:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:03:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2ca55a90>
2026-03-28 14:03:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:03:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:03:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:03:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d75bc751-3167-5395-a067-9fe76cc20a2d/d75bc751-3167-5395-a067-9fe76cc20a2d_image_3.jpg HTTP/1.1" 201 0
2026-03-28 14:03:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FOV64PLN%252F698965996%252F600') HTTP/1.1" 204 0
2026-03-28 14:03:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/OV64PLN/698965996/600 saved to cache
2026-03-28 14:03:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item d75bc751-3167-5395-a067-9fe76cc20a2d
2026-03-28 14:03:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:03:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c7f4b90>
2026-03-28 14:03:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:03:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:03:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:03:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d8436e02-8218-5d88-bcc5-e01ffac7eb8e/d8436e02-8218-5d88-bcc5-e01ffac7eb8e_image_3.jpg HTTP/1.1" 201 0
2026-03-28 14:03:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FFY68WNB%252F698106313%252F600') HTTP/1.1" 204 0
2026-03-28 14:03:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FY68WNB/698106313/600 saved to cache
2026-03-28 14:03:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item d8436e02-8218-5d88-bcc5-e01ffac7eb8e
2026-03-28 14:03:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/WV16UWB/42797605?sv=2020-08-04&st=2026-03-28T14%3A03%3A48Z&se=2026-03-28T14%3A28%3A48Z&sr=b&sp=r&sig=tZmKWGpA7mZ9Rie4bcnpNzrMU30KCOw%2BfaCUNgMn820%3D> (referer: https://www.bca.co.uk/)
2026-03-28 14:03:52 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YH13CHD/698786511/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698786511>
2026-03-28 14:03:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D697551181%27 HTTP/1.1" 200 None
2026-03-28 14:03:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=697551181 not downloaded yet
2026-03-28 14:03:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D697887986%27 HTTP/1.1" 200 None
2026-03-28 14:03:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=697887986 not downloaded yet
2026-03-28 14:03:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698920207%27 HTTP/1.1" 200 None
2026-03-28 14:03:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698920207 not downloaded yet
2026-03-28 14:03:52 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/CK18AEJ/42809519?sv=2020-08-04&st=2026-03-28T14%3A03%3A52Z&se=2026-03-28T14%3A28%3A52Z&sr=b&sp=r&sig=tMAO1WCWalJ7mXIWRlCxzQ1Rx0voh0Hr3%2FaR8xfgZTg%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=CK18%20AEJ-GB>
2026-03-28 14:03:52 [bca.uk] INFO: Found listing with ID: WJ22%20OXH
2026-03-28 14:03:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WJ22%2520OXH%27 HTTP/1.1" 200 None
2026-03-28 14:03:52 [bca.uk] INFO: Scrape type for WJ22%20OXH: 1
2026-03-28 14:03:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 53a4e9e1-ee6b-549b-aea2-9b80871af97d with identifier: WJ22%20OXH
2026-03-28 14:03:52 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 53a4e9e1-ee6b-549b-aea2-9b80871af97d
2026-03-28 14:03:52 [bca.uk] INFO: Found listing with ID: MV57%20UOY
2026-03-28 14:03:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MV57%2520UOY%27 HTTP/1.1" 200 None
2026-03-28 14:03:52 [bca.uk] INFO: Scrape type for MV57%20UOY: 1
2026-03-28 14:03:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b344c6b3-761f-572b-9e4c-84678fe27e52 with identifier: MV57%20UOY
2026-03-28 14:03:52 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item b344c6b3-761f-572b-9e4c-84678fe27e52
2026-03-28 14:03:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/X11BBM/42809514?sv=2020-08-04&st=2026-03-28T14%3A03%3A48Z&se=2026-03-28T14%3A28%3A48Z&sr=b&sp=r&sig=iFv2U%2F%2BmiJcqZ%2BPwwi1Pjq9aw6DZNzQsG5k9GNFr4Nw%3D> (referer: https://www.bca.co.uk/)
2026-03-28 14:03:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/NL64KGO/42810049?sv=2020-08-04&st=2026-03-28T14%3A03%3A48Z&se=2026-03-28T14%3A28%3A48Z&sr=b&sp=r&sig=GCr8gvM5cBzuZAr6Na7pdcamsQO4tFs2xqxAknQovkg%3D> (referer: https://www.bca.co.uk/)
2026-03-28 14:03:52 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VX19OYP/698251025/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698251025>
2026-03-28 14:03:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D697551188%27 HTTP/1.1" 200 None
2026-03-28 14:03:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=697551188 not downloaded yet
2026-03-28 14:03:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D697887990%27 HTTP/1.1" 200 None
2026-03-28 14:03:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=697887990 not downloaded yet
2026-03-28 14:03:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698920229%27 HTTP/1.1" 200 None
2026-03-28 14:03:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698920229 not downloaded yet
2026-03-28 14:03:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:03:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c7eeed0>
2026-03-28 14:03:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:03:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:03:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:03:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d7b30cd7-3fb2-520c-9629-4539584c6e2c/d7b30cd7-3fb2-520c-9629-4539584c6e2c_expert_report_file_0041958c-f77d-4384-94e3-23f3a8205af3.pdf HTTP/1.1" 201 0
2026-03-28 14:03:52 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item d7b30cd7-3fb2-520c-9629-4539584c6e2c
2026-03-28 14:03:52 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: d7b30cd7-3fb2-520c-9629-4539584c6e2c, skipping ID generation
2026-03-28 14:03:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item d7b30cd7-3fb2-520c-9629-4539584c6e2c
2026-03-28 14:03:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DFV17TYW-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-28 14:03:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=FV17TYW-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-28 14:03:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:03:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c78f050>
2026-03-28 14:03:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:03:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:03:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:03:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_40999011-32af-5ad3-a840-4cb8242ff02a/40999011-32af-5ad3-a840-4cb8242ff02a_expert_report_file_2b60a4d8-352e-4dc6-b040-c177c14aa1f2.pdf HTTP/1.1" 201 0
2026-03-28 14:03:52 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item 40999011-32af-5ad3-a840-4cb8242ff02a
2026-03-28 14:03:52 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 40999011-32af-5ad3-a840-4cb8242ff02a, skipping ID generation
2026-03-28 14:03:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 40999011-32af-5ad3-a840-4cb8242ff02a
2026-03-28 14:03:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DFY66OTD-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-28 14:03:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=FY66OTD-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-28 14:03:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:03:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2d973d50>
2026-03-28 14:03:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:03:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:03:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:03:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7708aee7-65e8-597e-aa3d-426819c9c319/7708aee7-65e8-597e-aa3d-426819c9c319_expert_report_file_db1a75b9-c738-40ae-a223-d8b0b9244449.pdf HTTP/1.1" 201 0
2026-03-28 14:03:52 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item 7708aee7-65e8-597e-aa3d-426819c9c319
2026-03-28 14:03:52 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 7708aee7-65e8-597e-aa3d-426819c9c319, skipping ID generation
2026-03-28 14:03:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 7708aee7-65e8-597e-aa3d-426819c9c319
2026-03-28 14:03:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DOY67JPV-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-28 14:03:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=OY67JPV-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-28 14:03:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/BV61MVO/42809949?sv=2020-08-04&st=2026-03-28T14%3A03%3A49Z&se=2026-03-28T14%3A28%3A49Z&sr=b&sp=r&sig=PJNKzVVeJy1FKQt32eUXNOOsoTV6pqchYxeSDnPTh7w%3D> (referer: https://www.bca.co.uk/)
2026-03-28 14:03:52 [bca.uk] INFO: Found listing with ID: FT19%20BHF
2026-03-28 14:03:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FT19%2520BHF%27 HTTP/1.1" 200 None
2026-03-28 14:03:52 [bca.uk] INFO: Scrape type for FT19%20BHF: 0
2026-03-28 14:03:52 [bca.uk] INFO: Found listing with ID: KT21%20LUH
2026-03-28 14:03:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KT21%2520LUH%27 HTTP/1.1" 200 None
2026-03-28 14:03:52 [bca.uk] INFO: Scrape type for KT21%20LUH: 1
2026-03-28 14:03:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d0f73dcf-11ab-5c5f-8e62-eae10bfca806 with identifier: KT21%20LUH
2026-03-28 14:03:52 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item d0f73dcf-11ab-5c5f-8e62-eae10bfca806
2026-03-28 14:03:52 [bca.uk] INFO: Found listing with ID: NG62%20MFN
2026-03-28 14:03:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27NG62%2520MFN%27 HTTP/1.1" 200 None
2026-03-28 14:03:52 [bca.uk] INFO: Scrape type for NG62%20MFN: 1
2026-03-28 14:03:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ee540c51-cf33-581e-8fef-9e70457b2cad with identifier: NG62%20MFN
2026-03-28 14:03:52 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item ee540c51-cf33-581e-8fef-9e70457b2cad
2026-03-28 14:03:52 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LN68RBY/698920112/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=LN68RBY-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-28 14:03:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D697551197%27 HTTP/1.1" 200 None
2026-03-28 14:03:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=697551197 not downloaded yet
2026-03-28 14:03:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D697887996%27 HTTP/1.1" 200 None
2026-03-28 14:03:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=697887996 not downloaded yet
2026-03-28 14:03:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698920244%27 HTTP/1.1" 200 None
2026-03-28 14:03:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698920244 not downloaded yet
2026-03-28 14:03:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698767925%27 HTTP/1.1" 200 None
2026-03-28 14:03:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698767925 not downloaded yet
2026-03-28 14:03:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698150753%27 HTTP/1.1" 200 None
2026-03-28 14:03:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698150753 not downloaded yet
2026-03-28 14:03:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698107879%27 HTTP/1.1" 200 None
2026-03-28 14:03:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698107879 not downloaded yet
2026-03-28 14:03:52 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/BP67XDB/42810422?sv=2020-08-04&st=2026-03-28T14%3A03%3A52Z&se=2026-03-28T14%3A28%3A52Z&sr=b&sp=r&sig=Logn8Hbry8lNDBo7BHyP%2FFQM2Uo9ZZUQT4uyTv5b%2Bn0%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=BP67%20XDB-GB>
2026-03-28 14:03:52 [bca.uk] INFO: Found listing with ID: RE68%20RYC
2026-03-28 14:03:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27RE68%2520RYC%27 HTTP/1.1" 200 None
2026-03-28 14:03:52 [bca.uk] INFO: Scrape type for RE68%20RYC: 1
2026-03-28 14:03:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9ca8d44e-82e3-5298-8ffc-858aa7ec23ad with identifier: RE68%20RYC
2026-03-28 14:03:52 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 9ca8d44e-82e3-5298-8ffc-858aa7ec23ad
2026-03-28 14:03:52 [bca.uk] INFO: Found listing with ID: NY11%20BJE
2026-03-28 14:03:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27NY11%2520BJE%27 HTTP/1.1" 200 None
2026-03-28 14:03:52 [bca.uk] INFO: Scrape type for NY11%20BJE: 1
2026-03-28 14:03:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e7822f41-2074-585e-b916-185d4d55fb85 with identifier: NY11%20BJE
2026-03-28 14:03:52 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item e7822f41-2074-585e-b916-185d4d55fb85
2026-03-28 14:03:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:03:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2d6ab850>
2026-03-28 14:03:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:03:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:03:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:03:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_214771ac-26f4-5760-a178-e14681ff06b8/214771ac-26f4-5760-a178-e14681ff06b8_expert_report_file_46291f46-c5c7-491f-bf46-f0004f8cb173.pdf HTTP/1.1" 201 0
2026-03-28 14:03:53 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item 214771ac-26f4-5760-a178-e14681ff06b8
2026-03-28 14:03:53 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 214771ac-26f4-5760-a178-e14681ff06b8, skipping ID generation
2026-03-28 14:03:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 214771ac-26f4-5760-a178-e14681ff06b8
2026-03-28 14:03:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DWV16UWB-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-28 14:03:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=WV16UWB-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-28 14:03:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:03:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a1fe363d0>
2026-03-28 14:03:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:03:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:03:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:03:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6f52ae88-a710-5999-b75b-294cfedaf6f8/6f52ae88-a710-5999-b75b-294cfedaf6f8_expert_report_file_7d14c044-ed09-4d03-9489-38732ad92b03.pdf HTTP/1.1" 201 0
2026-03-28 14:03:53 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item 6f52ae88-a710-5999-b75b-294cfedaf6f8
2026-03-28 14:03:53 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 6f52ae88-a710-5999-b75b-294cfedaf6f8, skipping ID generation
2026-03-28 14:03:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 6f52ae88-a710-5999-b75b-294cfedaf6f8
2026-03-28 14:03:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DX11BBM-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-28 14:03:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=X11BBM-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-28 14:03:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:03:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a1fe39e10>
2026-03-28 14:03:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:03:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:03:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:03:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0c3c3ab5-91e6-5450-9be7-ee521ca8a766/0c3c3ab5-91e6-5450-9be7-ee521ca8a766_expert_report_file_586396e7-a461-450b-a201-0611bd7a5cc5.pdf HTTP/1.1" 201 0
2026-03-28 14:03:53 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item 0c3c3ab5-91e6-5450-9be7-ee521ca8a766
2026-03-28 14:03:53 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 0c3c3ab5-91e6-5450-9be7-ee521ca8a766, skipping ID generation
2026-03-28 14:03:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 0c3c3ab5-91e6-5450-9be7-ee521ca8a766
2026-03-28 14:03:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DNL64KGO-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-28 14:03:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=NL64KGO-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-28 14:03:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/KV16LDZ/42797857?sv=2020-08-04&st=2026-03-28T14%3A03%3A49Z&se=2026-03-28T14%3A28%3A49Z&sr=b&sp=r&sig=7pGIWvim4gxli5cifd615Lw7Q0s6ljm9z8msDK3x6Js%3D> (referer: https://www.bca.co.uk/)
2026-03-28 14:03:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EJ13JTO/698540235/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/EJ13JTO/42810382?sv=2020-08-04&st=2026-03-28T14%3A01%3A03Z&se=2026-03-28T14%3A26%3A03Z&sr=b&sp=r&sig=9n5SmvjaM772xUjZdL0t%2BMeZRNBu1TSQPyTFa%2FZiaIA%3D)
2026-03-28 14:03:53 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/KM11UUD/42809630?sv=2020-08-04&st=2026-03-28T14%3A03%3A52Z&se=2026-03-28T14%3A28%3A52Z&sr=b&sp=r&sig=S16ojkv9p8NH2wa7caJZQVn%2BDGo%2BREXS30Hz2ckWR%2FA%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=KM11%20UUD-GB>
2026-03-28 14:03:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D697551217%27 HTTP/1.1" 200 None
2026-03-28 14:03:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=697551217 not downloaded yet
2026-03-28 14:03:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D697888006%27 HTTP/1.1" 200 None
2026-03-28 14:03:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=697888006 not downloaded yet
2026-03-28 14:03:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698920267%27 HTTP/1.1" 200 None
2026-03-28 14:03:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698920267 not downloaded yet
2026-03-28 14:03:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698767940%27 HTTP/1.1" 200 None
2026-03-28 14:03:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698767940 not downloaded yet
2026-03-28 14:03:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698150760%27 HTTP/1.1" 200 None
2026-03-28 14:03:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698150760 not downloaded yet
2026-03-28 14:03:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698107893%27 HTTP/1.1" 200 None
2026-03-28 14:03:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698107893 not downloaded yet
2026-03-28 14:03:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/WU19VDC/42792335?sv=2020-08-04&st=2026-03-28T14%3A03%3A50Z&se=2026-03-28T14%3A28%3A50Z&sr=b&sp=r&sig=Mqd3JjFAqa%2F7fy72g8Zcx8u%2F7XgFrycUpKRkPg1JOjA%3D> (referer: https://www.bca.co.uk/)
2026-03-28 14:03:53 [bca.uk] INFO: Found listing with ID: WB19%20OHW
2026-03-28 14:03:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WB19%2520OHW%27 HTTP/1.1" 200 None
2026-03-28 14:03:53 [bca.uk] INFO: Scrape type for WB19%20OHW: 1
2026-03-28 14:03:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 946e6279-6e49-5961-b70a-53fd1b261e3f with identifier: WB19%20OHW
2026-03-28 14:03:53 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 946e6279-6e49-5961-b70a-53fd1b261e3f
2026-03-28 14:03:53 [bca.uk] INFO: Found listing with ID: TFZ%208294
2026-03-28 14:03:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27TFZ%25208294%27 HTTP/1.1" 200 None
2026-03-28 14:03:53 [bca.uk] INFO: Scrape type for TFZ%208294: 1
2026-03-28 14:03:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 18272ae4-7bc4-594a-a0ef-c08da1ce17ad with identifier: TFZ%208294
2026-03-28 14:03:53 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 18272ae4-7bc4-594a-a0ef-c08da1ce17ad
2026-03-28 14:03:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698284408%27 HTTP/1.1" 200 None
2026-03-28 14:03:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698284408 not downloaded yet
2026-03-28 14:03:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D697603970%27 HTTP/1.1" 200 None
2026-03-28 14:03:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=697603970 not downloaded yet
2026-03-28 14:03:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698157097%27 HTTP/1.1" 200 None
2026-03-28 14:03:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698157097 not downloaded yet
2026-03-28 14:03:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:03:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a1fe4c950>
2026-03-28 14:03:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:03:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:03:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:03:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6665ad2b-5db8-5cb5-8575-3440dfdc3f0c/6665ad2b-5db8-5cb5-8575-3440dfdc3f0c_expert_report_file_83f500f5-a9b6-4942-a35a-b2dcb55f4940.pdf HTTP/1.1" 201 0
2026-03-28 14:03:53 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item 6665ad2b-5db8-5cb5-8575-3440dfdc3f0c
2026-03-28 14:03:53 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 6665ad2b-5db8-5cb5-8575-3440dfdc3f0c, skipping ID generation
2026-03-28 14:03:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 6665ad2b-5db8-5cb5-8575-3440dfdc3f0c
2026-03-28 14:03:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DBV61MVO-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-28 14:03:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=BV61MVO-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-28 14:03:53 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LN68RBY/698920178/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698920178>
2026-03-28 14:03:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YH13CHD/698786511/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YH13CHD/42807762?sv=2020-08-04&st=2026-03-28T14%3A01%3A02Z&se=2026-03-28T14%3A26%3A02Z&sr=b&sp=r&sig=Kk3ZnO0H7wXbnR6jzpTNZkeJ9EaoXS3djv9g6kExg8o%3D)
2026-03-28 14:03:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D697551238%27 HTTP/1.1" 200 None
2026-03-28 14:03:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=697551238 not downloaded yet
2026-03-28 14:03:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D697888020%27 HTTP/1.1" 200 None
2026-03-28 14:03:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=697888020 not downloaded yet
2026-03-28 14:03:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698920295%27 HTTP/1.1" 200 None
2026-03-28 14:03:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698920295 not downloaded yet
2026-03-28 14:03:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698767959%27 HTTP/1.1" 200 None
2026-03-28 14:03:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698767959 not downloaded yet
2026-03-28 14:03:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698150768%27 HTTP/1.1" 200 None
2026-03-28 14:03:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698150768 not downloaded yet
2026-03-28 14:03:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698107909%27 HTTP/1.1" 200 None
2026-03-28 14:03:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698107909 not downloaded yet
2026-03-28 14:03:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/DF12VWL/42797174?sv=2020-08-04&st=2026-03-28T14%3A03%3A51Z&se=2026-03-28T14%3A28%3A51Z&sr=b&sp=r&sig=0mRjBtvz6tka1D82qBQ3%2FRs63GOtrqyuAG7vdnh5S9c%3D> (referer: https://www.bca.co.uk/)
2026-03-28 14:03:53 [bca.uk] INFO: Found listing with ID: WD19%20GOC
2026-03-28 14:03:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WD19%2520GOC%27 HTTP/1.1" 200 None
2026-03-28 14:03:53 [bca.uk] INFO: Scrape type for WD19%20GOC: 1
2026-03-28 14:03:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a1043301-1d6c-5ef5-8043-fba38100bdea with identifier: WD19%20GOC
2026-03-28 14:03:53 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item a1043301-1d6c-5ef5-8043-fba38100bdea
2026-03-28 14:03:53 [bca.uk] INFO: Found listing with ID: WP63%20USZ
2026-03-28 14:03:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WP63%2520USZ%27 HTTP/1.1" 200 None
2026-03-28 14:03:53 [bca.uk] INFO: Scrape type for WP63%20USZ: 1
2026-03-28 14:03:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 49f7b40c-fae2-5164-be3f-ce9eb1a2514d with identifier: WP63%20USZ
2026-03-28 14:03:53 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 49f7b40c-fae2-5164-be3f-ce9eb1a2514d
2026-03-28 14:03:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698284411%27 HTTP/1.1" 200 None
2026-03-28 14:03:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698284411 not downloaded yet
2026-03-28 14:03:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D697603972%27 HTTP/1.1" 200 None
2026-03-28 14:03:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=697603972 not downloaded yet
2026-03-28 14:03:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698157107%27 HTTP/1.1" 200 None
2026-03-28 14:03:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698157107 not downloaded yet
2026-03-28 14:03:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698928503%27 HTTP/1.1" 200 None
2026-03-28 14:03:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698928503 not downloaded yet
2026-03-28 14:03:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:03:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c979810>
2026-03-28 14:03:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:03:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:03:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:03:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8b90222e-e04a-5b27-ab41-392150aadde5/8b90222e-e04a-5b27-ab41-392150aadde5_expert_report_file_46e3b6a7-961a-4e52-9723-9317477d3672.pdf HTTP/1.1" 201 0
2026-03-28 14:03:53 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item 8b90222e-e04a-5b27-ab41-392150aadde5
2026-03-28 14:03:53 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 8b90222e-e04a-5b27-ab41-392150aadde5, skipping ID generation
2026-03-28 14:03:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 8b90222e-e04a-5b27-ab41-392150aadde5
2026-03-28 14:03:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DKV16LDZ-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-28 14:03:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=KV16LDZ-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-28 14:03:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:03:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c8b64d0>
2026-03-28 14:03:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:03:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:03:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:03:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5be82b2b-6926-5451-8e0e-f3d801ad1cad/5be82b2b-6926-5451-8e0e-f3d801ad1cad_image_3.jpg HTTP/1.1" 201 0
2026-03-28 14:03:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FEJ13JTO%252F698540235%252F600') HTTP/1.1" 204 0
2026-03-28 14:03:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EJ13JTO/698540235/600 saved to cache
2026-03-28 14:03:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 5be82b2b-6926-5451-8e0e-f3d801ad1cad
2026-03-28 14:03:53 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LN68RBY/698920207/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698920207>
2026-03-28 14:03:53 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DA21SOU/697887986/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=697887986>
2026-03-28 14:03:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VX19OYP/698251025/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/VX19OYP/42810376?sv=2020-08-04&st=2026-03-28T14%3A01%3A04Z&se=2026-03-28T14%3A26%3A04Z&sr=b&sp=r&sig=ZoloAWIhiMuraB8%2BrUA7GYd%2BDLx9PxJOBzKxmER1A8U%3D)
2026-03-28 14:03:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D697551259%27 HTTP/1.1" 200 None
2026-03-28 14:03:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=697551259 not downloaded yet
2026-03-28 14:03:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D697888030%27 HTTP/1.1" 200 None
2026-03-28 14:03:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=697888030 not downloaded yet
2026-03-28 14:03:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698920315%27 HTTP/1.1" 200 None
2026-03-28 14:03:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698920315 not downloaded yet
2026-03-28 14:03:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698767973%27 HTTP/1.1" 200 None
2026-03-28 14:03:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698767973 not downloaded yet
2026-03-28 14:03:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698150775%27 HTTP/1.1" 200 None
2026-03-28 14:03:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698150775 not downloaded yet
2026-03-28 14:03:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698107923%27 HTTP/1.1" 200 None
2026-03-28 14:03:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698107923 not downloaded yet
2026-03-28 14:03:53 [bca.uk] INFO: Found listing with ID: WL19%20LZJ
2026-03-28 14:03:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WL19%2520LZJ%27 HTTP/1.1" 200 None
2026-03-28 14:03:53 [bca.uk] INFO: Scrape type for WL19%20LZJ: 2
2026-03-28 14:03:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 85ed700d-c14f-58ab-9e96-fbe478a99ade with identifier: WL19%20LZJ
2026-03-28 14:03:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 85ed700d-c14f-58ab-9e96-fbe478a99ade with scrape type 2
2026-03-28 14:03:53 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 85ed700d-c14f-58ab-9e96-fbe478a99ade with scrape type 2
2026-03-28 14:03:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 85ed700d-c14f-58ab-9e96-fbe478a99ade, identifier: WL19%20LZJ
2026-03-28 14:03:54 [bca.uk] INFO: Found listing with ID: MV18%20VBD
2026-03-28 14:03:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MV18%2520VBD%27 HTTP/1.1" 200 None
2026-03-28 14:03:54 [bca.uk] INFO: Scrape type for MV18%20VBD: 1
2026-03-28 14:03:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1c35ef13-b24b-57bb-8a15-809839352176 with identifier: MV18%20VBD
2026-03-28 14:03:54 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 1c35ef13-b24b-57bb-8a15-809839352176
2026-03-28 14:03:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698284415%27 HTTP/1.1" 200 None
2026-03-28 14:03:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698284415 not downloaded yet
2026-03-28 14:03:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D697603974%27 HTTP/1.1" 200 None
2026-03-28 14:03:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=697603974 not downloaded yet
2026-03-28 14:03:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698157119%27 HTTP/1.1" 200 None
2026-03-28 14:03:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698157119 not downloaded yet
2026-03-28 14:03:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698928533%27 HTTP/1.1" 200 None
2026-03-28 14:03:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698928533 not downloaded yet
2026-03-28 14:03:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698296888%27 HTTP/1.1" 200 None
2026-03-28 14:03:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698296888 not downloaded yet
2026-03-28 14:03:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:03:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c961310>
2026-03-28 14:03:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:03:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:03:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:03:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2c7ab10e-203f-5d5d-b669-d394e3cfab8d/2c7ab10e-203f-5d5d-b669-d394e3cfab8d_expert_report_file_7d2e52a7-4f47-4a52-a682-03c5c5f73255.pdf HTTP/1.1" 201 0
2026-03-28 14:03:54 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item 2c7ab10e-203f-5d5d-b669-d394e3cfab8d
2026-03-28 14:03:54 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 2c7ab10e-203f-5d5d-b669-d394e3cfab8d, skipping ID generation
2026-03-28 14:03:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 2c7ab10e-203f-5d5d-b669-d394e3cfab8d
2026-03-28 14:03:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DWU19VDC-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-28 14:03:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=WU19VDC-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-28 14:03:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LK64NEJ/42810513?sv=2020-08-04&st=2026-03-28T14%3A03%3A51Z&se=2026-03-28T14%3A28%3A51Z&sr=b&sp=r&sig=dZi6EyBOQ2GoK8knfBZtxM9S6O3yD8ghOm4nMLyaJjo%3D> (referer: https://www.bca.co.uk/)
2026-03-28 14:03:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/CK18AEJ/42809519?sv=2020-08-04&st=2026-03-28T14%3A03%3A52Z&se=2026-03-28T14%3A28%3A52Z&sr=b&sp=r&sig=tMAO1WCWalJ7mXIWRlCxzQ1Rx0voh0Hr3%2FaR8xfgZTg%3D> (referer: https://www.bca.co.uk/)
2026-03-28 14:03:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LN68RBY/698920112/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LN68RBY/42809684?sv=2020-08-04&st=2026-03-28T14%3A03%3A42Z&se=2026-03-28T14%3A28%3A42Z&sr=b&sp=r&sig=aIYqAxiZsHZDOcTozI0zzgpiaCRiEseqbYSKBZyhWQ4%3D)
2026-03-28 14:03:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 85ed700d-c14f-58ab-9e96-fbe478a99ade with identifier: WL19%20LZJ
2026-03-28 14:03:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 85ed700d-c14f-58ab-9e96-fbe478a99ade with identifier: WL19%20LZJ
2026-03-28 14:03:54 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 85ed700d-c14f-58ab-9e96-fbe478a99ade with identifier: WL19%20LZJ to the API
2026-03-28 14:03:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:03:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:03:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=4&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 93,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=WL19%20LZJ-GB',
'category': 'Car',
'color': 'grey',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.5L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Diesel',
'id': '85ed700d-c14f-58ab-9e96-fbe478a99ade',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'WL19 LZJ',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=WL19%20LZJ&vehicleType=*',
'listing': 'auction',
'location': 'Bridgwater',
'make': 'PEUGEOT',
'model': '2008',
'odometer': 27568,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-01-01',
'seller_name': None,
'title': 'PEUGEOT 2008 1.5 BLUEHDI 100 GT LINE (5G) MPV',
'transmission': 'manual',
'trim': 'BLUEHDI 100 GT LINE (5G)',
'vin': 'VF3CUYHYPKY056049',
'year': 2019}
2026-03-28 14:03:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WL19%2520LZJ%27 HTTP/1.1" 200 None
2026-03-28 14:03:54 [bca.uk] INFO: Saving data for WL19%20LZJ: {'auction_closing_time': 1774864800.0, 'created_time': 1774562600.832976, 'last_price_update_time': 1774706634.681124}
2026-03-28 14:03:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='WL19%2520LZJ') HTTP/1.1" 204 0
2026-03-28 14:03:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D697551274%27 HTTP/1.1" 200 None
2026-03-28 14:03:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=697551274 not downloaded yet
2026-03-28 14:03:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D697888046%27 HTTP/1.1" 200 None
2026-03-28 14:03:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=697888046 not downloaded yet
2026-03-28 14:03:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698920336%27 HTTP/1.1" 200 None
2026-03-28 14:03:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698920336 not downloaded yet
2026-03-28 14:03:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698767980%27 HTTP/1.1" 200 None
2026-03-28 14:03:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698767980 not downloaded yet
2026-03-28 14:03:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698150784%27 HTTP/1.1" 200 None
2026-03-28 14:03:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698150784 not downloaded yet
2026-03-28 14:03:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698107940%27 HTTP/1.1" 200 None
2026-03-28 14:03:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698107940 not downloaded yet
2026-03-28 14:03:54 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/MV57UOY/42807073?sv=2020-08-04&st=2026-03-28T14%3A03%3A53Z&se=2026-03-28T14%3A28%3A53Z&sr=b&sp=r&sig=4yruJ8ij2lkpzOh%2Bl0IV9Mz1vdyrZkWNPL1z%2B2woEio%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=MV57%20UOY-GB>
2026-03-28 14:03:54 [bca.uk] INFO: Found listing with ID: VO67%20OHE
2026-03-28 14:03:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27VO67%2520OHE%27 HTTP/1.1" 200 None
2026-03-28 14:03:54 [bca.uk] INFO: Scrape type for VO67%20OHE: 1
2026-03-28 14:03:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: eaf9d23b-faf9-5201-9f92-ea95460928e4 with identifier: VO67%20OHE
2026-03-28 14:03:54 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item eaf9d23b-faf9-5201-9f92-ea95460928e4
2026-03-28 14:03:54 [bca.uk] INFO: Found listing with ID: PK68%20NZT
2026-03-28 14:03:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27PK68%2520NZT%27 HTTP/1.1" 200 None
2026-03-28 14:03:54 [bca.uk] INFO: Scrape type for PK68%20NZT: 1
2026-03-28 14:03:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 418ba9d9-1978-54c6-a2d3-b78329217655 with identifier: PK68%20NZT
2026-03-28 14:03:54 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 418ba9d9-1978-54c6-a2d3-b78329217655
2026-03-28 14:03:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698284418%27 HTTP/1.1" 200 None
2026-03-28 14:03:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698284418 not downloaded yet
2026-03-28 14:03:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D697603979%27 HTTP/1.1" 200 None
2026-03-28 14:03:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=697603979 not downloaded yet
2026-03-28 14:03:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698157130%27 HTTP/1.1" 200 None
2026-03-28 14:03:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698157130 not downloaded yet
2026-03-28 14:03:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698928556%27 HTTP/1.1" 200 None
2026-03-28 14:03:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698928556 not downloaded yet
2026-03-28 14:03:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698296895%27 HTTP/1.1" 200 None
2026-03-28 14:03:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698296895 not downloaded yet
2026-03-28 14:03:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698045620%27 HTTP/1.1" 200 None
2026-03-28 14:03:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698045620 not downloaded yet
2026-03-28 14:03:55 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NL64KGO/698157087/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=NL64KGO-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-28 14:03:55 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/X11BBM/697603967/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=X11BBM-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-28 14:03:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698767998%27 HTTP/1.1" 200 None
2026-03-28 14:03:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698767998 not downloaded yet
2026-03-28 14:03:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698150796%27 HTTP/1.1" 200 None
2026-03-28 14:03:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698150796 not downloaded yet
2026-03-28 14:03:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698107963%27 HTTP/1.1" 200 None
2026-03-28 14:03:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698107963 not downloaded yet
2026-03-28 14:03:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:03:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a1feb6610>
2026-03-28 14:03:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:03:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:03:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:03:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dabe1fc4-09bf-52ef-9042-78b5e1d2db10/dabe1fc4-09bf-52ef-9042-78b5e1d2db10_image_4.jpg HTTP/1.1" 201 0
2026-03-28 14:03:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FYH13CHD%252F698786511%252F600') HTTP/1.1" 204 0
2026-03-28 14:03:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YH13CHD/698786511/600 saved to cache
2026-03-28 14:03:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item dabe1fc4-09bf-52ef-9042-78b5e1d2db10
2026-03-28 14:03:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:03:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c9ae2d0>
2026-03-28 14:03:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:03:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:03:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:03:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_40991700-d0e5-5255-930d-6ca8fe3c072d/40991700-d0e5-5255-930d-6ca8fe3c072d_expert_report_file_ed9240c8-23dd-4a11-baad-675cb8e28563.pdf HTTP/1.1" 201 0
2026-03-28 14:03:55 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item 40991700-d0e5-5255-930d-6ca8fe3c072d
2026-03-28 14:03:55 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 40991700-d0e5-5255-930d-6ca8fe3c072d, skipping ID generation
2026-03-28 14:03:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 40991700-d0e5-5255-930d-6ca8fe3c072d
2026-03-28 14:03:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DDF12VWL-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-28 14:03:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=DF12VWL-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-28 14:03:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:03:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c78d190>
2026-03-28 14:03:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:03:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:03:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:03:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b7b36a17-d5d4-5e94-9bbf-8a754ca74b60/b7b36a17-d5d4-5e94-9bbf-8a754ca74b60_image_5.jpg HTTP/1.1" 201 0
2026-03-28 14:03:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FVX19OYP%252F698251025%252F600') HTTP/1.1" 204 0
2026-03-28 14:03:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VX19OYP/698251025/600 saved to cache
2026-03-28 14:03:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item b7b36a17-d5d4-5e94-9bbf-8a754ca74b60
2026-03-28 14:03:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/BP67XDB/42810422?sv=2020-08-04&st=2026-03-28T14%3A03%3A52Z&se=2026-03-28T14%3A28%3A52Z&sr=b&sp=r&sig=Logn8Hbry8lNDBo7BHyP%2FFQM2Uo9ZZUQT4uyTv5b%2Bn0%3D> (referer: https://www.bca.co.uk/)
2026-03-28 14:03:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LN68RBY/698920178/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LN68RBY/42809684?sv=2020-08-04&st=2026-03-28T14%3A03%3A42Z&se=2026-03-28T14%3A28%3A42Z&sr=b&sp=r&sig=aIYqAxiZsHZDOcTozI0zzgpiaCRiEseqbYSKBZyhWQ4%3D)
2026-03-28 14:03:55 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BV61MVO/698928485/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=BV61MVO-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-28 14:03:55 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WV16UWB/698284405/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=WV16UWB-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-28 14:03:55 [bca.uk] INFO: Found listing with ID: WD66%20RGU
2026-03-28 14:03:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WD66%2520RGU%27 HTTP/1.1" 200 None
2026-03-28 14:03:55 [bca.uk] INFO: Scrape type for WD66%20RGU: 1
2026-03-28 14:03:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5fc655ed-6705-5d8a-9f72-de0010832a06 with identifier: WD66%20RGU
2026-03-28 14:03:55 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 5fc655ed-6705-5d8a-9f72-de0010832a06
2026-03-28 14:03:55 [bca.uk] INFO: Found listing with ID: KR71%20ZWG
2026-03-28 14:03:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KR71%2520ZWG%27 HTTP/1.1" 200 None
2026-03-28 14:03:55 [bca.uk] INFO: Scrape type for KR71%20ZWG: 1
2026-03-28 14:03:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c1e22119-0b44-5e50-aa2c-6734ba2fd45e with identifier: KR71%20ZWG
2026-03-28 14:03:55 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item c1e22119-0b44-5e50-aa2c-6734ba2fd45e
2026-03-28 14:03:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698284425%27 HTTP/1.1" 200 None
2026-03-28 14:03:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698284425 not downloaded yet
2026-03-28 14:03:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D697603988%27 HTTP/1.1" 200 None
2026-03-28 14:03:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=697603988 not downloaded yet
2026-03-28 14:03:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698157139%27 HTTP/1.1" 200 None
2026-03-28 14:03:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698157139 not downloaded yet
2026-03-28 14:03:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698928578%27 HTTP/1.1" 200 None
2026-03-28 14:03:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698928578 not downloaded yet
2026-03-28 14:03:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698296899%27 HTTP/1.1" 200 None
2026-03-28 14:03:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698296899 not downloaded yet
2026-03-28 14:03:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698045623%27 HTTP/1.1" 200 None
2026-03-28 14:03:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698045623 not downloaded yet
2026-03-28 14:03:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/KM11UUD/42809630?sv=2020-08-04&st=2026-03-28T14%3A03%3A52Z&se=2026-03-28T14%3A28%3A52Z&sr=b&sp=r&sig=S16ojkv9p8NH2wa7caJZQVn%2BDGo%2BREXS30Hz2ckWR%2FA%3D> (referer: https://www.bca.co.uk/)
2026-03-28 14:03:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698768016%27 HTTP/1.1" 200 None
2026-03-28 14:03:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698768016 not downloaded yet
2026-03-28 14:03:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698150805%27 HTTP/1.1" 200 None
2026-03-28 14:03:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698150805 not downloaded yet
2026-03-28 14:03:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698107989%27 HTTP/1.1" 200 None
2026-03-28 14:03:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698107989 not downloaded yet
2026-03-28 14:03:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698228752%27 HTTP/1.1" 200 None
2026-03-28 14:03:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698228752 not downloaded yet
2026-03-28 14:03:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:03:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2d83aad0>
2026-03-28 14:03:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:03:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:03:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:03:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bb105475-65fd-5601-86d0-a8590c56bf0b/bb105475-65fd-5601-86d0-a8590c56bf0b_expert_report_file_99765518-3803-42d4-8708-f67e9dc2eb77.pdf HTTP/1.1" 201 0
2026-03-28 14:03:55 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item bb105475-65fd-5601-86d0-a8590c56bf0b
2026-03-28 14:03:55 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: bb105475-65fd-5601-86d0-a8590c56bf0b, skipping ID generation
2026-03-28 14:03:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item bb105475-65fd-5601-86d0-a8590c56bf0b
2026-03-28 14:03:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DLK64NEJ-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-28 14:03:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=LK64NEJ-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-28 14:03:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:03:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2d835e90>
2026-03-28 14:03:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:03:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:03:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:03:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_954e7a8e-294d-583e-8576-18c9af402ec0/954e7a8e-294d-583e-8576-18c9af402ec0_expert_report_file_05f54dd5-d3ca-45f6-9bfe-102b2b8b5947.pdf HTTP/1.1" 201 0
2026-03-28 14:03:55 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item 954e7a8e-294d-583e-8576-18c9af402ec0
2026-03-28 14:03:55 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 954e7a8e-294d-583e-8576-18c9af402ec0, skipping ID generation
2026-03-28 14:03:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 954e7a8e-294d-583e-8576-18c9af402ec0
2026-03-28 14:03:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DCK18AEJ-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-28 14:03:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=CK18AEJ-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-28 14:03:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:03:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2d83a250>
2026-03-28 14:03:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:03:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:03:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:03:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_04fa14f2-714c-5033-a1fe-bd0c784e7d7e/04fa14f2-714c-5033-a1fe-bd0c784e7d7e_image_0.jpg HTTP/1.1" 201 0
2026-03-28 14:03:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLN68RBY%252F698920112%252F600') HTTP/1.1" 204 0
2026-03-28 14:03:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LN68RBY/698920112/600 saved to cache
2026-03-28 14:03:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 04fa14f2-714c-5033-a1fe-bd0c784e7d7e
2026-03-28 14:03:55 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NL64KGO/698157097/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698157097>
2026-03-28 14:03:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DA21SOU/697887986/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/DA21SOU/42810340?sv=2020-08-04&st=2026-03-28T14%3A03%3A42Z&se=2026-03-28T14%3A28%3A42Z&sr=b&sp=r&sig=6%2F4a%2BWc9n6QD4YiOi5mt3dZkPnMZj%2Bfh7208k4Rd3hI%3D)
2026-03-28 14:03:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LN68RBY/698920207/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LN68RBY/42809684?sv=2020-08-04&st=2026-03-28T14%3A03%3A42Z&se=2026-03-28T14%3A28%3A42Z&sr=b&sp=r&sig=aIYqAxiZsHZDOcTozI0zzgpiaCRiEseqbYSKBZyhWQ4%3D)
2026-03-28 14:03:55 [bca.uk] INFO: Found listing with ID: HD12%20PKZ
2026-03-28 14:03:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27HD12%2520PKZ%27 HTTP/1.1" 200 None
2026-03-28 14:03:55 [bca.uk] INFO: Scrape type for HD12%20PKZ: 1
2026-03-28 14:03:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d7dfafc8-5ff1-5ae1-8e11-8b4c127fde8a with identifier: HD12%20PKZ
2026-03-28 14:03:55 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item d7dfafc8-5ff1-5ae1-8e11-8b4c127fde8a
2026-03-28 14:03:55 [bca.uk] INFO: Found listing with ID: DG19%20VCT
2026-03-28 14:03:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DG19%2520VCT%27 HTTP/1.1" 200 None
2026-03-28 14:03:55 [bca.uk] INFO: Scrape type for DG19%20VCT: 1
2026-03-28 14:03:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 82ce45e5-a8c4-552b-855d-b8e5816f3055 with identifier: DG19%20VCT
2026-03-28 14:03:55 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 82ce45e5-a8c4-552b-855d-b8e5816f3055
2026-03-28 14:03:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698284431%27 HTTP/1.1" 200 None
2026-03-28 14:03:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698284431 not downloaded yet
2026-03-28 14:03:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D697604002%27 HTTP/1.1" 200 None
2026-03-28 14:03:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=697604002 not downloaded yet
2026-03-28 14:03:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698157151%27 HTTP/1.1" 200 None
2026-03-28 14:03:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698157151 not downloaded yet
2026-03-28 14:03:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698928598%27 HTTP/1.1" 200 None
2026-03-28 14:03:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698928598 not downloaded yet
2026-03-28 14:03:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698296902%27 HTTP/1.1" 200 None
2026-03-28 14:03:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698296902 not downloaded yet
2026-03-28 14:03:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698045628%27 HTTP/1.1" 200 None
2026-03-28 14:03:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698045628 not downloaded yet
2026-03-28 14:03:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698768031%27 HTTP/1.1" 200 None
2026-03-28 14:03:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698768031 not downloaded yet
2026-03-28 14:03:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698150817%27 HTTP/1.1" 200 None
2026-03-28 14:03:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698150817 not downloaded yet
2026-03-28 14:03:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698108014%27 HTTP/1.1" 200 None
2026-03-28 14:03:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698108014 not downloaded yet
2026-03-28 14:03:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698228757%27 HTTP/1.1" 200 None
2026-03-28 14:03:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698228757 not downloaded yet
2026-03-28 14:03:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698947020%27 HTTP/1.1" 200 None
2026-03-28 14:03:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698947020 not downloaded yet
2026-03-28 14:03:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698910336%27 HTTP/1.1" 200 None
2026-03-28 14:03:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698910336 not downloaded yet
2026-03-28 14:03:55 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KV16LDZ/698296885/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=KV16LDZ-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-28 14:03:55 [bca.uk] INFO: Found listing with ID: LL12%20WDZ
2026-03-28 14:03:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LL12%2520WDZ%27 HTTP/1.1" 200 None
2026-03-28 14:03:55 [bca.uk] INFO: Scrape type for LL12%20WDZ: 0
2026-03-28 14:03:55 [bca.uk] INFO: Found listing with ID: RO06%20OCF
2026-03-28 14:03:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27RO06%2520OCF%27 HTTP/1.1" 200 None
2026-03-28 14:03:55 [bca.uk] INFO: Scrape type for RO06%20OCF: 2
2026-03-28 14:03:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3e59c59d-d9f0-5b0c-b05d-2ffa1fde90a5 with identifier: RO06%20OCF
2026-03-28 14:03:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3e59c59d-d9f0-5b0c-b05d-2ffa1fde90a5 with scrape type 2
2026-03-28 14:03:55 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3e59c59d-d9f0-5b0c-b05d-2ffa1fde90a5 with scrape type 2
2026-03-28 14:03:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 3e59c59d-d9f0-5b0c-b05d-2ffa1fde90a5, identifier: RO06%20OCF
2026-03-28 14:03:56 [bca.uk] INFO: Found listing with ID: DE72%20KZJ
2026-03-28 14:03:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DE72%2520KZJ%27 HTTP/1.1" 200 None
2026-03-28 14:03:56 [bca.uk] INFO: Scrape type for DE72%20KZJ: 1
2026-03-28 14:03:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 300e41a8-d251-59f7-802e-bbb7283fa1e6 with identifier: DE72%20KZJ
2026-03-28 14:03:56 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 300e41a8-d251-59f7-802e-bbb7283fa1e6
2026-03-28 14:03:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698284438%27 HTTP/1.1" 200 None
2026-03-28 14:03:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698284438 not downloaded yet
2026-03-28 14:03:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D697604011%27 HTTP/1.1" 200 None
2026-03-28 14:03:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=697604011 not downloaded yet
2026-03-28 14:03:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698157165%27 HTTP/1.1" 200 None
2026-03-28 14:03:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698157165 not downloaded yet
2026-03-28 14:03:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698928622%27 HTTP/1.1" 200 None
2026-03-28 14:03:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698928622 not downloaded yet
2026-03-28 14:03:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698296906%27 HTTP/1.1" 200 None
2026-03-28 14:03:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698296906 not downloaded yet
2026-03-28 14:03:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698045632%27 HTTP/1.1" 200 None
2026-03-28 14:03:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698045632 not downloaded yet
2026-03-28 14:03:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:03:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2ca6d350>
2026-03-28 14:03:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:03:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:03:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:03:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_090813ec-adc2-5b7f-923f-58bcb47db483/090813ec-adc2-5b7f-923f-58bcb47db483_expert_report_file_e94e21d5-0e0e-48e8-945e-a5d92b291759.pdf HTTP/1.1" 201 0
2026-03-28 14:03:56 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item 090813ec-adc2-5b7f-923f-58bcb47db483
2026-03-28 14:03:56 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 090813ec-adc2-5b7f-923f-58bcb47db483, skipping ID generation
2026-03-28 14:03:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 090813ec-adc2-5b7f-923f-58bcb47db483
2026-03-28 14:03:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DBP67XDB-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-28 14:03:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=BP67XDB-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-28 14:03:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:03:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c8b3610>
2026-03-28 14:03:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:03:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:03:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:03:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_04fa14f2-714c-5033-a1fe-bd0c784e7d7e/04fa14f2-714c-5033-a1fe-bd0c784e7d7e_image_2.jpg HTTP/1.1" 201 0
2026-03-28 14:03:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLN68RBY%252F698920178%252F600') HTTP/1.1" 204 0
2026-03-28 14:03:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LN68RBY/698920178/600 saved to cache
2026-03-28 14:03:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 04fa14f2-714c-5033-a1fe-bd0c784e7d7e
2026-03-28 14:03:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:03:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c4192d0>
2026-03-28 14:03:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:03:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:03:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:03:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7ba82627-3d66-5970-bb5d-b19d751b9eb4/7ba82627-3d66-5970-bb5d-b19d751b9eb4_expert_report_file_d11bd6ee-08c7-45e0-9613-a67a59280070.pdf HTTP/1.1" 201 0
2026-03-28 14:03:56 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item 7ba82627-3d66-5970-bb5d-b19d751b9eb4
2026-03-28 14:03:56 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 7ba82627-3d66-5970-bb5d-b19d751b9eb4, skipping ID generation
2026-03-28 14:03:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 7ba82627-3d66-5970-bb5d-b19d751b9eb4
2026-03-28 14:03:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DKM11UUD-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-28 14:03:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=KM11UUD-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-28 14:03:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 3e59c59d-d9f0-5b0c-b05d-2ffa1fde90a5 with identifier: RO06%20OCF
2026-03-28 14:03:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 3e59c59d-d9f0-5b0c-b05d-2ffa1fde90a5 with identifier: RO06%20OCF
2026-03-28 14:03:56 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 3e59c59d-d9f0-5b0c-b05d-2ffa1fde90a5 with identifier: RO06%20OCF to the API
2026-03-28 14:03:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:03:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:03:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=4&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 291,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=RO06%20OCF-GB',
'category': 'Car',
'color': 'blue',
'currency': 'GBP',
'doors_number': 2,
'engine': '5.5L',
'expiration_date': '2026-03-29T10:00:00Z',
'fuel_type': 'Petrol',
'id': '3e59c59d-d9f0-5b0c-b05d-2ffa1fde90a5',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'RO06 OCF',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=RO06%20OCF&vehicleType=*',
'listing': 'auction',
'location': 'Bridgwater',
'make': 'MERCEDES-BENZ',
'model': 'SL500',
'odometer': 156061,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2006-01-01',
'seller_name': None,
'title': 'MERCEDES-BENZ SL500 5.5 (388-7) Convertible',
'transmission': 'manual',
'trim': '(388-7)',
'vin': 'WDB2304712F120034',
'year': 2006}
2026-03-28 14:03:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27RO06%2520OCF%27 HTTP/1.1" 200 None
2026-03-28 14:03:56 [bca.uk] INFO: Saving data for RO06%20OCF: {'auction_closing_time': 1774778400.0, 'created_time': 1773908720.375073, 'last_price_update_time': 1774706636.637916}
2026-03-28 14:03:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='RO06%2520OCF') HTTP/1.1" 204 0
2026-03-28 14:03:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698768046%27 HTTP/1.1" 200 None
2026-03-28 14:03:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698768046 not downloaded yet
2026-03-28 14:03:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698150830%27 HTTP/1.1" 200 None
2026-03-28 14:03:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698150830 not downloaded yet
2026-03-28 14:03:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698108035%27 HTTP/1.1" 200 None
2026-03-28 14:03:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698108035 not downloaded yet
2026-03-28 14:03:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698228771%27 HTTP/1.1" 200 None
2026-03-28 14:03:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698228771 not downloaded yet
2026-03-28 14:03:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698947033%27 HTTP/1.1" 200 None
2026-03-28 14:03:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698947033 not downloaded yet
2026-03-28 14:03:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698910355%27 HTTP/1.1" 200 None
2026-03-28 14:03:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698910355 not downloaded yet
2026-03-28 14:03:56 [bca.uk] INFO: Found listing with ID: RX13%20YNL
2026-03-28 14:03:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27RX13%2520YNL%27 HTTP/1.1" 200 None
2026-03-28 14:03:56 [bca.uk] INFO: Scrape type for RX13%20YNL: 0
2026-03-28 14:03:56 [bca.uk] INFO: Found listing with ID: SO10%20SJD
2026-03-28 14:03:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SO10%2520SJD%27 HTTP/1.1" 200 None
2026-03-28 14:03:56 [bca.uk] INFO: Scrape type for SO10%20SJD: 0
2026-03-28 14:03:56 [bca.uk] INFO: Found listing with ID: VO62%20VVP
2026-03-28 14:03:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27VO62%2520VVP%27 HTTP/1.1" 200 None
2026-03-28 14:03:56 [bca.uk] INFO: Scrape type for VO62%20VVP: 0
2026-03-28 14:03:56 [bca.uk] INFO: Found listing with ID: WF61%20XJT
2026-03-28 14:03:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WF61%2520XJT%27 HTTP/1.1" 200 None
2026-03-28 14:03:56 [bca.uk] INFO: Scrape type for WF61%20XJT: 0
2026-03-28 14:03:56 [bca.uk] INFO: Found listing with ID: WP13%20WWY
2026-03-28 14:03:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WP13%2520WWY%27 HTTP/1.1" 200 None
2026-03-28 14:03:56 [bca.uk] INFO: Scrape type for WP13%20WWY: 1
2026-03-28 14:03:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8e80177a-614d-57e6-b32b-c4549bde7262 with identifier: WP13%20WWY
2026-03-28 14:03:56 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 8e80177a-614d-57e6-b32b-c4549bde7262
2026-03-28 14:03:56 [bca.uk] INFO: Found listing with ID: MD19%20GWP
2026-03-28 14:03:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MD19%2520GWP%27 HTTP/1.1" 200 None
2026-03-28 14:03:56 [bca.uk] INFO: Scrape type for MD19%20GWP: 0
2026-03-28 14:03:56 [bca.uk] INFO: Found listing with ID: ML71%20WFO
2026-03-28 14:03:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27ML71%2520WFO%27 HTTP/1.1" 200 None
2026-03-28 14:03:56 [bca.uk] INFO: Scrape type for ML71%20WFO: 1
2026-03-28 14:03:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 932ab700-a26e-556f-85b5-1bb9734e718c with identifier: ML71%20WFO
2026-03-28 14:03:56 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 932ab700-a26e-556f-85b5-1bb9734e718c
2026-03-28 14:03:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698284443%27 HTTP/1.1" 200 None
2026-03-28 14:03:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698284443 not downloaded yet
2026-03-28 14:03:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D697604017%27 HTTP/1.1" 200 None
2026-03-28 14:03:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=697604017 not downloaded yet
2026-03-28 14:03:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698157181%27 HTTP/1.1" 200 None
2026-03-28 14:03:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698157181 not downloaded yet
2026-03-28 14:03:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698928652%27 HTTP/1.1" 200 None
2026-03-28 14:03:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698928652 not downloaded yet
2026-03-28 14:03:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698296913%27 HTTP/1.1" 200 None
2026-03-28 14:03:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698296913 not downloaded yet
2026-03-28 14:03:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698045637%27 HTTP/1.1" 200 None
2026-03-28 14:03:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698045637 not downloaded yet
2026-03-28 14:03:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698933971%27 HTTP/1.1" 200 None
2026-03-28 14:03:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698933971 not downloaded yet
2026-03-28 14:03:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698915234%27 HTTP/1.1" 200 None
2026-03-28 14:03:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698915234 not downloaded yet
2026-03-28 14:03:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:03:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2de553d0>
2026-03-28 14:03:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:03:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:03:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:03:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1534762c-5952-5a28-84f7-7b27016558ac/1534762c-5952-5a28-84f7-7b27016558ac_image_3.jpg HTTP/1.1" 201 0
2026-03-28 14:03:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FDA21SOU%252F697887986%252F600') HTTP/1.1" 204 0
2026-03-28 14:03:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DA21SOU/697887986/600 saved to cache
2026-03-28 14:03:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 1534762c-5952-5a28-84f7-7b27016558ac
2026-03-28 14:03:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:03:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c85a790>
2026-03-28 14:03:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:03:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:03:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:03:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_04fa14f2-714c-5033-a1fe-bd0c784e7d7e/04fa14f2-714c-5033-a1fe-bd0c784e7d7e_image_3.jpg HTTP/1.1" 201 0
2026-03-28 14:03:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLN68RBY%252F698920207%252F600') HTTP/1.1" 204 0
2026-03-28 14:03:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LN68RBY/698920207/600 saved to cache
2026-03-28 14:03:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 04fa14f2-714c-5033-a1fe-bd0c784e7d7e
2026-03-28 14:03:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698228782%27 HTTP/1.1" 200 None
2026-03-28 14:03:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698228782 not downloaded yet
2026-03-28 14:03:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698947049%27 HTTP/1.1" 200 None
2026-03-28 14:03:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698947049 not downloaded yet
2026-03-28 14:03:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698910374%27 HTTP/1.1" 200 None
2026-03-28 14:03:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698910374 not downloaded yet
2026-03-28 14:03:57 [bca.uk] INFO: Found listing with ID: LF16%20ZZH
2026-03-28 14:03:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LF16%2520ZZH%27 HTTP/1.1" 200 None
2026-03-28 14:03:57 [bca.uk] INFO: Scrape type for LF16%20ZZH: 0
2026-03-28 14:03:57 [bca.uk] INFO: Found listing with ID: YD21%20LKP
2026-03-28 14:03:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YD21%2520LKP%27 HTTP/1.1" 200 None
2026-03-28 14:03:57 [bca.uk] INFO: Scrape type for YD21%20LKP: 1
2026-03-28 14:03:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e39beb78-d51f-5fbe-a58d-f26050dd24f6 with identifier: YD21%20LKP
2026-03-28 14:03:57 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item e39beb78-d51f-5fbe-a58d-f26050dd24f6
2026-03-28 14:03:57 [bca.uk] INFO: Found listing with ID: SH22%20GFY
2026-03-28 14:03:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SH22%2520GFY%27 HTTP/1.1" 200 None
2026-03-28 14:03:57 [bca.uk] INFO: Scrape type for SH22%20GFY: 1
2026-03-28 14:03:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 95add145-cfdb-56fb-a27d-d877a0432bd6 with identifier: SH22%20GFY
2026-03-28 14:03:57 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 95add145-cfdb-56fb-a27d-d877a0432bd6
2026-03-28 14:03:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698284450%27 HTTP/1.1" 200 None
2026-03-28 14:03:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698284450 not downloaded yet
2026-03-28 14:03:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D697604024%27 HTTP/1.1" 200 None
2026-03-28 14:03:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=697604024 not downloaded yet
2026-03-28 14:03:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698157200%27 HTTP/1.1" 200 None
2026-03-28 14:03:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698157200 not downloaded yet
2026-03-28 14:03:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698928679%27 HTTP/1.1" 200 None
2026-03-28 14:03:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698928679 not downloaded yet
2026-03-28 14:03:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698296918%27 HTTP/1.1" 200 None
2026-03-28 14:03:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698296918 not downloaded yet
2026-03-28 14:03:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698045644%27 HTTP/1.1" 200 None
2026-03-28 14:03:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698045644 not downloaded yet
2026-03-28 14:03:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698933985%27 HTTP/1.1" 200 None
2026-03-28 14:03:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698933985 not downloaded yet
2026-03-28 14:03:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698915253%27 HTTP/1.1" 200 None
2026-03-28 14:03:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698915253 not downloaded yet
2026-03-28 14:03:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698228796%27 HTTP/1.1" 200 None
2026-03-28 14:03:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698228796 not downloaded yet
2026-03-28 14:03:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698947067%27 HTTP/1.1" 200 None
2026-03-28 14:03:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698947067 not downloaded yet
2026-03-28 14:03:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698910391%27 HTTP/1.1" 200 None
2026-03-28 14:03:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698910391 not downloaded yet
2026-03-28 14:03:57 [bca.uk] INFO: Found listing with ID: YD23%20UGZ
2026-03-28 14:03:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YD23%2520UGZ%27 HTTP/1.1" 200 None
2026-03-28 14:03:57 [bca.uk] INFO: Scrape type for YD23%20UGZ: 0
2026-03-28 14:03:57 [bca.uk] INFO: Found listing with ID: YH22%20LZX
2026-03-28 14:03:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YH22%2520LZX%27 HTTP/1.1" 200 None
2026-03-28 14:03:57 [bca.uk] INFO: Scrape type for YH22%20LZX: 0
2026-03-28 14:03:57 [bca.uk] INFO: Found listing with ID: V22%20VJW
2026-03-28 14:03:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27V22%2520VJW%27 HTTP/1.1" 200 None
2026-03-28 14:03:57 [bca.uk] INFO: Scrape type for V22%20VJW: 0
2026-03-28 14:03:57 [bca.uk] INFO: Found listing with ID: T400%20WRS
2026-03-28 14:03:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27T400%2520WRS%27 HTTP/1.1" 200 None
2026-03-28 14:03:57 [bca.uk] INFO: Scrape type for T400%20WRS: 1
2026-03-28 14:03:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a2c13cca-acdb-56e9-80bf-41e2acf4aed1 with identifier: T400%20WRS
2026-03-28 14:03:57 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item a2c13cca-acdb-56e9-80bf-41e2acf4aed1
2026-03-28 14:03:57 [bca.uk] INFO: Found listing with ID: WF68%20XGD
2026-03-28 14:03:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WF68%2520XGD%27 HTTP/1.1" 200 None
2026-03-28 14:03:57 [bca.uk] INFO: Scrape type for WF68%20XGD: 0
2026-03-28 14:03:57 [bca.uk] INFO: Found listing with ID: YC68%20TVN
2026-03-28 14:03:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YC68%2520TVN%27 HTTP/1.1" 200 None
2026-03-28 14:03:57 [bca.uk] INFO: Scrape type for YC68%20TVN: 0
2026-03-28 14:03:57 [bca.uk] INFO: Found listing with ID: YK19%20TBP
2026-03-28 14:03:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YK19%2520TBP%27 HTTP/1.1" 200 None
2026-03-28 14:03:57 [bca.uk] INFO: Scrape type for YK19%20TBP: 0
2026-03-28 14:03:57 [bca.uk] INFO: Found listing with ID: YH19%20PTV
2026-03-28 14:03:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YH19%2520PTV%27 HTTP/1.1" 200 None
2026-03-28 14:03:57 [bca.uk] INFO: Scrape type for YH19%20PTV: 0
2026-03-28 14:03:57 [bca.uk] INFO: Found listing with ID: DV20%20CWA
2026-03-28 14:03:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DV20%2520CWA%27 HTTP/1.1" 200 None
2026-03-28 14:03:57 [bca.uk] INFO: Scrape type for DV20%20CWA: 0
2026-03-28 14:03:57 [bca.uk] INFO: Found listing with ID: KEZ%209481
2026-03-28 14:03:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KEZ%25209481%27 HTTP/1.1" 200 None
2026-03-28 14:03:57 [bca.uk] INFO: Scrape type for KEZ%209481: 1
2026-03-28 14:03:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f055b506-0022-5f0e-a7cd-13f0911779b4 with identifier: KEZ%209481
2026-03-28 14:03:57 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item f055b506-0022-5f0e-a7cd-13f0911779b4
2026-03-28 14:03:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698928702%27 HTTP/1.1" 200 None
2026-03-28 14:03:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698928702 not downloaded yet
2026-03-28 14:03:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698296923%27 HTTP/1.1" 200 None
2026-03-28 14:03:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698296923 not downloaded yet
2026-03-28 14:03:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698045650%27 HTTP/1.1" 200 None
2026-03-28 14:03:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698045650 not downloaded yet
2026-03-28 14:03:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698934010%27 HTTP/1.1" 200 None
2026-03-28 14:03:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698934010 not downloaded yet
2026-03-28 14:03:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698915278%27 HTTP/1.1" 200 None
2026-03-28 14:03:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698915278 not downloaded yet
2026-03-28 14:03:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698228819%27 HTTP/1.1" 200 None
2026-03-28 14:03:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698228819 not downloaded yet
2026-03-28 14:03:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698947086%27 HTTP/1.1" 200 None
2026-03-28 14:03:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698947086 not downloaded yet
2026-03-28 14:03:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698910404%27 HTTP/1.1" 200 None
2026-03-28 14:03:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698910404 not downloaded yet
2026-03-28 14:03:57 [bca.uk] INFO: Found listing with ID: YG70%20CMV
2026-03-28 14:03:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YG70%2520CMV%27 HTTP/1.1" 200 None
2026-03-28 14:03:57 [bca.uk] INFO: Scrape type for YG70%20CMV: 1
2026-03-28 14:03:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 505ec447-0f6d-5de4-9190-5ab4c6e276f7 with identifier: YG70%20CMV
2026-03-28 14:03:57 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 505ec447-0f6d-5de4-9190-5ab4c6e276f7
2026-03-28 14:03:57 [bca.uk] INFO: Found listing with ID: LD11%20FZB
2026-03-28 14:03:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LD11%2520FZB%27 HTTP/1.1" 200 None
2026-03-28 14:03:57 [bca.uk] INFO: Scrape type for LD11%20FZB: 1
2026-03-28 14:03:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fadd6eea-e2b0-5574-affe-cdf6b892b445 with identifier: LD11%20FZB
2026-03-28 14:03:57 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item fadd6eea-e2b0-5574-affe-cdf6b892b445
2026-03-28 14:03:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698296928%27 HTTP/1.1" 200 None
2026-03-28 14:03:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698296928 not downloaded yet
2026-03-28 14:03:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698045655%27 HTTP/1.1" 200 None
2026-03-28 14:03:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698045655 not downloaded yet
2026-03-28 14:03:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698934023%27 HTTP/1.1" 200 None
2026-03-28 14:03:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698934023 not downloaded yet
2026-03-28 14:03:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698915297%27 HTTP/1.1" 200 None
2026-03-28 14:03:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698915297 not downloaded yet
2026-03-28 14:03:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698228838%27 HTTP/1.1" 200 None
2026-03-28 14:03:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698228838 not downloaded yet
2026-03-28 14:03:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698947115%27 HTTP/1.1" 200 None
2026-03-28 14:03:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698947115 not downloaded yet
2026-03-28 14:03:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698910428%27 HTTP/1.1" 200 None
2026-03-28 14:03:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698910428 not downloaded yet
2026-03-28 14:03:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WV16UWB/698284405/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/WV16UWB/42797605?sv=2020-08-04&st=2026-03-28T14%3A03%3A48Z&se=2026-03-28T14%3A28%3A48Z&sr=b&sp=r&sig=tZmKWGpA7mZ9Rie4bcnpNzrMU30KCOw%2BfaCUNgMn820%3D)
2026-03-28 14:03:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/X11BBM/697603967/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/X11BBM/42809514?sv=2020-08-04&st=2026-03-28T14%3A03%3A48Z&se=2026-03-28T14%3A28%3A48Z&sr=b&sp=r&sig=iFv2U%2F%2BmiJcqZ%2BPwwi1Pjq9aw6DZNzQsG5k9GNFr4Nw%3D)
2026-03-28 14:03:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NL64KGO/698157097/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/NL64KGO/42810049?sv=2020-08-04&st=2026-03-28T14%3A03%3A48Z&se=2026-03-28T14%3A28%3A48Z&sr=b&sp=r&sig=GCr8gvM5cBzuZAr6Na7pdcamsQO4tFs2xqxAknQovkg%3D)
2026-03-28 14:03:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BV61MVO/698928485/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/BV61MVO/42809949?sv=2020-08-04&st=2026-03-28T14%3A03%3A49Z&se=2026-03-28T14%3A28%3A49Z&sr=b&sp=r&sig=PJNKzVVeJy1FKQt32eUXNOOsoTV6pqchYxeSDnPTh7w%3D)
2026-03-28 14:03:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NL64KGO/698157087/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/NL64KGO/42810049?sv=2020-08-04&st=2026-03-28T14%3A03%3A48Z&se=2026-03-28T14%3A28%3A48Z&sr=b&sp=r&sig=GCr8gvM5cBzuZAr6Na7pdcamsQO4tFs2xqxAknQovkg%3D)
2026-03-28 14:03:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KV16LDZ/698296885/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/KV16LDZ/42797857?sv=2020-08-04&st=2026-03-28T14%3A03%3A49Z&se=2026-03-28T14%3A28%3A49Z&sr=b&sp=r&sig=7pGIWvim4gxli5cifd615Lw7Q0s6ljm9z8msDK3x6Js%3D)
2026-03-28 14:03:57 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KM11UUD/698915253/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698915253>
2026-03-28 14:03:57 [bca.uk] INFO: Found listing with ID: YM19%20HXY
2026-03-28 14:03:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YM19%2520HXY%27 HTTP/1.1" 200 None
2026-03-28 14:03:57 [bca.uk] INFO: Scrape type for YM19%20HXY: 1
2026-03-28 14:03:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 755211f2-f13f-55e0-85f5-1079296d0fd3 with identifier: YM19%20HXY
2026-03-28 14:03:57 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 755211f2-f13f-55e0-85f5-1079296d0fd3
2026-03-28 14:03:57 [bca.uk] INFO: Found listing with ID: YA12%20SZX
2026-03-28 14:03:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YA12%2520SZX%27 HTTP/1.1" 200 None
2026-03-28 14:03:57 [bca.uk] INFO: Scrape type for YA12%20SZX: 1
2026-03-28 14:03:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0673e591-45ac-5d50-a3e1-15ce73402302 with identifier: YA12%20SZX
2026-03-28 14:03:57 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 0673e591-45ac-5d50-a3e1-15ce73402302
2026-03-28 14:03:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698045660%27 HTTP/1.1" 200 None
2026-03-28 14:03:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698045660 not downloaded yet
2026-03-28 14:03:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698934036%27 HTTP/1.1" 200 None
2026-03-28 14:03:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698934036 not downloaded yet
2026-03-28 14:03:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698915312%27 HTTP/1.1" 200 None
2026-03-28 14:03:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698915312 not downloaded yet
2026-03-28 14:03:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698228854%27 HTTP/1.1" 200 None
2026-03-28 14:03:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698228854 not downloaded yet
2026-03-28 14:03:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698947141%27 HTTP/1.1" 200 None
2026-03-28 14:03:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698947141 not downloaded yet
2026-03-28 14:03:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698910455%27 HTTP/1.1" 200 None
2026-03-28 14:03:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698910455 not downloaded yet
2026-03-28 14:03:58 [bca.uk] INFO: Found listing with ID: YS71%20HNL
2026-03-28 14:03:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YS71%2520HNL%27 HTTP/1.1" 200 None
2026-03-28 14:03:58 [bca.uk] INFO: Scrape type for YS71%20HNL: 1
2026-03-28 14:03:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 407ba07a-d347-557e-98dd-c9e1e020c5c1 with identifier: YS71%20HNL
2026-03-28 14:03:58 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 407ba07a-d347-557e-98dd-c9e1e020c5c1
2026-03-28 14:03:58 [bca.uk] INFO: Found listing with ID: YE57%20GFG
2026-03-28 14:03:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YE57%2520GFG%27 HTTP/1.1" 200 None
2026-03-28 14:03:58 [bca.uk] INFO: Scrape type for YE57%20GFG: 1
2026-03-28 14:03:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7a0ff710-890b-5157-a73c-3a4a72d88d1e with identifier: YE57%20GFG
2026-03-28 14:03:58 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 7a0ff710-890b-5157-a73c-3a4a72d88d1e
2026-03-28 14:03:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698934061%27 HTTP/1.1" 200 None
2026-03-28 14:03:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698934061 not downloaded yet
2026-03-28 14:03:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698915340%27 HTTP/1.1" 200 None
2026-03-28 14:03:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698915340 not downloaded yet
2026-03-28 14:03:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698228887%27 HTTP/1.1" 200 None
2026-03-28 14:03:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698228887 not downloaded yet
2026-03-28 14:03:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698947168%27 HTTP/1.1" 200 None
2026-03-28 14:03:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698947168 not downloaded yet
2026-03-28 14:03:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698910480%27 HTTP/1.1" 200 None
2026-03-28 14:03:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698910480 not downloaded yet
2026-03-28 14:03:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/MV57UOY/42807073?sv=2020-08-04&st=2026-03-28T14%3A03%3A53Z&se=2026-03-28T14%3A28%3A53Z&sr=b&sp=r&sig=4yruJ8ij2lkpzOh%2Bl0IV9Mz1vdyrZkWNPL1z%2B2woEio%3D> (referer: https://www.bca.co.uk/)
2026-03-28 14:03:58 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KV16LDZ/698296918/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698296918>
2026-03-28 14:03:58 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WU19VDC/698045644/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698045644>
2026-03-28 14:03:58 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WV16UWB/698284450/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698284450>
2026-03-28 14:03:58 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NL64KGO/698157200/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698157200>
2026-03-28 14:03:58 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/X11BBM/697604024/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=697604024>
2026-03-28 14:03:58 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BV61MVO/698928679/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698928679>
2026-03-28 14:03:58 [bca.uk] INFO: Found listing with ID: YD70%20WOM
2026-03-28 14:03:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YD70%2520WOM%27 HTTP/1.1" 200 None
2026-03-28 14:03:58 [bca.uk] INFO: Scrape type for YD70%20WOM: 1
2026-03-28 14:03:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d4588dea-a04d-50d3-a9af-4f8459203fea with identifier: YD70%20WOM
2026-03-28 14:03:58 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item d4588dea-a04d-50d3-a9af-4f8459203fea
2026-03-28 14:03:58 [bca.uk] INFO: Found listing with ID: DE04%20GDK
2026-03-28 14:03:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DE04%2520GDK%27 HTTP/1.1" 200 None
2026-03-28 14:03:58 [bca.uk] INFO: Scrape type for DE04%20GDK: 1
2026-03-28 14:03:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 842ae7be-18fd-5ebf-ace8-89e5a9f85a09 with identifier: DE04%20GDK
2026-03-28 14:03:58 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 842ae7be-18fd-5ebf-ace8-89e5a9f85a09
2026-03-28 14:03:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698934081%27 HTTP/1.1" 200 None
2026-03-28 14:03:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698934081 not downloaded yet
2026-03-28 14:03:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698915361%27 HTTP/1.1" 200 None
2026-03-28 14:03:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698915361 not downloaded yet
2026-03-28 14:03:58 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BP67XDB/698933985/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698933985>
2026-03-28 14:03:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698947193%27 HTTP/1.1" 200 None
2026-03-28 14:03:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698947193 not downloaded yet
2026-03-28 14:03:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698910501%27 HTTP/1.1" 200 None
2026-03-28 14:03:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698910501 not downloaded yet
2026-03-28 14:03:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:03:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c627710>
2026-03-28 14:03:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:03:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:03:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:03:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_214771ac-26f4-5760-a178-e14681ff06b8/214771ac-26f4-5760-a178-e14681ff06b8_image_0.jpg HTTP/1.1" 201 0
2026-03-28 14:03:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FWV16UWB%252F698284405%252F600') HTTP/1.1" 204 0
2026-03-28 14:03:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WV16UWB/698284405/600 saved to cache
2026-03-28 14:03:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 214771ac-26f4-5760-a178-e14681ff06b8
2026-03-28 14:03:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:03:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2d9126d0>
2026-03-28 14:03:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:03:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:03:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:03:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6f52ae88-a710-5999-b75b-294cfedaf6f8/6f52ae88-a710-5999-b75b-294cfedaf6f8_image_0.jpg HTTP/1.1" 201 0
2026-03-28 14:03:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FX11BBM%252F697603967%252F600') HTTP/1.1" 204 0
2026-03-28 14:03:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/X11BBM/697603967/600 saved to cache
2026-03-28 14:03:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 6f52ae88-a710-5999-b75b-294cfedaf6f8
2026-03-28 14:03:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:03:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c51ad50>
2026-03-28 14:03:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:03:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:03:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:03:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0c3c3ab5-91e6-5450-9be7-ee521ca8a766/0c3c3ab5-91e6-5450-9be7-ee521ca8a766_image_1.jpg HTTP/1.1" 201 0
2026-03-28 14:03:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FNL64KGO%252F698157097%252F600') HTTP/1.1" 204 0
2026-03-28 14:03:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NL64KGO/698157097/600 saved to cache
2026-03-28 14:03:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 0c3c3ab5-91e6-5450-9be7-ee521ca8a766
2026-03-28 14:03:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:03:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2d911e50>
2026-03-28 14:03:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:03:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:03:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:03:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6665ad2b-5db8-5cb5-8575-3440dfdc3f0c/6665ad2b-5db8-5cb5-8575-3440dfdc3f0c_image_0.jpg HTTP/1.1" 201 0
2026-03-28 14:03:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FBV61MVO%252F698928485%252F600') HTTP/1.1" 204 0
2026-03-28 14:03:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BV61MVO/698928485/600 saved to cache
2026-03-28 14:03:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 6665ad2b-5db8-5cb5-8575-3440dfdc3f0c
2026-03-28 14:03:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:03:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c7e0290>
2026-03-28 14:03:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:03:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:03:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:03:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0c3c3ab5-91e6-5450-9be7-ee521ca8a766/0c3c3ab5-91e6-5450-9be7-ee521ca8a766_image_0.jpg HTTP/1.1" 201 0
2026-03-28 14:03:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FNL64KGO%252F698157087%252F600') HTTP/1.1" 204 0
2026-03-28 14:03:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NL64KGO/698157087/600 saved to cache
2026-03-28 14:03:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 0c3c3ab5-91e6-5450-9be7-ee521ca8a766
2026-03-28 14:03:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:03:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2d910c90>
2026-03-28 14:03:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:03:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:03:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:03:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8b90222e-e04a-5b27-ab41-392150aadde5/8b90222e-e04a-5b27-ab41-392150aadde5_image_0.jpg HTTP/1.1" 201 0
2026-03-28 14:03:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FKV16LDZ%252F698296885%252F600') HTTP/1.1" 204 0
2026-03-28 14:03:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KV16LDZ/698296885/600 saved to cache
2026-03-28 14:03:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 8b90222e-e04a-5b27-ab41-392150aadde5
2026-03-28 14:03:58 [bca.uk] INFO: Found listing with ID: AX15%20GHV
2026-03-28 14:03:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27AX15%2520GHV%27 HTTP/1.1" 200 None
2026-03-28 14:03:58 [bca.uk] INFO: Scrape type for AX15%20GHV: 1
2026-03-28 14:03:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 605bb574-f032-5f24-9f53-91befb051fec with identifier: AX15%20GHV
2026-03-28 14:03:58 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 605bb574-f032-5f24-9f53-91befb051fec
2026-03-28 14:03:58 [bca.uk] INFO: Found listing with ID: WJZ%209285
2026-03-28 14:03:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WJZ%25209285%27 HTTP/1.1" 200 None
2026-03-28 14:03:58 [bca.uk] INFO: Scrape type for WJZ%209285: 1
2026-03-28 14:03:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a149de9c-cfcc-5dd2-a714-96be3f56b350 with identifier: WJZ%209285
2026-03-28 14:03:58 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item a149de9c-cfcc-5dd2-a714-96be3f56b350
2026-03-28 14:03:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698934110%27 HTTP/1.1" 200 None
2026-03-28 14:03:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698934110 not downloaded yet
2026-03-28 14:03:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698915386%27 HTTP/1.1" 200 None
2026-03-28 14:03:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698915386 not downloaded yet
2026-03-28 14:03:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KM11UUD/698915253/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/KM11UUD/42809630?sv=2020-08-04&st=2026-03-28T14%3A03%3A52Z&se=2026-03-28T14%3A28%3A52Z&sr=b&sp=r&sig=S16ojkv9p8NH2wa7caJZQVn%2BDGo%2BREXS30Hz2ckWR%2FA%3D)
2026-03-28 14:03:58 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KV16LDZ/698296928/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698296928>
2026-03-28 14:03:58 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BP67XDB/698934023/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698934023>
2026-03-28 14:03:58 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WU19VDC/698045655/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698045655>
2026-03-28 14:03:58 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KM11UUD/698915297/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698915297>
2026-03-28 14:03:58 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YG70CMV/42809751?sv=2020-08-04&st=2026-03-28T14%3A03%3A58Z&se=2026-03-28T14%3A28%3A58Z&sr=b&sp=r&sig=1ABLz0vVsC9yYBr%2F09SZY1lBMEdGcrDzJ1kVHXJEJlA%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=YG70%20CMV-GB>
2026-03-28 14:03:58 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LD11FZB/42809686?sv=2020-08-04&st=2026-03-28T14%3A03%3A58Z&se=2026-03-28T14%3A28%3A58Z&sr=b&sp=r&sig=%2FK4BAlVG%2BClj51VCbQA3WyKfnHgVC%2B3mVHIA2lg6Jqc%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=LD11%20FZB-GB>
2026-03-28 14:03:58 [bca.uk] INFO: Found listing with ID: BT66%20DFX
2026-03-28 14:03:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BT66%2520DFX%27 HTTP/1.1" 200 None
2026-03-28 14:03:58 [bca.uk] INFO: Scrape type for BT66%20DFX: 1
2026-03-28 14:03:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ca2c3006-0503-55ad-a26d-88f328a541b5 with identifier: BT66%20DFX
2026-03-28 14:03:58 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item ca2c3006-0503-55ad-a26d-88f328a541b5
2026-03-28 14:03:58 [bca.uk] INFO: Found listing with ID: AK67%20LWT
2026-03-28 14:03:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27AK67%2520LWT%27 HTTP/1.1" 200 None
2026-03-28 14:03:58 [bca.uk] INFO: Scrape type for AK67%20LWT: 1
2026-03-28 14:03:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 96df00f7-d862-5338-b935-5c42d63b82c0 with identifier: AK67%20LWT
2026-03-28 14:03:58 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 96df00f7-d862-5338-b935-5c42d63b82c0
2026-03-28 14:03:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698934128%27 HTTP/1.1" 200 None
2026-03-28 14:03:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698934128 not downloaded yet
2026-03-28 14:03:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698915403%27 HTTP/1.1" 200 None
2026-03-28 14:03:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698915403 not downloaded yet
2026-03-28 14:03:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BV61MVO/698928679/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/BV61MVO/42809949?sv=2020-08-04&st=2026-03-28T14%3A03%3A49Z&se=2026-03-28T14%3A28%3A49Z&sr=b&sp=r&sig=PJNKzVVeJy1FKQt32eUXNOOsoTV6pqchYxeSDnPTh7w%3D)
2026-03-28 14:03:58 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KM11UUD/698915340/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698915340>
2026-03-28 14:03:58 [bca.uk] INFO: Found listing with ID: YD64%20WJN
2026-03-28 14:03:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YD64%2520WJN%27 HTTP/1.1" 200 None
2026-03-28 14:03:58 [bca.uk] INFO: Scrape type for YD64%20WJN: 1
2026-03-28 14:03:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a6b7695a-3dc3-56dd-a07d-29432fe9fa43 with identifier: YD64%20WJN
2026-03-28 14:03:58 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item a6b7695a-3dc3-56dd-a07d-29432fe9fa43
2026-03-28 14:03:58 [bca.uk] INFO: Found listing with ID: HY65%20KRJ
2026-03-28 14:03:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27HY65%2520KRJ%27 HTTP/1.1" 200 None
2026-03-28 14:03:58 [bca.uk] INFO: Scrape type for HY65%20KRJ: 1
2026-03-28 14:03:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fe123a59-25d0-509d-9046-e45117da9996 with identifier: HY65%20KRJ
2026-03-28 14:03:58 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item fe123a59-25d0-509d-9046-e45117da9996
2026-03-28 14:03:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:03:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a1fea20d0>
2026-03-28 14:03:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:03:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:03:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:03:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b344c6b3-761f-572b-9e4c-84678fe27e52/b344c6b3-761f-572b-9e4c-84678fe27e52_expert_report_file_01c36beb-92f0-430c-a878-974237118823.pdf HTTP/1.1" 201 0
2026-03-28 14:03:58 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item b344c6b3-761f-572b-9e4c-84678fe27e52
2026-03-28 14:03:58 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: b344c6b3-761f-572b-9e4c-84678fe27e52, skipping ID generation
2026-03-28 14:03:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item b344c6b3-761f-572b-9e4c-84678fe27e52
2026-03-28 14:03:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DMV57UOY-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-28 14:03:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=MV57UOY-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-28 14:03:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WU19VDC/698045644/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/WU19VDC/42792335?sv=2020-08-04&st=2026-03-28T14%3A03%3A50Z&se=2026-03-28T14%3A28%3A50Z&sr=b&sp=r&sig=Mqd3JjFAqa%2F7fy72g8Zcx8u%2F7XgFrycUpKRkPg1JOjA%3D)
2026-03-28 14:03:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/X11BBM/697604024/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/X11BBM/42809514?sv=2020-08-04&st=2026-03-28T14%3A03%3A48Z&se=2026-03-28T14%3A28%3A48Z&sr=b&sp=r&sig=iFv2U%2F%2BmiJcqZ%2BPwwi1Pjq9aw6DZNzQsG5k9GNFr4Nw%3D)
2026-03-28 14:03:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WV16UWB/698284450/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/WV16UWB/42797605?sv=2020-08-04&st=2026-03-28T14%3A03%3A48Z&se=2026-03-28T14%3A28%3A48Z&sr=b&sp=r&sig=tZmKWGpA7mZ9Rie4bcnpNzrMU30KCOw%2BfaCUNgMn820%3D)
2026-03-28 14:03:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BP67XDB/698933985/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/BP67XDB/42810422?sv=2020-08-04&st=2026-03-28T14%3A03%3A52Z&se=2026-03-28T14%3A28%3A52Z&sr=b&sp=r&sig=Logn8Hbry8lNDBo7BHyP%2FFQM2Uo9ZZUQT4uyTv5b%2Bn0%3D)
2026-03-28 14:03:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KV16LDZ/698296918/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/KV16LDZ/42797857?sv=2020-08-04&st=2026-03-28T14%3A03%3A49Z&se=2026-03-28T14%3A28%3A49Z&sr=b&sp=r&sig=7pGIWvim4gxli5cifd615Lw7Q0s6ljm9z8msDK3x6Js%3D)
2026-03-28 14:03:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NL64KGO/698157200/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/NL64KGO/42810049?sv=2020-08-04&st=2026-03-28T14%3A03%3A48Z&se=2026-03-28T14%3A28%3A48Z&sr=b&sp=r&sig=GCr8gvM5cBzuZAr6Na7pdcamsQO4tFs2xqxAknQovkg%3D)
2026-03-28 14:03:58 [bca.uk] INFO: Found listing with ID: YO66%20ENU
2026-03-28 14:03:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YO66%2520ENU%27 HTTP/1.1" 200 None
2026-03-28 14:03:58 [bca.uk] INFO: Scrape type for YO66%20ENU: 1
2026-03-28 14:03:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8d0c9ac8-161b-5c76-8a79-0338cb8a1867 with identifier: YO66%20ENU
2026-03-28 14:03:58 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 8d0c9ac8-161b-5c76-8a79-0338cb8a1867
2026-03-28 14:03:58 [bca.uk] INFO: Found listing with ID: M70%20ODE
2026-03-28 14:03:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27M70%2520ODE%27 HTTP/1.1" 200 None
2026-03-28 14:03:58 [bca.uk] INFO: Scrape type for M70%20ODE: 1
2026-03-28 14:03:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6671a6d0-673a-5170-b57c-2fa413a2722d with identifier: M70%20ODE
2026-03-28 14:03:58 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 6671a6d0-673a-5170-b57c-2fa413a2722d
2026-03-28 14:03:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698798192%27 HTTP/1.1" 200 None
2026-03-28 14:03:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698798192 not downloaded yet
2026-03-28 14:03:58 [bca.uk] INFO: Found listing with ID: YB63%20ZKP
2026-03-28 14:03:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YB63%2520ZKP%27 HTTP/1.1" 200 None
2026-03-28 14:03:58 [bca.uk] INFO: Scrape type for YB63%20ZKP: 1
2026-03-28 14:03:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 243a05a7-7cda-5444-ab1c-5fdc014fa410 with identifier: YB63%20ZKP
2026-03-28 14:03:58 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 243a05a7-7cda-5444-ab1c-5fdc014fa410
2026-03-28 14:03:58 [bca.uk] INFO: Found listing with ID: NK64%20UTR
2026-03-28 14:03:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27NK64%2520UTR%27 HTTP/1.1" 200 None
2026-03-28 14:03:58 [bca.uk] INFO: Scrape type for NK64%20UTR: 1
2026-03-28 14:03:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1a399624-5154-54f6-ad94-51c45341542d with identifier: NK64%20UTR
2026-03-28 14:03:58 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 1a399624-5154-54f6-ad94-51c45341542d
2026-03-28 14:03:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698798204%27 HTTP/1.1" 200 None
2026-03-28 14:03:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698798204 not downloaded yet
2026-03-28 14:03:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:03:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2d641ed0>
2026-03-28 14:03:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:03:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:03:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:03:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7ba82627-3d66-5970-bb5d-b19d751b9eb4/7ba82627-3d66-5970-bb5d-b19d751b9eb4_image_2.jpg HTTP/1.1" 201 0
2026-03-28 14:03:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FKM11UUD%252F698915253%252F600') HTTP/1.1" 204 0
2026-03-28 14:03:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KM11UUD/698915253/600 saved to cache
2026-03-28 14:03:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 7ba82627-3d66-5970-bb5d-b19d751b9eb4
2026-03-28 14:03:58 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:03:58 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:03:58 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:03:58 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:03:58 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:03:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:03:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c62c190>
2026-03-28 14:03:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:03:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:03:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:03:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6665ad2b-5db8-5cb5-8575-3440dfdc3f0c/6665ad2b-5db8-5cb5-8575-3440dfdc3f0c_image_8.jpg HTTP/1.1" 201 0
2026-03-28 14:03:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FBV61MVO%252F698928679%252F600') HTTP/1.1" 204 0
2026-03-28 14:03:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BV61MVO/698928679/600 saved to cache
2026-03-28 14:03:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 6665ad2b-5db8-5cb5-8575-3440dfdc3f0c
2026-03-28 14:03:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KM11UUD/698915297/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/KM11UUD/42809630?sv=2020-08-04&st=2026-03-28T14%3A03%3A52Z&se=2026-03-28T14%3A28%3A52Z&sr=b&sp=r&sig=S16ojkv9p8NH2wa7caJZQVn%2BDGo%2BREXS30Hz2ckWR%2FA%3D)
2026-03-28 14:03:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BP67XDB/698934023/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/BP67XDB/42810422?sv=2020-08-04&st=2026-03-28T14%3A03%3A52Z&se=2026-03-28T14%3A28%3A52Z&sr=b&sp=r&sig=Logn8Hbry8lNDBo7BHyP%2FFQM2Uo9ZZUQT4uyTv5b%2Bn0%3D)
2026-03-28 14:03:58 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CK18AEJ/698910501/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698910501>
2026-03-28 14:03:58 [bca.uk] INFO: Found listing with ID: BC65%20FJV
2026-03-28 14:03:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BC65%2520FJV%27 HTTP/1.1" 200 None
2026-03-28 14:03:58 [bca.uk] INFO: Scrape type for BC65%20FJV: 1
2026-03-28 14:03:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 515d9b9e-7ed9-596c-8fe3-830ee20f7887 with identifier: BC65%20FJV
2026-03-28 14:03:58 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 515d9b9e-7ed9-596c-8fe3-830ee20f7887
2026-03-28 14:03:58 [bca.uk] INFO: Found listing with ID: PXZ%201595
2026-03-28 14:03:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27PXZ%25201595%27 HTTP/1.1" 200 None
2026-03-28 14:03:58 [bca.uk] INFO: Scrape type for PXZ%201595: 1
2026-03-28 14:03:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8f3e30a4-6b64-5dd1-8e1e-6cce5d49fef3 with identifier: PXZ%201595
2026-03-28 14:03:58 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 8f3e30a4-6b64-5dd1-8e1e-6cce5d49fef3
2026-03-28 14:03:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698798217%27 HTTP/1.1" 200 None
2026-03-28 14:03:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698798217 not downloaded yet
2026-03-28 14:03:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WU19VDC/698045655/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/WU19VDC/42792335?sv=2020-08-04&st=2026-03-28T14%3A03%3A50Z&se=2026-03-28T14%3A28%3A50Z&sr=b&sp=r&sig=Mqd3JjFAqa%2F7fy72g8Zcx8u%2F7XgFrycUpKRkPg1JOjA%3D)
2026-03-28 14:03:59 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:03:59 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:03:59 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:03:59 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:03:59 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:03:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:03:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c845890>
2026-03-28 14:03:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:03:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:03:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:03:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2c7ab10e-203f-5d5d-b669-d394e3cfab8d/2c7ab10e-203f-5d5d-b669-d394e3cfab8d_image_6.jpg HTTP/1.1" 201 0
2026-03-28 14:03:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FWU19VDC%252F698045644%252F600') HTTP/1.1" 204 0
2026-03-28 14:03:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WU19VDC/698045644/600 saved to cache
2026-03-28 14:03:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 2c7ab10e-203f-5d5d-b669-d394e3cfab8d
2026-03-28 14:03:59 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:03:59 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:03:59 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:03:59 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:03:59 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:03:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:03:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2ca46c50>
2026-03-28 14:03:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:03:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:03:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:03:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6f52ae88-a710-5999-b75b-294cfedaf6f8/6f52ae88-a710-5999-b75b-294cfedaf6f8_image_9.jpg HTTP/1.1" 201 0
2026-03-28 14:03:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FX11BBM%252F697604024%252F600') HTTP/1.1" 204 0
2026-03-28 14:03:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/X11BBM/697604024/600 saved to cache
2026-03-28 14:03:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 6f52ae88-a710-5999-b75b-294cfedaf6f8
2026-03-28 14:03:59 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:03:59 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:03:59 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:03:59 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:03:59 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:03:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:03:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a1ff23b90>
2026-03-28 14:03:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:03:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:03:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:03:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_214771ac-26f4-5760-a178-e14681ff06b8/214771ac-26f4-5760-a178-e14681ff06b8_image_9.jpg HTTP/1.1" 201 0
2026-03-28 14:03:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FWV16UWB%252F698284450%252F600') HTTP/1.1" 204 0
2026-03-28 14:03:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WV16UWB/698284450/600 saved to cache
2026-03-28 14:03:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 214771ac-26f4-5760-a178-e14681ff06b8
2026-03-28 14:03:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:03:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c9debd0>
2026-03-28 14:03:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:03:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:03:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:03:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_090813ec-adc2-5b7f-923f-58bcb47db483/090813ec-adc2-5b7f-923f-58bcb47db483_image_2.jpg HTTP/1.1" 201 0
2026-03-28 14:03:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FBP67XDB%252F698933985%252F600') HTTP/1.1" 204 0
2026-03-28 14:03:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BP67XDB/698933985/600 saved to cache
2026-03-28 14:03:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 090813ec-adc2-5b7f-923f-58bcb47db483
2026-03-28 14:03:59 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:03:59 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:03:59 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:03:59 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:03:59 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:03:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:03:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c8db850>
2026-03-28 14:03:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:03:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:03:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:03:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8b90222e-e04a-5b27-ab41-392150aadde5/8b90222e-e04a-5b27-ab41-392150aadde5_image_7.jpg HTTP/1.1" 201 0
2026-03-28 14:03:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FKV16LDZ%252F698296918%252F600') HTTP/1.1" 204 0
2026-03-28 14:03:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KV16LDZ/698296918/600 saved to cache
2026-03-28 14:03:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 8b90222e-e04a-5b27-ab41-392150aadde5
2026-03-28 14:03:59 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:03:59 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:03:59 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:03:59 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:03:59 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:03:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:03:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c97b9d0>
2026-03-28 14:03:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:03:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:03:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:03:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0c3c3ab5-91e6-5450-9be7-ee521ca8a766/0c3c3ab5-91e6-5450-9be7-ee521ca8a766_image_9.jpg HTTP/1.1" 201 0
2026-03-28 14:03:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FNL64KGO%252F698157200%252F600') HTTP/1.1" 204 0
2026-03-28 14:03:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NL64KGO/698157200/600 saved to cache
2026-03-28 14:03:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 0c3c3ab5-91e6-5450-9be7-ee521ca8a766
2026-03-28 14:03:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KV16LDZ/698296928/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/KV16LDZ/42797857?sv=2020-08-04&st=2026-03-28T14%3A03%3A49Z&se=2026-03-28T14%3A28%3A49Z&sr=b&sp=r&sig=7pGIWvim4gxli5cifd615Lw7Q0s6ljm9z8msDK3x6Js%3D)
2026-03-28 14:03:59 [bca.uk] INFO: Found listing with ID: WJ58%20DWA
2026-03-28 14:03:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WJ58%2520DWA%27 HTTP/1.1" 200 None
2026-03-28 14:03:59 [bca.uk] INFO: Scrape type for WJ58%20DWA: 1
2026-03-28 14:03:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8413221f-7948-5093-9030-c87150f157c7 with identifier: WJ58%20DWA
2026-03-28 14:03:59 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 8413221f-7948-5093-9030-c87150f157c7
2026-03-28 14:03:59 [bca.uk] INFO: Found listing with ID: EP68%20EZZ
2026-03-28 14:03:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27EP68%2520EZZ%27 HTTP/1.1" 200 None
2026-03-28 14:03:59 [bca.uk] INFO: Scrape type for EP68%20EZZ: 0
2026-03-28 14:03:59 [bca.uk] INFO: Found listing with ID: KW24%20UKR
2026-03-28 14:03:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KW24%2520UKR%27 HTTP/1.1" 200 None
2026-03-28 14:03:59 [bca.uk] INFO: Scrape type for KW24%20UKR: 0
2026-03-28 14:03:59 [bca.uk] INFO: Found listing with ID: MX69%20OBE
2026-03-28 14:03:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MX69%2520OBE%27 HTTP/1.1" 200 None
2026-03-28 14:03:59 [bca.uk] INFO: Scrape type for MX69%20OBE: 0
2026-03-28 14:03:59 [bca.uk] INFO: Found listing with ID: ND18%20UAG
2026-03-28 14:03:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27ND18%2520UAG%27 HTTP/1.1" 200 None
2026-03-28 14:03:59 [bca.uk] INFO: Scrape type for ND18%20UAG: 2
2026-03-28 14:03:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9f8cb184-e3fd-5530-ad1f-3a95f612a1c2 with identifier: ND18%20UAG
2026-03-28 14:03:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9f8cb184-e3fd-5530-ad1f-3a95f612a1c2 with scrape type 2
2026-03-28 14:03:59 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9f8cb184-e3fd-5530-ad1f-3a95f612a1c2 with scrape type 2
2026-03-28 14:03:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 9f8cb184-e3fd-5530-ad1f-3a95f612a1c2, identifier: ND18%20UAG
2026-03-28 14:03:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698798243%27 HTTP/1.1" 200 None
2026-03-28 14:03:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698798243 not downloaded yet
2026-03-28 14:03:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YG70CMV/42809751?sv=2020-08-04&st=2026-03-28T14%3A03%3A58Z&se=2026-03-28T14%3A28%3A58Z&sr=b&sp=r&sig=1ABLz0vVsC9yYBr%2F09SZY1lBMEdGcrDzJ1kVHXJEJlA%3D> (referer: https://www.bca.co.uk/)
2026-03-28 14:03:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 9f8cb184-e3fd-5530-ad1f-3a95f612a1c2 with identifier: ND18%20UAG
2026-03-28 14:03:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 9f8cb184-e3fd-5530-ad1f-3a95f612a1c2 with identifier: ND18%20UAG
2026-03-28 14:03:59 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 9f8cb184-e3fd-5530-ad1f-3a95f612a1c2 with identifier: ND18%20UAG to the API
2026-03-28 14:03:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:03:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:04:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=5&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 108,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=ND18%20UAG-GB',
'category': 'Car',
'color': 'white',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.2L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol',
'id': '9f8cb184-e3fd-5530-ad1f-3a95f612a1c2',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'ND18 UAG',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=ND18%20UAG&vehicleType=*',
'listing': 'auction',
'location': 'Bedford',
'make': 'CITROEN',
'model': 'C4 CACTUS',
'odometer': 79683,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-01-01',
'seller_name': None,
'title': 'CITROEN C4 CACTUS 1.2 P/T 82 FEEL EDITION Hatchback',
'transmission': 'manual',
'trim': 'P/T 82 FEEL EDITION',
'vin': 'VF70PHMZBJE510702',
'year': 2018}
2026-03-28 14:04:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27ND18%2520UAG%27 HTTP/1.1" 200 None
2026-03-28 14:04:00 [bca.uk] INFO: Saving data for ND18%20UAG: {'auction_closing_time': 1774864800.0, 'created_time': 1774274609.393477, 'last_price_update_time': 1774706640.113385}
2026-03-28 14:04:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='ND18%2520UAG') HTTP/1.1" 204 0
2026-03-28 14:04:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LD11FZB/42809686?sv=2020-08-04&st=2026-03-28T14%3A03%3A58Z&se=2026-03-28T14%3A28%3A58Z&sr=b&sp=r&sig=%2FK4BAlVG%2BClj51VCbQA3WyKfnHgVC%2B3mVHIA2lg6Jqc%3D> (referer: https://www.bca.co.uk/)
2026-03-28 14:04:00 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KM11UUD/698915403/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698915403>
2026-03-28 14:04:00 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/HY65KRJ/42809575?sv=2020-08-04&st=2026-03-28T14%3A03%3A59Z&se=2026-03-28T14%3A28%3A59Z&sr=b&sp=r&sig=qQyrthkWradfVt2c0sIhPBRny5qzj5uOjQmOciVVoMo%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=HY65%20KRJ-GB>
2026-03-28 14:04:00 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YD64WJN/42809986?sv=2020-08-04&st=2026-03-28T14%3A03%3A59Z&se=2026-03-28T14%3A28%3A59Z&sr=b&sp=r&sig=5rsKGf%2F78vqwWJXVPXpM1R60yxRlhwBt0pb8A02KPMk%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=YD64%20WJN-GB>
2026-03-28 14:04:00 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MV57UOY/698798182/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=MV57UOY-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-28 14:04:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KM11UUD/698915340/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/KM11UUD/42809630?sv=2020-08-04&st=2026-03-28T14%3A03%3A52Z&se=2026-03-28T14%3A28%3A52Z&sr=b&sp=r&sig=S16ojkv9p8NH2wa7caJZQVn%2BDGo%2BREXS30Hz2ckWR%2FA%3D)
2026-03-28 14:04:00 [bca.uk] INFO: Found listing with ID: YH12%20ZWB
2026-03-28 14:04:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YH12%2520ZWB%27 HTTP/1.1" 200 None
2026-03-28 14:04:00 [bca.uk] INFO: Scrape type for YH12%20ZWB: 1
2026-03-28 14:04:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bca1d29f-c38f-5f42-aceb-2939b9e67c99 with identifier: YH12%20ZWB
2026-03-28 14:04:00 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item bca1d29f-c38f-5f42-aceb-2939b9e67c99
2026-03-28 14:04:00 [bca.uk] INFO: Found listing with ID: BT24%20NCX
2026-03-28 14:04:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BT24%2520NCX%27 HTTP/1.1" 200 None
2026-03-28 14:04:00 [bca.uk] INFO: Scrape type for BT24%20NCX: 0
2026-03-28 14:04:00 [bca.uk] INFO: Found listing with ID: GJ70%20LXZ
2026-03-28 14:04:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GJ70%2520LXZ%27 HTTP/1.1" 200 None
2026-03-28 14:04:00 [bca.uk] INFO: Scrape type for GJ70%20LXZ: 1
2026-03-28 14:04:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 680c4e9b-15ae-54e0-a824-8a7fce3528fb with identifier: GJ70%20LXZ
2026-03-28 14:04:00 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 680c4e9b-15ae-54e0-a824-8a7fce3528fb
2026-03-28 14:04:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698798259%27 HTTP/1.1" 200 None
2026-03-28 14:04:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698798259 not downloaded yet
2026-03-28 14:04:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:04:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2d85fe10>
2026-03-28 14:04:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:04:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:04:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:04:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7ba82627-3d66-5970-bb5d-b19d751b9eb4/7ba82627-3d66-5970-bb5d-b19d751b9eb4_image_4.jpg HTTP/1.1" 201 0
2026-03-28 14:04:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FKM11UUD%252F698915297%252F600') HTTP/1.1" 204 0
2026-03-28 14:04:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KM11UUD/698915297/600 saved to cache
2026-03-28 14:04:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 7ba82627-3d66-5970-bb5d-b19d751b9eb4
2026-03-28 14:04:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:04:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2d870ed0>
2026-03-28 14:04:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:04:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:04:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:04:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_090813ec-adc2-5b7f-923f-58bcb47db483/090813ec-adc2-5b7f-923f-58bcb47db483_image_4.jpg HTTP/1.1" 201 0
2026-03-28 14:04:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FBP67XDB%252F698934023%252F600') HTTP/1.1" 204 0
2026-03-28 14:04:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BP67XDB/698934023/600 saved to cache
2026-03-28 14:04:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 090813ec-adc2-5b7f-923f-58bcb47db483
2026-03-28 14:04:00 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:04:00 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:04:00 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:04:00 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:04:00 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:04:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:04:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2d870450>
2026-03-28 14:04:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:04:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:04:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:04:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2c7ab10e-203f-5d5d-b669-d394e3cfab8d/2c7ab10e-203f-5d5d-b669-d394e3cfab8d_image_8.jpg HTTP/1.1" 201 0
2026-03-28 14:04:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FWU19VDC%252F698045655%252F600') HTTP/1.1" 204 0
2026-03-28 14:04:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WU19VDC/698045655/600 saved to cache
2026-03-28 14:04:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 2c7ab10e-203f-5d5d-b669-d394e3cfab8d
2026-03-28 14:04:00 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BP67XDB/698934128/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698934128>
2026-03-28 14:04:00 [bca.uk] INFO: Found listing with ID: MJ58%20UJC
2026-03-28 14:04:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MJ58%2520UJC%27 HTTP/1.1" 200 None
2026-03-28 14:04:00 [bca.uk] INFO: Scrape type for MJ58%20UJC: 2
2026-03-28 14:04:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4272d6ec-0f33-5ac0-b001-a40e71f4bd6e with identifier: MJ58%20UJC
2026-03-28 14:04:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4272d6ec-0f33-5ac0-b001-a40e71f4bd6e with scrape type 2
2026-03-28 14:04:00 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4272d6ec-0f33-5ac0-b001-a40e71f4bd6e with scrape type 2
2026-03-28 14:04:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 4272d6ec-0f33-5ac0-b001-a40e71f4bd6e, identifier: MJ58%20UJC
2026-03-28 14:04:00 [bca.uk] INFO: Found listing with ID: KJ70%20LJU
2026-03-28 14:04:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KJ70%2520LJU%27 HTTP/1.1" 200 None
2026-03-28 14:04:00 [bca.uk] INFO: Scrape type for KJ70%20LJU: 1
2026-03-28 14:04:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: df9a9a0d-7908-5df5-80db-63767b9fcbae with identifier: KJ70%20LJU
2026-03-28 14:04:00 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item df9a9a0d-7908-5df5-80db-63767b9fcbae
2026-03-28 14:04:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698798285%27 HTTP/1.1" 200 None
2026-03-28 14:04:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698798285 not downloaded yet
2026-03-28 14:04:00 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:04:00 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:04:00 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:04:00 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:04:00 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:04:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:04:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2d871e90>
2026-03-28 14:04:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:04:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:04:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:04:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8b90222e-e04a-5b27-ab41-392150aadde5/8b90222e-e04a-5b27-ab41-392150aadde5_image_9.jpg HTTP/1.1" 201 0
2026-03-28 14:04:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FKV16LDZ%252F698296928%252F600') HTTP/1.1" 204 0
2026-03-28 14:04:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KV16LDZ/698296928/600 saved to cache
2026-03-28 14:04:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 8b90222e-e04a-5b27-ab41-392150aadde5
2026-03-28 14:04:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:04:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a1fe35010>
2026-03-28 14:04:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:04:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:04:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:04:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_505ec447-0f6d-5de4-9190-5ab4c6e276f7/505ec447-0f6d-5de4-9190-5ab4c6e276f7_expert_report_file_8a3ecf23-4626-4ef3-926a-baf583f3b389.pdf HTTP/1.1" 201 0
2026-03-28 14:04:00 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item 505ec447-0f6d-5de4-9190-5ab4c6e276f7
2026-03-28 14:04:00 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 505ec447-0f6d-5de4-9190-5ab4c6e276f7, skipping ID generation
2026-03-28 14:04:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 505ec447-0f6d-5de4-9190-5ab4c6e276f7
2026-03-28 14:04:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DYG70CMV-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-28 14:04:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=YG70CMV-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-28 14:04:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 4272d6ec-0f33-5ac0-b001-a40e71f4bd6e with identifier: MJ58%20UJC
2026-03-28 14:04:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 4272d6ec-0f33-5ac0-b001-a40e71f4bd6e with identifier: MJ58%20UJC
2026-03-28 14:04:00 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 4272d6ec-0f33-5ac0-b001-a40e71f4bd6e with identifier: MJ58%20UJC to the API
2026-03-28 14:04:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:04:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:04:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=4&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 182,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=MJ58%20UJC-GB',
'category': 'Car',
'color': 'grey',
'currency': 'GBP',
'doors_number': 4,
'engine': '1.8L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol',
'id': '4272d6ec-0f33-5ac0-b001-a40e71f4bd6e',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'MJ58 UJC',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=MJ58%20UJC&vehicleType=*',
'listing': 'auction',
'location': 'Blackbushe',
'make': 'MERCEDES-BENZ',
'model': 'C180',
'odometer': 83922,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2008-01-01',
'seller_name': None,
'title': 'MERCEDES-BENZ C180 1.8 K ELEGANCE Saloon',
'transmission': 'manual',
'trim': 'K ELEGANCE',
'vin': 'WDD2040462A234542',
'year': 2008}
2026-03-28 14:04:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MJ58%2520UJC%27 HTTP/1.1" 200 None
2026-03-28 14:04:00 [bca.uk] INFO: Saving data for MJ58%20UJC: {'auction_closing_time': 1774864800.0, 'created_time': 1774562533.609688, 'last_price_update_time': 1774706640.984452}
2026-03-28 14:04:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='MJ58%2520UJC') HTTP/1.1" 204 0
2026-03-28 14:04:01 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/BT66DFX/42810013?sv=2020-08-04&st=2026-03-28T14%3A04%3A00Z&se=2026-03-28T14%3A29%3A00Z&sr=b&sp=r&sig=Yx0iLoKJXBk4DPNXOVJLOrRp66ZUz648vIo6BTtbrJ0%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=BT66%20DFX-GB>
2026-03-28 14:04:01 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MV57UOY/698798217/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698798217>
2026-03-28 14:04:01 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YB63ZKP/42797877?sv=2020-08-04&st=2026-03-28T14%3A04%3A00Z&se=2026-03-28T14%3A29%3A00Z&sr=b&sp=r&sig=86nclI4iCmgLh3evtZ%2BtpNUit8HkmrBcUBeJLBRYtzg%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=YB63%20ZKP-GB>
2026-03-28 14:04:01 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MV57UOY/698798204/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698798204>
2026-03-28 14:04:01 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/AK67LWT/42810366?sv=2020-08-04&st=2026-03-28T14%3A04%3A00Z&se=2026-03-28T14%3A29%3A00Z&sr=b&sp=r&sig=dnN3%2FeKHnzQfSMnyGaraMReo6SkHH2Dy4nbY3zUESfI%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=AK67%20LWT-GB>
2026-03-28 14:04:01 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/NK64UTR/42807827?sv=2020-08-04&st=2026-03-28T14%3A04%3A00Z&se=2026-03-28T14%3A29%3A00Z&sr=b&sp=r&sig=B2djBTwUnOYzqxtI8e7WJD2j2cACy9SjmoGLE3oN2SE%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=NK64%20UTR-GB>
2026-03-28 14:04:01 [bca.uk] INFO: Found listing with ID: AV13%20PZZ
2026-03-28 14:04:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27AV13%2520PZZ%27 HTTP/1.1" 200 None
2026-03-28 14:04:01 [bca.uk] INFO: Scrape type for AV13%20PZZ: 1
2026-03-28 14:04:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a2561847-ff84-5663-b0c4-a7e1fe0e31f4 with identifier: AV13%20PZZ
2026-03-28 14:04:01 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item a2561847-ff84-5663-b0c4-a7e1fe0e31f4
2026-03-28 14:04:01 [bca.uk] INFO: Found listing with ID: KN70%20RHA
2026-03-28 14:04:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KN70%2520RHA%27 HTTP/1.1" 200 None
2026-03-28 14:04:01 [bca.uk] INFO: Scrape type for KN70%20RHA: 0
2026-03-28 14:04:01 [bca.uk] INFO: Found listing with ID: NU19%20CDX
2026-03-28 14:04:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27NU19%2520CDX%27 HTTP/1.1" 200 None
2026-03-28 14:04:01 [bca.uk] INFO: Scrape type for NU19%20CDX: 0
2026-03-28 14:04:01 [bca.uk] INFO: Found listing with ID: SR19%20TNU
2026-03-28 14:04:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SR19%2520TNU%27 HTTP/1.1" 200 None
2026-03-28 14:04:01 [bca.uk] INFO: Scrape type for SR19%20TNU: 2
2026-03-28 14:04:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c70e3fdb-b0ea-5265-86f4-be72920b6a49 with identifier: SR19%20TNU
2026-03-28 14:04:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c70e3fdb-b0ea-5265-86f4-be72920b6a49 with scrape type 2
2026-03-28 14:04:01 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c70e3fdb-b0ea-5265-86f4-be72920b6a49 with scrape type 2
2026-03-28 14:04:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: c70e3fdb-b0ea-5265-86f4-be72920b6a49, identifier: SR19%20TNU
2026-03-28 14:04:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698798308%27 HTTP/1.1" 200 None
2026-03-28 14:04:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698798308 not downloaded yet
2026-03-28 14:04:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D697550745%27 HTTP/1.1" 200 None
2026-03-28 14:04:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=697550745 not downloaded yet
2026-03-28 14:04:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MV57UOY/698798182/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/MV57UOY/42807073?sv=2020-08-04&st=2026-03-28T14%3A03%3A53Z&se=2026-03-28T14%3A28%3A53Z&sr=b&sp=r&sig=4yruJ8ij2lkpzOh%2Bl0IV9Mz1vdyrZkWNPL1z%2B2woEio%3D)
2026-03-28 14:04:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CK18AEJ/698910501/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/CK18AEJ/42809519?sv=2020-08-04&st=2026-03-28T14%3A03%3A52Z&se=2026-03-28T14%3A28%3A52Z&sr=b&sp=r&sig=tMAO1WCWalJ7mXIWRlCxzQ1Rx0voh0Hr3%2FaR8xfgZTg%3D)
2026-03-28 14:04:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: c70e3fdb-b0ea-5265-86f4-be72920b6a49 with identifier: SR19%20TNU
2026-03-28 14:04:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: c70e3fdb-b0ea-5265-86f4-be72920b6a49 with identifier: SR19%20TNU
2026-03-28 14:04:01 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: c70e3fdb-b0ea-5265-86f4-be72920b6a49 with identifier: SR19%20TNU to the API
2026-03-28 14:04:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:04:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:04:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=5&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 144,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=SR19%20TNU-GB',
'category': 'Car',
'color': 'black',
'currency': 'GBP',
'doors_number': 5,
'engine': '2.0L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Diesel',
'id': 'c70e3fdb-b0ea-5265-86f4-be72920b6a49',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'SR19 TNU',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=SR19%20TNU&vehicleType=*',
'listing': 'auction',
'location': 'Bedford',
'make': 'AUDI',
'model': 'Q5',
'odometer': 45035,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-01-01',
'seller_name': None,
'title': 'AUDI Q5 2.0 40 TDI QUATTRO SPORT S-T StationWagon',
'transmission': 'automatic',
'trim': '40 TDI QUATTRO SPORT S-T',
'vin': 'WAUZZZFY6K2089494',
'year': 2019}
2026-03-28 14:04:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SR19%2520TNU%27 HTTP/1.1" 200 None
2026-03-28 14:04:01 [bca.uk] INFO: Saving data for SR19%20TNU: {'auction_closing_time': 1774864800.0, 'created_time': 1774562659.854421, 'last_price_update_time': 1774706641.592667}
2026-03-28 14:04:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='SR19%2520TNU') HTTP/1.1" 204 0
2026-03-28 14:04:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:04:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c68c290>
2026-03-28 14:04:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:04:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:04:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:04:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fadd6eea-e2b0-5574-affe-cdf6b892b445/fadd6eea-e2b0-5574-affe-cdf6b892b445_expert_report_file_db0f0701-344c-4398-a0f9-7927ecbd182a.pdf HTTP/1.1" 201 0
2026-03-28 14:04:01 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item fadd6eea-e2b0-5574-affe-cdf6b892b445
2026-03-28 14:04:01 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: fadd6eea-e2b0-5574-affe-cdf6b892b445, skipping ID generation
2026-03-28 14:04:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item fadd6eea-e2b0-5574-affe-cdf6b892b445
2026-03-28 14:04:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DLD11FZB-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-28 14:04:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=LD11FZB-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-28 14:04:01 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:04:01 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:04:01 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:04:01 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:04:01 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:04:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:04:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2d901090>
2026-03-28 14:04:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:04:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:04:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:04:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7ba82627-3d66-5970-bb5d-b19d751b9eb4/7ba82627-3d66-5970-bb5d-b19d751b9eb4_image_6.jpg HTTP/1.1" 201 0
2026-03-28 14:04:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FKM11UUD%252F698915340%252F600') HTTP/1.1" 204 0
2026-03-28 14:04:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KM11UUD/698915340/600 saved to cache
2026-03-28 14:04:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 7ba82627-3d66-5970-bb5d-b19d751b9eb4
2026-03-28 14:04:01 [bca.uk] INFO: Found listing with ID: BN10%20FFD
2026-03-28 14:04:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BN10%2520FFD%27 HTTP/1.1" 200 None
2026-03-28 14:04:01 [bca.uk] INFO: Scrape type for BN10%20FFD: 1
2026-03-28 14:04:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: aa05e46e-6535-54ec-9d2a-990536e25c18 with identifier: BN10%20FFD
2026-03-28 14:04:01 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item aa05e46e-6535-54ec-9d2a-990536e25c18
2026-03-28 14:04:01 [bca.uk] INFO: Found listing with ID: AJ17%20HXL
2026-03-28 14:04:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27AJ17%2520HXL%27 HTTP/1.1" 200 None
2026-03-28 14:04:01 [bca.uk] INFO: Scrape type for AJ17%20HXL: 1
2026-03-28 14:04:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2a541890-0343-5ec1-9e09-787ef67af079 with identifier: AJ17%20HXL
2026-03-28 14:04:01 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 2a541890-0343-5ec1-9e09-787ef67af079
2026-03-28 14:04:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698798330%27 HTTP/1.1" 200 None
2026-03-28 14:04:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698798330 not downloaded yet
2026-03-28 14:04:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D697550760%27 HTTP/1.1" 200 None
2026-03-28 14:04:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=697550760 not downloaded yet
2026-03-28 14:04:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698929094%27 HTTP/1.1" 200 None
2026-03-28 14:04:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698929094 not downloaded yet
2026-03-28 14:04:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.bca.co.uk/api/search?q=&pageSize=100&page=6&sort=MostRecentlyAdded> (referer: https://www.bca.co.uk/search) ['zyte-api']
2026-03-28 14:04:01 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MV57UOY/698798243/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698798243>
2026-03-28 14:04:01 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/WJ58DWA/42809994?sv=2020-08-04&st=2026-03-28T14%3A04%3A01Z&se=2026-03-28T14%3A29%3A01Z&sr=b&sp=r&sig=WelJkUnZ%2FryduuiTM2iL%2FzPRBftp3wpY3FkYWG%2FP0gk%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=WJ58%20DWA-GB>
2026-03-28 14:04:01 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/PXZ1595/42808016?sv=2020-08-04&st=2026-03-28T14%3A04%3A01Z&se=2026-03-28T14%3A29%3A01Z&sr=b&sp=r&sig=xu3OmTnGiQ74jDpi5YWrXOjZvBn7hDxoXdoCW9aef04%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=PXZ%201595-GB>
2026-03-28 14:04:01 [bca.uk] INFO: Found listing with ID: GL11%20XOW
2026-03-28 14:04:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GL11%2520XOW%27 HTTP/1.1" 200 None
2026-03-28 14:04:01 [bca.uk] INFO: Scrape type for GL11%20XOW: 1
2026-03-28 14:04:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 011230be-e1a4-58b5-92df-e152edda7f73 with identifier: GL11%20XOW
2026-03-28 14:04:01 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 011230be-e1a4-58b5-92df-e152edda7f73
2026-03-28 14:04:01 [bca.uk] INFO: Found listing with ID: GK66%20WPY
2026-03-28 14:04:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GK66%2520WPY%27 HTTP/1.1" 200 None
2026-03-28 14:04:01 [bca.uk] INFO: Scrape type for GK66%20WPY: 1
2026-03-28 14:04:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3e1a668c-07f1-5b40-8f70-ce6f3b64756d with identifier: GK66%20WPY
2026-03-28 14:04:01 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 3e1a668c-07f1-5b40-8f70-ce6f3b64756d
2026-03-28 14:04:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698798344%27 HTTP/1.1" 200 None
2026-03-28 14:04:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698798344 not downloaded yet
2026-03-28 14:04:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D697550773%27 HTTP/1.1" 200 None
2026-03-28 14:04:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=697550773 not downloaded yet
2026-03-28 14:04:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:04:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c429490>
2026-03-28 14:04:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:04:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:04:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:04:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b344c6b3-761f-572b-9e4c-84678fe27e52/b344c6b3-761f-572b-9e4c-84678fe27e52_image_0.jpg HTTP/1.1" 201 0
2026-03-28 14:04:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FMV57UOY%252F698798182%252F600') HTTP/1.1" 204 0
2026-03-28 14:04:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MV57UOY/698798182/600 saved to cache
2026-03-28 14:04:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item b344c6b3-761f-572b-9e4c-84678fe27e52
2026-03-28 14:04:02 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:04:02 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:04:02 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:04:02 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:04:02 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:04:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:04:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2d7277d0>
2026-03-28 14:04:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:04:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:04:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:04:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_954e7a8e-294d-583e-8576-18c9af402ec0/954e7a8e-294d-583e-8576-18c9af402ec0_image_9.jpg HTTP/1.1" 201 0
2026-03-28 14:04:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FCK18AEJ%252F698910501%252F600') HTTP/1.1" 204 0
2026-03-28 14:04:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CK18AEJ/698910501/600 saved to cache
2026-03-28 14:04:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 954e7a8e-294d-583e-8576-18c9af402ec0
2026-03-28 14:04:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698929108%27 HTTP/1.1" 200 None
2026-03-28 14:04:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698929108 not downloaded yet
2026-03-28 14:04:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KM11UUD/698915403/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/KM11UUD/42809630?sv=2020-08-04&st=2026-03-28T14%3A03%3A52Z&se=2026-03-28T14%3A28%3A52Z&sr=b&sp=r&sig=S16ojkv9p8NH2wa7caJZQVn%2BDGo%2BREXS30Hz2ckWR%2FA%3D)
2026-03-28 14:04:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BP67XDB/698934128/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/BP67XDB/42810422?sv=2020-08-04&st=2026-03-28T14%3A03%3A52Z&se=2026-03-28T14%3A28%3A52Z&sr=b&sp=r&sig=Logn8Hbry8lNDBo7BHyP%2FFQM2Uo9ZZUQT4uyTv5b%2Bn0%3D)
2026-03-28 14:04:02 [bca.uk] INFO: Found listing with ID: HK65%20ZWD
2026-03-28 14:04:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27HK65%2520ZWD%27 HTTP/1.1" 200 None
2026-03-28 14:04:02 [bca.uk] INFO: Scrape type for HK65%20ZWD: 2
2026-03-28 14:04:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3a425f36-31c4-5bbe-8e6e-3477cbaf2287 with identifier: HK65%20ZWD
2026-03-28 14:04:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3a425f36-31c4-5bbe-8e6e-3477cbaf2287 with scrape type 2
2026-03-28 14:04:02 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3a425f36-31c4-5bbe-8e6e-3477cbaf2287 with scrape type 2
2026-03-28 14:04:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 3a425f36-31c4-5bbe-8e6e-3477cbaf2287, identifier: HK65%20ZWD
2026-03-28 14:04:02 [bca.uk] INFO: Found listing with ID: LD16%20UKX
2026-03-28 14:04:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LD16%2520UKX%27 HTTP/1.1" 200 None
2026-03-28 14:04:02 [bca.uk] INFO: Scrape type for LD16%20UKX: 1
2026-03-28 14:04:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 826679c4-b83f-5ad2-b8a7-2183b5f0a082 with identifier: LD16%20UKX
2026-03-28 14:04:02 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 826679c4-b83f-5ad2-b8a7-2183b5f0a082
2026-03-28 14:04:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D697550796%27 HTTP/1.1" 200 None
2026-03-28 14:04:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=697550796 not downloaded yet
2026-03-28 14:04:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 3a425f36-31c4-5bbe-8e6e-3477cbaf2287 with identifier: HK65%20ZWD
2026-03-28 14:04:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 3a425f36-31c4-5bbe-8e6e-3477cbaf2287 with identifier: HK65%20ZWD
2026-03-28 14:04:02 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 3a425f36-31c4-5bbe-8e6e-3477cbaf2287 with identifier: HK65%20ZWD to the API
2026-03-28 14:04:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:04:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:04:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=4&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 104,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=HK65%20ZWD-GB',
'category': 'Car',
'color': 'red',
'currency': 'GBP',
'doors_number': 5,
'engine': '0.9L',
'expiration_date': '2026-03-29T10:00:00Z',
'fuel_type': 'Petrol',
'id': '3a425f36-31c4-5bbe-8e6e-3477cbaf2287',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'HK65 ZWD',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=HK65%20ZWD&vehicleType=*',
'listing': 'auction',
'location': 'Blackbushe',
'make': 'RENAULT',
'model': 'CLIO',
'odometer': 64172,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-01-01',
'seller_name': None,
'title': 'RENAULT CLIO 0.9 TCE 90 DYNAMIQUE Hatchback',
'transmission': 'manual',
'trim': 'TCE 90 DYNAMIQUE',
'vin': 'VF15RE20A53890522',
'year': 2016}
2026-03-28 14:04:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27HK65%2520ZWD%27 HTTP/1.1" 200 None
2026-03-28 14:04:02 [bca.uk] INFO: Saving data for HK65%20ZWD: {'auction_closing_time': 1774778400.0, 'created_time': 1774476498.454703, 'last_price_update_time': 1774706642.605173}
2026-03-28 14:04:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='HK65%2520ZWD') HTTP/1.1" 204 0
2026-03-28 14:04:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698929129%27 HTTP/1.1" 200 None
2026-03-28 14:04:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698929129 not downloaded yet
2026-03-28 14:04:02 [bca.uk] INFO: Total items found: 100
2026-03-28 14:04:02 [bca.uk] INFO: Requesting URL: https://www.bca.co.uk/api/search?q=&pageSize=100&page=7&sort=MostRecentlyAdded
2026-03-28 14:04:02 [bca.uk] INFO: Sending search API request with Bearer token (length=1492)
2026-03-28 14:04:02 [scrapy_zyte_api._params] WARNING: Request <GET https://www.bca.co.uk/api/search?q=&pageSize=100&page=7&sort=MostRecentlyAdded> defines the Zyte API customHttpRequestHeaders parameter, overriding Request.headers. Use Request.headers instead.
2026-03-28 14:04:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YD64WJN/42809986?sv=2020-08-04&st=2026-03-28T14%3A03%3A59Z&se=2026-03-28T14%3A28%3A59Z&sr=b&sp=r&sig=5rsKGf%2F78vqwWJXVPXpM1R60yxRlhwBt0pb8A02KPMk%3D> (referer: https://www.bca.co.uk/)
2026-03-28 14:04:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/NK64UTR/42807827?sv=2020-08-04&st=2026-03-28T14%3A04%3A00Z&se=2026-03-28T14%3A29%3A00Z&sr=b&sp=r&sig=B2djBTwUnOYzqxtI8e7WJD2j2cACy9SjmoGLE3oN2SE%3D> (referer: https://www.bca.co.uk/)
2026-03-28 14:04:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MV57UOY/698798204/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/MV57UOY/42807073?sv=2020-08-04&st=2026-03-28T14%3A03%3A53Z&se=2026-03-28T14%3A28%3A53Z&sr=b&sp=r&sig=4yruJ8ij2lkpzOh%2Bl0IV9Mz1vdyrZkWNPL1z%2B2woEio%3D)
2026-03-28 14:04:02 [bca.uk] INFO: Found listing with ID: HV08%20XHP
2026-03-28 14:04:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27HV08%2520XHP%27 HTTP/1.1" 200 None
2026-03-28 14:04:02 [bca.uk] INFO: Scrape type for HV08%20XHP: 1
2026-03-28 14:04:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cdaa9411-8148-5f71-bb89-a031dafbf539 with identifier: HV08%20XHP
2026-03-28 14:04:02 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item cdaa9411-8148-5f71-bb89-a031dafbf539
2026-03-28 14:04:02 [bca.uk] INFO: Found listing with ID: SM20%20VYX
2026-03-28 14:04:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SM20%2520VYX%27 HTTP/1.1" 200 None
2026-03-28 14:04:02 [bca.uk] INFO: Scrape type for SM20%20VYX: 0
2026-03-28 14:04:02 [bca.uk] INFO: Found listing with ID: OY10%20PHZ
2026-03-28 14:04:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27OY10%2520PHZ%27 HTTP/1.1" 200 None
2026-03-28 14:04:02 [bca.uk] INFO: Scrape type for OY10%20PHZ: 0
2026-03-28 14:04:02 [bca.uk] INFO: Found listing with ID: LN03%20XSM
2026-03-28 14:04:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LN03%2520XSM%27 HTTP/1.1" 200 None
2026-03-28 14:04:02 [bca.uk] INFO: Scrape type for LN03%20XSM: 0
2026-03-28 14:04:02 [bca.uk] INFO: Found listing with ID: LS06%20BVE
2026-03-28 14:04:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LS06%2520BVE%27 HTTP/1.1" 200 None
2026-03-28 14:04:02 [bca.uk] INFO: Scrape type for LS06%20BVE: 0
2026-03-28 14:04:02 [bca.uk] INFO: Found listing with ID: LT64%20YWX
2026-03-28 14:04:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LT64%2520YWX%27 HTTP/1.1" 200 None
2026-03-28 14:04:02 [bca.uk] INFO: Scrape type for LT64%20YWX: 0
2026-03-28 14:04:02 [bca.uk] INFO: Found listing with ID: RJ03%20NRF
2026-03-28 14:04:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27RJ03%2520NRF%27 HTTP/1.1" 200 None
2026-03-28 14:04:02 [bca.uk] INFO: Scrape type for RJ03%20NRF: 0
2026-03-28 14:04:02 [bca.uk] INFO: Found listing with ID: WD59%20AZX
2026-03-28 14:04:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WD59%2520AZX%27 HTTP/1.1" 200 None
2026-03-28 14:04:02 [bca.uk] INFO: Scrape type for WD59%20AZX: 0
2026-03-28 14:04:02 [bca.uk] INFO: Found listing with ID: WP18%20BYR
2026-03-28 14:04:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WP18%2520BYR%27 HTTP/1.1" 200 None
2026-03-28 14:04:02 [bca.uk] INFO: Scrape type for WP18%20BYR: 2
2026-03-28 14:04:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 85bb8fe3-c879-5a71-8cea-c742e59244a3 with identifier: WP18%20BYR
2026-03-28 14:04:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 85bb8fe3-c879-5a71-8cea-c742e59244a3 with scrape type 2
2026-03-28 14:04:02 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 85bb8fe3-c879-5a71-8cea-c742e59244a3 with scrape type 2
2026-03-28 14:04:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 85bb8fe3-c879-5a71-8cea-c742e59244a3, identifier: WP18%20BYR
2026-03-28 14:04:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D697550812%27 HTTP/1.1" 200 None
2026-03-28 14:04:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=697550812 not downloaded yet
2026-03-28 14:04:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/HY65KRJ/42809575?sv=2020-08-04&st=2026-03-28T14%3A03%3A59Z&se=2026-03-28T14%3A28%3A59Z&sr=b&sp=r&sig=qQyrthkWradfVt2c0sIhPBRny5qzj5uOjQmOciVVoMo%3D> (referer: https://www.bca.co.uk/)
2026-03-28 14:04:03 [scrapy_zyte_api._params] WARNING: Request <GET https://www.bca.co.uk/api/search?q=&pageSize=100&page=7&sort=MostRecentlyAdded> defines the Zyte API customHttpRequestHeaders parameter, overriding Request.headers. Use Request.headers instead.
2026-03-28 14:04:03 [scrapy_zyte_api._params] WARNING: Request <GET https://www.bca.co.uk/api/search?q=&pageSize=100&page=7&sort=MostRecentlyAdded> defines the Zyte API customHttpRequestHeaders parameter, overriding Request.headers. Use Request.headers instead.
2026-03-28 14:04:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 85bb8fe3-c879-5a71-8cea-c742e59244a3 with identifier: WP18%20BYR
2026-03-28 14:04:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 85bb8fe3-c879-5a71-8cea-c742e59244a3 with identifier: WP18%20BYR
2026-03-28 14:04:03 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 85bb8fe3-c879-5a71-8cea-c742e59244a3 with identifier: WP18%20BYR to the API
2026-03-28 14:04:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:04:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:04:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=5&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 139,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=WP18%20BYR-GB',
'category': 'Car',
'color': 'black',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.6L',
'expiration_date': '2026-03-29T10:00:00Z',
'fuel_type': 'Diesel',
'id': '85bb8fe3-c879-5a71-8cea-c742e59244a3',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'WP18 BYR',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=WP18%20BYR&vehicleType=*',
'listing': 'auction',
'location': 'Bedford',
'make': 'HONDA',
'model': 'CR-V',
'odometer': 208522,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-01-01',
'seller_name': None,
'title': 'HONDA CR-V 1.6 I-DTEC 160 EX 4WD StationWagon',
'transmission': 'automatic',
'trim': 'I-DTEC 160 EX 4WD',
'vin': 'SHSRE6890JU003482',
'year': 2018}
2026-03-28 14:04:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WP18%2520BYR%27 HTTP/1.1" 200 None
2026-03-28 14:04:03 [bca.uk] INFO: Saving data for WP18%20BYR: {'auction_closing_time': 1774778400.0, 'created_time': 1774610808.118915, 'last_price_update_time': 1774706643.879785}
2026-03-28 14:04:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='WP18%2520BYR') HTTP/1.1" 204 0
2026-03-28 14:04:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698929149%27 HTTP/1.1" 200 None
2026-03-28 14:04:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698929149 not downloaded yet
2026-03-28 14:04:03 [bca.uk] INFO: Found listing with ID: DX16%20MYY
2026-03-28 14:04:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DX16%2520MYY%27 HTTP/1.1" 200 None
2026-03-28 14:04:03 [bca.uk] INFO: Scrape type for DX16%20MYY: 0
2026-03-28 14:04:03 [bca.uk] INFO: Found listing with ID: WN58%20UCF
2026-03-28 14:04:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WN58%2520UCF%27 HTTP/1.1" 200 None
2026-03-28 14:04:03 [bca.uk] INFO: Scrape type for WN58%20UCF: 0
2026-03-28 14:04:03 [bca.uk] INFO: Found listing with ID: CV68%20XCO
2026-03-28 14:04:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27CV68%2520XCO%27 HTTP/1.1" 200 None
2026-03-28 14:04:03 [bca.uk] INFO: Scrape type for CV68%20XCO: 0
2026-03-28 14:04:03 [bca.uk] INFO: Found listing with ID: VU18%20ACY
2026-03-28 14:04:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27VU18%2520ACY%27 HTTP/1.1" 200 None
2026-03-28 14:04:03 [bca.uk] INFO: Scrape type for VU18%20ACY: 0
2026-03-28 14:04:03 [bca.uk] INFO: Found listing with ID: YH19%20WFS
2026-03-28 14:04:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YH19%2520WFS%27 HTTP/1.1" 200 None
2026-03-28 14:04:04 [bca.uk] INFO: Scrape type for YH19%20WFS: 0
2026-03-28 14:04:04 [bca.uk] INFO: Found listing with ID: OE68%20NPP
2026-03-28 14:04:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27OE68%2520NPP%27 HTTP/1.1" 200 None
2026-03-28 14:04:04 [bca.uk] INFO: Scrape type for OE68%20NPP: 2
2026-03-28 14:04:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d7d28589-fb9e-53e0-a969-3ddefcb6568d with identifier: OE68%20NPP
2026-03-28 14:04:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d7d28589-fb9e-53e0-a969-3ddefcb6568d with scrape type 2
2026-03-28 14:04:04 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d7d28589-fb9e-53e0-a969-3ddefcb6568d with scrape type 2
2026-03-28 14:04:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: d7d28589-fb9e-53e0-a969-3ddefcb6568d, identifier: OE68%20NPP
2026-03-28 14:04:04 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 14:04:04 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:04:04 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:04:04 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:04:04 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:04:04 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:04:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:04:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c8baf90>
2026-03-28 14:04:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:04:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:04:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:04:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7ba82627-3d66-5970-bb5d-b19d751b9eb4/7ba82627-3d66-5970-bb5d-b19d751b9eb4_image_9.jpg HTTP/1.1" 201 0
2026-03-28 14:04:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FKM11UUD%252F698915403%252F600') HTTP/1.1" 204 0
2026-03-28 14:04:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KM11UUD/698915403/600 saved to cache
2026-03-28 14:04:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 7ba82627-3d66-5970-bb5d-b19d751b9eb4
2026-03-28 14:04:04 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:04:04 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:04:04 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:04:04 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:04:04 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:04:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:04:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c591ed0>
2026-03-28 14:04:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:04:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:04:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:04:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_090813ec-adc2-5b7f-923f-58bcb47db483/090813ec-adc2-5b7f-923f-58bcb47db483_image_9.jpg HTTP/1.1" 201 0
2026-03-28 14:04:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FBP67XDB%252F698934128%252F600') HTTP/1.1" 204 0
2026-03-28 14:04:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BP67XDB/698934128/600 saved to cache
2026-03-28 14:04:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 090813ec-adc2-5b7f-923f-58bcb47db483
2026-03-28 14:04:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YB63ZKP/42797877?sv=2020-08-04&st=2026-03-28T14%3A04%3A00Z&se=2026-03-28T14%3A29%3A00Z&sr=b&sp=r&sig=86nclI4iCmgLh3evtZ%2BtpNUit8HkmrBcUBeJLBRYtzg%3D> (referer: https://www.bca.co.uk/)
2026-03-28 14:04:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/AK67LWT/42810366?sv=2020-08-04&st=2026-03-28T14%3A04%3A00Z&se=2026-03-28T14%3A29%3A00Z&sr=b&sp=r&sig=dnN3%2FeKHnzQfSMnyGaraMReo6SkHH2Dy4nbY3zUESfI%3D> (referer: https://www.bca.co.uk/)
2026-03-28 14:04:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MV57UOY/698798217/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/MV57UOY/42807073?sv=2020-08-04&st=2026-03-28T14%3A03%3A53Z&se=2026-03-28T14%3A28%3A53Z&sr=b&sp=r&sig=4yruJ8ij2lkpzOh%2Bl0IV9Mz1vdyrZkWNPL1z%2B2woEio%3D)
2026-03-28 14:04:04 [bca.uk] INFO: Found listing with ID: RV60%20TZO
2026-03-28 14:04:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27RV60%2520TZO%27 HTTP/1.1" 200 None
2026-03-28 14:04:04 [bca.uk] INFO: Scrape type for RV60%20TZO: 1
2026-03-28 14:04:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: be5cf8be-a032-55c5-880a-33e1f5f6185e with identifier: RV60%20TZO
2026-03-28 14:04:04 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item be5cf8be-a032-55c5-880a-33e1f5f6185e
2026-03-28 14:04:04 [bca.uk] INFO: Found listing with ID: YA06%20KWC
2026-03-28 14:04:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YA06%2520KWC%27 HTTP/1.1" 200 None
2026-03-28 14:04:04 [bca.uk] INFO: Scrape type for YA06%20KWC: 0
2026-03-28 14:04:04 [bca.uk] INFO: Found listing with ID: YB57%20FZC
2026-03-28 14:04:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YB57%2520FZC%27 HTTP/1.1" 200 None
2026-03-28 14:04:04 [bca.uk] INFO: Scrape type for YB57%20FZC: 1
2026-03-28 14:04:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b9b1844a-f6e4-586f-88aa-fc22f6ebd424 with identifier: YB57%20FZC
2026-03-28 14:04:04 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item b9b1844a-f6e4-586f-88aa-fc22f6ebd424
2026-03-28 14:04:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D697550832%27 HTTP/1.1" 200 None
2026-03-28 14:04:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=697550832 not downloaded yet
2026-03-28 14:04:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: d7d28589-fb9e-53e0-a969-3ddefcb6568d with identifier: OE68%20NPP
2026-03-28 14:04:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: d7d28589-fb9e-53e0-a969-3ddefcb6568d with identifier: OE68%20NPP
2026-03-28 14:04:04 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: d7d28589-fb9e-53e0-a969-3ddefcb6568d with identifier: OE68%20NPP to the API
2026-03-28 14:04:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:04:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:04:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=6&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 186,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=OE68%20NPP-GB',
'category': 'Car',
'color': 'red',
'currency': 'GBP',
'doors_number': 5,
'engine': '2.0L',
'expiration_date': '2026-03-29T10:00:00Z',
'fuel_type': 'Diesel',
'id': 'd7d28589-fb9e-53e0-a969-3ddefcb6568d',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'OE68 NPP',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=OE68%20NPP&vehicleType=*',
'listing': 'auction',
'location': 'Walsall',
'make': 'LAND ROVER',
'model': 'DISCOVERY SPORT',
'odometer': 43868,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-01-01',
'seller_name': None,
'title': 'LAND ROVER DISCOVERY SPORT 2.0 SD4 240 HSE StationWagon',
'transmission': 'automatic',
'trim': 'SD4 240 HSE',
'vin': 'SALCA2AN1KH800979',
'year': 2018}
2026-03-28 14:04:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27OE68%2520NPP%27 HTTP/1.1" 200 None
2026-03-28 14:04:04 [bca.uk] INFO: Saving data for OE68%20NPP: {'auction_closing_time': 1774778400.0, 'created_time': 1774390935.79991, 'last_price_update_time': 1774706644.76357}
2026-03-28 14:04:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='OE68%2520NPP') HTTP/1.1" 204 0
2026-03-28 14:04:04 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MV57UOY/698798285/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698798285>
2026-03-28 14:04:04 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YG70CMV/697550736/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=YG70CMV-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-28 14:04:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698929162%27 HTTP/1.1" 200 None
2026-03-28 14:04:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698929162 not downloaded yet
2026-03-28 14:04:04 [bca.uk] INFO: Found listing with ID: BT71%20ZWP
2026-03-28 14:04:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BT71%2520ZWP%27 HTTP/1.1" 200 None
2026-03-28 14:04:04 [bca.uk] INFO: Scrape type for BT71%20ZWP: 0
2026-03-28 14:04:04 [bca.uk] INFO: Found listing with ID: CV23%20JXZ
2026-03-28 14:04:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27CV23%2520JXZ%27 HTTP/1.1" 200 None
2026-03-28 14:04:04 [bca.uk] INFO: Scrape type for CV23%20JXZ: 0
2026-03-28 14:04:04 [bca.uk] INFO: Found listing with ID: VA19%20TJU
2026-03-28 14:04:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27VA19%2520TJU%27 HTTP/1.1" 200 None
2026-03-28 14:04:04 [bca.uk] INFO: Scrape type for VA19%20TJU: 0
2026-03-28 14:04:04 [bca.uk] INFO: Found listing with ID: VN73%20XUO
2026-03-28 14:04:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27VN73%2520XUO%27 HTTP/1.1" 200 None
2026-03-28 14:04:04 [bca.uk] INFO: Scrape type for VN73%20XUO: 0
2026-03-28 14:04:04 [bca.uk] INFO: Found listing with ID: WP68%20JYS
2026-03-28 14:04:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WP68%2520JYS%27 HTTP/1.1" 200 None
2026-03-28 14:04:04 [bca.uk] INFO: Scrape type for WP68%20JYS: 0
2026-03-28 14:04:04 [bca.uk] INFO: Found listing with ID: YS18%20GXM
2026-03-28 14:04:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YS18%2520GXM%27 HTTP/1.1" 200 None
2026-03-28 14:04:05 [bca.uk] INFO: Scrape type for YS18%20GXM: 0
2026-03-28 14:04:05 [bca.uk] INFO: Found listing with ID: MT18%20EXX
2026-03-28 14:04:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MT18%2520EXX%27 HTTP/1.1" 200 None
2026-03-28 14:04:05 [bca.uk] INFO: Scrape type for MT18%20EXX: 0
2026-03-28 14:04:05 [bca.uk] INFO: Found listing with ID: WG68%20NGF
2026-03-28 14:04:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WG68%2520NGF%27 HTTP/1.1" 200 None
2026-03-28 14:04:05 [bca.uk] INFO: Scrape type for WG68%20NGF: 0
2026-03-28 14:04:05 [bca.uk] INFO: Found listing with ID: WK70%20VKG
2026-03-28 14:04:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WK70%2520VKG%27 HTTP/1.1" 200 None
2026-03-28 14:04:05 [bca.uk] INFO: Scrape type for WK70%20VKG: 0
2026-03-28 14:04:05 [bca.uk] INFO: Found listing with ID: DX15%20JFF
2026-03-28 14:04:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DX15%2520JFF%27 HTTP/1.1" 200 None
2026-03-28 14:04:05 [bca.uk] INFO: Scrape type for DX15%20JFF: 0
2026-03-28 14:04:05 [bca.uk] INFO: Found listing with ID: BL57%20MXT
2026-03-28 14:04:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BL57%2520MXT%27 HTTP/1.1" 200 None
2026-03-28 14:04:05 [bca.uk] INFO: Scrape type for BL57%20MXT: 0
2026-03-28 14:04:05 [bca.uk] INFO: Found listing with ID: BD08%20AYG
2026-03-28 14:04:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BD08%2520AYG%27 HTTP/1.1" 200 None
2026-03-28 14:04:05 [bca.uk] INFO: Scrape type for BD08%20AYG: 0
2026-03-28 14:04:05 [bca.uk] INFO: Found listing with ID: BK05%20KCN
2026-03-28 14:04:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BK05%2520KCN%27 HTTP/1.1" 200 None
2026-03-28 14:04:05 [bca.uk] INFO: Scrape type for BK05%20KCN: 0
2026-03-28 14:04:05 [bca.uk] INFO: Found listing with ID: CE58%20JHU
2026-03-28 14:04:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27CE58%2520JHU%27 HTTP/1.1" 200 None
2026-03-28 14:04:05 [bca.uk] INFO: Scrape type for CE58%20JHU: 0
2026-03-28 14:04:05 [bca.uk] INFO: Found listing with ID: KW55%20WSO
2026-03-28 14:04:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KW55%2520WSO%27 HTTP/1.1" 200 None
2026-03-28 14:04:05 [bca.uk] INFO: Scrape type for KW55%20WSO: 0
2026-03-28 14:04:05 [bca.uk] INFO: Found listing with ID: VN54%20DZL
2026-03-28 14:04:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27VN54%2520DZL%27 HTTP/1.1" 200 None
2026-03-28 14:04:05 [bca.uk] INFO: Scrape type for VN54%20DZL: 0
2026-03-28 14:04:05 [bca.uk] INFO: Found listing with ID: YC60%20AWJ
2026-03-28 14:04:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YC60%2520AWJ%27 HTTP/1.1" 200 None
2026-03-28 14:04:05 [bca.uk] INFO: Scrape type for YC60%20AWJ: 0
2026-03-28 14:04:05 [bca.uk] INFO: Found listing with ID: LL66%20JRX
2026-03-28 14:04:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LL66%2520JRX%27 HTTP/1.1" 200 None
2026-03-28 14:04:05 [bca.uk] INFO: Scrape type for LL66%20JRX: 0
2026-03-28 14:04:05 [bca.uk] INFO: Found listing with ID: SM14%20UKA
2026-03-28 14:04:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SM14%2520UKA%27 HTTP/1.1" 200 None
2026-03-28 14:04:05 [bca.uk] INFO: Scrape type for SM14%20UKA: 0
2026-03-28 14:04:05 [bca.uk] INFO: Found listing with ID: WG14%20SMV
2026-03-28 14:04:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WG14%2520SMV%27 HTTP/1.1" 200 None
2026-03-28 14:04:05 [bca.uk] INFO: Scrape type for WG14%20SMV: 0
2026-03-28 14:04:05 [bca.uk] INFO: Found listing with ID: BT65%20DVV
2026-03-28 14:04:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BT65%2520DVV%27 HTTP/1.1" 200 None
2026-03-28 14:04:05 [bca.uk] INFO: Scrape type for BT65%20DVV: 0
2026-03-28 14:04:05 [bca.uk] INFO: Found listing with ID: DC16%20EVN
2026-03-28 14:04:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DC16%2520EVN%27 HTTP/1.1" 200 None
2026-03-28 14:04:05 [bca.uk] INFO: Scrape type for DC16%20EVN: 0
2026-03-28 14:04:05 [bca.uk] INFO: Found listing with ID: DL17%20GHX
2026-03-28 14:04:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DL17%2520GHX%27 HTTP/1.1" 200 None
2026-03-28 14:04:05 [bca.uk] INFO: Scrape type for DL17%20GHX: 0
2026-03-28 14:04:05 [bca.uk] INFO: Found listing with ID: DS17%20WZL
2026-03-28 14:04:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DS17%2520WZL%27 HTTP/1.1" 200 None
2026-03-28 14:04:05 [bca.uk] INFO: Scrape type for DS17%20WZL: 0
2026-03-28 14:04:05 [bca.uk] INFO: Found listing with ID: DV64%20UEP
2026-03-28 14:04:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DV64%2520UEP%27 HTTP/1.1" 200 None
2026-03-28 14:04:05 [bca.uk] INFO: Scrape type for DV64%20UEP: 0
2026-03-28 14:04:05 [bca.uk] INFO: Found listing with ID: BG16%20VPU
2026-03-28 14:04:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BG16%2520VPU%27 HTTP/1.1" 200 None
2026-03-28 14:04:05 [bca.uk] INFO: Scrape type for BG16%20VPU: 2
2026-03-28 14:04:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 477bab74-dc05-5a7b-9859-e3241d0cdc6e with identifier: BG16%20VPU
2026-03-28 14:04:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 477bab74-dc05-5a7b-9859-e3241d0cdc6e with scrape type 2
2026-03-28 14:04:05 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 477bab74-dc05-5a7b-9859-e3241d0cdc6e with scrape type 2
2026-03-28 14:04:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 477bab74-dc05-5a7b-9859-e3241d0cdc6e, identifier: BG16%20VPU
2026-03-28 14:04:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:04:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a1ff22e10>
2026-03-28 14:04:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:04:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:04:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:04:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a6b7695a-3dc3-56dd-a07d-29432fe9fa43/a6b7695a-3dc3-56dd-a07d-29432fe9fa43_expert_report_file_ccc4390d-9622-4ec3-8a04-ee2ee1227083.pdf HTTP/1.1" 201 0
2026-03-28 14:04:05 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item a6b7695a-3dc3-56dd-a07d-29432fe9fa43
2026-03-28 14:04:05 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: a6b7695a-3dc3-56dd-a07d-29432fe9fa43, skipping ID generation
2026-03-28 14:04:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item a6b7695a-3dc3-56dd-a07d-29432fe9fa43
2026-03-28 14:04:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DYD64WJN-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-28 14:04:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=YD64WJN-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-28 14:04:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:04:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c999ad0>
2026-03-28 14:04:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:04:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:04:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:04:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1a399624-5154-54f6-ad94-51c45341542d/1a399624-5154-54f6-ad94-51c45341542d_expert_report_file_8a86a61a-288e-46c2-8357-da037834c361.pdf HTTP/1.1" 201 0
2026-03-28 14:04:05 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item 1a399624-5154-54f6-ad94-51c45341542d
2026-03-28 14:04:05 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 1a399624-5154-54f6-ad94-51c45341542d, skipping ID generation
2026-03-28 14:04:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 1a399624-5154-54f6-ad94-51c45341542d
2026-03-28 14:04:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DNK64UTR-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-28 14:04:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=NK64UTR-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-28 14:04:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:04:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c1295d0>
2026-03-28 14:04:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:04:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:04:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:04:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b344c6b3-761f-572b-9e4c-84678fe27e52/b344c6b3-761f-572b-9e4c-84678fe27e52_image_2.jpg HTTP/1.1" 201 0
2026-03-28 14:04:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FMV57UOY%252F698798204%252F600') HTTP/1.1" 204 0
2026-03-28 14:04:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MV57UOY/698798204/600 saved to cache
2026-03-28 14:04:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item b344c6b3-761f-572b-9e4c-84678fe27e52
2026-03-28 14:04:05 [bca.uk] INFO: Found listing with ID: HV69%20NLA
2026-03-28 14:04:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27HV69%2520NLA%27 HTTP/1.1" 200 None
2026-03-28 14:04:05 [bca.uk] INFO: Scrape type for HV69%20NLA: 1
2026-03-28 14:04:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: eadb8ebe-5b0a-5541-a2d1-caa5b9148e41 with identifier: HV69%20NLA
2026-03-28 14:04:05 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item eadb8ebe-5b0a-5541-a2d1-caa5b9148e41
2026-03-28 14:04:05 [bca.uk] INFO: Found listing with ID: YY62%20EHO
2026-03-28 14:04:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YY62%2520EHO%27 HTTP/1.1" 200 None
2026-03-28 14:04:05 [bca.uk] INFO: Scrape type for YY62%20EHO: 0
2026-03-28 14:04:05 [bca.uk] INFO: Found listing with ID: BK60%20RMU
2026-03-28 14:04:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BK60%2520RMU%27 HTTP/1.1" 200 None
2026-03-28 14:04:05 [bca.uk] INFO: Scrape type for BK60%20RMU: 0
2026-03-28 14:04:05 [bca.uk] INFO: Found listing with ID: CU13%20HUZ
2026-03-28 14:04:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27CU13%2520HUZ%27 HTTP/1.1" 200 None
2026-03-28 14:04:05 [bca.uk] INFO: Scrape type for CU13%20HUZ: 0
2026-03-28 14:04:05 [bca.uk] INFO: Found listing with ID: DE59%20LRX
2026-03-28 14:04:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DE59%2520LRX%27 HTTP/1.1" 200 None
2026-03-28 14:04:05 [bca.uk] INFO: Scrape type for DE59%20LRX: 0
2026-03-28 14:04:05 [bca.uk] INFO: Found listing with ID: DE61%20AVB
2026-03-28 14:04:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DE61%2520AVB%27 HTTP/1.1" 200 None
2026-03-28 14:04:05 [bca.uk] INFO: Scrape type for DE61%20AVB: 0
2026-03-28 14:04:05 [bca.uk] INFO: Found listing with ID: FE12%20WRX
2026-03-28 14:04:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FE12%2520WRX%27 HTTP/1.1" 200 None
2026-03-28 14:04:05 [bca.uk] INFO: Scrape type for FE12%20WRX: 1
2026-03-28 14:04:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a3ad7a0d-b4c8-5ced-b470-27d0e0c9322f with identifier: FE12%20WRX
2026-03-28 14:04:05 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item a3ad7a0d-b4c8-5ced-b470-27d0e0c9322f
2026-03-28 14:04:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D697550856%27 HTTP/1.1" 200 None
2026-03-28 14:04:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=697550856 not downloaded yet
2026-03-28 14:04:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 477bab74-dc05-5a7b-9859-e3241d0cdc6e with identifier: BG16%20VPU
2026-03-28 14:04:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 477bab74-dc05-5a7b-9859-e3241d0cdc6e with identifier: BG16%20VPU
2026-03-28 14:04:05 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 477bab74-dc05-5a7b-9859-e3241d0cdc6e with identifier: BG16%20VPU to the API
2026-03-28 14:04:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:04:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:04:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=6&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 128,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=BG16%20VPU-GB',
'category': 'Car',
'color': 'white',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.2L',
'expiration_date': '2026-03-29T10:00:00Z',
'fuel_type': 'Petrol',
'id': '477bab74-dc05-5a7b-9859-e3241d0cdc6e',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'BG16 VPU',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=BG16%20VPU&vehicleType=*',
'listing': 'auction',
'location': 'Walsall',
'make': 'NISSAN',
'model': 'JUKE',
'odometer': 56542,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-01-01',
'seller_name': None,
'title': 'NISSAN JUKE 1.2 DIG-T 113 ACENTA PREMIUM Hatchback',
'transmission': 'manual',
'trim': 'DIG-T 113 ACENTA PREMIUM',
'vin': 'SJNFEAF15U7166433',
'year': 2016}
2026-03-28 14:04:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BG16%2520VPU%27 HTTP/1.1" 200 None
2026-03-28 14:04:06 [bca.uk] INFO: Saving data for BG16%20VPU: {'auction_closing_time': 1774778400.0, 'created_time': 1774188114.028666, 'last_price_update_time': 1774706646.22307}
2026-03-28 14:04:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='BG16%2520VPU') HTTP/1.1" 204 0
2026-03-28 14:04:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/BT66DFX/42810013?sv=2020-08-04&st=2026-03-28T14%3A04%3A00Z&se=2026-03-28T14%3A29%3A00Z&sr=b&sp=r&sig=Yx0iLoKJXBk4DPNXOVJLOrRp66ZUz648vIo6BTtbrJ0%3D> (referer: https://www.bca.co.uk/)
2026-03-28 14:04:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/PXZ1595/42808016?sv=2020-08-04&st=2026-03-28T14%3A04%3A01Z&se=2026-03-28T14%3A29%3A01Z&sr=b&sp=r&sig=xu3OmTnGiQ74jDpi5YWrXOjZvBn7hDxoXdoCW9aef04%3D> (referer: https://www.bca.co.uk/)
2026-03-28 14:04:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698929196%27 HTTP/1.1" 200 None
2026-03-28 14:04:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698929196 not downloaded yet
2026-03-28 14:04:06 [bca.uk] INFO: Found listing with ID: WG66%20DHY
2026-03-28 14:04:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WG66%2520DHY%27 HTTP/1.1" 200 None
2026-03-28 14:04:06 [bca.uk] INFO: Scrape type for WG66%20DHY: 0
2026-03-28 14:04:06 [bca.uk] INFO: Found listing with ID: YK17%20ZRC
2026-03-28 14:04:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YK17%2520ZRC%27 HTTP/1.1" 200 None
2026-03-28 14:04:06 [bca.uk] INFO: Scrape type for YK17%20ZRC: 0
2026-03-28 14:04:06 [bca.uk] INFO: Found listing with ID: EN14%20ZRU
2026-03-28 14:04:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27EN14%2520ZRU%27 HTTP/1.1" 200 None
2026-03-28 14:04:06 [bca.uk] INFO: Scrape type for EN14%20ZRU: 2
2026-03-28 14:04:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 74ca2454-1575-51c9-88ce-0746fde280b1 with identifier: EN14%20ZRU
2026-03-28 14:04:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 74ca2454-1575-51c9-88ce-0746fde280b1 with scrape type 2
2026-03-28 14:04:06 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 74ca2454-1575-51c9-88ce-0746fde280b1 with scrape type 2
2026-03-28 14:04:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 74ca2454-1575-51c9-88ce-0746fde280b1, identifier: EN14%20ZRU
2026-03-28 14:04:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D697180780%27 HTTP/1.1" 200 None
2026-03-28 14:04:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=697180780 not downloaded yet
2026-03-28 14:04:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698814073%27 HTTP/1.1" 200 None
2026-03-28 14:04:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698814073 not downloaded yet
2026-03-28 14:04:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MV57UOY/698798243/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/MV57UOY/42807073?sv=2020-08-04&st=2026-03-28T14%3A03%3A53Z&se=2026-03-28T14%3A28%3A53Z&sr=b&sp=r&sig=4yruJ8ij2lkpzOh%2Bl0IV9Mz1vdyrZkWNPL1z%2B2woEio%3D)
2026-03-28 14:04:06 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YG70CMV/697550796/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=697550796>
2026-03-28 14:04:06 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LD11FZB/698929108/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698929108>
2026-03-28 14:04:06 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YG70CMV/697550773/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=697550773>
2026-03-28 14:04:06 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YG70CMV/697550760/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=697550760>
2026-03-28 14:04:06 [bca.uk] INFO: Found listing with ID: ND19%20ZXL
2026-03-28 14:04:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27ND19%2520ZXL%27 HTTP/1.1" 200 None
2026-03-28 14:04:06 [bca.uk] INFO: Scrape type for ND19%20ZXL: 1
2026-03-28 14:04:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c9c54905-b471-54fb-b36b-18e3160cc696 with identifier: ND19%20ZXL
2026-03-28 14:04:06 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item c9c54905-b471-54fb-b36b-18e3160cc696
2026-03-28 14:04:06 [bca.uk] INFO: Found listing with ID: FN15%20HLM
2026-03-28 14:04:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FN15%2520HLM%27 HTTP/1.1" 200 None
2026-03-28 14:04:06 [bca.uk] INFO: Scrape type for FN15%20HLM: 0
2026-03-28 14:04:06 [bca.uk] INFO: Found listing with ID: FN62%20YVR
2026-03-28 14:04:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FN62%2520YVR%27 HTTP/1.1" 200 None
2026-03-28 14:04:06 [bca.uk] INFO: Scrape type for FN62%20YVR: 2
2026-03-28 14:04:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d4a62cde-ec8d-52e3-b619-7959d3b78674 with identifier: FN62%20YVR
2026-03-28 14:04:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d4a62cde-ec8d-52e3-b619-7959d3b78674 with scrape type 2
2026-03-28 14:04:06 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d4a62cde-ec8d-52e3-b619-7959d3b78674 with scrape type 2
2026-03-28 14:04:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: d4a62cde-ec8d-52e3-b619-7959d3b78674, identifier: FN62%20YVR
2026-03-28 14:04:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D697550876%27 HTTP/1.1" 200 None
2026-03-28 14:04:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=697550876 not downloaded yet
2026-03-28 14:04:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 74ca2454-1575-51c9-88ce-0746fde280b1 with identifier: EN14%20ZRU
2026-03-28 14:04:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 74ca2454-1575-51c9-88ce-0746fde280b1 with identifier: EN14%20ZRU
2026-03-28 14:04:06 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 74ca2454-1575-51c9-88ce-0746fde280b1 with identifier: EN14%20ZRU to the API
2026-03-28 14:04:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:04:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:04:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=6&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 146,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=EN14%20ZRU-GB',
'category': 'Car',
'color': 'grey',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.6L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol',
'id': '74ca2454-1575-51c9-88ce-0746fde280b1',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'EN14 ZRU',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=EN14%20ZRU&vehicleType=*',
'listing': 'auction',
'location': 'Walsall',
'make': 'FORD',
'model': 'FOCUS',
'odometer': 65552,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2014-01-01',
'seller_name': None,
'title': 'FORD FOCUS 1.6 TI-VCT 125 TITANIUM NAVIGATOR Hatchback',
'transmission': 'automatic',
'trim': 'TI-VCT 125 TITANIUM NAVIGATOR',
'vin': 'WF0KXXGCBKEM37730',
'year': 2014}
2026-03-28 14:04:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27EN14%2520ZRU%27 HTTP/1.1" 200 None
2026-03-28 14:04:07 [bca.uk] INFO: Saving data for EN14%20ZRU: {'auction_closing_time': 1774864800.0, 'created_time': 1774523559.634921, 'last_price_update_time': 1774706647.029359}
2026-03-28 14:04:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='EN14%2520ZRU') HTTP/1.1" 204 0
2026-03-28 14:04:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:04:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a1ff3f150>
2026-03-28 14:04:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:04:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:04:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:04:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fe123a59-25d0-509d-9046-e45117da9996/fe123a59-25d0-509d-9046-e45117da9996_expert_report_file_e3f10af4-dc17-4c41-aae8-7982da737d79.pdf HTTP/1.1" 201 0
2026-03-28 14:04:07 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item fe123a59-25d0-509d-9046-e45117da9996
2026-03-28 14:04:07 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: fe123a59-25d0-509d-9046-e45117da9996, skipping ID generation
2026-03-28 14:04:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item fe123a59-25d0-509d-9046-e45117da9996
2026-03-28 14:04:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DHY65KRJ-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-28 14:04:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=HY65KRJ-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-28 14:04:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:04:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c12f610>
2026-03-28 14:04:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:04:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:04:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:04:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_243a05a7-7cda-5444-ab1c-5fdc014fa410/243a05a7-7cda-5444-ab1c-5fdc014fa410_expert_report_file_556d0e6f-c230-4445-b8bb-5f2ca5c92ce2.pdf HTTP/1.1" 201 0
2026-03-28 14:04:07 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item 243a05a7-7cda-5444-ab1c-5fdc014fa410
2026-03-28 14:04:07 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 243a05a7-7cda-5444-ab1c-5fdc014fa410, skipping ID generation
2026-03-28 14:04:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 243a05a7-7cda-5444-ab1c-5fdc014fa410
2026-03-28 14:04:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DYB63ZKP-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-28 14:04:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=YB63ZKP-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-28 14:04:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:04:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c9604d0>
2026-03-28 14:04:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:04:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:04:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:04:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_96df00f7-d862-5338-b935-5c42d63b82c0/96df00f7-d862-5338-b935-5c42d63b82c0_expert_report_file_eda58b57-73f8-4dfb-83a5-72990c802962.pdf HTTP/1.1" 201 0
2026-03-28 14:04:07 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item 96df00f7-d862-5338-b935-5c42d63b82c0
2026-03-28 14:04:07 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 96df00f7-d862-5338-b935-5c42d63b82c0, skipping ID generation
2026-03-28 14:04:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 96df00f7-d862-5338-b935-5c42d63b82c0
2026-03-28 14:04:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DAK67LWT-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-28 14:04:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=AK67LWT-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-28 14:04:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:04:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c1a0590>
2026-03-28 14:04:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:04:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:04:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:04:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b344c6b3-761f-572b-9e4c-84678fe27e52/b344c6b3-761f-572b-9e4c-84678fe27e52_image_3.jpg HTTP/1.1" 201 0
2026-03-28 14:04:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FMV57UOY%252F698798217%252F600') HTTP/1.1" 204 0
2026-03-28 14:04:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MV57UOY/698798217/600 saved to cache
2026-03-28 14:04:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item b344c6b3-761f-572b-9e4c-84678fe27e52
2026-03-28 14:04:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/WJ58DWA/42809994?sv=2020-08-04&st=2026-03-28T14%3A04%3A01Z&se=2026-03-28T14%3A29%3A01Z&sr=b&sp=r&sig=WelJkUnZ%2FryduuiTM2iL%2FzPRBftp3wpY3FkYWG%2FP0gk%3D> (referer: https://www.bca.co.uk/)
2026-03-28 14:04:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: d4a62cde-ec8d-52e3-b619-7959d3b78674 with identifier: FN62%20YVR
2026-03-28 14:04:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: d4a62cde-ec8d-52e3-b619-7959d3b78674 with identifier: FN62%20YVR
2026-03-28 14:04:07 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: d4a62cde-ec8d-52e3-b619-7959d3b78674 with identifier: FN62%20YVR to the API
2026-03-28 14:04:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:04:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:04:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=5&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 129,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=FN62%20YVR-GB',
'category': 'Car',
'color': 'blue',
'currency': 'GBP',
'doors_number': 5,
'engine': '2.0L',
'expiration_date': '2026-03-29T10:00:00Z',
'fuel_type': 'Diesel',
'id': 'd4a62cde-ec8d-52e3-b619-7959d3b78674',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'FN62 YVR',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=FN62%20YVR&vehicleType=*',
'listing': 'auction',
'location': 'Bedford',
'make': 'FORD',
'model': 'MONDEO',
'odometer': 180785,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2012-01-01',
'seller_name': None,
'title': 'FORD MONDEO 2.0 TDCI 140 ZETEC Hatchback',
'transmission': 'manual',
'trim': 'TDCI 140 ZETEC',
'vin': 'WF0EXXGBBECK22491',
'year': 2012}
2026-03-28 14:04:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FN62%2520YVR%27 HTTP/1.1" 200 None
2026-03-28 14:04:07 [bca.uk] INFO: Saving data for FN62%20YVR: {'auction_closing_time': 1774778400.0, 'created_time': 1774610807.71444, 'last_price_update_time': 1774706647.591915}
2026-03-28 14:04:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='FN62%2520YVR') HTTP/1.1" 204 0
2026-03-28 14:04:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698929226%27 HTTP/1.1" 200 None
2026-03-28 14:04:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698929226 not downloaded yet
2026-03-28 14:04:07 [bca.uk] INFO: Found listing with ID: KP66%20FXV
2026-03-28 14:04:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KP66%2520FXV%27 HTTP/1.1" 200 None
2026-03-28 14:04:07 [bca.uk] INFO: Scrape type for KP66%20FXV: 0
2026-03-28 14:04:07 [bca.uk] INFO: Found listing with ID: NU67%20NWA
2026-03-28 14:04:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27NU67%2520NWA%27 HTTP/1.1" 200 None
2026-03-28 14:04:07 [bca.uk] INFO: Scrape type for NU67%20NWA: 0
2026-03-28 14:04:07 [bca.uk] INFO: Found listing with ID: OY17%20FXG
2026-03-28 14:04:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27OY17%2520FXG%27 HTTP/1.1" 200 None
2026-03-28 14:04:07 [bca.uk] INFO: Scrape type for OY17%20FXG: 2
2026-03-28 14:04:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3b475510-573d-5339-a2bf-8981b4cb0ef6 with identifier: OY17%20FXG
2026-03-28 14:04:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3b475510-573d-5339-a2bf-8981b4cb0ef6 with scrape type 2
2026-03-28 14:04:07 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3b475510-573d-5339-a2bf-8981b4cb0ef6 with scrape type 2
2026-03-28 14:04:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 3b475510-573d-5339-a2bf-8981b4cb0ef6, identifier: OY17%20FXG
2026-03-28 14:04:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D697180789%27 HTTP/1.1" 200 None
2026-03-28 14:04:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=697180789 not downloaded yet
2026-03-28 14:04:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698814095%27 HTTP/1.1" 200 None
2026-03-28 14:04:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698814095 not downloaded yet
2026-03-28 14:04:07 [bca.uk] INFO: Found listing with ID: YR18%20ZWP
2026-03-28 14:04:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YR18%2520ZWP%27 HTTP/1.1" 200 None
2026-03-28 14:04:07 [bca.uk] INFO: Scrape type for YR18%20ZWP: 1
2026-03-28 14:04:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b702a3ab-2b9c-56eb-8885-dba723a802f3 with identifier: YR18%20ZWP
2026-03-28 14:04:07 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item b702a3ab-2b9c-56eb-8885-dba723a802f3
2026-03-28 14:04:07 [bca.uk] INFO: Found listing with ID: GY62%20OLR
2026-03-28 14:04:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GY62%2520OLR%27 HTTP/1.1" 200 None
2026-03-28 14:04:07 [bca.uk] INFO: Scrape type for GY62%20OLR: 0
2026-03-28 14:04:07 [bca.uk] INFO: Found listing with ID: KM62%20FPV
2026-03-28 14:04:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KM62%2520FPV%27 HTTP/1.1" 200 None
2026-03-28 14:04:07 [bca.uk] INFO: Scrape type for KM62%20FPV: 0
2026-03-28 14:04:07 [bca.uk] INFO: Found listing with ID: LJ63%20JYB
2026-03-28 14:04:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LJ63%2520JYB%27 HTTP/1.1" 200 None
2026-03-28 14:04:07 [bca.uk] INFO: Scrape type for LJ63%20JYB: 1
2026-03-28 14:04:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4870bb8b-60c3-52a3-9777-e0e27c2bb711 with identifier: LJ63%20JYB
2026-03-28 14:04:07 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 4870bb8b-60c3-52a3-9777-e0e27c2bb711
2026-03-28 14:04:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D697550898%27 HTTP/1.1" 200 None
2026-03-28 14:04:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=697550898 not downloaded yet
2026-03-28 14:04:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 3b475510-573d-5339-a2bf-8981b4cb0ef6 with identifier: OY17%20FXG
2026-03-28 14:04:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 3b475510-573d-5339-a2bf-8981b4cb0ef6 with identifier: OY17%20FXG
2026-03-28 14:04:08 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 3b475510-573d-5339-a2bf-8981b4cb0ef6 with identifier: OY17%20FXG to the API
2026-03-28 14:04:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:04:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:04:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=6&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 189,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=OY17%20FXG-GB',
'category': 'Car',
'color': 'red',
'currency': 'GBP',
'doors_number': 5,
'engine': '3.0L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Diesel',
'id': '3b475510-573d-5339-a2bf-8981b4cb0ef6',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'OY17 FXG',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=OY17%20FXG&vehicleType=*',
'listing': 'auction',
'location': 'Walsall',
'make': 'LAND ROVER',
'model': 'DISCOVERY',
'odometer': 110688,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-01-01',
'seller_name': None,
'title': 'LAND ROVER DISCOVERY 3.0 TD6 258 HSE LUXURY StationWagon',
'transmission': 'automatic',
'trim': 'TD6 258 HSE LUXURY',
'vin': 'SALRA2AK2HA005649',
'year': 2017}
2026-03-28 14:04:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27OY17%2520FXG%27 HTTP/1.1" 200 None
2026-03-28 14:04:08 [bca.uk] INFO: Saving data for OY17%20FXG: {'auction_closing_time': 1774864800.0, 'created_time': 1773840872.002305, 'last_price_update_time': 1774706648.257236}
2026-03-28 14:04:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='OY17%2520FXG') HTTP/1.1" 204 0
2026-03-28 14:04:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698920375%27 HTTP/1.1" 200 None
2026-03-28 14:04:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698920375 not downloaded yet
2026-03-28 14:04:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698284358%27 HTTP/1.1" 200 None
2026-03-28 14:04:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698284358 not downloaded yet
2026-03-28 14:04:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698947142%27 HTTP/1.1" 200 None
2026-03-28 14:04:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698947142 not downloaded yet
2026-03-28 14:04:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YG70CMV/697550736/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YG70CMV/42809751?sv=2020-08-04&st=2026-03-28T14%3A03%3A58Z&se=2026-03-28T14%3A28%3A58Z&sr=b&sp=r&sig=1ABLz0vVsC9yYBr%2F09SZY1lBMEdGcrDzJ1kVHXJEJlA%3D)
2026-03-28 14:04:08 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LD11FZB/698929149/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698929149>
2026-03-28 14:04:08 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/HV08XHP/42810135?sv=2020-08-04&st=2026-03-28T14%3A04%3A07Z&se=2026-03-28T14%3A29%3A07Z&sr=b&sp=r&sig=nDBJaQ0d1Lnn1Q%2BoiL0EJlYO6HO0nKvJULaa1yflDpY%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=HV08%20XHP-GB>
2026-03-28 14:04:08 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YG70CMV/697550812/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=697550812>
2026-03-28 14:04:08 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LD16UKX/42809855?sv=2020-08-04&st=2026-03-28T14%3A04%3A07Z&se=2026-03-28T14%3A29%3A07Z&sr=b&sp=r&sig=CHOiwblSOmf2jh7w7FrmkfA8BVi7dwLavRkRtCs3kTQ%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=LD16%20UKX-GB>
2026-03-28 14:04:08 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MV57UOY/698798344/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698798344>
2026-03-28 14:04:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698929254%27 HTTP/1.1" 200 None
2026-03-28 14:04:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698929254 not downloaded yet
2026-03-28 14:04:08 [bca.uk] INFO: Found listing with ID: SGZ%206140
2026-03-28 14:04:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SGZ%25206140%27 HTTP/1.1" 200 None
2026-03-28 14:04:08 [bca.uk] INFO: Scrape type for SGZ%206140: 0
2026-03-28 14:04:08 [bca.uk] INFO: Found listing with ID: F6%20ENE
2026-03-28 14:04:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27F6%2520ENE%27 HTTP/1.1" 200 None
2026-03-28 14:04:08 [bca.uk] INFO: Scrape type for F6%20ENE: 2
2026-03-28 14:04:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bafcdc1a-f5b1-5c8c-9f0b-4658af5ead21 with identifier: F6%20ENE
2026-03-28 14:04:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bafcdc1a-f5b1-5c8c-9f0b-4658af5ead21 with scrape type 2
2026-03-28 14:04:08 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item bafcdc1a-f5b1-5c8c-9f0b-4658af5ead21 with scrape type 2
2026-03-28 14:04:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: bafcdc1a-f5b1-5c8c-9f0b-4658af5ead21, identifier: F6%20ENE
2026-03-28 14:04:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D697180798%27 HTTP/1.1" 200 None
2026-03-28 14:04:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=697180798 not downloaded yet
2026-03-28 14:04:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698814113%27 HTTP/1.1" 200 None
2026-03-28 14:04:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698814113 not downloaded yet
2026-03-28 14:04:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:04:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c0fa190>
2026-03-28 14:04:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:04:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:04:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:04:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ca2c3006-0503-55ad-a26d-88f328a541b5/ca2c3006-0503-55ad-a26d-88f328a541b5_expert_report_file_ee7de95f-3019-4880-bf03-c0ec2e74c8b0.pdf HTTP/1.1" 201 0
2026-03-28 14:04:08 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item ca2c3006-0503-55ad-a26d-88f328a541b5
2026-03-28 14:04:08 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: ca2c3006-0503-55ad-a26d-88f328a541b5, skipping ID generation
2026-03-28 14:04:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item ca2c3006-0503-55ad-a26d-88f328a541b5
2026-03-28 14:04:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DBT66DFX-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-28 14:04:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=BT66DFX-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-28 14:04:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:04:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c93dd50>
2026-03-28 14:04:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:04:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:04:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:04:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8f3e30a4-6b64-5dd1-8e1e-6cce5d49fef3/8f3e30a4-6b64-5dd1-8e1e-6cce5d49fef3_expert_report_file_d6e46f81-0680-46ef-97e7-3f7fdf26697b.pdf HTTP/1.1" 201 0
2026-03-28 14:04:08 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item 8f3e30a4-6b64-5dd1-8e1e-6cce5d49fef3
2026-03-28 14:04:08 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 8f3e30a4-6b64-5dd1-8e1e-6cce5d49fef3, skipping ID generation
2026-03-28 14:04:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 8f3e30a4-6b64-5dd1-8e1e-6cce5d49fef3
2026-03-28 14:04:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DPXZ1595-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-28 14:04:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=PXZ1595-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-28 14:04:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:04:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c181550>
2026-03-28 14:04:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:04:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:04:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:04:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b344c6b3-761f-572b-9e4c-84678fe27e52/b344c6b3-761f-572b-9e4c-84678fe27e52_image_4.jpg HTTP/1.1" 201 0
2026-03-28 14:04:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FMV57UOY%252F698798243%252F600') HTTP/1.1" 204 0
2026-03-28 14:04:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MV57UOY/698798243/600 saved to cache
2026-03-28 14:04:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item b344c6b3-761f-572b-9e4c-84678fe27e52
2026-03-28 14:04:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YG70CMV/697550760/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YG70CMV/42809751?sv=2020-08-04&st=2026-03-28T14%3A03%3A58Z&se=2026-03-28T14%3A28%3A58Z&sr=b&sp=r&sig=1ABLz0vVsC9yYBr%2F09SZY1lBMEdGcrDzJ1kVHXJEJlA%3D)
2026-03-28 14:04:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MV57UOY/698798285/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/MV57UOY/42807073?sv=2020-08-04&st=2026-03-28T14%3A03%3A53Z&se=2026-03-28T14%3A28%3A53Z&sr=b&sp=r&sig=4yruJ8ij2lkpzOh%2Bl0IV9Mz1vdyrZkWNPL1z%2B2woEio%3D)
2026-03-28 14:04:08 [bca.uk] INFO: Found listing with ID: HN73%20ZTC
2026-03-28 14:04:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27HN73%2520ZTC%27 HTTP/1.1" 200 None
2026-03-28 14:04:08 [bca.uk] INFO: Scrape type for HN73%20ZTC: 0
2026-03-28 14:04:08 [bca.uk] INFO: Found listing with ID: HT19%20DXO
2026-03-28 14:04:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27HT19%2520DXO%27 HTTP/1.1" 200 None
2026-03-28 14:04:08 [bca.uk] INFO: Scrape type for HT19%20DXO: 2
2026-03-28 14:04:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c945c153-a99c-5263-bf16-5440e669676e with identifier: HT19%20DXO
2026-03-28 14:04:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c945c153-a99c-5263-bf16-5440e669676e with scrape type 2
2026-03-28 14:04:08 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c945c153-a99c-5263-bf16-5440e669676e with scrape type 2
2026-03-28 14:04:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: c945c153-a99c-5263-bf16-5440e669676e, identifier: HT19%20DXO
2026-03-28 14:04:08 [bca.uk] INFO: Found listing with ID: NX10%20HHP
2026-03-28 14:04:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27NX10%2520HHP%27 HTTP/1.1" 200 None
2026-03-28 14:04:08 [bca.uk] INFO: Scrape type for NX10%20HHP: 0
2026-03-28 14:04:08 [bca.uk] INFO: Found listing with ID: LL19%20WUR
2026-03-28 14:04:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LL19%2520WUR%27 HTTP/1.1" 200 None
2026-03-28 14:04:08 [bca.uk] INFO: Scrape type for LL19%20WUR: 2
2026-03-28 14:04:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d8117b92-254d-556f-bb05-b05ba99b2b70 with identifier: LL19%20WUR
2026-03-28 14:04:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d8117b92-254d-556f-bb05-b05ba99b2b70 with scrape type 2
2026-03-28 14:04:08 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d8117b92-254d-556f-bb05-b05ba99b2b70 with scrape type 2
2026-03-28 14:04:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: d8117b92-254d-556f-bb05-b05ba99b2b70, identifier: LL19%20WUR
2026-03-28 14:04:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: bafcdc1a-f5b1-5c8c-9f0b-4658af5ead21 with identifier: F6%20ENE
2026-03-28 14:04:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: bafcdc1a-f5b1-5c8c-9f0b-4658af5ead21 with identifier: F6%20ENE
2026-03-28 14:04:09 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: bafcdc1a-f5b1-5c8c-9f0b-4658af5ead21 with identifier: F6%20ENE to the API
2026-03-28 14:04:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:04:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:04:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=6&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 396,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=F6%20ENE-GB',
'category': 'Car',
'color': 'grey',
'currency': 'GBP',
'doors_number': 2,
'engine': '6.0L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol',
'id': 'bafcdc1a-f5b1-5c8c-9f0b-4658af5ead21',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'F6 ENE',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=F6%20ENE&vehicleType=*',
'listing': 'auction',
'location': 'Walsall',
'make': 'BENTLEY',
'model': 'CONTINENTAL GT',
'odometer': 73471,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2010-01-01',
'seller_name': None,
'title': 'BENTLEY CONTINENTAL GT 6.0 W12 SPEED Coupe',
'transmission': 'manual',
'trim': 'W12 SPEED',
'vin': 'SCBCF63W3AC066706',
'year': 2010}
2026-03-28 14:04:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27F6%2520ENE%27 HTTP/1.1" 200 None
2026-03-28 14:04:09 [bca.uk] INFO: Saving data for F6%20ENE: {'auction_closing_time': 1774864800.0, 'created_time': 1773907589.325524, 'last_price_update_time': 1774706649.368969}
2026-03-28 14:04:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='F6%2520ENE') HTTP/1.1" 204 0
2026-03-28 14:04:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698920380%27 HTTP/1.1" 200 None
2026-03-28 14:04:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698920380 not downloaded yet
2026-03-28 14:04:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698284362%27 HTTP/1.1" 200 None
2026-03-28 14:04:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698284362 not downloaded yet
2026-03-28 14:04:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698947158%27 HTTP/1.1" 200 None
2026-03-28 14:04:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698947158 not downloaded yet
2026-03-28 14:04:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: c945c153-a99c-5263-bf16-5440e669676e with identifier: HT19%20DXO
2026-03-28 14:04:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: c945c153-a99c-5263-bf16-5440e669676e with identifier: HT19%20DXO
2026-03-28 14:04:09 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: c945c153-a99c-5263-bf16-5440e669676e with identifier: HT19%20DXO to the API
2026-03-28 14:04:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:04:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:04:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=4&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 110,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=HT19%20DXO-GB',
'category': 'Car',
'color': 'red',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.0L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol',
'id': 'c945c153-a99c-5263-bf16-5440e669676e',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'HT19 DXO',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=HT19%20DXO&vehicleType=*',
'listing': 'auction',
'location': 'Blackbushe',
'make': 'FORD',
'model': 'FIESTA',
'odometer': 61795,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-01-01',
'seller_name': None,
'title': 'FORD FIESTA 1.0 E/B 100 ZETEC Hatchback',
'transmission': 'manual',
'trim': 'E/B 100 ZETEC',
'vin': 'WF0JXXGAHJKK87809',
'year': 2019}
2026-03-28 14:04:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27HT19%2520DXO%27 HTTP/1.1" 200 None
2026-03-28 14:04:09 [bca.uk] INFO: Saving data for HT19%20DXO: {'auction_closing_time': 1774864800.0, 'created_time': 1774562607.103511, 'last_price_update_time': 1774706649.733907}
2026-03-28 14:04:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='HT19%2520DXO') HTTP/1.1" 204 0
2026-03-28 14:04:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: d8117b92-254d-556f-bb05-b05ba99b2b70 with identifier: LL19%20WUR
2026-03-28 14:04:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: d8117b92-254d-556f-bb05-b05ba99b2b70 with identifier: LL19%20WUR
2026-03-28 14:04:09 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: d8117b92-254d-556f-bb05-b05ba99b2b70 with identifier: LL19%20WUR to the API
2026-03-28 14:04:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:04:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:04:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=5&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 178,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=LL19%20WUR-GB',
'category': 'Car',
'color': 'black',
'currency': 'GBP',
'doors_number': 5,
'engine': '3.0L',
'expiration_date': '2026-03-29T10:00:00Z',
'fuel_type': 'Diesel',
'id': 'd8117b92-254d-556f-bb05-b05ba99b2b70',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'LL19 WUR',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=LL19%20WUR&vehicleType=*',
'listing': 'auction',
'location': 'Crawley',
'make': 'AUDI',
'model': 'Q7',
'odometer': 76473,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-01-01',
'seller_name': None,
'title': 'AUDI Q7 3.0 45 TDI QUATTRO S LINE TIP StationWagon',
'transmission': 'manual',
'trim': '45 TDI QUATTRO S LINE TIP',
'vin': 'WAUZZZ4M6KD012872',
'year': 2019}
2026-03-28 14:04:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LL19%2520WUR%27 HTTP/1.1" 200 None
2026-03-28 14:04:10 [bca.uk] INFO: Saving data for LL19%20WUR: {'auction_closing_time': 1774778400.0, 'created_time': 1774609392.660476, 'last_price_update_time': 1774706650.073657}
2026-03-28 14:04:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='LL19%2520WUR') HTTP/1.1" 204 0
2026-03-28 14:04:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698929281%27 HTTP/1.1" 200 None
2026-03-28 14:04:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698929281 not downloaded yet
2026-03-28 14:04:10 [bca.uk] INFO: Found listing with ID: SY63%20BZU
2026-03-28 14:04:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SY63%2520BZU%27 HTTP/1.1" 200 None
2026-03-28 14:04:10 [bca.uk] INFO: Scrape type for SY63%20BZU: 0
2026-03-28 14:04:10 [bca.uk] INFO: Found listing with ID: WU10%20OBT
2026-03-28 14:04:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WU10%2520OBT%27 HTTP/1.1" 200 None
2026-03-28 14:04:10 [bca.uk] INFO: Scrape type for WU10%20OBT: 0
2026-03-28 14:04:10 [bca.uk] INFO: Found listing with ID: YA08%20OVK
2026-03-28 14:04:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YA08%2520OVK%27 HTTP/1.1" 200 None
2026-03-28 14:04:10 [bca.uk] INFO: Scrape type for YA08%20OVK: 0
2026-03-28 14:04:10 [bca.uk] INFO: Found listing with ID: FL59%20GYJ
2026-03-28 14:04:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FL59%2520GYJ%27 HTTP/1.1" 200 None
2026-03-28 14:04:10 [bca.uk] INFO: Scrape type for FL59%20GYJ: 2
2026-03-28 14:04:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2579fa45-6bdd-5d07-9208-d09476f4b37d with identifier: FL59%20GYJ
2026-03-28 14:04:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2579fa45-6bdd-5d07-9208-d09476f4b37d with scrape type 2
2026-03-28 14:04:10 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2579fa45-6bdd-5d07-9208-d09476f4b37d with scrape type 2
2026-03-28 14:04:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 2579fa45-6bdd-5d07-9208-d09476f4b37d, identifier: FL59%20GYJ
2026-03-28 14:04:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D697180810%27 HTTP/1.1" 200 None
2026-03-28 14:04:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=697180810 not downloaded yet
2026-03-28 14:04:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698814133%27 HTTP/1.1" 200 None
2026-03-28 14:04:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698814133 not downloaded yet
2026-03-28 14:04:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698129699%27 HTTP/1.1" 200 None
2026-03-28 14:04:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698129699 not downloaded yet
2026-03-28 14:04:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698814105%27 HTTP/1.1" 200 None
2026-03-28 14:04:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698814105 not downloaded yet
2026-03-28 14:04:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LD11FZB/698929108/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LD11FZB/42809686?sv=2020-08-04&st=2026-03-28T14%3A03%3A58Z&se=2026-03-28T14%3A28%3A58Z&sr=b&sp=r&sig=%2FK4BAlVG%2BClj51VCbQA3WyKfnHgVC%2B3mVHIA2lg6Jqc%3D)
2026-03-28 14:04:10 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YG70CMV/697550856/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=697550856>
2026-03-28 14:04:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YG70CMV/697550773/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YG70CMV/42809751?sv=2020-08-04&st=2026-03-28T14%3A03%3A58Z&se=2026-03-28T14%3A28%3A58Z&sr=b&sp=r&sig=1ABLz0vVsC9yYBr%2F09SZY1lBMEdGcrDzJ1kVHXJEJlA%3D)
2026-03-28 14:04:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YG70CMV/697550796/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YG70CMV/42809751?sv=2020-08-04&st=2026-03-28T14%3A03%3A58Z&se=2026-03-28T14%3A28%3A58Z&sr=b&sp=r&sig=1ABLz0vVsC9yYBr%2F09SZY1lBMEdGcrDzJ1kVHXJEJlA%3D)
2026-03-28 14:04:10 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/FE12WRX/42809715?sv=2020-08-04&st=2026-03-28T14%3A04%3A08Z&se=2026-03-28T14%3A29%3A08Z&sr=b&sp=r&sig=IhVxQK0SibgR8nCtLOUZrswprKTYcjKJBEdadhY0N3I%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=FE12%20WRX-GB>
2026-03-28 14:04:10 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/HV69NLA/42810551?sv=2020-08-04&st=2026-03-28T14%3A04%3A08Z&se=2026-03-28T14%3A29%3A08Z&sr=b&sp=r&sig=sCJK6ApeU%2FoHZHPsXN72GO3cagNVfUluR%2FbC%2B%2BOeYM4%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=HV69%20NLA-GB>
2026-03-28 14:04:10 [bca.uk] INFO: Found listing with ID: KY19%20BNC
2026-03-28 14:04:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KY19%2520BNC%27 HTTP/1.1" 200 None
2026-03-28 14:04:10 [bca.uk] INFO: Scrape type for KY19%20BNC: 1
2026-03-28 14:04:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e70be94c-e868-51f1-a147-7ef5a60aac74 with identifier: KY19%20BNC
2026-03-28 14:04:10 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item e70be94c-e868-51f1-a147-7ef5a60aac74
2026-03-28 14:04:10 [bca.uk] INFO: Found listing with ID: LF66%20PMO
2026-03-28 14:04:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LF66%2520PMO%27 HTTP/1.1" 200 None
2026-03-28 14:04:10 [bca.uk] INFO: Scrape type for LF66%20PMO: 2
2026-03-28 14:04:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: def9c7a5-3b42-5e39-8213-622f0f23c0fd with identifier: LF66%20PMO
2026-03-28 14:04:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item def9c7a5-3b42-5e39-8213-622f0f23c0fd with scrape type 2
2026-03-28 14:04:10 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item def9c7a5-3b42-5e39-8213-622f0f23c0fd with scrape type 2
2026-03-28 14:04:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: def9c7a5-3b42-5e39-8213-622f0f23c0fd, identifier: LF66%20PMO
2026-03-28 14:04:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 2579fa45-6bdd-5d07-9208-d09476f4b37d with identifier: FL59%20GYJ
2026-03-28 14:04:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 2579fa45-6bdd-5d07-9208-d09476f4b37d with identifier: FL59%20GYJ
2026-03-28 14:04:10 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 2579fa45-6bdd-5d07-9208-d09476f4b37d with identifier: FL59%20GYJ to the API
2026-03-28 14:04:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:04:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:04:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=6&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 186,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=FL59%20GYJ-GB',
'category': 'Car',
'color': 'grey',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.8L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol',
'id': '2579fa45-6bdd-5d07-9208-d09476f4b37d',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'FL59 GYJ',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=FL59%20GYJ&vehicleType=*',
'listing': 'auction',
'location': 'Thurleigh',
'make': 'VAUXHALL',
'model': 'ASTRA',
'odometer': 99386,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2009-01-01',
'seller_name': None,
'title': 'VAUXHALL ASTRA 1.8 VVT DESIGN Estate',
'transmission': 'automatic',
'trim': 'VVT DESIGN',
'vin': 'W0L0AHL35A2039813',
'year': 2009}
2026-03-28 14:04:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FL59%2520GYJ%27 HTTP/1.1" 200 None
2026-03-28 14:04:10 [bca.uk] INFO: Saving data for FL59%20GYJ: {'auction_closing_time': 1774864800.0, 'created_time': 1774305755.389417, 'last_price_update_time': 1774706650.797659}
2026-03-28 14:04:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='FL59%2520GYJ') HTTP/1.1" 204 0
2026-03-28 14:04:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698920383%27 HTTP/1.1" 200 None
2026-03-28 14:04:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698920383 not downloaded yet
2026-03-28 14:04:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698284367%27 HTTP/1.1" 200 None
2026-03-28 14:04:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698284367 not downloaded yet
2026-03-28 14:04:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698947171%27 HTTP/1.1" 200 None
2026-03-28 14:04:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698947171 not downloaded yet
2026-03-28 14:04:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:04:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c9ffd90>
2026-03-28 14:04:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:04:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:04:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:04:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8413221f-7948-5093-9030-c87150f157c7/8413221f-7948-5093-9030-c87150f157c7_expert_report_file_a4b1ba2b-35cb-49a4-bc22-ba4907b39e06.pdf HTTP/1.1" 201 0
2026-03-28 14:04:10 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item 8413221f-7948-5093-9030-c87150f157c7
2026-03-28 14:04:10 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 8413221f-7948-5093-9030-c87150f157c7, skipping ID generation
2026-03-28 14:04:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 8413221f-7948-5093-9030-c87150f157c7
2026-03-28 14:04:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DWJ58DWA-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-28 14:04:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=WJ58DWA-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-28 14:04:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:04:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2dd29250>
2026-03-28 14:04:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:04:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:04:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:04:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_505ec447-0f6d-5de4-9190-5ab4c6e276f7/505ec447-0f6d-5de4-9190-5ab4c6e276f7_image_0.jpg HTTP/1.1" 201 0
2026-03-28 14:04:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FYG70CMV%252F697550736%252F600') HTTP/1.1" 204 0
2026-03-28 14:04:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YG70CMV/697550736/600 saved to cache
2026-03-28 14:04:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 505ec447-0f6d-5de4-9190-5ab4c6e276f7
2026-03-28 14:04:11 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NK64UTR/698814073/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698814073>
2026-03-28 14:04:11 [scrapy.extensions.logstats] INFO: Crawled 142 pages (at 45 pages/min), scraped 154 items (at 53 items/min)
2026-03-28 14:04:11 [scrapy.extensions.memusage] INFO: Peak memory usage is 195MiB
2026-03-28 14:04:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: def9c7a5-3b42-5e39-8213-622f0f23c0fd with identifier: LF66%20PMO
2026-03-28 14:04:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: def9c7a5-3b42-5e39-8213-622f0f23c0fd with identifier: LF66%20PMO
2026-03-28 14:04:11 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: def9c7a5-3b42-5e39-8213-622f0f23c0fd with identifier: LF66%20PMO to the API
2026-03-28 14:04:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:04:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:04:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=5&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 157,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=LF66%20PMO-GB',
'category': 'Car',
'color': 'white',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.7L',
'expiration_date': '2026-03-29T10:00:00Z',
'fuel_type': 'Petrol',
'id': 'def9c7a5-3b42-5e39-8213-622f0f23c0fd',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'LF66 PMO',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=LF66%20PMO&vehicleType=*',
'listing': 'auction',
'location': 'Crawley',
'make': 'ALFA ROMEO',
'model': 'GIULIETTA',
'odometer': 47491,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-01-01',
'seller_name': None,
'title': 'ALFA ROMEO GIULIETTA 1.7 1750 TBI 240 VELOCE TCT Hatchback',
'transmission': 'automatic',
'trim': '1750 TBI 240 VELOCE TCT',
'vin': 'ZAR94000007431804',
'year': 2016}
2026-03-28 14:04:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LF66%2520PMO%27 HTTP/1.1" 200 None
2026-03-28 14:04:11 [bca.uk] INFO: Saving data for LF66%20PMO: {'auction_closing_time': 1774778400.0, 'created_time': 1774016952.307759, 'last_price_update_time': 1774706651.397312}
2026-03-28 14:04:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='LF66%2520PMO') HTTP/1.1" 204 0
2026-03-28 14:04:11 [bca.uk] INFO: Found listing with ID: KR60%20ZHC
2026-03-28 14:04:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KR60%2520ZHC%27 HTTP/1.1" 200 None
2026-03-28 14:04:11 [bca.uk] INFO: Scrape type for KR60%20ZHC: 2
2026-03-28 14:04:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2b557c90-3d44-508e-9010-99aa5cd59c8d with identifier: KR60%20ZHC
2026-03-28 14:04:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2b557c90-3d44-508e-9010-99aa5cd59c8d with scrape type 2
2026-03-28 14:04:11 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2b557c90-3d44-508e-9010-99aa5cd59c8d with scrape type 2
2026-03-28 14:04:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 2b557c90-3d44-508e-9010-99aa5cd59c8d, identifier: KR60%20ZHC
2026-03-28 14:04:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D697180820%27 HTTP/1.1" 200 None
2026-03-28 14:04:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=697180820 not downloaded yet
2026-03-28 14:04:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698814148%27 HTTP/1.1" 200 None
2026-03-28 14:04:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698814148 not downloaded yet
2026-03-28 14:04:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698129701%27 HTTP/1.1" 200 None
2026-03-28 14:04:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698129701 not downloaded yet
2026-03-28 14:04:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698814130%27 HTTP/1.1" 200 None
2026-03-28 14:04:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698814130 not downloaded yet
2026-03-28 14:04:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MV57UOY/698798344/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/MV57UOY/42807073?sv=2020-08-04&st=2026-03-28T14%3A03%3A53Z&se=2026-03-28T14%3A28%3A53Z&sr=b&sp=r&sig=4yruJ8ij2lkpzOh%2Bl0IV9Mz1vdyrZkWNPL1z%2B2woEio%3D)
2026-03-28 14:04:11 [bca.uk] INFO: Found listing with ID: LD22%20EZW
2026-03-28 14:04:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LD22%2520EZW%27 HTTP/1.1" 200 None
2026-03-28 14:04:11 [bca.uk] INFO: Scrape type for LD22%20EZW: 2
2026-03-28 14:04:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9b644329-0ac6-591a-8b1e-440abe7bae1f with identifier: LD22%20EZW
2026-03-28 14:04:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9b644329-0ac6-591a-8b1e-440abe7bae1f with scrape type 2
2026-03-28 14:04:11 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9b644329-0ac6-591a-8b1e-440abe7bae1f with scrape type 2
2026-03-28 14:04:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 9b644329-0ac6-591a-8b1e-440abe7bae1f, identifier: LD22%20EZW
2026-03-28 14:04:11 [bca.uk] INFO: Found listing with ID: KW19%20XMZ
2026-03-28 14:04:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KW19%2520XMZ%27 HTTP/1.1" 200 None
2026-03-28 14:04:11 [bca.uk] INFO: Scrape type for KW19%20XMZ: 0
2026-03-28 14:04:11 [bca.uk] INFO: Found listing with ID: FE70%20MZU
2026-03-28 14:04:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FE70%2520MZU%27 HTTP/1.1" 200 None
2026-03-28 14:04:11 [bca.uk] INFO: Scrape type for FE70%20MZU: 0
2026-03-28 14:04:11 [bca.uk] INFO: Found listing with ID: AP08%20SUO
2026-03-28 14:04:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27AP08%2520SUO%27 HTTP/1.1" 200 None
2026-03-28 14:04:11 [bca.uk] INFO: Scrape type for AP08%20SUO: 0
2026-03-28 14:04:11 [bca.uk] INFO: Found listing with ID: GU69%20EBF
2026-03-28 14:04:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GU69%2520EBF%27 HTTP/1.1" 200 None
2026-03-28 14:04:11 [bca.uk] INFO: Scrape type for GU69%20EBF: 0
2026-03-28 14:04:11 [bca.uk] INFO: Found listing with ID: GK65%20ONX
2026-03-28 14:04:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GK65%2520ONX%27 HTTP/1.1" 200 None
2026-03-28 14:04:11 [bca.uk] INFO: Scrape type for GK65%20ONX: 0
2026-03-28 14:04:11 [bca.uk] INFO: Found listing with ID: OW69%20BUU
2026-03-28 14:04:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27OW69%2520BUU%27 HTTP/1.1" 200 None
2026-03-28 14:04:11 [bca.uk] INFO: Scrape type for OW69%20BUU: 1
2026-03-28 14:04:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0d569b1a-e283-5140-bff5-8b0083b89ad4 with identifier: OW69%20BUU
2026-03-28 14:04:11 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 0d569b1a-e283-5140-bff5-8b0083b89ad4
2026-03-28 14:04:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 2b557c90-3d44-508e-9010-99aa5cd59c8d with identifier: KR60%20ZHC
2026-03-28 14:04:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 2b557c90-3d44-508e-9010-99aa5cd59c8d with identifier: KR60%20ZHC
2026-03-28 14:04:11 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 2b557c90-3d44-508e-9010-99aa5cd59c8d with identifier: KR60%20ZHC to the API
2026-03-28 14:04:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:04:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:04:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=6&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 144,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=KR60%20ZHC-GB',
'category': 'Car',
'color': 'grey',
'currency': 'GBP',
'doors_number': 5,
'engine': '2.0L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Diesel',
'id': '2b557c90-3d44-508e-9010-99aa5cd59c8d',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'KR60 ZHC',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=KR60%20ZHC&vehicleType=*',
'listing': 'auction',
'location': 'Thurleigh',
'make': 'MERCEDES-BENZ',
'model': 'A180',
'odometer': 109241,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2011-01-01',
'seller_name': None,
'title': 'MERCEDES-BENZ A180 2.0 CDI AVANTGARDE SE Hatchback',
'transmission': 'manual',
'trim': 'CDI AVANTGARDE SE',
'vin': 'WDD1690072J924898',
'year': 2011}
2026-03-28 14:04:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KR60%2520ZHC%27 HTTP/1.1" 200 None
2026-03-28 14:04:12 [bca.uk] INFO: Saving data for KR60%20ZHC: {'auction_closing_time': 1774864800.0, 'created_time': 1774363699.998403, 'last_price_update_time': 1774706652.125119}
2026-03-28 14:04:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='KR60%2520ZHC') HTTP/1.1" 204 0
2026-03-28 14:04:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698920388%27 HTTP/1.1" 200 None
2026-03-28 14:04:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698920388 not downloaded yet
2026-03-28 14:04:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698284372%27 HTTP/1.1" 200 None
2026-03-28 14:04:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698284372 not downloaded yet
2026-03-28 14:04:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698947180%27 HTTP/1.1" 200 None
2026-03-28 14:04:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698947180 not downloaded yet
2026-03-28 14:04:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D697410328%27 HTTP/1.1" 200 None
2026-03-28 14:04:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=697410328 not downloaded yet
2026-03-28 14:04:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:04:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c6aa6d0>
2026-03-28 14:04:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:04:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:04:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:04:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_505ec447-0f6d-5de4-9190-5ab4c6e276f7/505ec447-0f6d-5de4-9190-5ab4c6e276f7_image_2.jpg HTTP/1.1" 201 0
2026-03-28 14:04:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FYG70CMV%252F697550760%252F600') HTTP/1.1" 204 0
2026-03-28 14:04:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YG70CMV/697550760/600 saved to cache
2026-03-28 14:04:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 505ec447-0f6d-5de4-9190-5ab4c6e276f7
2026-03-28 14:04:12 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:04:12 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:04:12 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:04:12 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:04:12 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:04:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:04:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2ddb1c10>
2026-03-28 14:04:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:04:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:04:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:04:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b344c6b3-761f-572b-9e4c-84678fe27e52/b344c6b3-761f-572b-9e4c-84678fe27e52_image_6.jpg HTTP/1.1" 201 0
2026-03-28 14:04:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FMV57UOY%252F698798285%252F600') HTTP/1.1" 204 0
2026-03-28 14:04:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MV57UOY/698798285/600 saved to cache
2026-03-28 14:04:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item b344c6b3-761f-572b-9e4c-84678fe27e52
2026-03-28 14:04:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YG70CMV/697550812/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YG70CMV/42809751?sv=2020-08-04&st=2026-03-28T14%3A03%3A58Z&se=2026-03-28T14%3A28%3A58Z&sr=b&sp=r&sig=1ABLz0vVsC9yYBr%2F09SZY1lBMEdGcrDzJ1kVHXJEJlA%3D)
2026-03-28 14:04:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LD11FZB/698929149/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LD11FZB/42809686?sv=2020-08-04&st=2026-03-28T14%3A03%3A58Z&se=2026-03-28T14%3A28%3A58Z&sr=b&sp=r&sig=%2FK4BAlVG%2BClj51VCbQA3WyKfnHgVC%2B3mVHIA2lg6Jqc%3D)
2026-03-28 14:04:12 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AK67LWT/698947142/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698947142>
2026-03-28 14:04:12 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NK64UTR/698814095/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698814095>
2026-03-28 14:04:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 9b644329-0ac6-591a-8b1e-440abe7bae1f with identifier: LD22%20EZW
2026-03-28 14:04:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 9b644329-0ac6-591a-8b1e-440abe7bae1f with identifier: LD22%20EZW
2026-03-28 14:04:12 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 9b644329-0ac6-591a-8b1e-440abe7bae1f with identifier: LD22%20EZW to the API
2026-03-28 14:04:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:04:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:04:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=4&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 102,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=LD22%20EZW-GB',
'category': 'Car',
'color': 'grey',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.5L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol/Electric',
'id': '9b644329-0ac6-591a-8b1e-440abe7bae1f',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'LD22 EZW',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=LD22%20EZW&vehicleType=*',
'listing': 'auction',
'location': 'Blackbushe',
'make': 'HONDA',
'model': 'JAZZ',
'odometer': 23391,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-01-01',
'seller_name': None,
'title': 'HONDA JAZZ 1.5 I-MMD HYBRID SE ECVT Hatchback',
'transmission': 'automatic',
'trim': 'I-MMD HYBRID SE ECVT',
'vin': 'JHMGR3830NS208585',
'year': 2022}
2026-03-28 14:04:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LD22%2520EZW%27 HTTP/1.1" 200 None
2026-03-28 14:04:12 [bca.uk] INFO: Saving data for LD22%20EZW: {'auction_closing_time': 1774864800.0, 'created_time': 1774476195.871557, 'last_price_update_time': 1774706652.62272}
2026-03-28 14:04:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='LD22%2520EZW') HTTP/1.1" 204 0
2026-03-28 14:04:12 [bca.uk] INFO: Found listing with ID: KV61%20SXO
2026-03-28 14:04:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KV61%2520SXO%27 HTTP/1.1" 200 None
2026-03-28 14:04:12 [bca.uk] INFO: Scrape type for KV61%20SXO: 2
2026-03-28 14:04:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 790901d1-4c7e-5479-92f5-a5897f3fd2ad with identifier: KV61%20SXO
2026-03-28 14:04:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 790901d1-4c7e-5479-92f5-a5897f3fd2ad with scrape type 2
2026-03-28 14:04:12 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 790901d1-4c7e-5479-92f5-a5897f3fd2ad with scrape type 2
2026-03-28 14:04:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 790901d1-4c7e-5479-92f5-a5897f3fd2ad, identifier: KV61%20SXO
2026-03-28 14:04:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D697180844%27 HTTP/1.1" 200 None
2026-03-28 14:04:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=697180844 not downloaded yet
2026-03-28 14:04:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698814175%27 HTTP/1.1" 200 None
2026-03-28 14:04:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698814175 not downloaded yet
2026-03-28 14:04:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698129706%27 HTTP/1.1" 200 None
2026-03-28 14:04:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698129706 not downloaded yet
2026-03-28 14:04:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698814140%27 HTTP/1.1" 200 None
2026-03-28 14:04:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698814140 not downloaded yet
2026-03-28 14:04:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:04:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2dbbf310>
2026-03-28 14:04:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:04:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:04:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:04:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fadd6eea-e2b0-5574-affe-cdf6b892b445/fadd6eea-e2b0-5574-affe-cdf6b892b445_image_2.jpg HTTP/1.1" 201 0
2026-03-28 14:04:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLD11FZB%252F698929108%252F600') HTTP/1.1" 204 0
2026-03-28 14:04:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LD11FZB/698929108/600 saved to cache
2026-03-28 14:04:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item fadd6eea-e2b0-5574-affe-cdf6b892b445
2026-03-28 14:04:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:04:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a1fe11810>
2026-03-28 14:04:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:04:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:04:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:04:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_505ec447-0f6d-5de4-9190-5ab4c6e276f7/505ec447-0f6d-5de4-9190-5ab4c6e276f7_image_3.jpg HTTP/1.1" 201 0
2026-03-28 14:04:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FYG70CMV%252F697550773%252F600') HTTP/1.1" 204 0
2026-03-28 14:04:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YG70CMV/697550773/600 saved to cache
2026-03-28 14:04:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 505ec447-0f6d-5de4-9190-5ab4c6e276f7
2026-03-28 14:04:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:04:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2ca32d10>
2026-03-28 14:04:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:04:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:04:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:04:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_505ec447-0f6d-5de4-9190-5ab4c6e276f7/505ec447-0f6d-5de4-9190-5ab4c6e276f7_image_4.jpg HTTP/1.1" 201 0
2026-03-28 14:04:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FYG70CMV%252F697550796%252F600') HTTP/1.1" 204 0
2026-03-28 14:04:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YG70CMV/697550796/600 saved to cache
2026-03-28 14:04:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 505ec447-0f6d-5de4-9190-5ab4c6e276f7
2026-03-28 14:04:12 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YB63ZKP/698284358/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698284358>
2026-03-28 14:04:12 [bca.uk] INFO: Found listing with ID: LT19%20JWW
2026-03-28 14:04:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LT19%2520JWW%27 HTTP/1.1" 200 None
2026-03-28 14:04:12 [bca.uk] INFO: Scrape type for LT19%20JWW: 0
2026-03-28 14:04:12 [bca.uk] INFO: Found listing with ID: MA20%20EKM
2026-03-28 14:04:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MA20%2520EKM%27 HTTP/1.1" 200 None
2026-03-28 14:04:12 [bca.uk] INFO: Scrape type for MA20%20EKM: 2
2026-03-28 14:04:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ae6fd4eb-3a8b-5c3c-9d45-f2fb36988eca with identifier: MA20%20EKM
2026-03-28 14:04:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ae6fd4eb-3a8b-5c3c-9d45-f2fb36988eca with scrape type 2
2026-03-28 14:04:12 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ae6fd4eb-3a8b-5c3c-9d45-f2fb36988eca with scrape type 2
2026-03-28 14:04:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: ae6fd4eb-3a8b-5c3c-9d45-f2fb36988eca, identifier: MA20%20EKM
2026-03-28 14:04:13 [bca.uk] INFO: Found listing with ID: LJ24%20UKC
2026-03-28 14:04:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LJ24%2520UKC%27 HTTP/1.1" 200 None
2026-03-28 14:04:13 [bca.uk] INFO: Scrape type for LJ24%20UKC: 1
2026-03-28 14:04:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e21ba6d8-ccbd-5912-bd24-f51d3dc89889 with identifier: LJ24%20UKC
2026-03-28 14:04:13 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item e21ba6d8-ccbd-5912-bd24-f51d3dc89889
2026-03-28 14:04:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 790901d1-4c7e-5479-92f5-a5897f3fd2ad with identifier: KV61%20SXO
2026-03-28 14:04:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 790901d1-4c7e-5479-92f5-a5897f3fd2ad with identifier: KV61%20SXO
2026-03-28 14:04:13 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 790901d1-4c7e-5479-92f5-a5897f3fd2ad with identifier: KV61%20SXO to the API
2026-03-28 14:04:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:04:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:04:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=6&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 131,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=KV61%20SXO-GB',
'category': 'Car',
'color': 'black',
'currency': 'GBP',
'doors_number': 4,
'engine': '2.1L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Diesel',
'id': '790901d1-4c7e-5479-92f5-a5897f3fd2ad',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'KV61 SXO',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=KV61%20SXO&vehicleType=*',
'listing': 'auction',
'location': 'Thurleigh',
'make': 'MERCEDES-BENZ',
'model': 'C220',
'odometer': 101139,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2011-01-01',
'seller_name': None,
'title': 'MERCEDES-BENZ C220 2.1 CDI B/E ELEGANCE EDITION 125 Saloon',
'transmission': 'manual',
'trim': 'CDI B/E ELEGANCE EDITION 125',
'vin': 'WDD2040022A619218',
'year': 2011}
2026-03-28 14:04:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KV61%2520SXO%27 HTTP/1.1" 200 None
2026-03-28 14:04:13 [bca.uk] INFO: Saving data for KV61%20SXO: {'auction_closing_time': 1774864800.0, 'created_time': 1774363703.39618, 'last_price_update_time': 1774706653.465996}
2026-03-28 14:04:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='KV61%2520SXO') HTTP/1.1" 204 0
2026-03-28 14:04:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698920390%27 HTTP/1.1" 200 None
2026-03-28 14:04:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698920390 not downloaded yet
2026-03-28 14:04:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698284376%27 HTTP/1.1" 200 None
2026-03-28 14:04:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698284376 not downloaded yet
2026-03-28 14:04:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698947195%27 HTTP/1.1" 200 None
2026-03-28 14:04:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698947195 not downloaded yet
2026-03-28 14:04:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D697410338%27 HTTP/1.1" 200 None
2026-03-28 14:04:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=697410338 not downloaded yet
2026-03-28 14:04:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LD16UKX/42809855?sv=2020-08-04&st=2026-03-28T14%3A04%3A07Z&se=2026-03-28T14%3A29%3A07Z&sr=b&sp=r&sig=CHOiwblSOmf2jh7w7FrmkfA8BVi7dwLavRkRtCs3kTQ%3D> (referer: https://www.bca.co.uk/)
2026-03-28 14:04:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NK64UTR/698814073/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/NK64UTR/42807827?sv=2020-08-04&st=2026-03-28T14%3A04%3A00Z&se=2026-03-28T14%3A29%3A00Z&sr=b&sp=r&sig=B2djBTwUnOYzqxtI8e7WJD2j2cACy9SjmoGLE3oN2SE%3D)
2026-03-28 14:04:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: ae6fd4eb-3a8b-5c3c-9d45-f2fb36988eca with identifier: MA20%20EKM
2026-03-28 14:04:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: ae6fd4eb-3a8b-5c3c-9d45-f2fb36988eca with identifier: MA20%20EKM
2026-03-28 14:04:13 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: ae6fd4eb-3a8b-5c3c-9d45-f2fb36988eca with identifier: MA20%20EKM to the API
2026-03-28 14:04:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:04:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:04:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=4&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 185,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=MA20%20EKM-GB',
'category': 'Car',
'color': 'grey',
'currency': 'GBP',
'doors_number': 5,
'engine': '2.0L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol',
'id': 'ae6fd4eb-3a8b-5c3c-9d45-f2fb36988eca',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'MA20 EKM',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=MA20%20EKM&vehicleType=*',
'listing': 'auction',
'location': 'Blackbushe',
'make': 'LAND ROVER',
'model': 'R/R EVOQUE',
'odometer': 34296,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-01-01',
'seller_name': None,
'title': 'LAND ROVER R/R EVOQUE 2.0 P300 4WD R-DYNAMIC HSE Hatchback',
'transmission': 'automatic',
'trim': 'P300 4WD R-DYNAMIC HSE',
'vin': 'SALZA2AX2LH085711',
'year': 2020}
2026-03-28 14:04:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MA20%2520EKM%27 HTTP/1.1" 200 None
2026-03-28 14:04:14 [bca.uk] INFO: Saving data for MA20%20EKM: {'auction_closing_time': 1774864800.0, 'created_time': 1774447620.101502, 'last_price_update_time': 1774706654.018035}
2026-03-28 14:04:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='MA20%2520EKM') HTTP/1.1" 204 0
2026-03-28 14:04:14 [bca.uk] INFO: Found listing with ID: MH07%20CHJ
2026-03-28 14:04:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MH07%2520CHJ%27 HTTP/1.1" 200 None
2026-03-28 14:04:14 [bca.uk] INFO: Scrape type for MH07%20CHJ: 2
2026-03-28 14:04:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: dc19d35f-8733-5752-bf1c-d9528016493f with identifier: MH07%20CHJ
2026-03-28 14:04:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item dc19d35f-8733-5752-bf1c-d9528016493f with scrape type 2
2026-03-28 14:04:14 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item dc19d35f-8733-5752-bf1c-d9528016493f with scrape type 2
2026-03-28 14:04:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: dc19d35f-8733-5752-bf1c-d9528016493f, identifier: MH07%20CHJ
2026-03-28 14:04:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D697180879%27 HTTP/1.1" 200 None
2026-03-28 14:04:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=697180879 not downloaded yet
2026-03-28 14:04:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698814200%27 HTTP/1.1" 200 None
2026-03-28 14:04:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698814200 not downloaded yet
2026-03-28 14:04:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698129708%27 HTTP/1.1" 200 None
2026-03-28 14:04:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698129708 not downloaded yet
2026-03-28 14:04:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698814161%27 HTTP/1.1" 200 None
2026-03-28 14:04:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698814161 not downloaded yet
2026-03-28 14:04:14 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:04:14 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:04:14 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:04:14 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:04:14 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:04:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:04:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a1fd3b790>
2026-03-28 14:04:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:04:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:04:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:04:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b344c6b3-761f-572b-9e4c-84678fe27e52/b344c6b3-761f-572b-9e4c-84678fe27e52_image_9.jpg HTTP/1.1" 201 0
2026-03-28 14:04:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FMV57UOY%252F698798344%252F600') HTTP/1.1" 204 0
2026-03-28 14:04:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MV57UOY/698798344/600 saved to cache
2026-03-28 14:04:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item b344c6b3-761f-572b-9e4c-84678fe27e52
2026-03-28 14:04:14 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PXZ1595/698814105/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698814105>
2026-03-28 14:04:14 [bca.uk] INFO: Found listing with ID: YR19%20AOV
2026-03-28 14:04:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YR19%2520AOV%27 HTTP/1.1" 200 None
2026-03-28 14:04:14 [bca.uk] INFO: Scrape type for YR19%20AOV: 0
2026-03-28 14:04:14 [bca.uk] INFO: Found listing with ID: LD06%20WNS
2026-03-28 14:04:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LD06%2520WNS%27 HTTP/1.1" 200 None
2026-03-28 14:04:14 [bca.uk] INFO: Scrape type for LD06%20WNS: 1
2026-03-28 14:04:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bbfa1477-6876-5cb3-8bcc-b863e9aae5b2 with identifier: LD06%20WNS
2026-03-28 14:04:14 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item bbfa1477-6876-5cb3-8bcc-b863e9aae5b2
2026-03-28 14:04:14 [bca.uk] INFO: Found listing with ID: SA60%20NYT
2026-03-28 14:04:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SA60%2520NYT%27 HTTP/1.1" 200 None
2026-03-28 14:04:14 [bca.uk] INFO: Scrape type for SA60%20NYT: 1
2026-03-28 14:04:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 389368a0-4349-5257-9e72-f8c2c2fc01c4 with identifier: SA60%20NYT
2026-03-28 14:04:14 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 389368a0-4349-5257-9e72-f8c2c2fc01c4
2026-03-28 14:04:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: dc19d35f-8733-5752-bf1c-d9528016493f with identifier: MH07%20CHJ
2026-03-28 14:04:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: dc19d35f-8733-5752-bf1c-d9528016493f with identifier: MH07%20CHJ
2026-03-28 14:04:14 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: dc19d35f-8733-5752-bf1c-d9528016493f with identifier: MH07%20CHJ to the API
2026-03-28 14:04:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:04:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:04:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=6&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 220,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=MH07%20CHJ-GB',
'category': 'Car',
'color': 'red',
'currency': 'GBP',
'doors_number': 2,
'engine': '3.0L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol',
'id': 'dc19d35f-8733-5752-bf1c-d9528016493f',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'MH07 CHJ',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=MH07%20CHJ&vehicleType=*',
'listing': 'auction',
'location': 'Thurleigh',
'make': 'MERCEDES-BENZ',
'model': 'CLK 280',
'odometer': 63878,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2007-01-01',
'seller_name': None,
'title': 'MERCEDES-BENZ CLK 280 3.0 ELEGANCE TIP Coupe',
'transmission': 'manual',
'trim': 'ELEGANCE TIP',
'vin': 'WDB2093542F236335',
'year': 2007}
2026-03-28 14:04:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MH07%2520CHJ%27 HTTP/1.1" 200 None
2026-03-28 14:04:14 [bca.uk] INFO: Saving data for MH07%20CHJ: {'auction_closing_time': 1774864800.0, 'created_time': 1774101894.085673, 'last_price_update_time': 1774706654.643742}
2026-03-28 14:04:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='MH07%2520CHJ') HTTP/1.1" 204 0
2026-03-28 14:04:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698920398%27 HTTP/1.1" 200 None
2026-03-28 14:04:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698920398 not downloaded yet
2026-03-28 14:04:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698284382%27 HTTP/1.1" 200 None
2026-03-28 14:04:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698284382 not downloaded yet
2026-03-28 14:04:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698947215%27 HTTP/1.1" 200 None
2026-03-28 14:04:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698947215 not downloaded yet
2026-03-28 14:04:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D697410343%27 HTTP/1.1" 200 None
2026-03-28 14:04:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=697410343 not downloaded yet
2026-03-28 14:04:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:04:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2dd33010>
2026-03-28 14:04:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:04:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:04:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:04:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_505ec447-0f6d-5de4-9190-5ab4c6e276f7/505ec447-0f6d-5de4-9190-5ab4c6e276f7_image_5.jpg HTTP/1.1" 201 0
2026-03-28 14:04:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FYG70CMV%252F697550812%252F600') HTTP/1.1" 204 0
2026-03-28 14:04:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YG70CMV/697550812/600 saved to cache
2026-03-28 14:04:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 505ec447-0f6d-5de4-9190-5ab4c6e276f7
2026-03-28 14:04:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:04:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c9ffd90>
2026-03-28 14:04:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:04:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:04:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:04:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fadd6eea-e2b0-5574-affe-cdf6b892b445/fadd6eea-e2b0-5574-affe-cdf6b892b445_image_4.jpg HTTP/1.1" 201 0
2026-03-28 14:04:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLD11FZB%252F698929149%252F600') HTTP/1.1" 204 0
2026-03-28 14:04:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LD11FZB/698929149/600 saved to cache
2026-03-28 14:04:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item fadd6eea-e2b0-5574-affe-cdf6b892b445
2026-03-28 14:04:14 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BT66DFX/698129699/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698129699>
2026-03-28 14:04:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YG70CMV/697550856/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YG70CMV/42809751?sv=2020-08-04&st=2026-03-28T14%3A03%3A58Z&se=2026-03-28T14%3A28%3A58Z&sr=b&sp=r&sig=1ABLz0vVsC9yYBr%2F09SZY1lBMEdGcrDzJ1kVHXJEJlA%3D)
2026-03-28 14:04:14 [bca.uk] INFO: Found listing with ID: ND11%20FHJ
2026-03-28 14:04:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27ND11%2520FHJ%27 HTTP/1.1" 200 None
2026-03-28 14:04:14 [bca.uk] INFO: Scrape type for ND11%20FHJ: 2
2026-03-28 14:04:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 74887297-f119-5f99-8dcf-fa45a75b3411 with identifier: ND11%20FHJ
2026-03-28 14:04:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 74887297-f119-5f99-8dcf-fa45a75b3411 with scrape type 2
2026-03-28 14:04:14 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 74887297-f119-5f99-8dcf-fa45a75b3411 with scrape type 2
2026-03-28 14:04:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 74887297-f119-5f99-8dcf-fa45a75b3411, identifier: ND11%20FHJ
2026-03-28 14:04:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D697180911%27 HTTP/1.1" 200 None
2026-03-28 14:04:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=697180911 not downloaded yet
2026-03-28 14:04:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698814227%27 HTTP/1.1" 200 None
2026-03-28 14:04:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698814227 not downloaded yet
2026-03-28 14:04:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698129712%27 HTTP/1.1" 200 None
2026-03-28 14:04:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698129712 not downloaded yet
2026-03-28 14:04:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698814180%27 HTTP/1.1" 200 None
2026-03-28 14:04:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698814180 not downloaded yet
2026-03-28 14:04:15 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WJ58DWA/697410325/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=WJ58DWA-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-28 14:04:15 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NK64UTR/698814133/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698814133>
2026-03-28 14:04:15 [bca.uk] INFO: Found listing with ID: BU67%20HNA
2026-03-28 14:04:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BU67%2520HNA%27 HTTP/1.1" 200 None
2026-03-28 14:04:15 [bca.uk] INFO: Scrape type for BU67%20HNA: 1
2026-03-28 14:04:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e5b1ecb7-cfa8-5758-b32f-ed9093a37d21 with identifier: BU67%20HNA
2026-03-28 14:04:15 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item e5b1ecb7-cfa8-5758-b32f-ed9093a37d21
2026-03-28 14:04:15 [bca.uk] INFO: Found listing with ID: LD57%20FXL
2026-03-28 14:04:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LD57%2520FXL%27 HTTP/1.1" 200 None
2026-03-28 14:04:15 [bca.uk] INFO: Scrape type for LD57%20FXL: 1
2026-03-28 14:04:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 64e95b6e-a78f-537e-8c08-58f1a7f0a9cb with identifier: LD57%20FXL
2026-03-28 14:04:15 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 64e95b6e-a78f-537e-8c08-58f1a7f0a9cb
2026-03-28 14:04:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 74887297-f119-5f99-8dcf-fa45a75b3411 with identifier: ND11%20FHJ
2026-03-28 14:04:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 74887297-f119-5f99-8dcf-fa45a75b3411 with identifier: ND11%20FHJ
2026-03-28 14:04:15 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 74887297-f119-5f99-8dcf-fa45a75b3411 with identifier: ND11%20FHJ to the API
2026-03-28 14:04:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:04:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:04:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=6&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 159,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=ND11%20FHJ-GB',
'category': 'Car',
'color': 'red',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.6L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol',
'id': '74887297-f119-5f99-8dcf-fa45a75b3411',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'ND11 FHJ',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=ND11%20FHJ&vehicleType=*',
'listing': 'auction',
'location': 'Thurleigh',
'make': 'NISSAN',
'model': 'NOTE',
'odometer': 119056,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2011-01-01',
'seller_name': None,
'title': 'NISSAN NOTE 1.6 N-TEC Hatchback',
'transmission': 'automatic',
'trim': 'N-TEC',
'vin': 'SJNFCAE11U2126010',
'year': 2011}
2026-03-28 14:04:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27ND11%2520FHJ%27 HTTP/1.1" 200 None
2026-03-28 14:04:15 [bca.uk] INFO: Saving data for ND11%20FHJ: {'auction_closing_time': 1774864800.0, 'created_time': 1774391473.937595, 'last_price_update_time': 1774706655.401095}
2026-03-28 14:04:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='ND11%2520FHJ') HTTP/1.1" 204 0
2026-03-28 14:04:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698920406%27 HTTP/1.1" 200 None
2026-03-28 14:04:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698920406 not downloaded yet
2026-03-28 14:04:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698284387%27 HTTP/1.1" 200 None
2026-03-28 14:04:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698284387 not downloaded yet
2026-03-28 14:04:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698947231%27 HTTP/1.1" 200 None
2026-03-28 14:04:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698947231 not downloaded yet
2026-03-28 14:04:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D697410348%27 HTTP/1.1" 200 None
2026-03-28 14:04:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=697410348 not downloaded yet
2026-03-28 14:04:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.bca.co.uk/api/search?q=&pageSize=100&page=7&sort=MostRecentlyAdded> (referer: https://www.bca.co.uk/search) ['zyte-api']
2026-03-28 14:04:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:04:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a1fe0e750>
2026-03-28 14:04:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:04:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:04:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:04:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_826679c4-b83f-5ad2-b8a7-2183b5f0a082/826679c4-b83f-5ad2-b8a7-2183b5f0a082_expert_report_file_61ee616e-5686-46e4-8a39-75ea631fb813.pdf HTTP/1.1" 201 0
2026-03-28 14:04:15 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item 826679c4-b83f-5ad2-b8a7-2183b5f0a082
2026-03-28 14:04:15 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 826679c4-b83f-5ad2-b8a7-2183b5f0a082, skipping ID generation
2026-03-28 14:04:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 826679c4-b83f-5ad2-b8a7-2183b5f0a082
2026-03-28 14:04:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DLD16UKX-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-28 14:04:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=LD16UKX-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-28 14:04:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:04:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2dd82c10>
2026-03-28 14:04:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:04:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:04:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:04:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1a399624-5154-54f6-ad94-51c45341542d/1a399624-5154-54f6-ad94-51c45341542d_image_1.jpg HTTP/1.1" 201 0
2026-03-28 14:04:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FNK64UTR%252F698814073%252F600') HTTP/1.1" 204 0
2026-03-28 14:04:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NK64UTR/698814073/600 saved to cache
2026-03-28 14:04:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 1a399624-5154-54f6-ad94-51c45341542d
2026-03-28 14:04:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/HV08XHP/42810135?sv=2020-08-04&st=2026-03-28T14%3A04%3A07Z&se=2026-03-28T14%3A29%3A07Z&sr=b&sp=r&sig=nDBJaQ0d1Lnn1Q%2BoiL0EJlYO6HO0nKvJULaa1yflDpY%3D> (referer: https://www.bca.co.uk/)
2026-03-28 14:04:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/FE12WRX/42809715?sv=2020-08-04&st=2026-03-28T14%3A04%3A08Z&se=2026-03-28T14%3A29%3A08Z&sr=b&sp=r&sig=IhVxQK0SibgR8nCtLOUZrswprKTYcjKJBEdadhY0N3I%3D> (referer: https://www.bca.co.uk/)
2026-03-28 14:04:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YB63ZKP/698284358/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YB63ZKP/42797877?sv=2020-08-04&st=2026-03-28T14%3A04%3A00Z&se=2026-03-28T14%3A29%3A00Z&sr=b&sp=r&sig=86nclI4iCmgLh3evtZ%2BtpNUit8HkmrBcUBeJLBRYtzg%3D)
2026-03-28 14:04:15 [bca.uk] INFO: Found listing with ID: T99%20NNO
2026-03-28 14:04:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27T99%2520NNO%27 HTTP/1.1" 200 None
2026-03-28 14:04:15 [bca.uk] INFO: Scrape type for T99%20NNO: 2
2026-03-28 14:04:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6990dd9c-fa5a-5030-b260-ce31ce2d0b6c with identifier: T99%20NNO
2026-03-28 14:04:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6990dd9c-fa5a-5030-b260-ce31ce2d0b6c with scrape type 2
2026-03-28 14:04:15 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6990dd9c-fa5a-5030-b260-ce31ce2d0b6c with scrape type 2
2026-03-28 14:04:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 6990dd9c-fa5a-5030-b260-ce31ce2d0b6c, identifier: T99%20NNO
2026-03-28 14:04:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D697180946%27 HTTP/1.1" 200 None
2026-03-28 14:04:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=697180946 not downloaded yet
2026-03-28 14:04:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698814245%27 HTTP/1.1" 200 None
2026-03-28 14:04:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698814245 not downloaded yet
2026-03-28 14:04:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698129715%27 HTTP/1.1" 200 None
2026-03-28 14:04:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698129715 not downloaded yet
2026-03-28 14:04:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698814207%27 HTTP/1.1" 200 None
2026-03-28 14:04:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698814207 not downloaded yet
2026-03-28 14:04:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/HV69NLA/42810551?sv=2020-08-04&st=2026-03-28T14%3A04%3A08Z&se=2026-03-28T14%3A29%3A08Z&sr=b&sp=r&sig=sCJK6ApeU%2FoHZHPsXN72GO3cagNVfUluR%2FbC%2B%2BOeYM4%3D> (referer: https://www.bca.co.uk/)
2026-03-28 14:04:15 [bca.uk] INFO: Found listing with ID: GD17%20MJV
2026-03-28 14:04:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GD17%2520MJV%27 HTTP/1.1" 200 None
2026-03-28 14:04:15 [bca.uk] INFO: Scrape type for GD17%20MJV: 1
2026-03-28 14:04:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: df8c97f7-3f96-5220-9648-b6806ba88234 with identifier: GD17%20MJV
2026-03-28 14:04:15 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item df8c97f7-3f96-5220-9648-b6806ba88234
2026-03-28 14:04:15 [bca.uk] INFO: Found listing with ID: DA64%20AKP
2026-03-28 14:04:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DA64%2520AKP%27 HTTP/1.1" 200 None
2026-03-28 14:04:15 [bca.uk] INFO: Scrape type for DA64%20AKP: 1
2026-03-28 14:04:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1d31f426-9911-536f-8f01-f0daf0072cc0 with identifier: DA64%20AKP
2026-03-28 14:04:15 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 1d31f426-9911-536f-8f01-f0daf0072cc0
2026-03-28 14:04:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 6990dd9c-fa5a-5030-b260-ce31ce2d0b6c with identifier: T99%20NNO
2026-03-28 14:04:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 6990dd9c-fa5a-5030-b260-ce31ce2d0b6c with identifier: T99%20NNO
2026-03-28 14:04:15 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 6990dd9c-fa5a-5030-b260-ce31ce2d0b6c with identifier: T99%20NNO to the API
2026-03-28 14:04:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:04:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:04:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=6&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 166,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=T99%20NNO-GB',
'category': 'Car',
'color': 'black',
'currency': 'GBP',
'doors_number': 5,
'engine': '2.0L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol',
'id': '6990dd9c-fa5a-5030-b260-ce31ce2d0b6c',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'T99 NNO',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=T99%20NNO&vehicleType=*',
'listing': 'auction',
'location': 'Thurleigh',
'make': 'SEAT',
'model': 'TARRACO',
'odometer': 94004,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-01-01',
'seller_name': None,
'title': 'SEAT TARRACO 2.0 TSI 190 4D XCELLENCE 1ST ED+DS StationWagon',
'transmission': 'automatic',
'trim': 'TSI 190 4D XCELLENCE 1ST ED+DS',
'vin': 'VSSZZZKNZKW002780',
'year': 2019}
2026-03-28 14:04:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27T99%2520NNO%27 HTTP/1.1" 200 None
2026-03-28 14:04:16 [bca.uk] INFO: Saving data for T99%20NNO: {'auction_closing_time': 1774864800.0, 'created_time': 1774363782.469771, 'last_price_update_time': 1774706656.225634}
2026-03-28 14:04:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='T99%2520NNO') HTTP/1.1" 204 0
2026-03-28 14:04:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698920412%27 HTTP/1.1" 200 None
2026-03-28 14:04:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698920412 not downloaded yet
2026-03-28 14:04:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698284395%27 HTTP/1.1" 200 None
2026-03-28 14:04:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698284395 not downloaded yet
2026-03-28 14:04:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698947249%27 HTTP/1.1" 200 None
2026-03-28 14:04:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698947249 not downloaded yet
2026-03-28 14:04:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D697410351%27 HTTP/1.1" 200 None
2026-03-28 14:04:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=697410351 not downloaded yet
2026-03-28 14:04:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699001701%27 HTTP/1.1" 200 None
2026-03-28 14:04:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699001701 not downloaded yet
2026-03-28 14:04:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NK64UTR/698814095/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/NK64UTR/42807827?sv=2020-08-04&st=2026-03-28T14%3A04%3A00Z&se=2026-03-28T14%3A29%3A00Z&sr=b&sp=r&sig=B2djBTwUnOYzqxtI8e7WJD2j2cACy9SjmoGLE3oN2SE%3D)
2026-03-28 14:04:16 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WJ58DWA/697410328/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=697410328>
2026-03-28 14:04:16 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AK67LWT/698947180/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698947180>
2026-03-28 14:04:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AK67LWT/698947142/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/AK67LWT/42810366?sv=2020-08-04&st=2026-03-28T14%3A04%3A00Z&se=2026-03-28T14%3A29%3A00Z&sr=b&sp=r&sig=dnN3%2FeKHnzQfSMnyGaraMReo6SkHH2Dy4nbY3zUESfI%3D)
2026-03-28 14:04:16 [bca.uk] INFO: Found listing with ID: YK22%20XJW
2026-03-28 14:04:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YK22%2520XJW%27 HTTP/1.1" 200 None
2026-03-28 14:04:16 [bca.uk] INFO: Scrape type for YK22%20XJW: 0
2026-03-28 14:04:16 [bca.uk] INFO: Found listing with ID: AD22%20HLK
2026-03-28 14:04:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27AD22%2520HLK%27 HTTP/1.1" 200 None
2026-03-28 14:04:16 [bca.uk] INFO: Scrape type for AD22%20HLK: 2
2026-03-28 14:04:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 36f27e24-f69b-539f-89f2-73e874b06bee with identifier: AD22%20HLK
2026-03-28 14:04:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 36f27e24-f69b-539f-89f2-73e874b06bee with scrape type 2
2026-03-28 14:04:16 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 36f27e24-f69b-539f-89f2-73e874b06bee with scrape type 2
2026-03-28 14:04:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 36f27e24-f69b-539f-89f2-73e874b06bee, identifier: AD22%20HLK
2026-03-28 14:04:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698129720%27 HTTP/1.1" 200 None
2026-03-28 14:04:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698129720 not downloaded yet
2026-03-28 14:04:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698814225%27 HTTP/1.1" 200 None
2026-03-28 14:04:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698814225 not downloaded yet
2026-03-28 14:04:16 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:04:16 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:04:16 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:04:16 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:04:16 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:04:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:04:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c12bf90>
2026-03-28 14:04:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:04:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:04:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:04:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_505ec447-0f6d-5de4-9190-5ab4c6e276f7/505ec447-0f6d-5de4-9190-5ab4c6e276f7_image_7.jpg HTTP/1.1" 201 0
2026-03-28 14:04:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FYG70CMV%252F697550856%252F600') HTTP/1.1" 204 0
2026-03-28 14:04:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YG70CMV/697550856/600 saved to cache
2026-03-28 14:04:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 505ec447-0f6d-5de4-9190-5ab4c6e276f7
2026-03-28 14:04:16 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BT66DFX/698129706/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698129706>
2026-03-28 14:04:16 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PXZ1595/698814140/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698814140>
2026-03-28 14:04:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PXZ1595/698814105/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/PXZ1595/42808016?sv=2020-08-04&st=2026-03-28T14%3A04%3A01Z&se=2026-03-28T14%3A29%3A01Z&sr=b&sp=r&sig=xu3OmTnGiQ74jDpi5YWrXOjZvBn7hDxoXdoCW9aef04%3D)
2026-03-28 14:04:16 [bca.uk] INFO: Found listing with ID: LO66%20UOC
2026-03-28 14:04:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LO66%2520UOC%27 HTTP/1.1" 200 None
2026-03-28 14:04:16 [bca.uk] INFO: Scrape type for LO66%20UOC: 2
2026-03-28 14:04:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 859d6921-72bf-5c66-8586-99bf5f7313bc with identifier: LO66%20UOC
2026-03-28 14:04:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 859d6921-72bf-5c66-8586-99bf5f7313bc with scrape type 2
2026-03-28 14:04:16 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 859d6921-72bf-5c66-8586-99bf5f7313bc with scrape type 2
2026-03-28 14:04:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 859d6921-72bf-5c66-8586-99bf5f7313bc, identifier: LO66%20UOC
2026-03-28 14:04:16 [bca.uk] INFO: Found listing with ID: ST12%20HSO
2026-03-28 14:04:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27ST12%2520HSO%27 HTTP/1.1" 200 None
2026-03-28 14:04:16 [bca.uk] INFO: Scrape type for ST12%20HSO: 1
2026-03-28 14:04:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d6214c2d-d518-55cf-9ab4-09004f56f218 with identifier: ST12%20HSO
2026-03-28 14:04:16 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item d6214c2d-d518-55cf-9ab4-09004f56f218
2026-03-28 14:04:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 36f27e24-f69b-539f-89f2-73e874b06bee with identifier: AD22%20HLK
2026-03-28 14:04:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 36f27e24-f69b-539f-89f2-73e874b06bee with identifier: AD22%20HLK
2026-03-28 14:04:16 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 36f27e24-f69b-539f-89f2-73e874b06bee with identifier: AD22%20HLK to the API
2026-03-28 14:04:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:04:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:04:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=6&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 149,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=AD22%20HLK-GB',
'category': 'Car',
'color': 'blue',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.2L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol',
'id': '36f27e24-f69b-539f-89f2-73e874b06bee',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'AD22 HLK',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=AD22%20HLK&vehicleType=*',
'listing': 'auction',
'location': 'Thurleigh',
'make': 'PEUGEOT',
'model': '3008',
'odometer': 54293,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-01-01',
'seller_name': None,
'title': 'PEUGEOT 3008 1.2 P/T 130 GT PREMIUM EAT8 Hatchback',
'transmission': 'automatic',
'trim': 'P/T 130 GT PREMIUM EAT8',
'vin': 'VF3MRHNSUMS267269',
'year': 2022}
2026-03-28 14:04:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27AD22%2520HLK%27 HTTP/1.1" 200 None
2026-03-28 14:04:17 [bca.uk] INFO: Saving data for AD22%20HLK: {'auction_closing_time': 1774864800.0, 'created_time': 1774391471.440085, 'last_price_update_time': 1774706657.046963}
2026-03-28 14:04:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='AD22%2520HLK') HTTP/1.1" 204 0
2026-03-28 14:04:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698920420%27 HTTP/1.1" 200 None
2026-03-28 14:04:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698920420 not downloaded yet
2026-03-28 14:04:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698284400%27 HTTP/1.1" 200 None
2026-03-28 14:04:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698284400 not downloaded yet
2026-03-28 14:04:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698947264%27 HTTP/1.1" 200 None
2026-03-28 14:04:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698947264 not downloaded yet
2026-03-28 14:04:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D697410359%27 HTTP/1.1" 200 None
2026-03-28 14:04:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=697410359 not downloaded yet
2026-03-28 14:04:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699001704%27 HTTP/1.1" 200 None
2026-03-28 14:04:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699001704 not downloaded yet
2026-03-28 14:04:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 859d6921-72bf-5c66-8586-99bf5f7313bc with identifier: LO66%20UOC
2026-03-28 14:04:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 859d6921-72bf-5c66-8586-99bf5f7313bc with identifier: LO66%20UOC
2026-03-28 14:04:17 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 859d6921-72bf-5c66-8586-99bf5f7313bc with identifier: LO66%20UOC to the API
2026-03-28 14:04:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:04:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:04:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=4&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 149,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=LO66%20UOC-GB',
'category': 'Car',
'color': 'white',
'currency': 'GBP',
'doors_number': 5,
'engine': '2.0L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Diesel',
'id': '859d6921-72bf-5c66-8586-99bf5f7313bc',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'LO66 UOC',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=LO66%20UOC&vehicleType=*',
'listing': 'auction',
'location': 'Blackbushe',
'make': 'VOLKSWAGEN',
'model': 'TIGUAN',
'odometer': 68926,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-01-01',
'seller_name': None,
'title': 'VOLKSWAGEN TIGUAN 2.0 TDI 150 BMT 4M SEL DSG StationWagon',
'transmission': 'automatic',
'trim': 'TDI 150 BMT 4M SEL DSG',
'vin': 'WVGZZZ5NZGW303590',
'year': 2016}
2026-03-28 14:04:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LO66%2520UOC%27 HTTP/1.1" 200 None
2026-03-28 14:04:17 [bca.uk] INFO: Saving data for LO66%20UOC: {'auction_closing_time': 1774864800.0, 'created_time': 1774562553.781476, 'last_price_update_time': 1774706657.611185}
2026-03-28 14:04:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='LO66%2520UOC') HTTP/1.1" 204 0
2026-03-28 14:04:17 [bca.uk] INFO: Found listing with ID: AF20%20XAB
2026-03-28 14:04:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27AF20%2520XAB%27 HTTP/1.1" 200 None
2026-03-28 14:04:17 [bca.uk] INFO: Scrape type for AF20%20XAB: 2
2026-03-28 14:04:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9e7a9b96-92f7-5ad4-ab0a-add4d4bbbc65 with identifier: AF20%20XAB
2026-03-28 14:04:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9e7a9b96-92f7-5ad4-ab0a-add4d4bbbc65 with scrape type 2
2026-03-28 14:04:17 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9e7a9b96-92f7-5ad4-ab0a-add4d4bbbc65 with scrape type 2
2026-03-28 14:04:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 9e7a9b96-92f7-5ad4-ab0a-add4d4bbbc65, identifier: AF20%20XAB
2026-03-28 14:04:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698129725%27 HTTP/1.1" 200 None
2026-03-28 14:04:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698129725 not downloaded yet
2026-03-28 14:04:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698814242%27 HTTP/1.1" 200 None
2026-03-28 14:04:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698814242 not downloaded yet
2026-03-28 14:04:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NK64UTR/698814133/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/NK64UTR/42807827?sv=2020-08-04&st=2026-03-28T14%3A04%3A00Z&se=2026-03-28T14%3A29%3A00Z&sr=b&sp=r&sig=B2djBTwUnOYzqxtI8e7WJD2j2cACy9SjmoGLE3oN2SE%3D)
2026-03-28 14:04:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WJ58DWA/697410325/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/WJ58DWA/42809994?sv=2020-08-04&st=2026-03-28T14%3A04%3A01Z&se=2026-03-28T14%3A29%3A01Z&sr=b&sp=r&sig=WelJkUnZ%2FryduuiTM2iL%2FzPRBftp3wpY3FkYWG%2FP0gk%3D)
2026-03-28 14:04:17 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WJ58DWA/697410343/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=697410343>
2026-03-28 14:04:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BT66DFX/698129699/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/BT66DFX/42810013?sv=2020-08-04&st=2026-03-28T14%3A04%3A00Z&se=2026-03-28T14%3A29%3A00Z&sr=b&sp=r&sig=Yx0iLoKJXBk4DPNXOVJLOrRp66ZUz648vIo6BTtbrJ0%3D)
2026-03-28 14:04:17 [bca.uk] INFO: Found listing with ID: JP04%20STP
2026-03-28 14:04:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27JP04%2520STP%27 HTTP/1.1" 200 None
2026-03-28 14:04:17 [bca.uk] INFO: Scrape type for JP04%20STP: 1
2026-03-28 14:04:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bbc16d12-29f9-531b-8c11-9870b348d92a with identifier: JP04%20STP
2026-03-28 14:04:17 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item bbc16d12-29f9-531b-8c11-9870b348d92a
2026-03-28 14:04:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 9e7a9b96-92f7-5ad4-ab0a-add4d4bbbc65 with identifier: AF20%20XAB
2026-03-28 14:04:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-28 14:04:17 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=beige HTTP/1.1" 200 None
2026-03-28 14:04:18 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-28 14:04:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-28 14:04:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 9e7a9b96-92f7-5ad4-ab0a-add4d4bbbc65 with identifier: AF20%20XAB
2026-03-28 14:04:18 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 9e7a9b96-92f7-5ad4-ab0a-add4d4bbbc65 with identifier: AF20%20XAB to the API
2026-03-28 14:04:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:04:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:04:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=6&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 136,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=AF20%20XAB-GB',
'category': 'Car',
'color': 'beige',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.0L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol',
'id': '9e7a9b96-92f7-5ad4-ab0a-add4d4bbbc65',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'AF20 XAB',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=AF20%20XAB&vehicleType=*',
'listing': 'auction',
'location': 'Thurleigh',
'make': 'FIAT',
'model': '500X',
'odometer': 48856,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-01-01',
'seller_name': None,
'title': 'FIAT 500X 1.0 M/AIR CROSS PLUS Hatchback',
'transmission': 'manual',
'trim': 'M/AIR CROSS PLUS',
'vin': 'ZFA3340000P820301',
'year': 2020}
2026-03-28 14:04:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27AF20%2520XAB%27 HTTP/1.1" 200 None
2026-03-28 14:04:18 [bca.uk] INFO: Saving data for AF20%20XAB: {'auction_closing_time': 1774864800.0, 'created_time': 1774363784.560051, 'last_price_update_time': 1774706658.421374}
2026-03-28 14:04:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='AF20%2520XAB') HTTP/1.1" 204 0
2026-03-28 14:04:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D697410369%27 HTTP/1.1" 200 None
2026-03-28 14:04:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=697410369 not downloaded yet
2026-03-28 14:04:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699001710%27 HTTP/1.1" 200 None
2026-03-28 14:04:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699001710 not downloaded yet
2026-03-28 14:04:18 [bca.uk] INFO: Total items found: 100
2026-03-28 14:04:18 [bca.uk] INFO: Requesting URL: https://www.bca.co.uk/api/search?q=&pageSize=100&page=8&sort=MostRecentlyAdded
2026-03-28 14:04:18 [bca.uk] INFO: Sending search API request with Bearer token (length=1492)
2026-03-28 14:04:18 [scrapy_zyte_api._params] WARNING: Request <GET https://www.bca.co.uk/api/search?q=&pageSize=100&page=8&sort=MostRecentlyAdded> defines the Zyte API customHttpRequestHeaders parameter, overriding Request.headers. Use Request.headers instead.
2026-03-28 14:04:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:04:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c1abd50>
2026-03-28 14:04:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:04:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:04:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:04:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cdaa9411-8148-5f71-bb89-a031dafbf539/cdaa9411-8148-5f71-bb89-a031dafbf539_expert_report_file_3c27e54b-1233-4f8b-a2bb-6dc14d50ddb4.pdf HTTP/1.1" 201 0
2026-03-28 14:04:18 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item cdaa9411-8148-5f71-bb89-a031dafbf539
2026-03-28 14:04:18 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: cdaa9411-8148-5f71-bb89-a031dafbf539, skipping ID generation
2026-03-28 14:04:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item cdaa9411-8148-5f71-bb89-a031dafbf539
2026-03-28 14:04:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DHV08XHP-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-28 14:04:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=HV08XHP-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-28 14:04:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:04:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c62f1d0>
2026-03-28 14:04:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:04:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:04:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:04:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a3ad7a0d-b4c8-5ced-b470-27d0e0c9322f/a3ad7a0d-b4c8-5ced-b470-27d0e0c9322f_expert_report_file_c1170ebb-470e-436b-9a3e-94a957a120bb.pdf HTTP/1.1" 201 0
2026-03-28 14:04:18 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item a3ad7a0d-b4c8-5ced-b470-27d0e0c9322f
2026-03-28 14:04:18 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: a3ad7a0d-b4c8-5ced-b470-27d0e0c9322f, skipping ID generation
2026-03-28 14:04:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item a3ad7a0d-b4c8-5ced-b470-27d0e0c9322f
2026-03-28 14:04:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DFE12WRX-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-28 14:04:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=FE12WRX-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-28 14:04:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:04:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c980910>
2026-03-28 14:04:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:04:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:04:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:04:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_243a05a7-7cda-5444-ab1c-5fdc014fa410/243a05a7-7cda-5444-ab1c-5fdc014fa410_image_1.jpg HTTP/1.1" 201 0
2026-03-28 14:04:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FYB63ZKP%252F698284358%252F600') HTTP/1.1" 204 0
2026-03-28 14:04:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YB63ZKP/698284358/600 saved to cache
2026-03-28 14:04:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 243a05a7-7cda-5444-ab1c-5fdc014fa410
2026-03-28 14:04:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:04:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c12b410>
2026-03-28 14:04:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:04:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:04:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:04:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_eadb8ebe-5b0a-5541-a2d1-caa5b9148e41/eadb8ebe-5b0a-5541-a2d1-caa5b9148e41_expert_report_file_fe2adbd5-30ae-4c88-9722-57ffe02e52e3.pdf HTTP/1.1" 201 0
2026-03-28 14:04:18 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item eadb8ebe-5b0a-5541-a2d1-caa5b9148e41
2026-03-28 14:04:18 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: eadb8ebe-5b0a-5541-a2d1-caa5b9148e41, skipping ID generation
2026-03-28 14:04:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item eadb8ebe-5b0a-5541-a2d1-caa5b9148e41
2026-03-28 14:04:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DHV69NLA-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-28 14:04:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=HV69NLA-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-28 14:04:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:04:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c7e12d0>
2026-03-28 14:04:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:04:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:04:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:04:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1a399624-5154-54f6-ad94-51c45341542d/1a399624-5154-54f6-ad94-51c45341542d_image_2.jpg HTTP/1.1" 201 0
2026-03-28 14:04:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FNK64UTR%252F698814095%252F600') HTTP/1.1" 204 0
2026-03-28 14:04:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NK64UTR/698814095/600 saved to cache
2026-03-28 14:04:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 1a399624-5154-54f6-ad94-51c45341542d
2026-03-28 14:04:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:04:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2ca6e810>
2026-03-28 14:04:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:04:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:04:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:04:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_96df00f7-d862-5338-b935-5c42d63b82c0/96df00f7-d862-5338-b935-5c42d63b82c0_image_1.jpg HTTP/1.1" 201 0
2026-03-28 14:04:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FAK67LWT%252F698947142%252F600') HTTP/1.1" 204 0
2026-03-28 14:04:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AK67LWT/698947142/600 saved to cache
2026-03-28 14:04:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 96df00f7-d862-5338-b935-5c42d63b82c0
2026-03-28 14:04:18 [bca.uk] INFO: Found listing with ID: CF19%20EJU
2026-03-28 14:04:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27CF19%2520EJU%27 HTTP/1.1" 200 None
2026-03-28 14:04:18 [bca.uk] INFO: Scrape type for CF19%20EJU: 0
2026-03-28 14:04:18 [bca.uk] INFO: Found listing with ID: DT21%20WNL
2026-03-28 14:04:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DT21%2520WNL%27 HTTP/1.1" 200 None
2026-03-28 14:04:18 [bca.uk] INFO: Scrape type for DT21%20WNL: 0
2026-03-28 14:04:18 [bca.uk] INFO: Found listing with ID: FM19%20TVL
2026-03-28 14:04:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FM19%2520TVL%27 HTTP/1.1" 200 None
2026-03-28 14:04:18 [bca.uk] INFO: Scrape type for FM19%20TVL: 0
2026-03-28 14:04:18 [bca.uk] INFO: Found listing with ID: GV19%20DVR
2026-03-28 14:04:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GV19%2520DVR%27 HTTP/1.1" 200 None
2026-03-28 14:04:18 [bca.uk] INFO: Scrape type for GV19%20DVR: 0
2026-03-28 14:04:18 [bca.uk] INFO: Found listing with ID: EJ18%20ZYC
2026-03-28 14:04:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27EJ18%2520ZYC%27 HTTP/1.1" 200 None
2026-03-28 14:04:18 [bca.uk] INFO: Scrape type for EJ18%20ZYC: 0
2026-03-28 14:04:18 [bca.uk] INFO: Found listing with ID: MH16%20UOL
2026-03-28 14:04:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MH16%2520UOL%27 HTTP/1.1" 200 None
2026-03-28 14:04:18 [bca.uk] INFO: Scrape type for MH16%20UOL: 0
2026-03-28 14:04:18 [bca.uk] INFO: Found listing with ID: VU65%20FPP
2026-03-28 14:04:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27VU65%2520FPP%27 HTTP/1.1" 200 None
2026-03-28 14:04:18 [bca.uk] INFO: Scrape type for VU65%20FPP: 0
2026-03-28 14:04:18 [bca.uk] INFO: Found listing with ID: BF58%20VKL
2026-03-28 14:04:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BF58%2520VKL%27 HTTP/1.1" 200 None
2026-03-28 14:04:18 [bca.uk] INFO: Scrape type for BF58%20VKL: 0
2026-03-28 14:04:18 [bca.uk] INFO: Found listing with ID: DU17%20VHK
2026-03-28 14:04:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DU17%2520VHK%27 HTTP/1.1" 200 None
2026-03-28 14:04:18 [bca.uk] INFO: Scrape type for DU17%20VHK: 0
2026-03-28 14:04:18 [bca.uk] INFO: Found listing with ID: EN63%20CGG
2026-03-28 14:04:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27EN63%2520CGG%27 HTTP/1.1" 200 None
2026-03-28 14:04:18 [bca.uk] INFO: Scrape type for EN63%20CGG: 0
2026-03-28 14:04:18 [bca.uk] INFO: Found listing with ID: AO10%20XMX
2026-03-28 14:04:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27AO10%2520XMX%27 HTTP/1.1" 200 None
2026-03-28 14:04:18 [bca.uk] INFO: Scrape type for AO10%20XMX: 0
2026-03-28 14:04:18 [bca.uk] INFO: Found listing with ID: CY09%20BAO
2026-03-28 14:04:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27CY09%2520BAO%27 HTTP/1.1" 200 None
2026-03-28 14:04:18 [bca.uk] INFO: Scrape type for CY09%20BAO: 0
2026-03-28 14:04:18 [bca.uk] INFO: Found listing with ID: HN54%20ZBG
2026-03-28 14:04:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27HN54%2520ZBG%27 HTTP/1.1" 200 None
2026-03-28 14:04:18 [bca.uk] INFO: Scrape type for HN54%20ZBG: 0
2026-03-28 14:04:18 [bca.uk] INFO: Found listing with ID: LD55%20ULT
2026-03-28 14:04:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LD55%2520ULT%27 HTTP/1.1" 200 None
2026-03-28 14:04:19 [bca.uk] INFO: Scrape type for LD55%20ULT: 0
2026-03-28 14:04:19 [bca.uk] INFO: Found listing with ID: BD17%20TZF
2026-03-28 14:04:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BD17%2520TZF%27 HTTP/1.1" 200 None
2026-03-28 14:04:19 [bca.uk] INFO: Scrape type for BD17%20TZF: 0
2026-03-28 14:04:19 [bca.uk] INFO: Found listing with ID: CU18%20AXX
2026-03-28 14:04:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27CU18%2520AXX%27 HTTP/1.1" 200 None
2026-03-28 14:04:19 [bca.uk] INFO: Scrape type for CU18%20AXX: 0
2026-03-28 14:04:19 [bca.uk] INFO: Found listing with ID: LK65%20VPG
2026-03-28 14:04:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LK65%2520VPG%27 HTTP/1.1" 200 None
2026-03-28 14:04:19 [bca.uk] INFO: Scrape type for LK65%20VPG: 0
2026-03-28 14:04:19 [bca.uk] INFO: Found listing with ID: NJ18%20YDM
2026-03-28 14:04:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27NJ18%2520YDM%27 HTTP/1.1" 200 None
2026-03-28 14:04:19 [bca.uk] INFO: Scrape type for NJ18%20YDM: 0
2026-03-28 14:04:19 [bca.uk] INFO: Found listing with ID: OV20%20KUN
2026-03-28 14:04:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27OV20%2520KUN%27 HTTP/1.1" 200 None
2026-03-28 14:04:19 [bca.uk] INFO: Scrape type for OV20%20KUN: 0
2026-03-28 14:04:19 [bca.uk] INFO: Found listing with ID: WD67%20HAX
2026-03-28 14:04:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WD67%2520HAX%27 HTTP/1.1" 200 None
2026-03-28 14:04:19 [bca.uk] INFO: Scrape type for WD67%20HAX: 0
2026-03-28 14:04:19 [bca.uk] INFO: Found listing with ID: VU13%20OVD
2026-03-28 14:04:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27VU13%2520OVD%27 HTTP/1.1" 200 None
2026-03-28 14:04:19 [bca.uk] INFO: Scrape type for VU13%20OVD: 0
2026-03-28 14:04:19 [bca.uk] INFO: Found listing with ID: KN14%20XZR
2026-03-28 14:04:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KN14%2520XZR%27 HTTP/1.1" 200 None
2026-03-28 14:04:19 [bca.uk] INFO: Scrape type for KN14%20XZR: 0
2026-03-28 14:04:19 [bca.uk] INFO: Found listing with ID: DL18%20NSO
2026-03-28 14:04:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DL18%2520NSO%27 HTTP/1.1" 200 None
2026-03-28 14:04:19 [bca.uk] INFO: Scrape type for DL18%20NSO: 0
2026-03-28 14:04:19 [bca.uk] INFO: Found listing with ID: GV18%20EXP
2026-03-28 14:04:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GV18%2520EXP%27 HTTP/1.1" 200 None
2026-03-28 14:04:19 [bca.uk] INFO: Scrape type for GV18%20EXP: 2
2026-03-28 14:04:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2645e8a7-9f08-55dd-9d06-2ef82515449a with identifier: GV18%20EXP
2026-03-28 14:04:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2645e8a7-9f08-55dd-9d06-2ef82515449a with scrape type 2
2026-03-28 14:04:19 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2645e8a7-9f08-55dd-9d06-2ef82515449a with scrape type 2
2026-03-28 14:04:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 2645e8a7-9f08-55dd-9d06-2ef82515449a, identifier: GV18%20EXP
2026-03-28 14:04:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698129740%27 HTTP/1.1" 200 None
2026-03-28 14:04:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698129740 not downloaded yet
2026-03-28 14:04:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698814256%27 HTTP/1.1" 200 None
2026-03-28 14:04:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698814256 not downloaded yet
2026-03-28 14:04:19 [bca.uk] INFO: Found listing with ID: HK20%20GFE
2026-03-28 14:04:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27HK20%2520GFE%27 HTTP/1.1" 200 None
2026-03-28 14:04:19 [bca.uk] INFO: Scrape type for HK20%20GFE: 2
2026-03-28 14:04:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5c9f9a5b-4102-5e11-b48f-51ee122c4612 with identifier: HK20%20GFE
2026-03-28 14:04:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5c9f9a5b-4102-5e11-b48f-51ee122c4612 with scrape type 2
2026-03-28 14:04:19 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5c9f9a5b-4102-5e11-b48f-51ee122c4612 with scrape type 2
2026-03-28 14:04:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 5c9f9a5b-4102-5e11-b48f-51ee122c4612, identifier: HK20%20GFE
2026-03-28 14:04:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 2645e8a7-9f08-55dd-9d06-2ef82515449a with identifier: GV18%20EXP
2026-03-28 14:04:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 2645e8a7-9f08-55dd-9d06-2ef82515449a with identifier: GV18%20EXP
2026-03-28 14:04:19 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 2645e8a7-9f08-55dd-9d06-2ef82515449a with identifier: GV18%20EXP to the API
2026-03-28 14:04:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:04:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:04:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=6&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 158,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=GV18%20EXP-GB',
'category': 'Car',
'color': 'grey',
'currency': 'GBP',
'doors_number': 5,
'engine': '2.0L',
'expiration_date': '2026-03-29T10:00:00Z',
'fuel_type': 'Diesel',
'id': '2645e8a7-9f08-55dd-9d06-2ef82515449a',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'GV18 EXP',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=GV18%20EXP&vehicleType=*',
'listing': 'auction',
'location': 'Preston',
'make': 'VOLVO',
'model': 'XC90',
'odometer': 61434,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-01-01',
'seller_name': None,
'title': 'VOLVO XC90 2.0 D5 PP 235 AWD INSCRIPTION G/T StationWagon',
'transmission': 'manual',
'trim': 'D5 PP 235 AWD INSCRIPTION G/T',
'vin': 'YV1LF68UCK1419794',
'year': 2018}
2026-03-28 14:04:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GV18%2520EXP%27 HTTP/1.1" 200 None
2026-03-28 14:04:19 [bca.uk] INFO: Saving data for GV18%20EXP: {'auction_closing_time': 1774778400.0, 'created_time': 1774391035.667489, 'last_price_update_time': 1774706659.828159}
2026-03-28 14:04:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='GV18%2520EXP') HTTP/1.1" 204 0
2026-03-28 14:04:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D697410373%27 HTTP/1.1" 200 None
2026-03-28 14:04:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=697410373 not downloaded yet
2026-03-28 14:04:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699001714%27 HTTP/1.1" 200 None
2026-03-28 14:04:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699001714 not downloaded yet
2026-03-28 14:04:19 [bca.uk] INFO: Found listing with ID: PK12%20WWH
2026-03-28 14:04:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27PK12%2520WWH%27 HTTP/1.1" 200 None
2026-03-28 14:04:20 [bca.uk] INFO: Scrape type for PK12%20WWH: 2
2026-03-28 14:04:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 266a2138-2940-5e0e-86d2-99b26eeed463 with identifier: PK12%20WWH
2026-03-28 14:04:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 266a2138-2940-5e0e-86d2-99b26eeed463 with scrape type 2
2026-03-28 14:04:20 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 266a2138-2940-5e0e-86d2-99b26eeed463 with scrape type 2
2026-03-28 14:04:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 266a2138-2940-5e0e-86d2-99b26eeed463, identifier: PK12%20WWH
2026-03-28 14:04:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698707920%27 HTTP/1.1" 200 None
2026-03-28 14:04:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698707920 not downloaded yet
2026-03-28 14:04:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698993215%27 HTTP/1.1" 200 None
2026-03-28 14:04:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698993215 not downloaded yet
2026-03-28 14:04:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698729623%27 HTTP/1.1" 200 None
2026-03-28 14:04:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698729623 not downloaded yet
2026-03-28 14:04:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 5c9f9a5b-4102-5e11-b48f-51ee122c4612 with identifier: HK20%20GFE
2026-03-28 14:04:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 5c9f9a5b-4102-5e11-b48f-51ee122c4612 with identifier: HK20%20GFE
2026-03-28 14:04:20 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 5c9f9a5b-4102-5e11-b48f-51ee122c4612 with identifier: HK20%20GFE to the API
2026-03-28 14:04:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:04:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:04:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=5&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 125,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=HK20%20GFE-GB',
'category': 'Car',
'color': 'black',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.5L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Diesel',
'id': '5c9f9a5b-4102-5e11-b48f-51ee122c4612',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'HK20 GFE',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=HK20%20GFE&vehicleType=*',
'listing': 'auction',
'location': 'Wolverhampton',
'make': 'RENAULT',
'model': 'CAPTUR',
'odometer': 32105,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-01-01',
'seller_name': None,
'title': 'RENAULT CAPTUR 1.5 DCI 95 ICONIC Hatchback',
'transmission': 'manual',
'trim': 'DCI 95 ICONIC',
'vin': 'VF1RJB00465395083',
'year': 2020}
2026-03-28 14:04:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27HK20%2520GFE%27 HTTP/1.1" 200 None
2026-03-28 14:04:20 [bca.uk] INFO: Saving data for HK20%20GFE: {'auction_closing_time': 1774864800.0, 'created_time': 1774363806.323594, 'last_price_update_time': 1774706660.490015}
2026-03-28 14:04:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='HK20%2520GFE') HTTP/1.1" 204 0
2026-03-28 14:04:20 [bca.uk] INFO: Found listing with ID: MP19%20OSZ
2026-03-28 14:04:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MP19%2520OSZ%27 HTTP/1.1" 200 None
2026-03-28 14:04:20 [bca.uk] INFO: Scrape type for MP19%20OSZ: 2
2026-03-28 14:04:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 433d502c-bc15-57b3-8efc-dbbdc51edd3b with identifier: MP19%20OSZ
2026-03-28 14:04:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 433d502c-bc15-57b3-8efc-dbbdc51edd3b with scrape type 2
2026-03-28 14:04:20 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 433d502c-bc15-57b3-8efc-dbbdc51edd3b with scrape type 2
2026-03-28 14:04:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 433d502c-bc15-57b3-8efc-dbbdc51edd3b, identifier: MP19%20OSZ
2026-03-28 14:04:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 266a2138-2940-5e0e-86d2-99b26eeed463 with identifier: PK12%20WWH
2026-03-28 14:04:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 266a2138-2940-5e0e-86d2-99b26eeed463 with identifier: PK12%20WWH
2026-03-28 14:04:20 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 266a2138-2940-5e0e-86d2-99b26eeed463 with identifier: PK12%20WWH to the API
2026-03-28 14:04:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:04:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:04:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=7&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 139,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=PK12%20WWH-GB',
'category': 'Car',
'color': 'grey',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.4L',
'expiration_date': '2026-03-29T10:00:00Z',
'fuel_type': 'Petrol',
'id': '266a2138-2940-5e0e-86d2-99b26eeed463',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'PK12 WWH',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=PK12%20WWH&vehicleType=*',
'listing': 'auction',
'location': 'Preston',
'make': 'VOLKSWAGEN',
'model': 'TOURAN',
'odometer': 117477,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2012-01-01',
'seller_name': None,
'title': 'VOLKSWAGEN TOURAN 1.4 TSI 140 SE MPV',
'transmission': 'manual',
'trim': 'TSI 140 SE',
'vin': 'WVGZZZ1TZCW115821',
'year': 2012}
2026-03-28 14:04:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27PK12%2520WWH%27 HTTP/1.1" 200 None
2026-03-28 14:04:20 [bca.uk] INFO: Saving data for PK12%20WWH: {'auction_closing_time': 1774778400.0, 'created_time': 1774365688.816808, 'last_price_update_time': 1774706660.929163}
2026-03-28 14:04:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='PK12%2520WWH') HTTP/1.1" 204 0
2026-03-28 14:04:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:04:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2dbe42d0>
2026-03-28 14:04:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:04:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:04:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:04:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8f3e30a4-6b64-5dd1-8e1e-6cce5d49fef3/8f3e30a4-6b64-5dd1-8e1e-6cce5d49fef3_image_1.jpg HTTP/1.1" 201 0
2026-03-28 14:04:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FPXZ1595%252F698814105%252F600') HTTP/1.1" 204 0
2026-03-28 14:04:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PXZ1595/698814105/600 saved to cache
2026-03-28 14:04:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 8f3e30a4-6b64-5dd1-8e1e-6cce5d49fef3
2026-03-28 14:04:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:04:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2dbf6990>
2026-03-28 14:04:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:04:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:04:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:04:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1a399624-5154-54f6-ad94-51c45341542d/1a399624-5154-54f6-ad94-51c45341542d_image_4.jpg HTTP/1.1" 201 0
2026-03-28 14:04:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FNK64UTR%252F698814133%252F600') HTTP/1.1" 204 0
2026-03-28 14:04:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NK64UTR/698814133/600 saved to cache
2026-03-28 14:04:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 1a399624-5154-54f6-ad94-51c45341542d
2026-03-28 14:04:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:04:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2dbe6cd0>
2026-03-28 14:04:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:04:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:04:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:04:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8413221f-7948-5093-9030-c87150f157c7/8413221f-7948-5093-9030-c87150f157c7_image_0.jpg HTTP/1.1" 201 0
2026-03-28 14:04:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FWJ58DWA%252F697410325%252F600') HTTP/1.1" 204 0
2026-03-28 14:04:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WJ58DWA/697410325/600 saved to cache
2026-03-28 14:04:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 8413221f-7948-5093-9030-c87150f157c7
2026-03-28 14:04:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:04:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2ddb2750>
2026-03-28 14:04:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:04:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:04:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:04:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ca2c3006-0503-55ad-a26d-88f328a541b5/ca2c3006-0503-55ad-a26d-88f328a541b5_image_1.jpg HTTP/1.1" 201 0
2026-03-28 14:04:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FBT66DFX%252F698129699%252F600') HTTP/1.1" 204 0
2026-03-28 14:04:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BT66DFX/698129699/600 saved to cache
2026-03-28 14:04:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item ca2c3006-0503-55ad-a26d-88f328a541b5
2026-03-28 14:04:21 [scrapy_zyte_api._params] WARNING: Request <GET https://www.bca.co.uk/api/search?q=&pageSize=100&page=8&sort=MostRecentlyAdded> defines the Zyte API customHttpRequestHeaders parameter, overriding Request.headers. Use Request.headers instead.
2026-03-28 14:04:21 [scrapy_zyte_api._params] WARNING: Request <GET https://www.bca.co.uk/api/search?q=&pageSize=100&page=8&sort=MostRecentlyAdded> defines the Zyte API customHttpRequestHeaders parameter, overriding Request.headers. Use Request.headers instead.
2026-03-28 14:04:21 [bca.uk] INFO: Found listing with ID: VF19%20GJU
2026-03-28 14:04:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27VF19%2520GJU%27 HTTP/1.1" 200 None
2026-03-28 14:04:21 [bca.uk] INFO: Scrape type for VF19%20GJU: 0
2026-03-28 14:04:21 [bca.uk] INFO: Found listing with ID: BV15%20PDK
2026-03-28 14:04:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BV15%2520PDK%27 HTTP/1.1" 200 None
2026-03-28 14:04:21 [bca.uk] INFO: Scrape type for BV15%20PDK: 0
2026-03-28 14:04:21 [bca.uk] INFO: Found listing with ID: BW15%20VJX
2026-03-28 14:04:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BW15%2520VJX%27 HTTP/1.1" 200 None
2026-03-28 14:04:21 [bca.uk] INFO: Scrape type for BW15%20VJX: 0
2026-03-28 14:04:21 [bca.uk] INFO: Found listing with ID: BJ67%20RFF
2026-03-28 14:04:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BJ67%2520RFF%27 HTTP/1.1" 200 None
2026-03-28 14:04:21 [bca.uk] INFO: Scrape type for BJ67%20RFF: 0
2026-03-28 14:04:21 [bca.uk] INFO: Found listing with ID: CK17%20ZKE
2026-03-28 14:04:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27CK17%2520ZKE%27 HTTP/1.1" 200 None
2026-03-28 14:04:21 [bca.uk] INFO: Scrape type for CK17%20ZKE: 0
2026-03-28 14:04:21 [bca.uk] INFO: Found listing with ID: YE15%20LBK
2026-03-28 14:04:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YE15%2520LBK%27 HTTP/1.1" 200 None
2026-03-28 14:04:21 [bca.uk] INFO: Scrape type for YE15%20LBK: 0
2026-03-28 14:04:21 [bca.uk] INFO: Found listing with ID: BF17%20UCH
2026-03-28 14:04:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BF17%2520UCH%27 HTTP/1.1" 200 None
2026-03-28 14:04:21 [bca.uk] INFO: Scrape type for BF17%20UCH: 2
2026-03-28 14:04:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e8a3dda1-53f0-58f8-a5da-033dc945fd46 with identifier: BF17%20UCH
2026-03-28 14:04:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e8a3dda1-53f0-58f8-a5da-033dc945fd46 with scrape type 2
2026-03-28 14:04:21 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e8a3dda1-53f0-58f8-a5da-033dc945fd46 with scrape type 2
2026-03-28 14:04:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: e8a3dda1-53f0-58f8-a5da-033dc945fd46, identifier: BF17%20UCH
2026-03-28 14:04:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 433d502c-bc15-57b3-8efc-dbbdc51edd3b with identifier: MP19%20OSZ
2026-03-28 14:04:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 433d502c-bc15-57b3-8efc-dbbdc51edd3b with identifier: MP19%20OSZ
2026-03-28 14:04:21 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 433d502c-bc15-57b3-8efc-dbbdc51edd3b with identifier: MP19%20OSZ to the API
2026-03-28 14:04:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:04:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:04:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=6&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 111,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=MP19%20OSZ-GB',
'category': 'Car',
'color': 'grey',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.5L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Diesel',
'id': '433d502c-bc15-57b3-8efc-dbbdc51edd3b',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'MP19 OSZ',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=MP19%20OSZ&vehicleType=*',
'listing': 'auction',
'location': 'Preston',
'make': 'DACIA',
'model': 'DUSTER',
'odometer': 97496,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-01-01',
'seller_name': None,
'title': 'DACIA DUSTER 1.5 BLUE DCI 115 COMFORT StationWagon',
'transmission': 'manual',
'trim': 'BLUE DCI 115 COMFORT',
'vin': 'VF1HJD20763674091',
'year': 2019}
2026-03-28 14:04:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MP19%2520OSZ%27 HTTP/1.1" 200 None
2026-03-28 14:04:21 [bca.uk] INFO: Saving data for MP19%20OSZ: {'auction_closing_time': 1774864800.0, 'created_time': 1773910169.616278, 'last_price_update_time': 1774706661.662772}
2026-03-28 14:04:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='MP19%2520OSZ') HTTP/1.1" 204 0
2026-03-28 14:04:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D697410380%27 HTTP/1.1" 200 None
2026-03-28 14:04:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=697410380 not downloaded yet
2026-03-28 14:04:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699001718%27 HTTP/1.1" 200 None
2026-03-28 14:04:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699001718 not downloaded yet
2026-03-28 14:04:21 [bca.uk] INFO: Found listing with ID: PN08%20XDF
2026-03-28 14:04:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27PN08%2520XDF%27 HTTP/1.1" 200 None
2026-03-28 14:04:21 [bca.uk] INFO: Scrape type for PN08%20XDF: 0
2026-03-28 14:04:21 [bca.uk] INFO: Found listing with ID: SW14%20OLM
2026-03-28 14:04:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SW14%2520OLM%27 HTTP/1.1" 200 None
2026-03-28 14:04:21 [bca.uk] INFO: Scrape type for SW14%20OLM: 0
2026-03-28 14:04:21 [bca.uk] INFO: Found listing with ID: YE63%20SXL
2026-03-28 14:04:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YE63%2520SXL%27 HTTP/1.1" 200 None
2026-03-28 14:04:21 [bca.uk] INFO: Scrape type for YE63%20SXL: 0
2026-03-28 14:04:21 [bca.uk] INFO: Found listing with ID: YR14%20KPG
2026-03-28 14:04:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YR14%2520KPG%27 HTTP/1.1" 200 None
2026-03-28 14:04:21 [bca.uk] INFO: Scrape type for YR14%20KPG: 0
2026-03-28 14:04:21 [bca.uk] INFO: Found listing with ID: AK15%20EWP
2026-03-28 14:04:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27AK15%2520EWP%27 HTTP/1.1" 200 None
2026-03-28 14:04:21 [bca.uk] INFO: Scrape type for AK15%20EWP: 0
2026-03-28 14:04:21 [bca.uk] INFO: Found listing with ID: CX16%20CRU
2026-03-28 14:04:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27CX16%2520CRU%27 HTTP/1.1" 200 None
2026-03-28 14:04:21 [bca.uk] INFO: Scrape type for CX16%20CRU: 2
2026-03-28 14:04:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7723c704-da67-5c00-8040-135773d457f9 with identifier: CX16%20CRU
2026-03-28 14:04:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7723c704-da67-5c00-8040-135773d457f9 with scrape type 2
2026-03-28 14:04:21 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7723c704-da67-5c00-8040-135773d457f9 with scrape type 2
2026-03-28 14:04:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 7723c704-da67-5c00-8040-135773d457f9, identifier: CX16%20CRU
2026-03-28 14:04:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698707943%27 HTTP/1.1" 200 None
2026-03-28 14:04:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698707943 not downloaded yet
2026-03-28 14:04:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698993222%27 HTTP/1.1" 200 None
2026-03-28 14:04:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698993222 not downloaded yet
2026-03-28 14:04:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698729640%27 HTTP/1.1" 200 None
2026-03-28 14:04:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698729640 not downloaded yet
2026-03-28 14:04:21 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 14:04:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: e8a3dda1-53f0-58f8-a5da-033dc945fd46 with identifier: BF17%20UCH
2026-03-28 14:04:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: e8a3dda1-53f0-58f8-a5da-033dc945fd46 with identifier: BF17%20UCH
2026-03-28 14:04:22 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: e8a3dda1-53f0-58f8-a5da-033dc945fd46 with identifier: BF17%20UCH to the API
2026-03-28 14:04:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:04:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:04:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=5&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 139,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=BF17%20UCH-GB',
'category': 'Car',
'color': 'grey',
'currency': 'GBP',
'doors_number': 5,
'engine': '2.0L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Diesel',
'id': 'e8a3dda1-53f0-58f8-a5da-033dc945fd46',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'BF17 UCH',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=BF17%20UCH&vehicleType=*',
'listing': 'auction',
'location': 'Wolverhampton',
'make': 'LAND ROVER',
'model': 'DISCOVERY SPORT',
'odometer': 98827,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-01-01',
'seller_name': None,
'title': 'LAND ROVER DISCOVERY SPORT 2.0 TD4 180 HSE DYNAMIC LUXURY '
'StationWagon',
'transmission': 'automatic',
'trim': 'TD4 180 HSE DYNAMIC LUXURY',
'vin': 'SALCA2AN6HH682355',
'year': 2017}
2026-03-28 14:04:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BF17%2520UCH%27 HTTP/1.1" 200 None
2026-03-28 14:04:22 [bca.uk] INFO: Saving data for BF17%20UCH: {'auction_closing_time': 1774864800.0, 'created_time': 1774305808.239317, 'last_price_update_time': 1774706662.293711}
2026-03-28 14:04:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='BF17%2520UCH') HTTP/1.1" 204 0
2026-03-28 14:04:22 [bca.uk] INFO: Found listing with ID: RF21%20DKD
2026-03-28 14:04:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27RF21%2520DKD%27 HTTP/1.1" 200 None
2026-03-28 14:04:22 [bca.uk] INFO: Scrape type for RF21%20DKD: 0
2026-03-28 14:04:22 [bca.uk] INFO: Found listing with ID: VK22%20LGG
2026-03-28 14:04:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27VK22%2520LGG%27 HTTP/1.1" 200 None
2026-03-28 14:04:22 [bca.uk] INFO: Scrape type for VK22%20LGG: 0
2026-03-28 14:04:22 [bca.uk] INFO: Found listing with ID: YJ70%20TKD
2026-03-28 14:04:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YJ70%2520TKD%27 HTTP/1.1" 200 None
2026-03-28 14:04:22 [bca.uk] INFO: Scrape type for YJ70%20TKD: 0
2026-03-28 14:04:22 [bca.uk] INFO: Found listing with ID: MA62%20RAA
2026-03-28 14:04:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MA62%2520RAA%27 HTTP/1.1" 200 None
2026-03-28 14:04:22 [bca.uk] INFO: Scrape type for MA62%20RAA: 2
2026-03-28 14:04:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d123a6e0-630a-56a9-ad84-71e3545e2482 with identifier: MA62%20RAA
2026-03-28 14:04:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d123a6e0-630a-56a9-ad84-71e3545e2482 with scrape type 2
2026-03-28 14:04:22 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d123a6e0-630a-56a9-ad84-71e3545e2482 with scrape type 2
2026-03-28 14:04:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: d123a6e0-630a-56a9-ad84-71e3545e2482, identifier: MA62%20RAA
2026-03-28 14:04:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 7723c704-da67-5c00-8040-135773d457f9 with identifier: CX16%20CRU
2026-03-28 14:04:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 7723c704-da67-5c00-8040-135773d457f9 with identifier: CX16%20CRU
2026-03-28 14:04:22 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 7723c704-da67-5c00-8040-135773d457f9 with identifier: CX16%20CRU to the API
2026-03-28 14:04:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:04:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:04:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=7&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 106,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=CX16%20CRU-GB',
'category': 'Car',
'color': 'grey',
'currency': 'GBP',
'doors_number': 5,
'engine': '2.1L',
'expiration_date': '2026-03-29T10:00:00Z',
'fuel_type': 'Diesel',
'id': '7723c704-da67-5c00-8040-135773d457f9',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'CX16 CRU',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=CX16%20CRU&vehicleType=*',
'listing': 'auction',
'location': 'Preston',
'make': 'MERCEDES-BENZ',
'model': 'B200 D',
'odometer': 28791,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-01-01',
'seller_name': None,
'title': 'MERCEDES-BENZ B200 D 2.1 AMG LINE PREMIUM DCT MPV',
'transmission': 'automatic',
'trim': 'AMG LINE PREMIUM DCT',
'vin': 'WDD2462082J390076',
'year': 2016}
2026-03-28 14:04:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27CX16%2520CRU%27 HTTP/1.1" 200 None
2026-03-28 14:04:22 [bca.uk] INFO: Saving data for CX16%20CRU: {'auction_closing_time': 1774778400.0, 'created_time': 1774102203.182069, 'last_price_update_time': 1774706662.910562}
2026-03-28 14:04:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='CX16%2520CRU') HTTP/1.1" 204 0
2026-03-28 14:04:22 [bca.uk] INFO: Found listing with ID: FM16%20JXO
2026-03-28 14:04:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FM16%2520JXO%27 HTTP/1.1" 200 None
2026-03-28 14:04:22 [bca.uk] INFO: Scrape type for FM16%20JXO: 0
2026-03-28 14:04:22 [bca.uk] INFO: Found listing with ID: WF67%20CFE
2026-03-28 14:04:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WF67%2520CFE%27 HTTP/1.1" 200 None
2026-03-28 14:04:22 [bca.uk] INFO: Scrape type for WF67%20CFE: 0
2026-03-28 14:04:22 [bca.uk] INFO: Found listing with ID: FJ59%20TSZ
2026-03-28 14:04:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FJ59%2520TSZ%27 HTTP/1.1" 200 None
2026-03-28 14:04:22 [bca.uk] INFO: Scrape type for FJ59%20TSZ: 2
2026-03-28 14:04:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 62d37e6f-655a-5e8e-a462-f5ad6f0d593a with identifier: FJ59%20TSZ
2026-03-28 14:04:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 62d37e6f-655a-5e8e-a462-f5ad6f0d593a with scrape type 2
2026-03-28 14:04:22 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 62d37e6f-655a-5e8e-a462-f5ad6f0d593a with scrape type 2
2026-03-28 14:04:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 62d37e6f-655a-5e8e-a462-f5ad6f0d593a, identifier: FJ59%20TSZ
2026-03-28 14:04:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: d123a6e0-630a-56a9-ad84-71e3545e2482 with identifier: MA62%20RAA
2026-03-28 14:04:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: d123a6e0-630a-56a9-ad84-71e3545e2482 with identifier: MA62%20RAA
2026-03-28 14:04:23 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: d123a6e0-630a-56a9-ad84-71e3545e2482 with identifier: MA62%20RAA to the API
2026-03-28 14:04:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:04:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:04:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=6&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 140,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=MA62%20RAA-GB',
'category': 'Car',
'color': 'grey',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.0L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol',
'id': 'd123a6e0-630a-56a9-ad84-71e3545e2482',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'MA62 RAA',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=MA62%20RAA&vehicleType=*',
'listing': 'auction',
'location': 'Preston',
'make': 'DACIA',
'model': 'SANDERO STEPWAY',
'odometer': 9440,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-01-01',
'seller_name': None,
'title': 'DACIA SANDERO STEPWAY 1.0 TCE COMFORT Hatchback',
'transmission': 'automatic',
'trim': 'TCE COMFORT',
'vin': 'UU1DJF00168820338',
'year': 2022}
2026-03-28 14:04:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MA62%2520RAA%27 HTTP/1.1" 200 None
2026-03-28 14:04:23 [bca.uk] INFO: Saving data for MA62%20RAA: {'auction_closing_time': 1774864800.0, 'created_time': 1773909344.589204, 'last_price_update_time': 1774706663.432036}
2026-03-28 14:04:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='MA62%2520RAA') HTTP/1.1" 204 0
2026-03-28 14:04:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699001725%27 HTTP/1.1" 200 None
2026-03-28 14:04:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699001725 not downloaded yet
2026-03-28 14:04:23 [bca.uk] INFO: Found listing with ID: CY62%20HLP
2026-03-28 14:04:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27CY62%2520HLP%27 HTTP/1.1" 200 None
2026-03-28 14:04:23 [bca.uk] INFO: Scrape type for CY62%20HLP: 0
2026-03-28 14:04:23 [bca.uk] INFO: Found listing with ID: DE61%20AOO
2026-03-28 14:04:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DE61%2520AOO%27 HTTP/1.1" 200 None
2026-03-28 14:04:23 [bca.uk] INFO: Scrape type for DE61%20AOO: 0
2026-03-28 14:04:23 [bca.uk] INFO: Found listing with ID: DV63%20FNX
2026-03-28 14:04:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DV63%2520FNX%27 HTTP/1.1" 200 None
2026-03-28 14:04:23 [bca.uk] INFO: Scrape type for DV63%20FNX: 2
2026-03-28 14:04:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 34f1c497-7fc5-5cfb-ba12-98ef318ac331 with identifier: DV63%20FNX
2026-03-28 14:04:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 34f1c497-7fc5-5cfb-ba12-98ef318ac331 with scrape type 2
2026-03-28 14:04:23 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 34f1c497-7fc5-5cfb-ba12-98ef318ac331 with scrape type 2
2026-03-28 14:04:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 34f1c497-7fc5-5cfb-ba12-98ef318ac331, identifier: DV63%20FNX
2026-03-28 14:04:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698707976%27 HTTP/1.1" 200 None
2026-03-28 14:04:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698707976 not downloaded yet
2026-03-28 14:04:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698993234%27 HTTP/1.1" 200 None
2026-03-28 14:04:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698993234 not downloaded yet
2026-03-28 14:04:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698729657%27 HTTP/1.1" 200 None
2026-03-28 14:04:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698729657 not downloaded yet
2026-03-28 14:04:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 62d37e6f-655a-5e8e-a462-f5ad6f0d593a with identifier: FJ59%20TSZ
2026-03-28 14:04:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 62d37e6f-655a-5e8e-a462-f5ad6f0d593a with identifier: FJ59%20TSZ
2026-03-28 14:04:23 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 62d37e6f-655a-5e8e-a462-f5ad6f0d593a with identifier: FJ59%20TSZ to the API
2026-03-28 14:04:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:04:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:04:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=5&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 186,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=FJ59%20TSZ-GB',
'category': 'Car',
'color': 'grey',
'currency': 'GBP',
'doors_number': 3,
'engine': '1.8L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol',
'id': '62d37e6f-655a-5e8e-a462-f5ad6f0d593a',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'FJ59 TSZ',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=FJ59%20TSZ&vehicleType=*',
'listing': 'auction',
'location': 'Walsall',
'make': 'MERCEDES-BENZ',
'model': 'CLC 180K',
'odometer': 71811,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2010-01-01',
'seller_name': None,
'title': 'MERCEDES-BENZ CLC 180K 1.8 SE Coupe',
'transmission': 'manual',
'trim': 'SE',
'vin': 'WDB2037462E038632',
'year': 2010}
2026-03-28 14:04:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FJ59%2520TSZ%27 HTTP/1.1" 200 None
2026-03-28 14:04:23 [bca.uk] INFO: Saving data for FJ59%20TSZ: {'auction_closing_time': 1774864800.0, 'created_time': 1774391974.237116, 'last_price_update_time': 1774706663.961919}
2026-03-28 14:04:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='FJ59%2520TSZ') HTTP/1.1" 204 0
2026-03-28 14:04:23 [bca.uk] INFO: Found listing with ID: LJ68%20TTK
2026-03-28 14:04:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LJ68%2520TTK%27 HTTP/1.1" 200 None
2026-03-28 14:04:23 [bca.uk] INFO: Scrape type for LJ68%20TTK: 2
2026-03-28 14:04:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e6313037-6a21-51e4-bd8d-6e44e6fba45b with identifier: LJ68%20TTK
2026-03-28 14:04:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e6313037-6a21-51e4-bd8d-6e44e6fba45b with scrape type 2
2026-03-28 14:04:23 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e6313037-6a21-51e4-bd8d-6e44e6fba45b with scrape type 2
2026-03-28 14:04:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: e6313037-6a21-51e4-bd8d-6e44e6fba45b, identifier: LJ68%20TTK
2026-03-28 14:04:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 34f1c497-7fc5-5cfb-ba12-98ef318ac331 with identifier: DV63%20FNX
2026-03-28 14:04:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 34f1c497-7fc5-5cfb-ba12-98ef318ac331 with identifier: DV63%20FNX
2026-03-28 14:04:24 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 34f1c497-7fc5-5cfb-ba12-98ef318ac331 with identifier: DV63%20FNX to the API
2026-03-28 14:04:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:04:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:04:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=7&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 107,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=DV63%20FNX-GB',
'category': 'Car',
'color': 'blue',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.6L',
'expiration_date': '2026-03-29T10:00:00Z',
'fuel_type': 'Diesel',
'id': '34f1c497-7fc5-5cfb-ba12-98ef318ac331',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'DV63 FNX',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=DV63%20FNX&vehicleType=*',
'listing': 'auction',
'location': 'Preston',
'make': 'PEUGEOT',
'model': '308',
'odometer': 121816,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2013-01-01',
'seller_name': None,
'title': 'PEUGEOT 308 1.6 HDI 92 ACTIVE Hatchback',
'transmission': 'manual',
'trim': 'HDI 92 ACTIVE',
'vin': 'VF34C9HP0DS157174',
'year': 2013}
2026-03-28 14:04:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DV63%2520FNX%27 HTTP/1.1" 200 None
2026-03-28 14:04:24 [bca.uk] INFO: Saving data for DV63%20FNX: {'auction_closing_time': 1774778400.0, 'created_time': 1774365705.346219, 'last_price_update_time': 1774706664.425427}
2026-03-28 14:04:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='DV63%2520FNX') HTTP/1.1" 204 0
2026-03-28 14:04:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PXZ1595/698814140/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/PXZ1595/42808016?sv=2020-08-04&st=2026-03-28T14%3A04%3A01Z&se=2026-03-28T14%3A29%3A01Z&sr=b&sp=r&sig=xu3OmTnGiQ74jDpi5YWrXOjZvBn7hDxoXdoCW9aef04%3D)
2026-03-28 14:04:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BT66DFX/698129706/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/BT66DFX/42810013?sv=2020-08-04&st=2026-03-28T14%3A04%3A00Z&se=2026-03-28T14%3A29%3A00Z&sr=b&sp=r&sig=Yx0iLoKJXBk4DPNXOVJLOrRp66ZUz648vIo6BTtbrJ0%3D)
2026-03-28 14:04:24 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FE12WRX/698993215/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698993215>
2026-03-28 14:04:24 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HV08XHP/698707920/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698707920>
2026-03-28 14:04:24 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HV69NLA/698729623/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698729623>
2026-03-28 14:04:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WJ58DWA/697410328/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/WJ58DWA/42809994?sv=2020-08-04&st=2026-03-28T14%3A04%3A01Z&se=2026-03-28T14%3A29%3A01Z&sr=b&sp=r&sig=WelJkUnZ%2FryduuiTM2iL%2FzPRBftp3wpY3FkYWG%2FP0gk%3D)
2026-03-28 14:04:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AK67LWT/698947180/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/AK67LWT/42810366?sv=2020-08-04&st=2026-03-28T14%3A04%3A00Z&se=2026-03-28T14%3A29%3A00Z&sr=b&sp=r&sig=dnN3%2FeKHnzQfSMnyGaraMReo6SkHH2Dy4nbY3zUESfI%3D)
2026-03-28 14:04:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WJ58DWA/697410343/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/WJ58DWA/42809994?sv=2020-08-04&st=2026-03-28T14%3A04%3A01Z&se=2026-03-28T14%3A29%3A01Z&sr=b&sp=r&sig=WelJkUnZ%2FryduuiTM2iL%2FzPRBftp3wpY3FkYWG%2FP0gk%3D)
2026-03-28 14:04:24 [bca.uk] INFO: Found listing with ID: MV13%20TFX
2026-03-28 14:04:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MV13%2520TFX%27 HTTP/1.1" 200 None
2026-03-28 14:04:24 [bca.uk] INFO: Scrape type for MV13%20TFX: 2
2026-03-28 14:04:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 74f20eec-9d10-5c20-a1da-a8060b6a2ea3 with identifier: MV13%20TFX
2026-03-28 14:04:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 74f20eec-9d10-5c20-a1da-a8060b6a2ea3 with scrape type 2
2026-03-28 14:04:24 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 74f20eec-9d10-5c20-a1da-a8060b6a2ea3 with scrape type 2
2026-03-28 14:04:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 74f20eec-9d10-5c20-a1da-a8060b6a2ea3, identifier: MV13%20TFX
2026-03-28 14:04:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: e6313037-6a21-51e4-bd8d-6e44e6fba45b with identifier: LJ68%20TTK
2026-03-28 14:04:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: e6313037-6a21-51e4-bd8d-6e44e6fba45b with identifier: LJ68%20TTK
2026-03-28 14:04:24 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: e6313037-6a21-51e4-bd8d-6e44e6fba45b with identifier: LJ68%20TTK to the API
2026-03-28 14:04:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:04:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:04:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=6&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 57,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=LJ68%20TTK-GB',
'category': 'Car',
'color': 'white',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.5L',
'expiration_date': '2026-03-29T10:00:00Z',
'fuel_type': 'Petrol/Electric',
'id': 'e6313037-6a21-51e4-bd8d-6e44e6fba45b',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'LJ68 TTK',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=LJ68%20TTK&vehicleType=*',
'listing': 'auction',
'location': 'Preston',
'make': 'BMW',
'model': '2 ACTIVE TOURER',
'odometer': 98409,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-01-01',
'seller_name': None,
'title': 'BMW 2 ACTIVE TOURER 1.5 225XE M SPORT PREMIUM Hatchback',
'transmission': 'automatic',
'trim': '225XE M SPORT PREMIUM',
'vin': 'WBA6Y320807D12110',
'year': 2018}
2026-03-28 14:04:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LJ68%2520TTK%27 HTTP/1.1" 200 None
2026-03-28 14:04:25 [bca.uk] INFO: Saving data for LJ68%20TTK: {'auction_closing_time': 1774778400.0, 'created_time': 1774044810.129902, 'last_price_update_time': 1774706665.044583}
2026-03-28 14:04:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='LJ68%2520TTK') HTTP/1.1" 204 0
2026-03-28 14:04:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699001734%27 HTTP/1.1" 200 None
2026-03-28 14:04:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699001734 not downloaded yet
2026-03-28 14:04:25 [bca.uk] INFO: Found listing with ID: EN60%20NNM
2026-03-28 14:04:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27EN60%2520NNM%27 HTTP/1.1" 200 None
2026-03-28 14:04:25 [bca.uk] INFO: Scrape type for EN60%20NNM: 0
2026-03-28 14:04:25 [bca.uk] INFO: Found listing with ID: EU13%20BPY
2026-03-28 14:04:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27EU13%2520BPY%27 HTTP/1.1" 200 None
2026-03-28 14:04:25 [bca.uk] INFO: Scrape type for EU13%20BPY: 0
2026-03-28 14:04:25 [bca.uk] INFO: Found listing with ID: EX63%20EOA
2026-03-28 14:04:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27EX63%2520EOA%27 HTTP/1.1" 200 None
2026-03-28 14:04:25 [bca.uk] INFO: Scrape type for EX63%20EOA: 0
2026-03-28 14:04:25 [bca.uk] INFO: Found listing with ID: GV09%20SKZ
2026-03-28 14:04:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GV09%2520SKZ%27 HTTP/1.1" 200 None
2026-03-28 14:04:25 [bca.uk] INFO: Scrape type for GV09%20SKZ: 0
2026-03-28 14:04:25 [bca.uk] INFO: Found listing with ID: AC58%20KVH
2026-03-28 14:04:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27AC58%2520KVH%27 HTTP/1.1" 200 None
2026-03-28 14:04:25 [bca.uk] INFO: Scrape type for AC58%20KVH: 0
2026-03-28 14:04:25 [bca.uk] INFO: Found listing with ID: GY19%20ZXT
2026-03-28 14:04:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GY19%2520ZXT%27 HTTP/1.1" 200 None
2026-03-28 14:04:25 [bca.uk] INFO: Scrape type for GY19%20ZXT: 0
2026-03-28 14:04:25 [bca.uk] INFO: Found listing with ID: KM20%20ZZB
2026-03-28 14:04:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KM20%2520ZZB%27 HTTP/1.1" 200 None
2026-03-28 14:04:25 [bca.uk] INFO: Scrape type for KM20%20ZZB: 0
2026-03-28 14:04:25 [bca.uk] INFO: Found listing with ID: AB%20181
2026-03-28 14:04:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27AB%2520181%27 HTTP/1.1" 200 None
2026-03-28 14:04:25 [bca.uk] INFO: Scrape type for AB%20181: 0
2026-03-28 14:04:25 [bca.uk] INFO: Found listing with ID: AO65%20LWK
2026-03-28 14:04:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27AO65%2520LWK%27 HTTP/1.1" 200 None
2026-03-28 14:04:25 [bca.uk] INFO: Scrape type for AO65%20LWK: 0
2026-03-28 14:04:25 [bca.uk] INFO: Found listing with ID: HY15%20PHK
2026-03-28 14:04:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27HY15%2520PHK%27 HTTP/1.1" 200 None
2026-03-28 14:04:25 [bca.uk] INFO: Scrape type for HY15%20PHK: 0
2026-03-28 14:04:25 [bca.uk] INFO: Found listing with ID: PN16%20TXY
2026-03-28 14:04:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27PN16%2520TXY%27 HTTP/1.1" 200 None
2026-03-28 14:04:25 [bca.uk] INFO: Scrape type for PN16%20TXY: 0
2026-03-28 14:04:25 [bca.uk] INFO: Found listing with ID: LC11%20FTF
2026-03-28 14:04:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LC11%2520FTF%27 HTTP/1.1" 200 None
2026-03-28 14:04:25 [bca.uk] INFO: Scrape type for LC11%20FTF: 0
2026-03-28 14:04:25 [bca.uk] INFO: Found listing with ID: KD55%20WDG
2026-03-28 14:04:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KD55%2520WDG%27 HTTP/1.1" 200 None
2026-03-28 14:04:25 [bca.uk] INFO: Scrape type for KD55%20WDG: 0
2026-03-28 14:04:25 [bca.uk] INFO: Found listing with ID: BD19%20RBF
2026-03-28 14:04:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BD19%2520RBF%27 HTTP/1.1" 200 None
2026-03-28 14:04:25 [bca.uk] INFO: Scrape type for BD19%20RBF: 0
2026-03-28 14:04:25 [bca.uk] INFO: Found listing with ID: CV66%20MDJ
2026-03-28 14:04:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27CV66%2520MDJ%27 HTTP/1.1" 200 None
2026-03-28 14:04:25 [bca.uk] INFO: Scrape type for CV66%20MDJ: 0
2026-03-28 14:04:25 [bca.uk] INFO: Found listing with ID: LA66%20CNU
2026-03-28 14:04:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LA66%2520CNU%27 HTTP/1.1" 200 None
2026-03-28 14:04:25 [bca.uk] INFO: Scrape type for LA66%20CNU: 0
2026-03-28 14:04:25 [bca.uk] INFO: Found listing with ID: SP14%20YXM
2026-03-28 14:04:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SP14%2520YXM%27 HTTP/1.1" 200 None
2026-03-28 14:04:25 [bca.uk] INFO: Scrape type for SP14%20YXM: 0
2026-03-28 14:04:25 [bca.uk] INFO: Found listing with ID: LM64%20MUY
2026-03-28 14:04:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LM64%2520MUY%27 HTTP/1.1" 200 None
2026-03-28 14:04:25 [bca.uk] INFO: Scrape type for LM64%20MUY: 2
2026-03-28 14:04:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 30ca613c-fbca-5035-b9ac-c29ab48945e3 with identifier: LM64%20MUY
2026-03-28 14:04:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 30ca613c-fbca-5035-b9ac-c29ab48945e3 with scrape type 2
2026-03-28 14:04:25 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 30ca613c-fbca-5035-b9ac-c29ab48945e3 with scrape type 2
2026-03-28 14:04:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 30ca613c-fbca-5035-b9ac-c29ab48945e3, identifier: LM64%20MUY
2026-03-28 14:04:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698708000%27 HTTP/1.1" 200 None
2026-03-28 14:04:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698708000 not downloaded yet
2026-03-28 14:04:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698993239%27 HTTP/1.1" 200 None
2026-03-28 14:04:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698993239 not downloaded yet
2026-03-28 14:04:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698729675%27 HTTP/1.1" 200 None
2026-03-28 14:04:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698729675 not downloaded yet
2026-03-28 14:04:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 74f20eec-9d10-5c20-a1da-a8060b6a2ea3 with identifier: MV13%20TFX
2026-03-28 14:04:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 74f20eec-9d10-5c20-a1da-a8060b6a2ea3 with identifier: MV13%20TFX
2026-03-28 14:04:25 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 74f20eec-9d10-5c20-a1da-a8060b6a2ea3 with identifier: MV13%20TFX to the API
2026-03-28 14:04:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:04:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:04:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=5&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 149,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=MV13%20TFX-GB',
'category': 'Car',
'color': 'white',
'currency': 'GBP',
'doors_number': 5,
'engine': '2.0L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Diesel',
'id': '74f20eec-9d10-5c20-a1da-a8060b6a2ea3',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'MV13 TFX',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=MV13%20TFX&vehicleType=*',
'listing': 'auction',
'location': 'Walsall',
'make': 'FORD',
'model': 'GRAND C-MAX',
'odometer': 83102,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2013-01-01',
'seller_name': None,
'title': 'FORD GRAND C-MAX 2.0 TDCI 140 TITANIUM P/SHIFT MPV',
'transmission': 'automatic',
'trim': 'TDCI 140 TITANIUM P/SHIFT',
'vin': 'WF0HXXWPBHDJ75049',
'year': 2013}
2026-03-28 14:04:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MV13%2520TFX%27 HTTP/1.1" 200 None
2026-03-28 14:04:26 [bca.uk] INFO: Saving data for MV13%20TFX: {'auction_closing_time': 1774864800.0, 'created_time': 1774391957.879323, 'last_price_update_time': 1774706666.130539}
2026-03-28 14:04:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='MV13%2520TFX') HTTP/1.1" 204 0
2026-03-28 14:04:26 [bca.uk] INFO: Found listing with ID: PX17%20MBO
2026-03-28 14:04:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27PX17%2520MBO%27 HTTP/1.1" 200 None
2026-03-28 14:04:26 [bca.uk] INFO: Scrape type for PX17%20MBO: 0
2026-03-28 14:04:26 [bca.uk] INFO: Found listing with ID: MF14%20BJJ
2026-03-28 14:04:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MF14%2520BJJ%27 HTTP/1.1" 200 None
2026-03-28 14:04:26 [bca.uk] INFO: Scrape type for MF14%20BJJ: 0
2026-03-28 14:04:26 [bca.uk] INFO: Found listing with ID: MF16%20UTG
2026-03-28 14:04:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MF16%2520UTG%27 HTTP/1.1" 200 None
2026-03-28 14:04:26 [bca.uk] INFO: Scrape type for MF16%20UTG: 0
2026-03-28 14:04:26 [bca.uk] INFO: Found listing with ID: PN65%20YXH
2026-03-28 14:04:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27PN65%2520YXH%27 HTTP/1.1" 200 None
2026-03-28 14:04:26 [bca.uk] INFO: Scrape type for PN65%20YXH: 2
2026-03-28 14:04:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 98b7269e-c5ee-569d-9fd9-0a91c44778da with identifier: PN65%20YXH
2026-03-28 14:04:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 98b7269e-c5ee-569d-9fd9-0a91c44778da with scrape type 2
2026-03-28 14:04:26 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 98b7269e-c5ee-569d-9fd9-0a91c44778da with scrape type 2
2026-03-28 14:04:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 98b7269e-c5ee-569d-9fd9-0a91c44778da, identifier: PN65%20YXH
2026-03-28 14:04:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 30ca613c-fbca-5035-b9ac-c29ab48945e3 with identifier: LM64%20MUY
2026-03-28 14:04:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-28 14:04:26 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=brown HTTP/1.1" 200 None
2026-03-28 14:04:26 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-28 14:04:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-28 14:04:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 30ca613c-fbca-5035-b9ac-c29ab48945e3 with identifier: LM64%20MUY
2026-03-28 14:04:26 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 30ca613c-fbca-5035-b9ac-c29ab48945e3 with identifier: LM64%20MUY to the API
2026-03-28 14:04:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:04:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:04:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=7&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 140,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=LM64%20MUY-GB',
'category': 'Car',
'color': 'brown',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.4L',
'expiration_date': '2026-03-29T10:00:00Z',
'fuel_type': 'Petrol',
'id': '30ca613c-fbca-5035-b9ac-c29ab48945e3',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'LM64 MUY',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=LM64%20MUY&vehicleType=*',
'listing': 'auction',
'location': 'Crawley',
'make': 'VAUXHALL',
'model': 'MERIVA',
'odometer': 82907,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2014-01-01',
'seller_name': None,
'title': 'VAUXHALL MERIVA 1.4 16V TECH LINE MPV',
'transmission': 'manual',
'trim': '16V TECH LINE',
'vin': 'W0LSH9EC1F4006219',
'year': 2014}
2026-03-28 14:04:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LM64%2520MUY%27 HTTP/1.1" 200 None
2026-03-28 14:04:26 [bca.uk] INFO: Saving data for LM64%20MUY: {'auction_closing_time': 1774778400.0, 'created_time': 1774275069.962502, 'last_price_update_time': 1774706666.950284}
2026-03-28 14:04:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='LM64%2520MUY') HTTP/1.1" 204 0
2026-03-28 14:04:26 [bca.uk] INFO: Found listing with ID: WG62%20AOC
2026-03-28 14:04:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WG62%2520AOC%27 HTTP/1.1" 200 None
2026-03-28 14:04:26 [bca.uk] INFO: Scrape type for WG62%20AOC: 0
2026-03-28 14:04:26 [bca.uk] INFO: Found listing with ID: BT13%20WSV
2026-03-28 14:04:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BT13%2520WSV%27 HTTP/1.1" 200 None
2026-03-28 14:04:27 [bca.uk] INFO: Scrape type for BT13%20WSV: 0
2026-03-28 14:04:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 98b7269e-c5ee-569d-9fd9-0a91c44778da with identifier: PN65%20YXH
2026-03-28 14:04:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 98b7269e-c5ee-569d-9fd9-0a91c44778da with identifier: PN65%20YXH
2026-03-28 14:04:27 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 98b7269e-c5ee-569d-9fd9-0a91c44778da with identifier: PN65%20YXH to the API
2026-03-28 14:04:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:04:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:04:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=6&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 114,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=PN65%20YXH-GB',
'category': 'Car',
'color': 'silver',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.3L',
'expiration_date': '2026-03-29T10:00:00Z',
'fuel_type': 'Petrol',
'id': '98b7269e-c5ee-569d-9fd9-0a91c44778da',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'PN65 YXH',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=PN65%20YXH&vehicleType=*',
'listing': 'auction',
'location': 'Preston',
'make': 'HONDA',
'model': 'JAZZ',
'odometer': 34483,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-01-01',
'seller_name': None,
'title': 'HONDA JAZZ 1.3 I-VTEC 102 EX Hatchback',
'transmission': 'automatic',
'trim': 'I-VTEC 102 EX',
'vin': 'JHMGK3870GX202850',
'year': 2015}
2026-03-28 14:04:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27PN65%2520YXH%27 HTTP/1.1" 200 None
2026-03-28 14:04:27 [bca.uk] INFO: Saving data for PN65%20YXH: {'auction_closing_time': 1774778400.0, 'created_time': 1774365718.649989, 'last_price_update_time': 1774706667.430533}
2026-03-28 14:04:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='PN65%2520YXH') HTTP/1.1" 204 0
2026-03-28 14:04:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699001742%27 HTTP/1.1" 200 None
2026-03-28 14:04:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699001742 not downloaded yet
2026-03-28 14:04:27 [bca.uk] INFO: Found listing with ID: OY14%20RPZ
2026-03-28 14:04:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27OY14%2520RPZ%27 HTTP/1.1" 200 None
2026-03-28 14:04:27 [bca.uk] INFO: Scrape type for OY14%20RPZ: 0
2026-03-28 14:04:27 [bca.uk] INFO: Found listing with ID: EX13%20SOH
2026-03-28 14:04:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27EX13%2520SOH%27 HTTP/1.1" 200 None
2026-03-28 14:04:27 [bca.uk] INFO: Scrape type for EX13%20SOH: 0
2026-03-28 14:04:27 [bca.uk] INFO: Found listing with ID: KU09%20AEA
2026-03-28 14:04:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KU09%2520AEA%27 HTTP/1.1" 200 None
2026-03-28 14:04:27 [bca.uk] INFO: Scrape type for KU09%20AEA: 2
2026-03-28 14:04:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c4d85045-f55c-5dde-9c04-09f57b69e813 with identifier: KU09%20AEA
2026-03-28 14:04:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c4d85045-f55c-5dde-9c04-09f57b69e813 with scrape type 2
2026-03-28 14:04:27 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c4d85045-f55c-5dde-9c04-09f57b69e813 with scrape type 2
2026-03-28 14:04:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: c4d85045-f55c-5dde-9c04-09f57b69e813, identifier: KU09%20AEA
2026-03-28 14:04:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698708031%27 HTTP/1.1" 200 None
2026-03-28 14:04:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698708031 not downloaded yet
2026-03-28 14:04:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698993245%27 HTTP/1.1" 200 None
2026-03-28 14:04:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698993245 not downloaded yet
2026-03-28 14:04:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698729689%27 HTTP/1.1" 200 None
2026-03-28 14:04:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698729689 not downloaded yet
2026-03-28 14:04:27 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PXZ1595/698814256/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698814256>
2026-03-28 14:04:27 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BT66DFX/698129740/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698129740>
2026-03-28 14:04:27 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HV69NLA/698729604/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=HV69NLA-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-28 14:04:27 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FE12WRX/698993191/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=FE12WRX-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-28 14:04:27 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LD16UKX/699001714/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699001714>
2026-03-28 14:04:27 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WJ58DWA/697410373/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=697410373>
2026-03-28 14:04:27 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HV08XHP/698707901/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=HV08XHP-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-28 14:04:27 [bca.uk] INFO: Found listing with ID: BK11%20UNU
2026-03-28 14:04:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BK11%2520UNU%27 HTTP/1.1" 200 None
2026-03-28 14:04:27 [bca.uk] INFO: Scrape type for BK11%20UNU: 0
2026-03-28 14:04:27 [bca.uk] INFO: Found listing with ID: SN65%20NPD
2026-03-28 14:04:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SN65%2520NPD%27 HTTP/1.1" 200 None
2026-03-28 14:04:27 [bca.uk] INFO: Scrape type for SN65%20NPD: 0
2026-03-28 14:04:27 [bca.uk] INFO: Found listing with ID: YH14%20PZJ
2026-03-28 14:04:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YH14%2520PZJ%27 HTTP/1.1" 200 None
2026-03-28 14:04:27 [bca.uk] INFO: Scrape type for YH14%20PZJ: 0
2026-03-28 14:04:27 [bca.uk] INFO: Found listing with ID: YX64%20PZC
2026-03-28 14:04:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YX64%2520PZC%27 HTTP/1.1" 200 None
2026-03-28 14:04:27 [bca.uk] INFO: Scrape type for YX64%20PZC: 2
2026-03-28 14:04:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ce7a5f53-c2d3-514a-ad12-77d2867e59cc with identifier: YX64%20PZC
2026-03-28 14:04:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ce7a5f53-c2d3-514a-ad12-77d2867e59cc with scrape type 2
2026-03-28 14:04:27 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ce7a5f53-c2d3-514a-ad12-77d2867e59cc with scrape type 2
2026-03-28 14:04:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: ce7a5f53-c2d3-514a-ad12-77d2867e59cc, identifier: YX64%20PZC
2026-03-28 14:04:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: c4d85045-f55c-5dde-9c04-09f57b69e813 with identifier: KU09%20AEA
2026-03-28 14:04:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: c4d85045-f55c-5dde-9c04-09f57b69e813 with identifier: KU09%20AEA
2026-03-28 14:04:28 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: c4d85045-f55c-5dde-9c04-09f57b69e813 with identifier: KU09%20AEA to the API
2026-03-28 14:04:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:04:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:04:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=7&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 166,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=KU09%20AEA-GB',
'category': 'Car',
'color': 'silver',
'currency': 'GBP',
'doors_number': 3,
'engine': '2.0L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol',
'id': 'c4d85045-f55c-5dde-9c04-09f57b69e813',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'KU09 AEA',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=KU09%20AEA&vehicleType=*',
'listing': 'auction',
'location': 'Crawley',
'make': 'AUDI',
'model': 'A3',
'odometer': 76930,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2009-01-01',
'seller_name': None,
'title': 'AUDI A3 2.0 TFSI SPORT S-T Hatchback',
'transmission': 'automatic',
'trim': 'TFSI SPORT S-T',
'vin': 'WAUZZZ8P79A078430',
'year': 2009}
2026-03-28 14:04:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KU09%2520AEA%27 HTTP/1.1" 200 None
2026-03-28 14:04:28 [bca.uk] INFO: Saving data for KU09%20AEA: {'auction_closing_time': 1774864800.0, 'created_time': 1773831943.852449, 'last_price_update_time': 1774706668.287229}
2026-03-28 14:04:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='KU09%2520AEA') HTTP/1.1" 204 0
2026-03-28 14:04:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:04:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2d990390>
2026-03-28 14:04:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:04:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:04:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:04:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8f3e30a4-6b64-5dd1-8e1e-6cce5d49fef3/8f3e30a4-6b64-5dd1-8e1e-6cce5d49fef3_image_3.jpg HTTP/1.1" 201 0
2026-03-28 14:04:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FPXZ1595%252F698814140%252F600') HTTP/1.1" 204 0
2026-03-28 14:04:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PXZ1595/698814140/600 saved to cache
2026-03-28 14:04:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 8f3e30a4-6b64-5dd1-8e1e-6cce5d49fef3
2026-03-28 14:04:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:04:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2d992f90>
2026-03-28 14:04:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:04:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:04:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:04:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ca2c3006-0503-55ad-a26d-88f328a541b5/ca2c3006-0503-55ad-a26d-88f328a541b5_image_3.jpg HTTP/1.1" 201 0
2026-03-28 14:04:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FBT66DFX%252F698129706%252F600') HTTP/1.1" 204 0
2026-03-28 14:04:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BT66DFX/698129706/600 saved to cache
2026-03-28 14:04:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item ca2c3006-0503-55ad-a26d-88f328a541b5
2026-03-28 14:04:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:04:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c0fda10>
2026-03-28 14:04:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:04:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:04:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:04:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8413221f-7948-5093-9030-c87150f157c7/8413221f-7948-5093-9030-c87150f157c7_image_1.jpg HTTP/1.1" 201 0
2026-03-28 14:04:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FWJ58DWA%252F697410328%252F600') HTTP/1.1" 204 0
2026-03-28 14:04:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WJ58DWA/697410328/600 saved to cache
2026-03-28 14:04:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 8413221f-7948-5093-9030-c87150f157c7
2026-03-28 14:04:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:04:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c4457d0>
2026-03-28 14:04:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:04:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:04:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:04:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_96df00f7-d862-5338-b935-5c42d63b82c0/96df00f7-d862-5338-b935-5c42d63b82c0_image_4.jpg HTTP/1.1" 201 0
2026-03-28 14:04:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FAK67LWT%252F698947180%252F600') HTTP/1.1" 204 0
2026-03-28 14:04:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AK67LWT/698947180/600 saved to cache
2026-03-28 14:04:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 96df00f7-d862-5338-b935-5c42d63b82c0
2026-03-28 14:04:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:04:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2da1aad0>
2026-03-28 14:04:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:04:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:04:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:04:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8413221f-7948-5093-9030-c87150f157c7/8413221f-7948-5093-9030-c87150f157c7_image_3.jpg HTTP/1.1" 201 0
2026-03-28 14:04:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FWJ58DWA%252F697410343%252F600') HTTP/1.1" 204 0
2026-03-28 14:04:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WJ58DWA/697410343/600 saved to cache
2026-03-28 14:04:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 8413221f-7948-5093-9030-c87150f157c7
2026-03-28 14:04:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HV69NLA/698729623/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/HV69NLA/42810551?sv=2020-08-04&st=2026-03-28T14%3A04%3A08Z&se=2026-03-28T14%3A29%3A08Z&sr=b&sp=r&sig=sCJK6ApeU%2FoHZHPsXN72GO3cagNVfUluR%2FbC%2B%2BOeYM4%3D)
2026-03-28 14:04:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: ce7a5f53-c2d3-514a-ad12-77d2867e59cc with identifier: YX64%20PZC
2026-03-28 14:04:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: ce7a5f53-c2d3-514a-ad12-77d2867e59cc with identifier: YX64%20PZC
2026-03-28 14:04:28 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: ce7a5f53-c2d3-514a-ad12-77d2867e59cc with identifier: YX64%20PZC to the API
2026-03-28 14:04:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:04:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:04:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=6&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 114,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=YX64%20PZC-GB',
'category': 'Car',
'color': 'blue',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.0L',
'expiration_date': '2026-03-29T10:00:00Z',
'fuel_type': 'Petrol',
'id': 'ce7a5f53-c2d3-514a-ad12-77d2867e59cc',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'YX64 PZC',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=YX64%20PZC&vehicleType=*',
'listing': 'auction',
'location': 'Preston',
'make': 'FORD',
'model': 'FOCUS',
'odometer': 91625,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2014-01-01',
'seller_name': None,
'title': 'FORD FOCUS 1.0 E/B 125 TITANIUM NAVIGATOR Hatchback',
'transmission': 'manual',
'trim': 'E/B 125 TITANIUM NAVIGATOR',
'vin': 'WF0KXXGCBKEB81555',
'year': 2014}
2026-03-28 14:04:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YX64%2520PZC%27 HTTP/1.1" 200 None
2026-03-28 14:04:28 [bca.uk] INFO: Saving data for YX64%20PZC: {'auction_closing_time': 1774778400.0, 'created_time': 1774365704.023629, 'last_price_update_time': 1774706668.953261}
2026-03-28 14:04:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='YX64%2520PZC') HTTP/1.1" 204 0
2026-03-28 14:04:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699001753%27 HTTP/1.1" 200 None
2026-03-28 14:04:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699001753 not downloaded yet
2026-03-28 14:04:28 [bca.uk] INFO: Found listing with ID: LD10%20VGG
2026-03-28 14:04:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LD10%2520VGG%27 HTTP/1.1" 200 None
2026-03-28 14:04:29 [bca.uk] INFO: Scrape type for LD10%20VGG: 2
2026-03-28 14:04:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 409b06aa-add4-5c16-b7f9-674d87f223b5 with identifier: LD10%20VGG
2026-03-28 14:04:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 409b06aa-add4-5c16-b7f9-674d87f223b5 with scrape type 2
2026-03-28 14:04:29 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 409b06aa-add4-5c16-b7f9-674d87f223b5 with scrape type 2
2026-03-28 14:04:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 409b06aa-add4-5c16-b7f9-674d87f223b5, identifier: LD10%20VGG
2026-03-28 14:04:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698708079%27 HTTP/1.1" 200 None
2026-03-28 14:04:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698708079 not downloaded yet
2026-03-28 14:04:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698993255%27 HTTP/1.1" 200 None
2026-03-28 14:04:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698993255 not downloaded yet
2026-03-28 14:04:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698729714%27 HTTP/1.1" 200 None
2026-03-28 14:04:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698729714 not downloaded yet
2026-03-28 14:04:29 [bca.uk] INFO: Found listing with ID: K999%20ENP
2026-03-28 14:04:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27K999%2520ENP%27 HTTP/1.1" 200 None
2026-03-28 14:04:29 [bca.uk] INFO: Scrape type for K999%20ENP: 0
2026-03-28 14:04:29 [bca.uk] INFO: Found listing with ID: YN64%20VNE
2026-03-28 14:04:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YN64%2520VNE%27 HTTP/1.1" 200 None
2026-03-28 14:04:29 [bca.uk] INFO: Scrape type for YN64%20VNE: 0
2026-03-28 14:04:29 [bca.uk] INFO: Found listing with ID: YG64%20YPR
2026-03-28 14:04:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YG64%2520YPR%27 HTTP/1.1" 200 None
2026-03-28 14:04:29 [bca.uk] INFO: Scrape type for YG64%20YPR: 0
2026-03-28 14:04:29 [bca.uk] INFO: Found listing with ID: GG05%20AVG
2026-03-28 14:04:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GG05%2520AVG%27 HTTP/1.1" 200 None
2026-03-28 14:04:29 [bca.uk] INFO: Scrape type for GG05%20AVG: 2
2026-03-28 14:04:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6938b20d-2e74-52fc-8909-d0536b176c6f with identifier: GG05%20AVG
2026-03-28 14:04:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6938b20d-2e74-52fc-8909-d0536b176c6f with scrape type 2
2026-03-28 14:04:29 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6938b20d-2e74-52fc-8909-d0536b176c6f with scrape type 2
2026-03-28 14:04:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 6938b20d-2e74-52fc-8909-d0536b176c6f, identifier: GG05%20AVG
2026-03-28 14:04:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 409b06aa-add4-5c16-b7f9-674d87f223b5 with identifier: LD10%20VGG
2026-03-28 14:04:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 409b06aa-add4-5c16-b7f9-674d87f223b5 with identifier: LD10%20VGG
2026-03-28 14:04:29 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 409b06aa-add4-5c16-b7f9-674d87f223b5 with identifier: LD10%20VGG to the API
2026-03-28 14:04:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:04:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:04:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=7&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 167,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=LD10%20VGG-GB',
'category': 'Car',
'color': 'red',
'currency': 'GBP',
'doors_number': 5,
'engine': '2.0L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Diesel',
'id': '409b06aa-add4-5c16-b7f9-674d87f223b5',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'LD10 VGG',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=LD10%20VGG&vehicleType=*',
'listing': 'auction',
'location': 'Crawley',
'make': 'BMW',
'model': 'X1',
'odometer': 115666,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2010-01-01',
'seller_name': None,
'title': 'BMW X1 2.0 XDRIVE 23D SE STEP StationWagon',
'transmission': 'automatic',
'trim': 'XDRIVE 23D SE STEP',
'vin': 'WBAVP52010VK52237',
'year': 2010}
2026-03-28 14:04:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LD10%2520VGG%27 HTTP/1.1" 200 None
2026-03-28 14:04:29 [bca.uk] INFO: Saving data for LD10%20VGG: {'auction_closing_time': 1774864800.0, 'created_time': 1774523551.680914, 'last_price_update_time': 1774706669.786529}
2026-03-28 14:04:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='LD10%2520VGG') HTTP/1.1" 204 0
2026-03-28 14:04:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FE12WRX/698993215/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/FE12WRX/42809715?sv=2020-08-04&st=2026-03-28T14%3A04%3A08Z&se=2026-03-28T14%3A29%3A08Z&sr=b&sp=r&sig=IhVxQK0SibgR8nCtLOUZrswprKTYcjKJBEdadhY0N3I%3D)
2026-03-28 14:04:29 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LD16UKX/699001725/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699001725>
2026-03-28 14:04:29 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FE12WRX/698993234/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698993234>
2026-03-28 14:04:29 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HV69NLA/698729657/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698729657>
2026-03-28 14:04:29 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HV08XHP/698707976/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698707976>
2026-03-28 14:04:29 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HV69NLA/698729640/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698729640>
2026-03-28 14:04:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HV08XHP/698707920/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/HV08XHP/42810135?sv=2020-08-04&st=2026-03-28T14%3A04%3A07Z&se=2026-03-28T14%3A29%3A07Z&sr=b&sp=r&sig=nDBJaQ0d1Lnn1Q%2BoiL0EJlYO6HO0nKvJULaa1yflDpY%3D)
2026-03-28 14:04:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 6938b20d-2e74-52fc-8909-d0536b176c6f with identifier: GG05%20AVG
2026-03-28 14:04:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 6938b20d-2e74-52fc-8909-d0536b176c6f with identifier: GG05%20AVG
2026-03-28 14:04:29 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 6938b20d-2e74-52fc-8909-d0536b176c6f with identifier: GG05%20AVG to the API
2026-03-28 14:04:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:04:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:04:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=6&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 241,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=GG05%20AVG-GB',
'category': 'Car',
'color': 'silver',
'currency': 'GBP',
'doors_number': 4,
'engine': '3.5L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol',
'id': '6938b20d-2e74-52fc-8909-d0536b176c6f',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'GG05 AVG',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=GG05%20AVG&vehicleType=*',
'listing': 'auction',
'location': 'Preston',
'make': 'MERCEDES-BENZ',
'model': 'CLS 350',
'odometer': 89304,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2005-01-01',
'seller_name': None,
'title': 'MERCEDES-BENZ CLS 350 3.5 7G Coupe',
'transmission': 'manual',
'trim': '7G',
'vin': 'WDD2193562A025392',
'year': 2005}
2026-03-28 14:04:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GG05%2520AVG%27 HTTP/1.1" 200 None
2026-03-28 14:04:30 [bca.uk] INFO: Saving data for GG05%20AVG: {'auction_closing_time': 1774864800.0, 'created_time': 1774523566.99732, 'last_price_update_time': 1774706670.148721}
2026-03-28 14:04:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='GG05%2520AVG') HTTP/1.1" 204 0
2026-03-28 14:04:30 [bca.uk] INFO: Found listing with ID: PK60%20UOG
2026-03-28 14:04:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27PK60%2520UOG%27 HTTP/1.1" 200 None
2026-03-28 14:04:30 [bca.uk] INFO: Scrape type for PK60%20UOG: 2
2026-03-28 14:04:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c1d0e624-0eca-5ae0-992f-152fa649cb1b with identifier: PK60%20UOG
2026-03-28 14:04:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c1d0e624-0eca-5ae0-992f-152fa649cb1b with scrape type 2
2026-03-28 14:04:30 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c1d0e624-0eca-5ae0-992f-152fa649cb1b with scrape type 2
2026-03-28 14:04:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: c1d0e624-0eca-5ae0-992f-152fa649cb1b, identifier: PK60%20UOG
2026-03-28 14:04:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698708117%27 HTTP/1.1" 200 None
2026-03-28 14:04:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698708117 not downloaded yet
2026-03-28 14:04:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698993267%27 HTTP/1.1" 200 None
2026-03-28 14:04:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698993267 not downloaded yet
2026-03-28 14:04:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698729733%27 HTTP/1.1" 200 None
2026-03-28 14:04:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698729733 not downloaded yet
2026-03-28 14:04:30 [bca.uk] INFO: Found listing with ID: S706%20NFV
2026-03-28 14:04:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27S706%2520NFV%27 HTTP/1.1" 200 None
2026-03-28 14:04:30 [bca.uk] INFO: Scrape type for S706%20NFV: 0
2026-03-28 14:04:30 [bca.uk] INFO: Found listing with ID: MK62%20TKE
2026-03-28 14:04:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MK62%2520TKE%27 HTTP/1.1" 200 None
2026-03-28 14:04:30 [bca.uk] INFO: Scrape type for MK62%20TKE: 0
2026-03-28 14:04:30 [bca.uk] INFO: Found listing with ID: MM13%20HZU
2026-03-28 14:04:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MM13%2520HZU%27 HTTP/1.1" 200 None
2026-03-28 14:04:30 [bca.uk] INFO: Scrape type for MM13%20HZU: 0
2026-03-28 14:04:30 [bca.uk] INFO: Found listing with ID: MT61%20BJF
2026-03-28 14:04:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MT61%2520BJF%27 HTTP/1.1" 200 None
2026-03-28 14:04:30 [bca.uk] INFO: Scrape type for MT61%20BJF: 0
2026-03-28 14:04:30 [bca.uk] INFO: Found listing with ID: MT64%20NPP
2026-03-28 14:04:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MT64%2520NPP%27 HTTP/1.1" 200 None
2026-03-28 14:04:30 [bca.uk] INFO: Scrape type for MT64%20NPP: 0
2026-03-28 14:04:30 [bca.uk] INFO: Found listing with ID: PJ61%20APK
2026-03-28 14:04:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27PJ61%2520APK%27 HTTP/1.1" 200 None
2026-03-28 14:04:30 [bca.uk] INFO: Scrape type for PJ61%20APK: 2
2026-03-28 14:04:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f3b8d87e-26a0-5a66-8e5c-a30517c7ec87 with identifier: PJ61%20APK
2026-03-28 14:04:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f3b8d87e-26a0-5a66-8e5c-a30517c7ec87 with scrape type 2
2026-03-28 14:04:30 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f3b8d87e-26a0-5a66-8e5c-a30517c7ec87 with scrape type 2
2026-03-28 14:04:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: f3b8d87e-26a0-5a66-8e5c-a30517c7ec87, identifier: PJ61%20APK
2026-03-28 14:04:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: c1d0e624-0eca-5ae0-992f-152fa649cb1b with identifier: PK60%20UOG
2026-03-28 14:04:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: c1d0e624-0eca-5ae0-992f-152fa649cb1b with identifier: PK60%20UOG
2026-03-28 14:04:30 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: c1d0e624-0eca-5ae0-992f-152fa649cb1b with identifier: PK60%20UOG to the API
2026-03-28 14:04:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:04:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:04:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=7&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 159,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=PK60%20UOG-GB',
'category': 'Car',
'color': 'red',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.6L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol',
'id': 'c1d0e624-0eca-5ae0-992f-152fa649cb1b',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'PK60 UOG',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=PK60%20UOG&vehicleType=*',
'listing': 'auction',
'location': 'Crawley',
'make': 'NISSAN',
'model': 'NOTE',
'odometer': 86514,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2010-01-01',
'seller_name': None,
'title': 'NISSAN NOTE 1.6 N-TEC Hatchback',
'transmission': 'automatic',
'trim': 'N-TEC',
'vin': 'SJNFCAE11U2096580',
'year': 2010}
2026-03-28 14:04:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27PK60%2520UOG%27 HTTP/1.1" 200 None
2026-03-28 14:04:30 [bca.uk] INFO: Saving data for PK60%20UOG: {'auction_closing_time': 1774864800.0, 'created_time': 1774418978.041535, 'last_price_update_time': 1774706670.864323}
2026-03-28 14:04:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='PK60%2520UOG') HTTP/1.1" 204 0
2026-03-28 14:04:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HV08XHP/698707901/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/HV08XHP/42810135?sv=2020-08-04&st=2026-03-28T14%3A04%3A07Z&se=2026-03-28T14%3A29%3A07Z&sr=b&sp=r&sig=nDBJaQ0d1Lnn1Q%2BoiL0EJlYO6HO0nKvJULaa1yflDpY%3D)
2026-03-28 14:04:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: f3b8d87e-26a0-5a66-8e5c-a30517c7ec87 with identifier: PJ61%20APK
2026-03-28 14:04:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: f3b8d87e-26a0-5a66-8e5c-a30517c7ec87 with identifier: PJ61%20APK
2026-03-28 14:04:31 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: f3b8d87e-26a0-5a66-8e5c-a30517c7ec87 with identifier: PJ61%20APK to the API
2026-03-28 14:04:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:04:31 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:04:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=6&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 162,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=PJ61%20APK-GB',
'category': 'Car',
'color': 'black',
'currency': 'GBP',
'doors_number': 3,
'engine': '1.3L',
'expiration_date': '2026-03-29T10:00:00Z',
'fuel_type': 'Petrol',
'id': 'f3b8d87e-26a0-5a66-8e5c-a30517c7ec87',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'PJ61 APK',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=PJ61%20APK&vehicleType=*',
'listing': 'auction',
'location': 'Preston',
'make': 'SUZUKI',
'model': 'JIMNY',
'odometer': 52080,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2012-01-01',
'seller_name': None,
'title': 'SUZUKI JIMNY 1.3 VVT SZ4 Estate',
'transmission': 'manual',
'trim': 'VVT SZ4',
'vin': 'JSAFJB43V00524957',
'year': 2012}
2026-03-28 14:04:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27PJ61%2520APK%27 HTTP/1.1" 200 None
2026-03-28 14:04:31 [bca.uk] INFO: Saving data for PJ61%20APK: {'auction_closing_time': 1774778400.0, 'created_time': 1774102205.356445, 'last_price_update_time': 1774706671.557234}
2026-03-28 14:04:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='PJ61%2520APK') HTTP/1.1" 204 0
2026-03-28 14:04:31 [bca.uk] INFO: Found listing with ID: EN05%20JVE
2026-03-28 14:04:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27EN05%2520JVE%27 HTTP/1.1" 200 None
2026-03-28 14:04:31 [bca.uk] INFO: Scrape type for EN05%20JVE: 2
2026-03-28 14:04:31 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fd0c7a5e-057a-511f-8d9b-6cf9f234eac6 with identifier: EN05%20JVE
2026-03-28 14:04:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fd0c7a5e-057a-511f-8d9b-6cf9f234eac6 with scrape type 2
2026-03-28 14:04:31 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item fd0c7a5e-057a-511f-8d9b-6cf9f234eac6 with scrape type 2
2026-03-28 14:04:31 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: fd0c7a5e-057a-511f-8d9b-6cf9f234eac6, identifier: EN05%20JVE
2026-03-28 14:04:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698708152%27 HTTP/1.1" 200 None
2026-03-28 14:04:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698708152 not downloaded yet
2026-03-28 14:04:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698993276%27 HTTP/1.1" 200 None
2026-03-28 14:04:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698993276 not downloaded yet
2026-03-28 14:04:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698729751%27 HTTP/1.1" 200 None
2026-03-28 14:04:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698729751 not downloaded yet
2026-03-28 14:04:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:04:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c0ffd50>
2026-03-28 14:04:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:04:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:04:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:04:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_eadb8ebe-5b0a-5541-a2d1-caa5b9148e41/eadb8ebe-5b0a-5541-a2d1-caa5b9148e41_image_1.jpg HTTP/1.1" 201 0
2026-03-28 14:04:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FHV69NLA%252F698729623%252F600') HTTP/1.1" 204 0
2026-03-28 14:04:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HV69NLA/698729623/600 saved to cache
2026-03-28 14:04:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item eadb8ebe-5b0a-5541-a2d1-caa5b9148e41
2026-03-28 14:04:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FE12WRX/698993191/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/FE12WRX/42809715?sv=2020-08-04&st=2026-03-28T14%3A04%3A08Z&se=2026-03-28T14%3A29%3A08Z&sr=b&sp=r&sig=IhVxQK0SibgR8nCtLOUZrswprKTYcjKJBEdadhY0N3I%3D)
2026-03-28 14:04:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LD16UKX/699001714/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LD16UKX/42809855?sv=2020-08-04&st=2026-03-28T14%3A04%3A07Z&se=2026-03-28T14%3A29%3A07Z&sr=b&sp=r&sig=CHOiwblSOmf2jh7w7FrmkfA8BVi7dwLavRkRtCs3kTQ%3D)
2026-03-28 14:04:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HV69NLA/698729604/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/HV69NLA/42810551?sv=2020-08-04&st=2026-03-28T14%3A04%3A08Z&se=2026-03-28T14%3A29%3A08Z&sr=b&sp=r&sig=sCJK6ApeU%2FoHZHPsXN72GO3cagNVfUluR%2FbC%2B%2BOeYM4%3D)
2026-03-28 14:04:32 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HV69NLA/698729689/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698729689>
2026-03-28 14:04:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: fd0c7a5e-057a-511f-8d9b-6cf9f234eac6 with identifier: EN05%20JVE
2026-03-28 14:04:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: fd0c7a5e-057a-511f-8d9b-6cf9f234eac6 with identifier: EN05%20JVE
2026-03-28 14:04:32 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: fd0c7a5e-057a-511f-8d9b-6cf9f234eac6 with identifier: EN05%20JVE to the API
2026-03-28 14:04:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:04:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:04:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=7&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 251,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=EN05%20JVE-GB',
'category': 'Car',
'color': 'silver',
'currency': 'GBP',
'doors_number': 5,
'engine': '2.5L',
'expiration_date': '2026-03-29T10:00:00Z',
'fuel_type': 'Petrol',
'id': 'fd0c7a5e-057a-511f-8d9b-6cf9f234eac6',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'EN05 JVE',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=EN05%20JVE&vehicleType=*',
'listing': 'auction',
'location': 'Crawley',
'make': 'FORD',
'model': 'MONDEO',
'odometer': 90211,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2005-01-01',
'seller_name': None,
'title': 'FORD MONDEO 2.5 V6 GHIA X DURASHIFT Estate',
'transmission': 'manual',
'trim': 'V6 GHIA X DURASHIFT',
'vin': 'WF0WXXGBBW5R19636',
'year': 2005}
2026-03-28 14:04:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27EN05%2520JVE%27 HTTP/1.1" 200 None
2026-03-28 14:04:32 [bca.uk] INFO: Saving data for EN05%20JVE: {'auction_closing_time': 1774778400.0, 'created_time': 1774305633.477242, 'last_price_update_time': 1774706672.644182}
2026-03-28 14:04:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='EN05%2520JVE') HTTP/1.1" 204 0
2026-03-28 14:04:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WJ58DWA/697410373/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/WJ58DWA/42809994?sv=2020-08-04&st=2026-03-28T14%3A04%3A01Z&se=2026-03-28T14%3A29%3A01Z&sr=b&sp=r&sig=WelJkUnZ%2FryduuiTM2iL%2FzPRBftp3wpY3FkYWG%2FP0gk%3D)
2026-03-28 14:04:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PXZ1595/698814256/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/PXZ1595/42808016?sv=2020-08-04&st=2026-03-28T14%3A04%3A01Z&se=2026-03-28T14%3A29%3A01Z&sr=b&sp=r&sig=xu3OmTnGiQ74jDpi5YWrXOjZvBn7hDxoXdoCW9aef04%3D)
2026-03-28 14:04:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BT66DFX/698129740/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/BT66DFX/42810013?sv=2020-08-04&st=2026-03-28T14%3A04%3A00Z&se=2026-03-28T14%3A29%3A00Z&sr=b&sp=r&sig=Yx0iLoKJXBk4DPNXOVJLOrRp66ZUz648vIo6BTtbrJ0%3D)
2026-03-28 14:04:32 [bca.uk] INFO: Found listing with ID: GF13%20WKW
2026-03-28 14:04:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GF13%2520WKW%27 HTTP/1.1" 200 None
2026-03-28 14:04:32 [bca.uk] INFO: Scrape type for GF13%20WKW: 0
2026-03-28 14:04:32 [bca.uk] INFO: Found listing with ID: GK14%20AYT
2026-03-28 14:04:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GK14%2520AYT%27 HTTP/1.1" 200 None
2026-03-28 14:04:32 [bca.uk] INFO: Scrape type for GK14%20AYT: 0
2026-03-28 14:04:32 [bca.uk] INFO: Found listing with ID: GY09%20BBY
2026-03-28 14:04:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GY09%2520BBY%27 HTTP/1.1" 200 None
2026-03-28 14:04:32 [bca.uk] INFO: Scrape type for GY09%20BBY: 0
2026-03-28 14:04:32 [bca.uk] INFO: Found listing with ID: HV10%20NKH
2026-03-28 14:04:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27HV10%2520NKH%27 HTTP/1.1" 200 None
2026-03-28 14:04:32 [bca.uk] INFO: Scrape type for HV10%20NKH: 0
2026-03-28 14:04:32 [bca.uk] INFO: Found listing with ID: LA54%20FXG
2026-03-28 14:04:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LA54%2520FXG%27 HTTP/1.1" 200 None
2026-03-28 14:04:32 [bca.uk] INFO: Scrape type for LA54%20FXG: 0
2026-03-28 14:04:32 [bca.uk] INFO: Found listing with ID: LR06%20SPZ
2026-03-28 14:04:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LR06%2520SPZ%27 HTTP/1.1" 200 None
2026-03-28 14:04:32 [bca.uk] INFO: Scrape type for LR06%20SPZ: 0
2026-03-28 14:04:32 [bca.uk] INFO: Found listing with ID: LV13%20FWF
2026-03-28 14:04:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LV13%2520FWF%27 HTTP/1.1" 200 None
2026-03-28 14:04:32 [bca.uk] INFO: Scrape type for LV13%20FWF: 0
2026-03-28 14:04:32 [bca.uk] INFO: Found listing with ID: T60%20NJR
2026-03-28 14:04:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27T60%2520NJR%27 HTTP/1.1" 200 None
2026-03-28 14:04:32 [bca.uk] INFO: Scrape type for T60%20NJR: 0
2026-03-28 14:04:32 [bca.uk] INFO: Found listing with ID: WN64%20TLV
2026-03-28 14:04:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WN64%2520TLV%27 HTTP/1.1" 200 None
2026-03-28 14:04:32 [bca.uk] INFO: Scrape type for WN64%20TLV: 0
2026-03-28 14:04:32 [bca.uk] INFO: Found listing with ID: DV15%20BDX
2026-03-28 14:04:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DV15%2520BDX%27 HTTP/1.1" 200 None
2026-03-28 14:04:32 [bca.uk] INFO: Scrape type for DV15%20BDX: 0
2026-03-28 14:04:32 [bca.uk] INFO: Found listing with ID: NA17%20GMZ
2026-03-28 14:04:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27NA17%2520GMZ%27 HTTP/1.1" 200 None
2026-03-28 14:04:32 [bca.uk] INFO: Scrape type for NA17%20GMZ: 0
2026-03-28 14:04:32 [bca.uk] INFO: Found listing with ID: YR07%20OWB
2026-03-28 14:04:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YR07%2520OWB%27 HTTP/1.1" 200 None
2026-03-28 14:04:32 [bca.uk] INFO: Scrape type for YR07%20OWB: 0
2026-03-28 14:04:32 [bca.uk] INFO: Found listing with ID: AY61%20ZBP
2026-03-28 14:04:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27AY61%2520ZBP%27 HTTP/1.1" 200 None
2026-03-28 14:04:32 [bca.uk] INFO: Scrape type for AY61%20ZBP: 0
2026-03-28 14:04:32 [bca.uk] INFO: Found listing with ID: GD12%20LSU
2026-03-28 14:04:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GD12%2520LSU%27 HTTP/1.1" 200 None
2026-03-28 14:04:32 [bca.uk] INFO: Scrape type for GD12%20LSU: 2
2026-03-28 14:04:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 42ab6db0-a2c2-50f8-8358-305edcd5ebd0 with identifier: GD12%20LSU
2026-03-28 14:04:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 42ab6db0-a2c2-50f8-8358-305edcd5ebd0 with scrape type 2
2026-03-28 14:04:32 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 42ab6db0-a2c2-50f8-8358-305edcd5ebd0 with scrape type 2
2026-03-28 14:04:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 42ab6db0-a2c2-50f8-8358-305edcd5ebd0, identifier: GD12%20LSU
2026-03-28 14:04:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698708185%27 HTTP/1.1" 200 None
2026-03-28 14:04:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698708185 not downloaded yet
2026-03-28 14:04:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698993287%27 HTTP/1.1" 200 None
2026-03-28 14:04:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698993287 not downloaded yet
2026-03-28 14:04:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698729767%27 HTTP/1.1" 200 None
2026-03-28 14:04:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698729767 not downloaded yet
2026-03-28 14:04:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:04:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c0fea50>
2026-03-28 14:04:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:04:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:04:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:04:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a3ad7a0d-b4c8-5ced-b470-27d0e0c9322f/a3ad7a0d-b4c8-5ced-b470-27d0e0c9322f_image_1.jpg HTTP/1.1" 201 0
2026-03-28 14:04:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FFE12WRX%252F698993215%252F600') HTTP/1.1" 204 0
2026-03-28 14:04:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FE12WRX/698993215/600 saved to cache
2026-03-28 14:04:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item a3ad7a0d-b4c8-5ced-b470-27d0e0c9322f
2026-03-28 14:04:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:04:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a1fe8ee50>
2026-03-28 14:04:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:04:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:04:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:04:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cdaa9411-8148-5f71-bb89-a031dafbf539/cdaa9411-8148-5f71-bb89-a031dafbf539_image_1.jpg HTTP/1.1" 201 0
2026-03-28 14:04:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FHV08XHP%252F698707920%252F600') HTTP/1.1" 204 0
2026-03-28 14:04:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HV08XHP/698707920/600 saved to cache
2026-03-28 14:04:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item cdaa9411-8148-5f71-bb89-a031dafbf539
2026-03-28 14:04:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HV69NLA/698729640/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/HV69NLA/42810551?sv=2020-08-04&st=2026-03-28T14%3A04%3A08Z&se=2026-03-28T14%3A29%3A08Z&sr=b&sp=r&sig=sCJK6ApeU%2FoHZHPsXN72GO3cagNVfUluR%2FbC%2B%2BOeYM4%3D)
2026-03-28 14:04:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 42ab6db0-a2c2-50f8-8358-305edcd5ebd0 with identifier: GD12%20LSU
2026-03-28 14:04:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 42ab6db0-a2c2-50f8-8358-305edcd5ebd0 with identifier: GD12%20LSU
2026-03-28 14:04:33 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 42ab6db0-a2c2-50f8-8358-305edcd5ebd0 with identifier: GD12%20LSU to the API
2026-03-28 14:04:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:04:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:04:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=7&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 117,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=GD12%20LSU-GB',
'category': 'Car',
'color': 'grey',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.6L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Diesel',
'id': '42ab6db0-a2c2-50f8-8358-305edcd5ebd0',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'GD12 LSU',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=GD12%20LSU&vehicleType=*',
'listing': 'auction',
'location': 'Paddock Wood',
'make': 'PEUGEOT',
'model': '3008',
'odometer': 96100,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2012-01-01',
'seller_name': None,
'title': 'PEUGEOT 3008 1.6 E-HDI 112 ACTIVE II EGC MPV',
'transmission': 'automatic',
'trim': 'E-HDI 112 ACTIVE II EGC',
'vin': 'VF30U9HR8CS138668',
'year': 2012}
2026-03-28 14:04:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GD12%2520LSU%27 HTTP/1.1" 200 None
2026-03-28 14:04:33 [bca.uk] INFO: Saving data for GD12%20LSU: {'auction_closing_time': 1774864800.0, 'created_time': 1774365774.925077, 'last_price_update_time': 1774706673.598386}
2026-03-28 14:04:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='GD12%2520LSU') HTTP/1.1" 204 0
2026-03-28 14:04:33 [bca.uk] INFO: Found listing with ID: KT09%20JOV
2026-03-28 14:04:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KT09%2520JOV%27 HTTP/1.1" 200 None
2026-03-28 14:04:33 [bca.uk] INFO: Scrape type for KT09%20JOV: 0
2026-03-28 14:04:33 [bca.uk] INFO: Found listing with ID: LG61%20YWR
2026-03-28 14:04:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LG61%2520YWR%27 HTTP/1.1" 200 None
2026-03-28 14:04:33 [bca.uk] INFO: Scrape type for LG61%20YWR: 0
2026-03-28 14:04:33 [bca.uk] INFO: Found listing with ID: LR53%20YBK
2026-03-28 14:04:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LR53%2520YBK%27 HTTP/1.1" 200 None
2026-03-28 14:04:33 [bca.uk] INFO: Scrape type for LR53%20YBK: 2
2026-03-28 14:04:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 23a84f7f-6f75-5068-8bce-edfabdbfdb32 with identifier: LR53%20YBK
2026-03-28 14:04:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 23a84f7f-6f75-5068-8bce-edfabdbfdb32 with scrape type 2
2026-03-28 14:04:33 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 23a84f7f-6f75-5068-8bce-edfabdbfdb32 with scrape type 2
2026-03-28 14:04:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 23a84f7f-6f75-5068-8bce-edfabdbfdb32, identifier: LR53%20YBK
2026-03-28 14:04:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:04:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c74af10>
2026-03-28 14:04:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:04:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:04:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:04:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cdaa9411-8148-5f71-bb89-a031dafbf539/cdaa9411-8148-5f71-bb89-a031dafbf539_image_0.jpg HTTP/1.1" 201 0
2026-03-28 14:04:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FHV08XHP%252F698707901%252F600') HTTP/1.1" 204 0
2026-03-28 14:04:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HV08XHP/698707901/600 saved to cache
2026-03-28 14:04:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item cdaa9411-8148-5f71-bb89-a031dafbf539
2026-03-28 14:04:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:04:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2d7b6790>
2026-03-28 14:04:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:04:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:04:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:04:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a3ad7a0d-b4c8-5ced-b470-27d0e0c9322f/a3ad7a0d-b4c8-5ced-b470-27d0e0c9322f_image_0.jpg HTTP/1.1" 201 0
2026-03-28 14:04:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FFE12WRX%252F698993191%252F600') HTTP/1.1" 204 0
2026-03-28 14:04:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FE12WRX/698993191/600 saved to cache
2026-03-28 14:04:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item a3ad7a0d-b4c8-5ced-b470-27d0e0c9322f
2026-03-28 14:04:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:04:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a1fe83c50>
2026-03-28 14:04:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:04:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:04:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:04:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_826679c4-b83f-5ad2-b8a7-2183b5f0a082/826679c4-b83f-5ad2-b8a7-2183b5f0a082_image_4.jpg HTTP/1.1" 201 0
2026-03-28 14:04:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLD16UKX%252F699001714%252F600') HTTP/1.1" 204 0
2026-03-28 14:04:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LD16UKX/699001714/600 saved to cache
2026-03-28 14:04:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 826679c4-b83f-5ad2-b8a7-2183b5f0a082
2026-03-28 14:04:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:04:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2ca37f10>
2026-03-28 14:04:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:04:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:04:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:04:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_eadb8ebe-5b0a-5541-a2d1-caa5b9148e41/eadb8ebe-5b0a-5541-a2d1-caa5b9148e41_image_0.jpg HTTP/1.1" 201 0
2026-03-28 14:04:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FHV69NLA%252F698729604%252F600') HTTP/1.1" 204 0
2026-03-28 14:04:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HV69NLA/698729604/600 saved to cache
2026-03-28 14:04:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item eadb8ebe-5b0a-5541-a2d1-caa5b9148e41
2026-03-28 14:04:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FE12WRX/698993234/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/FE12WRX/42809715?sv=2020-08-04&st=2026-03-28T14%3A04%3A08Z&se=2026-03-28T14%3A29%3A08Z&sr=b&sp=r&sig=IhVxQK0SibgR8nCtLOUZrswprKTYcjKJBEdadhY0N3I%3D)
2026-03-28 14:04:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HV08XHP/698707976/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/HV08XHP/42810135?sv=2020-08-04&st=2026-03-28T14%3A04%3A07Z&se=2026-03-28T14%3A29%3A07Z&sr=b&sp=r&sig=nDBJaQ0d1Lnn1Q%2BoiL0EJlYO6HO0nKvJULaa1yflDpY%3D)
2026-03-28 14:04:34 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HV69NLA/698729733/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698729733>
2026-03-28 14:04:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HV69NLA/698729657/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/HV69NLA/42810551?sv=2020-08-04&st=2026-03-28T14%3A04%3A08Z&se=2026-03-28T14%3A29%3A08Z&sr=b&sp=r&sig=sCJK6ApeU%2FoHZHPsXN72GO3cagNVfUluR%2FbC%2B%2BOeYM4%3D)
2026-03-28 14:04:34 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HV69NLA/698729714/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698729714>
2026-03-28 14:04:34 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FE12WRX/698993255/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698993255>
2026-03-28 14:04:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 23a84f7f-6f75-5068-8bce-edfabdbfdb32 with identifier: LR53%20YBK
2026-03-28 14:04:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 23a84f7f-6f75-5068-8bce-edfabdbfdb32 with identifier: LR53%20YBK
2026-03-28 14:04:34 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 23a84f7f-6f75-5068-8bce-edfabdbfdb32 with identifier: LR53%20YBK to the API
2026-03-28 14:04:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:04:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:04:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=7&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 231,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=LR53%20YBK-GB',
'category': 'Car',
'color': 'blue',
'currency': 'GBP',
'doors_number': 5,
'engine': '2.4L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol',
'id': '23a84f7f-6f75-5068-8bce-edfabdbfdb32',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'LR53 YBK',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=LR53%20YBK&vehicleType=*',
'listing': 'auction',
'location': 'Paddock Wood',
'make': 'VOLVO',
'model': 'V70',
'odometer': 119800,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2003-01-01',
'seller_name': None,
'title': 'VOLVO V70 2.4 140 SE Estate',
'transmission': 'automatic',
'trim': '140 SE',
'vin': 'YV1SW65S942390236',
'year': 2003}
2026-03-28 14:04:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LR53%2520YBK%27 HTTP/1.1" 200 None
2026-03-28 14:04:34 [bca.uk] INFO: Saving data for LR53%20YBK: {'auction_closing_time': 1774864800.0, 'created_time': 1774102204.432441, 'last_price_update_time': 1774706674.401405}
2026-03-28 14:04:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='LR53%2520YBK') HTTP/1.1" 204 0
2026-03-28 14:04:34 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:04:34 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:04:34 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:04:34 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:04:34 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:04:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:04:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2eb11390>
2026-03-28 14:04:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:04:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:04:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:04:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8413221f-7948-5093-9030-c87150f157c7/8413221f-7948-5093-9030-c87150f157c7_image_8.jpg HTTP/1.1" 201 0
2026-03-28 14:04:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FWJ58DWA%252F697410373%252F600') HTTP/1.1" 204 0
2026-03-28 14:04:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WJ58DWA/697410373/600 saved to cache
2026-03-28 14:04:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 8413221f-7948-5093-9030-c87150f157c7
2026-03-28 14:04:34 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:04:34 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:04:34 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:04:34 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:04:34 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:04:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:04:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2ca35890>
2026-03-28 14:04:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:04:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:04:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:04:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8f3e30a4-6b64-5dd1-8e1e-6cce5d49fef3/8f3e30a4-6b64-5dd1-8e1e-6cce5d49fef3_image_9.jpg HTTP/1.1" 201 0
2026-03-28 14:04:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FPXZ1595%252F698814256%252F600') HTTP/1.1" 204 0
2026-03-28 14:04:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PXZ1595/698814256/600 saved to cache
2026-03-28 14:04:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 8f3e30a4-6b64-5dd1-8e1e-6cce5d49fef3
2026-03-28 14:04:34 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:04:34 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:04:34 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:04:34 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:04:34 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:04:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:04:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c7d9250>
2026-03-28 14:04:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:04:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:04:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:04:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ca2c3006-0503-55ad-a26d-88f328a541b5/ca2c3006-0503-55ad-a26d-88f328a541b5_image_9.jpg HTTP/1.1" 201 0
2026-03-28 14:04:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FBT66DFX%252F698129740%252F600') HTTP/1.1" 204 0
2026-03-28 14:04:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BT66DFX/698129740/600 saved to cache
2026-03-28 14:04:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item ca2c3006-0503-55ad-a26d-88f328a541b5
2026-03-28 14:04:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HV69NLA/698729689/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/HV69NLA/42810551?sv=2020-08-04&st=2026-03-28T14%3A04%3A08Z&se=2026-03-28T14%3A29%3A08Z&sr=b&sp=r&sig=sCJK6ApeU%2FoHZHPsXN72GO3cagNVfUluR%2FbC%2B%2BOeYM4%3D)
2026-03-28 14:04:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LD16UKX/699001725/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LD16UKX/42809855?sv=2020-08-04&st=2026-03-28T14%3A04%3A07Z&se=2026-03-28T14%3A29%3A07Z&sr=b&sp=r&sig=CHOiwblSOmf2jh7w7FrmkfA8BVi7dwLavRkRtCs3kTQ%3D)
2026-03-28 14:04:34 [bca.uk] INFO: Found listing with ID: LV10%20WSE
2026-03-28 14:04:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LV10%2520WSE%27 HTTP/1.1" 200 None
2026-03-28 14:04:34 [bca.uk] INFO: Scrape type for LV10%20WSE: 2
2026-03-28 14:04:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c660028d-42ff-5d02-ac8c-6972bb90ee4f with identifier: LV10%20WSE
2026-03-28 14:04:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c660028d-42ff-5d02-ac8c-6972bb90ee4f with scrape type 2
2026-03-28 14:04:34 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c660028d-42ff-5d02-ac8c-6972bb90ee4f with scrape type 2
2026-03-28 14:04:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: c660028d-42ff-5d02-ac8c-6972bb90ee4f, identifier: LV10%20WSE
2026-03-28 14:04:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: c660028d-42ff-5d02-ac8c-6972bb90ee4f with identifier: LV10%20WSE
2026-03-28 14:04:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: c660028d-42ff-5d02-ac8c-6972bb90ee4f with identifier: LV10%20WSE
2026-03-28 14:04:34 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: c660028d-42ff-5d02-ac8c-6972bb90ee4f with identifier: LV10%20WSE to the API
2026-03-28 14:04:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:04:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:04:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=7&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 159,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=LV10%20WSE-GB',
'category': 'Car',
'color': 'red',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.6L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol',
'id': 'c660028d-42ff-5d02-ac8c-6972bb90ee4f',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'LV10 WSE',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=LV10%20WSE&vehicleType=*',
'listing': 'auction',
'location': 'Paddock Wood',
'make': 'NISSAN',
'model': 'NOTE',
'odometer': 103405,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2010-01-01',
'seller_name': None,
'title': 'NISSAN NOTE 1.6 N-TEC Hatchback',
'transmission': 'automatic',
'trim': 'N-TEC',
'vin': 'SJNFCAE11U2072446',
'year': 2010}
2026-03-28 14:04:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LV10%2520WSE%27 HTTP/1.1" 200 None
2026-03-28 14:04:34 [bca.uk] INFO: Saving data for LV10%20WSE: {'auction_closing_time': 1774864800.0, 'created_time': 1774523538.97837, 'last_price_update_time': 1774706674.968309}
2026-03-28 14:04:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='LV10%2520WSE') HTTP/1.1" 204 0
2026-03-28 14:04:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:04:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2d69e1d0>
2026-03-28 14:04:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:04:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:04:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:04:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_eadb8ebe-5b0a-5541-a2d1-caa5b9148e41/eadb8ebe-5b0a-5541-a2d1-caa5b9148e41_image_2.jpg HTTP/1.1" 201 0
2026-03-28 14:04:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FHV69NLA%252F698729640%252F600') HTTP/1.1" 204 0
2026-03-28 14:04:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HV69NLA/698729640/600 saved to cache
2026-03-28 14:04:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item eadb8ebe-5b0a-5541-a2d1-caa5b9148e41
2026-03-28 14:04:35 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HV08XHP/698708117/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698708117>
2026-03-28 14:04:35 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HV08XHP/698708079/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698708079>
2026-03-28 14:04:35 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HV69NLA/698729751/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698729751>
2026-03-28 14:04:35 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HV08XHP/698708152/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698708152>
2026-03-28 14:04:35 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FE12WRX/698993276/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698993276>
2026-03-28 14:04:35 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FE12WRX/698993267/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698993267>
2026-03-28 14:04:35 [bca.uk] INFO: Found listing with ID: PHZ%206637
2026-03-28 14:04:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27PHZ%25206637%27 HTTP/1.1" 200 None
2026-03-28 14:04:35 [bca.uk] INFO: Scrape type for PHZ%206637: 2
2026-03-28 14:04:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 78383262-d56b-508f-a65d-57736f3625af with identifier: PHZ%206637
2026-03-28 14:04:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 78383262-d56b-508f-a65d-57736f3625af with scrape type 2
2026-03-28 14:04:35 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 78383262-d56b-508f-a65d-57736f3625af with scrape type 2
2026-03-28 14:04:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 78383262-d56b-508f-a65d-57736f3625af, identifier: PHZ%206637
2026-03-28 14:04:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 78383262-d56b-508f-a65d-57736f3625af with identifier: PHZ%206637
2026-03-28 14:04:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 78383262-d56b-508f-a65d-57736f3625af with identifier: PHZ%206637
2026-03-28 14:04:35 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 78383262-d56b-508f-a65d-57736f3625af with identifier: PHZ%206637 to the API
2026-03-28 14:04:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:04:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:04:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=7&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 159,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=PHZ%206637-GB',
'category': 'Car',
'color': 'grey',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.6L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol',
'id': '78383262-d56b-508f-a65d-57736f3625af',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'PHZ 6637',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=PHZ%206637&vehicleType=*',
'listing': 'auction',
'location': 'Paddock Wood',
'make': 'NISSAN',
'model': 'NOTE',
'odometer': 110105,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2013-01-01',
'seller_name': None,
'title': 'NISSAN NOTE 1.6 N-TEC+ Hatchback',
'transmission': 'automatic',
'trim': 'N-TEC+',
'vin': 'SJNFCAE11U2196633',
'year': 2013}
2026-03-28 14:04:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27PHZ%25206637%27 HTTP/1.1" 200 None
2026-03-28 14:04:35 [bca.uk] INFO: Saving data for PHZ%206637: {'auction_closing_time': 1774864800.0, 'created_time': 1774303402.472778, 'last_price_update_time': 1774706675.569263}
2026-03-28 14:04:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='PHZ%25206637') HTTP/1.1" 204 0
2026-03-28 14:04:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FE12WRX/698993255/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/FE12WRX/42809715?sv=2020-08-04&st=2026-03-28T14%3A04%3A08Z&se=2026-03-28T14%3A29%3A08Z&sr=b&sp=r&sig=IhVxQK0SibgR8nCtLOUZrswprKTYcjKJBEdadhY0N3I%3D)
2026-03-28 14:04:35 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LD16UKX/699001753/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699001753>
2026-03-28 14:04:35 [bca.uk] INFO: Found listing with ID: VN09%20WSO
2026-03-28 14:04:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27VN09%2520WSO%27 HTTP/1.1" 200 None
2026-03-28 14:04:35 [bca.uk] INFO: Scrape type for VN09%20WSO: 0
2026-03-28 14:04:35 [bca.uk] INFO: Found listing with ID: KS04%20HEJ
2026-03-28 14:04:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KS04%2520HEJ%27 HTTP/1.1" 200 None
2026-03-28 14:04:35 [bca.uk] INFO: Scrape type for KS04%20HEJ: 2
2026-03-28 14:04:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 99bd7022-695f-552c-96c3-2c4518496ce1 with identifier: KS04%20HEJ
2026-03-28 14:04:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 99bd7022-695f-552c-96c3-2c4518496ce1 with scrape type 2
2026-03-28 14:04:35 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 99bd7022-695f-552c-96c3-2c4518496ce1 with scrape type 2
2026-03-28 14:04:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 99bd7022-695f-552c-96c3-2c4518496ce1, identifier: KS04%20HEJ
2026-03-28 14:04:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.bca.co.uk/api/search?q=&pageSize=100&page=8&sort=MostRecentlyAdded> (referer: https://www.bca.co.uk/search) ['zyte-api']
2026-03-28 14:04:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:04:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c9c4710>
2026-03-28 14:04:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:04:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:04:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:04:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a3ad7a0d-b4c8-5ced-b470-27d0e0c9322f/a3ad7a0d-b4c8-5ced-b470-27d0e0c9322f_image_3.jpg HTTP/1.1" 201 0
2026-03-28 14:04:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FFE12WRX%252F698993234%252F600') HTTP/1.1" 204 0
2026-03-28 14:04:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FE12WRX/698993234/600 saved to cache
2026-03-28 14:04:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item a3ad7a0d-b4c8-5ced-b470-27d0e0c9322f
2026-03-28 14:04:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:04:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2de3e890>
2026-03-28 14:04:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:04:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:04:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:04:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cdaa9411-8148-5f71-bb89-a031dafbf539/cdaa9411-8148-5f71-bb89-a031dafbf539_image_3.jpg HTTP/1.1" 201 0
2026-03-28 14:04:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FHV08XHP%252F698707976%252F600') HTTP/1.1" 204 0
2026-03-28 14:04:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HV08XHP/698707976/600 saved to cache
2026-03-28 14:04:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item cdaa9411-8148-5f71-bb89-a031dafbf539
2026-03-28 14:04:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:04:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2d742110>
2026-03-28 14:04:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:04:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:04:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:04:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_eadb8ebe-5b0a-5541-a2d1-caa5b9148e41/eadb8ebe-5b0a-5541-a2d1-caa5b9148e41_image_3.jpg HTTP/1.1" 201 0
2026-03-28 14:04:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FHV69NLA%252F698729657%252F600') HTTP/1.1" 204 0
2026-03-28 14:04:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HV69NLA/698729657/600 saved to cache
2026-03-28 14:04:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item eadb8ebe-5b0a-5541-a2d1-caa5b9148e41
2026-03-28 14:04:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:04:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2de3fed0>
2026-03-28 14:04:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:04:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:04:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:04:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_eadb8ebe-5b0a-5541-a2d1-caa5b9148e41/eadb8ebe-5b0a-5541-a2d1-caa5b9148e41_image_5.jpg HTTP/1.1" 201 0
2026-03-28 14:04:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FHV69NLA%252F698729689%252F600') HTTP/1.1" 204 0
2026-03-28 14:04:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HV69NLA/698729689/600 saved to cache
2026-03-28 14:04:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item eadb8ebe-5b0a-5541-a2d1-caa5b9148e41
2026-03-28 14:04:35 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:04:35 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:04:35 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:04:35 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:04:35 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:04:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:04:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c18df10>
2026-03-28 14:04:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:04:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:04:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:04:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_826679c4-b83f-5ad2-b8a7-2183b5f0a082/826679c4-b83f-5ad2-b8a7-2183b5f0a082_image_6.jpg HTTP/1.1" 201 0
2026-03-28 14:04:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLD16UKX%252F699001725%252F600') HTTP/1.1" 204 0
2026-03-28 14:04:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LD16UKX/699001725/600 saved to cache
2026-03-28 14:04:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 826679c4-b83f-5ad2-b8a7-2183b5f0a082
2026-03-28 14:04:35 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FE12WRX/698993287/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698993287>
2026-03-28 14:04:35 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FE12WRX/698993245/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698993245>
2026-03-28 14:04:35 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HV69NLA/698729767/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698729767>
2026-03-28 14:04:35 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HV08XHP/698708185/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698708185>
2026-03-28 14:04:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 99bd7022-695f-552c-96c3-2c4518496ce1 with identifier: KS04%20HEJ
2026-03-28 14:04:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 99bd7022-695f-552c-96c3-2c4518496ce1 with identifier: KS04%20HEJ
2026-03-28 14:04:36 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 99bd7022-695f-552c-96c3-2c4518496ce1 with identifier: KS04%20HEJ to the API
2026-03-28 14:04:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:04:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:04:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=7&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 195,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=KS04%20HEJ-GB',
'category': 'Car',
'color': 'silver',
'currency': 'GBP',
'doors_number': 4,
'engine': '1.8L',
'expiration_date': '2026-03-29T10:00:00Z',
'fuel_type': 'Petrol',
'id': '99bd7022-695f-552c-96c3-2c4518496ce1',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'KS04 HEJ',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=KS04%20HEJ&vehicleType=*',
'listing': 'auction',
'location': 'Paddock Wood',
'make': 'MERCEDES-BENZ',
'model': 'C180',
'odometer': 88828,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2004-01-01',
'seller_name': None,
'title': 'MERCEDES-BENZ C180 1.8 K CLASSIC SE Saloon',
'transmission': 'manual',
'trim': 'K CLASSIC SE',
'vin': 'WDC2030462R143408',
'year': 2004}
2026-03-28 14:04:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KS04%2520HEJ%27 HTTP/1.1" 200 None
2026-03-28 14:04:36 [bca.uk] INFO: Saving data for KS04%20HEJ: {'auction_closing_time': 1774778400.0, 'created_time': 1773824498.796855, 'last_price_update_time': 1774706676.295654}
2026-03-28 14:04:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='KS04%2520HEJ') HTTP/1.1" 204 0
2026-03-28 14:04:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HV69NLA/698729733/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/HV69NLA/42810551?sv=2020-08-04&st=2026-03-28T14%3A04%3A08Z&se=2026-03-28T14%3A29%3A08Z&sr=b&sp=r&sig=sCJK6ApeU%2FoHZHPsXN72GO3cagNVfUluR%2FbC%2B%2BOeYM4%3D)
2026-03-28 14:04:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HV69NLA/698729714/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/HV69NLA/42810551?sv=2020-08-04&st=2026-03-28T14%3A04%3A08Z&se=2026-03-28T14%3A29%3A08Z&sr=b&sp=r&sig=sCJK6ApeU%2FoHZHPsXN72GO3cagNVfUluR%2FbC%2B%2BOeYM4%3D)
2026-03-28 14:04:36 [bca.uk] INFO: Found listing with ID: LA08%20VDT
2026-03-28 14:04:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LA08%2520VDT%27 HTTP/1.1" 200 None
2026-03-28 14:04:36 [bca.uk] INFO: Scrape type for LA08%20VDT: 0
2026-03-28 14:04:36 [bca.uk] INFO: Found listing with ID: KX18%20YOG
2026-03-28 14:04:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KX18%2520YOG%27 HTTP/1.1" 200 None
2026-03-28 14:04:36 [bca.uk] INFO: Scrape type for KX18%20YOG: 0
2026-03-28 14:04:36 [bca.uk] INFO: Found listing with ID: BF19%20GGJ
2026-03-28 14:04:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BF19%2520GGJ%27 HTTP/1.1" 200 None
2026-03-28 14:04:36 [bca.uk] INFO: Scrape type for BF19%20GGJ: 0
2026-03-28 14:04:36 [bca.uk] INFO: Found listing with ID: LP69%20AYT
2026-03-28 14:04:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LP69%2520AYT%27 HTTP/1.1" 200 None
2026-03-28 14:04:36 [bca.uk] INFO: Scrape type for LP69%20AYT: 0
2026-03-28 14:04:36 [bca.uk] INFO: Found listing with ID: VK21%20OFN
2026-03-28 14:04:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27VK21%2520OFN%27 HTTP/1.1" 200 None
2026-03-28 14:04:36 [bca.uk] INFO: Scrape type for VK21%20OFN: 0
2026-03-28 14:04:36 [bca.uk] INFO: Found listing with ID: FL18%20SXT
2026-03-28 14:04:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FL18%2520SXT%27 HTTP/1.1" 200 None
2026-03-28 14:04:36 [bca.uk] INFO: Scrape type for FL18%20SXT: 0
2026-03-28 14:04:36 [bca.uk] INFO: Found listing with ID: SR68%20WGP
2026-03-28 14:04:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SR68%2520WGP%27 HTTP/1.1" 200 None
2026-03-28 14:04:36 [bca.uk] INFO: Scrape type for SR68%20WGP: 0
2026-03-28 14:04:36 [bca.uk] INFO: Found listing with ID: GU22%20LDF
2026-03-28 14:04:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GU22%2520LDF%27 HTTP/1.1" 200 None
2026-03-28 14:04:36 [bca.uk] INFO: Scrape type for GU22%20LDF: 0
2026-03-28 14:04:36 [bca.uk] INFO: Found listing with ID: RV69%20YEC
2026-03-28 14:04:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27RV69%2520YEC%27 HTTP/1.1" 200 None
2026-03-28 14:04:36 [bca.uk] INFO: Scrape type for RV69%20YEC: 0
2026-03-28 14:04:36 [bca.uk] INFO: Found listing with ID: CT15%20CRJ
2026-03-28 14:04:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27CT15%2520CRJ%27 HTTP/1.1" 200 None
2026-03-28 14:04:36 [bca.uk] INFO: Scrape type for CT15%20CRJ: 0
2026-03-28 14:04:36 [bca.uk] INFO: Found listing with ID: GN64%20WLF
2026-03-28 14:04:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GN64%2520WLF%27 HTTP/1.1" 200 None
2026-03-28 14:04:36 [bca.uk] INFO: Scrape type for GN64%20WLF: 0
2026-03-28 14:04:36 [bca.uk] INFO: Found listing with ID: KR67%20KTX
2026-03-28 14:04:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KR67%2520KTX%27 HTTP/1.1" 200 None
2026-03-28 14:04:36 [bca.uk] INFO: Scrape type for KR67%20KTX: 0
2026-03-28 14:04:36 [bca.uk] INFO: Found listing with ID: LG62%20CVX
2026-03-28 14:04:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LG62%2520CVX%27 HTTP/1.1" 200 None
2026-03-28 14:04:36 [bca.uk] INFO: Scrape type for LG62%20CVX: 0
2026-03-28 14:04:36 [bca.uk] INFO: Found listing with ID: EK63%20FJV
2026-03-28 14:04:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27EK63%2520FJV%27 HTTP/1.1" 200 None
2026-03-28 14:04:36 [bca.uk] INFO: Scrape type for EK63%20FJV: 0
2026-03-28 14:04:36 [bca.uk] INFO: Found listing with ID: KN57%20WVA
2026-03-28 14:04:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KN57%2520WVA%27 HTTP/1.1" 200 None
2026-03-28 14:04:36 [bca.uk] INFO: Scrape type for KN57%20WVA: 0
2026-03-28 14:04:36 [bca.uk] INFO: Found listing with ID: W838%20AJN
2026-03-28 14:04:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27W838%2520AJN%27 HTTP/1.1" 200 None
2026-03-28 14:04:36 [bca.uk] INFO: Scrape type for W838%20AJN: 0
2026-03-28 14:04:36 [bca.uk] INFO: Found listing with ID: HK14%20OFV
2026-03-28 14:04:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27HK14%2520OFV%27 HTTP/1.1" 200 None
2026-03-28 14:04:36 [bca.uk] INFO: Scrape type for HK14%20OFV: 0
2026-03-28 14:04:36 [bca.uk] INFO: Found listing with ID: MP65%20HBK
2026-03-28 14:04:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MP65%2520HBK%27 HTTP/1.1" 200 None
2026-03-28 14:04:36 [bca.uk] INFO: Scrape type for MP65%20HBK: 2
2026-03-28 14:04:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7dfeefb8-d7d5-578d-bfda-b2ccece77879 with identifier: MP65%20HBK
2026-03-28 14:04:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7dfeefb8-d7d5-578d-bfda-b2ccece77879 with scrape type 2
2026-03-28 14:04:36 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7dfeefb8-d7d5-578d-bfda-b2ccece77879 with scrape type 2
2026-03-28 14:04:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 7dfeefb8-d7d5-578d-bfda-b2ccece77879, identifier: MP65%20HBK
2026-03-28 14:04:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FE12WRX/698993267/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/FE12WRX/42809715?sv=2020-08-04&st=2026-03-28T14%3A04%3A08Z&se=2026-03-28T14%3A29%3A08Z&sr=b&sp=r&sig=IhVxQK0SibgR8nCtLOUZrswprKTYcjKJBEdadhY0N3I%3D)
2026-03-28 14:04:36 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HV08XHP/698708031/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698708031>
2026-03-28 14:04:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 7dfeefb8-d7d5-578d-bfda-b2ccece77879 with identifier: MP65%20HBK
2026-03-28 14:04:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 7dfeefb8-d7d5-578d-bfda-b2ccece77879 with identifier: MP65%20HBK
2026-03-28 14:04:36 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 7dfeefb8-d7d5-578d-bfda-b2ccece77879 with identifier: MP65%20HBK to the API
2026-03-28 14:04:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:04:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:04:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=7&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 108,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=MP65%20HBK-GB',
'category': 'Car',
'color': 'white',
'currency': 'GBP',
'doors_number': 5,
'engine': '2.1L',
'expiration_date': '2026-03-29T10:00:00Z',
'fuel_type': 'Diesel',
'id': '7dfeefb8-d7d5-578d-bfda-b2ccece77879',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'MP65 HBK',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=MP65%20HBK&vehicleType=*',
'listing': 'auction',
'location': 'Paddock Wood',
'make': 'MERCEDES-BENZ',
'model': 'C220 D',
'odometer': 83088,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-01-01',
'seller_name': None,
'title': 'MERCEDES-BENZ C220 D 2.1 SE EXECUTIVE Estate',
'transmission': 'manual',
'trim': 'SE EXECUTIVE',
'vin': 'WDD2052042F330855',
'year': 2016}
2026-03-28 14:04:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MP65%2520HBK%27 HTTP/1.1" 200 None
2026-03-28 14:04:37 [bca.uk] INFO: Saving data for MP65%20HBK: {'auction_closing_time': 1774778400.0, 'created_time': 1774390962.455067, 'last_price_update_time': 1774706677.336275}
2026-03-28 14:04:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='MP65%2520HBK') HTTP/1.1" 204 0
2026-03-28 14:04:37 [bca.uk] INFO: Found listing with ID: RO16%20OZH
2026-03-28 14:04:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27RO16%2520OZH%27 HTTP/1.1" 200 None
2026-03-28 14:04:37 [bca.uk] INFO: Scrape type for RO16%20OZH: 0
2026-03-28 14:04:37 [bca.uk] INFO: Found listing with ID: SW15%20MJE
2026-03-28 14:04:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SW15%2520MJE%27 HTTP/1.1" 200 None
2026-03-28 14:04:37 [bca.uk] INFO: Scrape type for SW15%20MJE: 0
2026-03-28 14:04:37 [bca.uk] INFO: Found listing with ID: EU64%20XKO
2026-03-28 14:04:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27EU64%2520XKO%27 HTTP/1.1" 200 None
2026-03-28 14:04:37 [bca.uk] INFO: Scrape type for EU64%20XKO: 2
2026-03-28 14:04:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c581e762-b664-5d4e-a53f-b0f6aee181a0 with identifier: EU64%20XKO
2026-03-28 14:04:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c581e762-b664-5d4e-a53f-b0f6aee181a0 with scrape type 2
2026-03-28 14:04:37 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c581e762-b664-5d4e-a53f-b0f6aee181a0 with scrape type 2
2026-03-28 14:04:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: c581e762-b664-5d4e-a53f-b0f6aee181a0, identifier: EU64%20XKO
2026-03-28 14:04:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: c581e762-b664-5d4e-a53f-b0f6aee181a0 with identifier: EU64%20XKO
2026-03-28 14:04:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: c581e762-b664-5d4e-a53f-b0f6aee181a0 with identifier: EU64%20XKO
2026-03-28 14:04:37 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: c581e762-b664-5d4e-a53f-b0f6aee181a0 with identifier: EU64%20XKO to the API
2026-03-28 14:04:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:04:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:04:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=7&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 139,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=EU64%20XKO-GB',
'category': 'Car',
'color': 'black',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.7L',
'expiration_date': '2026-03-29T10:00:00Z',
'fuel_type': 'Diesel',
'id': 'c581e762-b664-5d4e-a53f-b0f6aee181a0',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'EU64 XKO',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=EU64%20XKO&vehicleType=*',
'listing': 'auction',
'location': 'Paddock Wood',
'make': 'HYUNDAI',
'model': 'IX35',
'odometer': 115584,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2014-01-01',
'seller_name': None,
'title': 'HYUNDAI IX35 1.7 CRDI S 2WD StationWagon',
'transmission': 'manual',
'trim': 'CRDI S 2WD',
'vin': 'TMAJT81ULFJ635603',
'year': 2014}
2026-03-28 14:04:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27EU64%2520XKO%27 HTTP/1.1" 200 None
2026-03-28 14:04:37 [bca.uk] INFO: Saving data for EU64%20XKO: {'auction_closing_time': 1774778400.0, 'created_time': 1774476325.573911, 'last_price_update_time': 1774706677.982504}
2026-03-28 14:04:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='EU64%2520XKO') HTTP/1.1" 204 0
2026-03-28 14:04:38 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:04:38 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:04:38 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:04:38 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:04:38 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:04:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:04:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c6ad350>
2026-03-28 14:04:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:04:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:04:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:04:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a3ad7a0d-b4c8-5ced-b470-27d0e0c9322f/a3ad7a0d-b4c8-5ced-b470-27d0e0c9322f_image_6.jpg HTTP/1.1" 201 0
2026-03-28 14:04:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FFE12WRX%252F698993255%252F600') HTTP/1.1" 204 0
2026-03-28 14:04:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FE12WRX/698993255/600 saved to cache
2026-03-28 14:04:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item a3ad7a0d-b4c8-5ced-b470-27d0e0c9322f
2026-03-28 14:04:38 [bca.uk] INFO: Total items found: 100
2026-03-28 14:04:38 [bca.uk] INFO: Requesting URL: https://www.bca.co.uk/api/search?q=&pageSize=100&page=9&sort=MostRecentlyAdded
2026-03-28 14:04:38 [bca.uk] INFO: Sending search API request with Bearer token (length=1492)
2026-03-28 14:04:38 [scrapy_zyte_api._params] WARNING: Request <GET https://www.bca.co.uk/api/search?q=&pageSize=100&page=9&sort=MostRecentlyAdded> defines the Zyte API customHttpRequestHeaders parameter, overriding Request.headers. Use Request.headers instead.
2026-03-28 14:04:38 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:04:38 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:04:38 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:04:38 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:04:38 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:04:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:04:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2ca36a50>
2026-03-28 14:04:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:04:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:04:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:04:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_eadb8ebe-5b0a-5541-a2d1-caa5b9148e41/eadb8ebe-5b0a-5541-a2d1-caa5b9148e41_image_7.jpg HTTP/1.1" 201 0
2026-03-28 14:04:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FHV69NLA%252F698729733%252F600') HTTP/1.1" 204 0
2026-03-28 14:04:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HV69NLA/698729733/600 saved to cache
2026-03-28 14:04:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item eadb8ebe-5b0a-5541-a2d1-caa5b9148e41
2026-03-28 14:04:38 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:04:38 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:04:38 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:04:38 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:04:38 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:04:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:04:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a1fec9590>
2026-03-28 14:04:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:04:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:04:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:04:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_eadb8ebe-5b0a-5541-a2d1-caa5b9148e41/eadb8ebe-5b0a-5541-a2d1-caa5b9148e41_image_6.jpg HTTP/1.1" 201 0
2026-03-28 14:04:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FHV69NLA%252F698729714%252F600') HTTP/1.1" 204 0
2026-03-28 14:04:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HV69NLA/698729714/600 saved to cache
2026-03-28 14:04:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item eadb8ebe-5b0a-5541-a2d1-caa5b9148e41
2026-03-28 14:04:38 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LD16UKX/699001742/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699001742>
2026-03-28 14:04:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HV08XHP/698708185/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/HV08XHP/42810135?sv=2020-08-04&st=2026-03-28T14%3A04%3A07Z&se=2026-03-28T14%3A29%3A07Z&sr=b&sp=r&sig=nDBJaQ0d1Lnn1Q%2BoiL0EJlYO6HO0nKvJULaa1yflDpY%3D)
2026-03-28 14:04:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HV69NLA/698729751/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/HV69NLA/42810551?sv=2020-08-04&st=2026-03-28T14%3A04%3A08Z&se=2026-03-28T14%3A29%3A08Z&sr=b&sp=r&sig=sCJK6ApeU%2FoHZHPsXN72GO3cagNVfUluR%2FbC%2B%2BOeYM4%3D)
2026-03-28 14:04:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LD16UKX/699001753/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LD16UKX/42809855?sv=2020-08-04&st=2026-03-28T14%3A04%3A07Z&se=2026-03-28T14%3A29%3A07Z&sr=b&sp=r&sig=CHOiwblSOmf2jh7w7FrmkfA8BVi7dwLavRkRtCs3kTQ%3D)
2026-03-28 14:04:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FE12WRX/698993276/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/FE12WRX/42809715?sv=2020-08-04&st=2026-03-28T14%3A04%3A08Z&se=2026-03-28T14%3A29%3A08Z&sr=b&sp=r&sig=IhVxQK0SibgR8nCtLOUZrswprKTYcjKJBEdadhY0N3I%3D)
2026-03-28 14:04:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HV08XHP/698708152/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/HV08XHP/42810135?sv=2020-08-04&st=2026-03-28T14%3A04%3A07Z&se=2026-03-28T14%3A29%3A07Z&sr=b&sp=r&sig=nDBJaQ0d1Lnn1Q%2BoiL0EJlYO6HO0nKvJULaa1yflDpY%3D)
2026-03-28 14:04:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HV08XHP/698708117/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/HV08XHP/42810135?sv=2020-08-04&st=2026-03-28T14%3A04%3A07Z&se=2026-03-28T14%3A29%3A07Z&sr=b&sp=r&sig=nDBJaQ0d1Lnn1Q%2BoiL0EJlYO6HO0nKvJULaa1yflDpY%3D)
2026-03-28 14:04:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HV08XHP/698708079/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/HV08XHP/42810135?sv=2020-08-04&st=2026-03-28T14%3A04%3A07Z&se=2026-03-28T14%3A29%3A07Z&sr=b&sp=r&sig=nDBJaQ0d1Lnn1Q%2BoiL0EJlYO6HO0nKvJULaa1yflDpY%3D)
2026-03-28 14:04:38 [bca.uk] INFO: Found listing with ID: FX65%20YAO
2026-03-28 14:04:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FX65%2520YAO%27 HTTP/1.1" 200 None
2026-03-28 14:04:38 [bca.uk] INFO: Scrape type for FX65%20YAO: 0
2026-03-28 14:04:38 [bca.uk] INFO: Found listing with ID: GK17%20TWC
2026-03-28 14:04:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GK17%2520TWC%27 HTTP/1.1" 200 None
2026-03-28 14:04:38 [bca.uk] INFO: Scrape type for GK17%20TWC: 2
2026-03-28 14:04:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 53754fc8-d51a-5c66-9301-ab74777229f5 with identifier: GK17%20TWC
2026-03-28 14:04:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 53754fc8-d51a-5c66-9301-ab74777229f5 with scrape type 2
2026-03-28 14:04:38 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 53754fc8-d51a-5c66-9301-ab74777229f5 with scrape type 2
2026-03-28 14:04:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 53754fc8-d51a-5c66-9301-ab74777229f5, identifier: GK17%20TWC
2026-03-28 14:04:38 [scrapy_zyte_api._params] WARNING: Request <GET https://www.bca.co.uk/api/search?q=&pageSize=100&page=9&sort=MostRecentlyAdded> defines the Zyte API customHttpRequestHeaders parameter, overriding Request.headers. Use Request.headers instead.
2026-03-28 14:04:38 [scrapy_zyte_api._params] WARNING: Request <GET https://www.bca.co.uk/api/search?q=&pageSize=100&page=9&sort=MostRecentlyAdded> defines the Zyte API customHttpRequestHeaders parameter, overriding Request.headers. Use Request.headers instead.
2026-03-28 14:04:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 53754fc8-d51a-5c66-9301-ab74777229f5 with identifier: GK17%20TWC
2026-03-28 14:04:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 53754fc8-d51a-5c66-9301-ab74777229f5 with identifier: GK17%20TWC
2026-03-28 14:04:38 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 53754fc8-d51a-5c66-9301-ab74777229f5 with identifier: GK17%20TWC to the API
2026-03-28 14:04:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:04:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:04:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=7&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 134,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=GK17%20TWC-GB',
'category': 'Car',
'color': 'red',
'currency': 'GBP',
'doors_number': 5,
'engine': '2.0L',
'expiration_date': '2026-03-29T10:00:00Z',
'fuel_type': 'Diesel',
'id': '53754fc8-d51a-5c66-9301-ab74777229f5',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'GK17 TWC',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=GK17%20TWC&vehicleType=*',
'listing': 'auction',
'location': 'Paddock Wood',
'make': 'JAGUAR',
'model': 'F-PACE',
'odometer': 92344,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-01-01',
'seller_name': None,
'title': 'JAGUAR F-PACE 2.0 D 180 AWD PORTFOLIO StationWagon',
'transmission': 'manual',
'trim': 'D 180 AWD PORTFOLIO',
'vin': 'SADCA2CN2HA892047',
'year': 2017}
2026-03-28 14:04:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GK17%2520TWC%27 HTTP/1.1" 200 None
2026-03-28 14:04:38 [bca.uk] INFO: Saving data for GK17%20TWC: {'auction_closing_time': 1774778400.0, 'created_time': 1774390914.679002, 'last_price_update_time': 1774706678.640526}
2026-03-28 14:04:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='GK17%2520TWC') HTTP/1.1" 204 0
2026-03-28 14:04:38 [bca.uk] INFO: Found listing with ID: AE06%20HAU
2026-03-28 14:04:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27AE06%2520HAU%27 HTTP/1.1" 200 None
2026-03-28 14:04:38 [bca.uk] INFO: Scrape type for AE06%20HAU: 0
2026-03-28 14:04:38 [bca.uk] INFO: Found listing with ID: EA08%20SVO
2026-03-28 14:04:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27EA08%2520SVO%27 HTTP/1.1" 200 None
2026-03-28 14:04:38 [bca.uk] INFO: Scrape type for EA08%20SVO: 0
2026-03-28 14:04:38 [bca.uk] INFO: Found listing with ID: GU09%20BHP
2026-03-28 14:04:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GU09%2520BHP%27 HTTP/1.1" 200 None
2026-03-28 14:04:38 [bca.uk] INFO: Scrape type for GU09%20BHP: 0
2026-03-28 14:04:38 [bca.uk] INFO: Found listing with ID: SL07%20BVB
2026-03-28 14:04:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SL07%2520BVB%27 HTTP/1.1" 200 None
2026-03-28 14:04:38 [bca.uk] INFO: Scrape type for SL07%20BVB: 0
2026-03-28 14:04:38 [bca.uk] INFO: Found listing with ID: FG67%20NYZ
2026-03-28 14:04:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FG67%2520NYZ%27 HTTP/1.1" 200 None
2026-03-28 14:04:38 [bca.uk] INFO: Scrape type for FG67%20NYZ: 0
2026-03-28 14:04:38 [bca.uk] INFO: Found listing with ID: J22%20CDN
2026-03-28 14:04:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27J22%2520CDN%27 HTTP/1.1" 200 None
2026-03-28 14:04:38 [bca.uk] INFO: Scrape type for J22%20CDN: 2
2026-03-28 14:04:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b8eebd19-dbc9-5c5a-9094-21a11f9e6c87 with identifier: J22%20CDN
2026-03-28 14:04:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b8eebd19-dbc9-5c5a-9094-21a11f9e6c87 with scrape type 2
2026-03-28 14:04:38 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b8eebd19-dbc9-5c5a-9094-21a11f9e6c87 with scrape type 2
2026-03-28 14:04:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: b8eebd19-dbc9-5c5a-9094-21a11f9e6c87, identifier: J22%20CDN
2026-03-28 14:04:38 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 14:04:38 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:04:38 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:04:38 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:04:38 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:04:38 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:04:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:04:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2dd30150>
2026-03-28 14:04:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:04:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:04:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:04:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a3ad7a0d-b4c8-5ced-b470-27d0e0c9322f/a3ad7a0d-b4c8-5ced-b470-27d0e0c9322f_image_7.jpg HTTP/1.1" 201 0
2026-03-28 14:04:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FFE12WRX%252F698993267%252F600') HTTP/1.1" 204 0
2026-03-28 14:04:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FE12WRX/698993267/600 saved to cache
2026-03-28 14:04:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item a3ad7a0d-b4c8-5ced-b470-27d0e0c9322f
2026-03-28 14:04:38 [bca.uk] INFO: Found listing with ID: GV67%20PKE
2026-03-28 14:04:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GV67%2520PKE%27 HTTP/1.1" 200 None
2026-03-28 14:04:38 [bca.uk] INFO: Scrape type for GV67%20PKE: 0
2026-03-28 14:04:38 [bca.uk] INFO: Found listing with ID: GY65%20WJX
2026-03-28 14:04:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GY65%2520WJX%27 HTTP/1.1" 200 None
2026-03-28 14:04:38 [bca.uk] INFO: Scrape type for GY65%20WJX: 0
2026-03-28 14:04:38 [bca.uk] INFO: Found listing with ID: S20%20HNN
2026-03-28 14:04:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27S20%2520HNN%27 HTTP/1.1" 200 None
2026-03-28 14:04:38 [bca.uk] INFO: Scrape type for S20%20HNN: 2
2026-03-28 14:04:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 683d5783-6a2b-559f-8336-bd51af34d817 with identifier: S20%20HNN
2026-03-28 14:04:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 683d5783-6a2b-559f-8336-bd51af34d817 with scrape type 2
2026-03-28 14:04:38 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 683d5783-6a2b-559f-8336-bd51af34d817 with scrape type 2
2026-03-28 14:04:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 683d5783-6a2b-559f-8336-bd51af34d817, identifier: S20%20HNN
2026-03-28 14:04:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: b8eebd19-dbc9-5c5a-9094-21a11f9e6c87 with identifier: J22%20CDN
2026-03-28 14:04:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: b8eebd19-dbc9-5c5a-9094-21a11f9e6c87 with identifier: J22%20CDN
2026-03-28 14:04:39 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: b8eebd19-dbc9-5c5a-9094-21a11f9e6c87 with identifier: J22%20CDN to the API
2026-03-28 14:04:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:04:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:04:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=8&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 172,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=J22%20CDN-GB',
'category': 'Car',
'color': 'black',
'currency': 'GBP',
'doors_number': 5,
'engine': '2.0L',
'expiration_date': '2026-03-29T10:00:00Z',
'fuel_type': 'Petrol',
'id': 'b8eebd19-dbc9-5c5a-9094-21a11f9e6c87',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'J22 CDN',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=J22%20CDN&vehicleType=*',
'listing': 'auction',
'location': 'Nottingham',
'make': 'MERCEDES-BENZ',
'model': 'GLA45 AMG',
'odometer': 51118,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-01-01',
'seller_name': None,
'title': 'MERCEDES-BENZ GLA45 AMG 2.0 (381) 4MATIC DCT Hatchback',
'transmission': 'automatic',
'trim': '(381) 4MATIC DCT',
'vin': 'WDC1569522J315417',
'year': 2016}
2026-03-28 14:04:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27J22%2520CDN%27 HTTP/1.1" 200 None
2026-03-28 14:04:39 [bca.uk] INFO: Saving data for J22%20CDN: {'auction_closing_time': 1774778400.0, 'created_time': 1774365618.327777, 'last_price_update_time': 1774706679.512638}
2026-03-28 14:04:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='J22%2520CDN') HTTP/1.1" 204 0
2026-03-28 14:04:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 683d5783-6a2b-559f-8336-bd51af34d817 with identifier: S20%20HNN
2026-03-28 14:04:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 683d5783-6a2b-559f-8336-bd51af34d817 with identifier: S20%20HNN
2026-03-28 14:04:39 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 683d5783-6a2b-559f-8336-bd51af34d817 with identifier: S20%20HNN to the API
2026-03-28 14:04:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:04:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:04:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=7&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 185,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=S20%20HNN-GB',
'category': 'Car',
'color': 'red',
'currency': 'GBP',
'doors_number': 5,
'engine': '3.0L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Diesel',
'id': '683d5783-6a2b-559f-8336-bd51af34d817',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'S20 HNN',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=S20%20HNN&vehicleType=*',
'listing': 'auction',
'location': 'Paddock Wood',
'make': 'LAND ROVER',
'model': 'R/R SPORT',
'odometer': 105388,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-01-01',
'seller_name': None,
'title': 'LAND ROVER R/R SPORT 3.0 SDV6 306 A/B DYNAMIC (7ST) StationWagon',
'transmission': 'manual',
'trim': 'SDV6 306 A/B DYNAMIC (7ST)',
'vin': 'SALWA2KE4GA550715',
'year': 2015}
2026-03-28 14:04:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27S20%2520HNN%27 HTTP/1.1" 200 None
2026-03-28 14:04:40 [bca.uk] INFO: Saving data for S20%20HNN: {'auction_closing_time': 1774864800.0, 'created_time': 1774504930.005828, 'last_price_update_time': 1774706680.107761}
2026-03-28 14:04:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='S20%2520HNN') HTTP/1.1" 204 0
2026-03-28 14:04:40 [bca.uk] INFO: Found listing with ID: LD64%20UCP
2026-03-28 14:04:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LD64%2520UCP%27 HTTP/1.1" 200 None
2026-03-28 14:04:40 [bca.uk] INFO: Scrape type for LD64%20UCP: 0
2026-03-28 14:04:40 [bca.uk] INFO: Found listing with ID: MA14%20ZKB
2026-03-28 14:04:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MA14%2520ZKB%27 HTTP/1.1" 200 None
2026-03-28 14:04:40 [bca.uk] INFO: Scrape type for MA14%20ZKB: 0
2026-03-28 14:04:40 [bca.uk] INFO: Found listing with ID: MJ18%20VDO
2026-03-28 14:04:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MJ18%2520VDO%27 HTTP/1.1" 200 None
2026-03-28 14:04:40 [bca.uk] INFO: Scrape type for MJ18%20VDO: 0
2026-03-28 14:04:40 [bca.uk] INFO: Found listing with ID: AP15%20JHV
2026-03-28 14:04:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27AP15%2520JHV%27 HTTP/1.1" 200 None
2026-03-28 14:04:40 [bca.uk] INFO: Scrape type for AP15%20JHV: 0
2026-03-28 14:04:40 [bca.uk] INFO: Found listing with ID: BT16%20TPO
2026-03-28 14:04:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BT16%2520TPO%27 HTTP/1.1" 200 None
2026-03-28 14:04:40 [bca.uk] INFO: Scrape type for BT16%20TPO: 0
2026-03-28 14:04:40 [bca.uk] INFO: Found listing with ID: DA65%20YOO
2026-03-28 14:04:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DA65%2520YOO%27 HTTP/1.1" 200 None
2026-03-28 14:04:40 [bca.uk] INFO: Scrape type for DA65%20YOO: 0
2026-03-28 14:04:40 [bca.uk] INFO: Found listing with ID: EJ15%20LVF
2026-03-28 14:04:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27EJ15%2520LVF%27 HTTP/1.1" 200 None
2026-03-28 14:04:40 [bca.uk] INFO: Scrape type for EJ15%20LVF: 2
2026-03-28 14:04:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fe646fe6-f01e-5178-ac3e-7413a9f97e1c with identifier: EJ15%20LVF
2026-03-28 14:04:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fe646fe6-f01e-5178-ac3e-7413a9f97e1c with scrape type 2
2026-03-28 14:04:40 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item fe646fe6-f01e-5178-ac3e-7413a9f97e1c with scrape type 2
2026-03-28 14:04:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: fe646fe6-f01e-5178-ac3e-7413a9f97e1c, identifier: EJ15%20LVF
2026-03-28 14:04:40 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LD16UKX/699001734/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699001734>
2026-03-28 14:04:40 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HV08XHP/698708000/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698708000>
2026-03-28 14:04:40 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FE12WRX/698993239/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698993239>
2026-03-28 14:04:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HV08XHP/698708031/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/HV08XHP/42810135?sv=2020-08-04&st=2026-03-28T14%3A04%3A07Z&se=2026-03-28T14%3A29%3A07Z&sr=b&sp=r&sig=nDBJaQ0d1Lnn1Q%2BoiL0EJlYO6HO0nKvJULaa1yflDpY%3D)
2026-03-28 14:04:40 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HV69NLA/698729675/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698729675>
2026-03-28 14:04:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FE12WRX/698993245/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/FE12WRX/42809715?sv=2020-08-04&st=2026-03-28T14%3A04%3A08Z&se=2026-03-28T14%3A29%3A08Z&sr=b&sp=r&sig=IhVxQK0SibgR8nCtLOUZrswprKTYcjKJBEdadhY0N3I%3D)
2026-03-28 14:04:40 [bca.uk] INFO: Found listing with ID: FN64%20RAU
2026-03-28 14:04:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FN64%2520RAU%27 HTTP/1.1" 200 None
2026-03-28 14:04:40 [bca.uk] INFO: Scrape type for FN64%20RAU: 2
2026-03-28 14:04:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: afaeeb9b-3acc-5da6-99fb-8926c85708ce with identifier: FN64%20RAU
2026-03-28 14:04:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item afaeeb9b-3acc-5da6-99fb-8926c85708ce with scrape type 2
2026-03-28 14:04:40 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item afaeeb9b-3acc-5da6-99fb-8926c85708ce with scrape type 2
2026-03-28 14:04:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: afaeeb9b-3acc-5da6-99fb-8926c85708ce, identifier: FN64%20RAU
2026-03-28 14:04:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: fe646fe6-f01e-5178-ac3e-7413a9f97e1c with identifier: EJ15%20LVF
2026-03-28 14:04:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: fe646fe6-f01e-5178-ac3e-7413a9f97e1c with identifier: EJ15%20LVF
2026-03-28 14:04:40 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: fe646fe6-f01e-5178-ac3e-7413a9f97e1c with identifier: EJ15%20LVF to the API
2026-03-28 14:04:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:04:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:04:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=8&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 134,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=EJ15%20LVF-GB',
'category': 'Car',
'color': 'black',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.5L',
'expiration_date': '2026-03-29T10:00:00Z',
'fuel_type': 'Petrol',
'id': 'fe646fe6-f01e-5178-ac3e-7413a9f97e1c',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'EJ15 LVF',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=EJ15%20LVF&vehicleType=*',
'listing': 'auction',
'location': 'Nottingham',
'make': 'FORD',
'model': 'MONDEO',
'odometer': 77657,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-01-01',
'seller_name': None,
'title': 'FORD MONDEO 1.5 T E/B 160 TITANIUM Hatchback',
'transmission': 'manual',
'trim': 'T E/B 160 TITANIUM',
'vin': 'WF0EXXWPCEFE81977',
'year': 2015}
2026-03-28 14:04:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27EJ15%2520LVF%27 HTTP/1.1" 200 None
2026-03-28 14:04:40 [bca.uk] INFO: Saving data for EJ15%20LVF: {'auction_closing_time': 1774778400.0, 'created_time': 1774365642.674144, 'last_price_update_time': 1774706680.84977}
2026-03-28 14:04:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='EJ15%2520LVF') HTTP/1.1" 204 0
2026-03-28 14:04:40 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:04:40 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:04:40 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:04:40 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:04:40 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:04:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:04:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a1fd6f910>
2026-03-28 14:04:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:04:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:04:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:04:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cdaa9411-8148-5f71-bb89-a031dafbf539/cdaa9411-8148-5f71-bb89-a031dafbf539_image_9.jpg HTTP/1.1" 201 0
2026-03-28 14:04:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FHV08XHP%252F698708185%252F600') HTTP/1.1" 204 0
2026-03-28 14:04:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HV08XHP/698708185/600 saved to cache
2026-03-28 14:04:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item cdaa9411-8148-5f71-bb89-a031dafbf539
2026-03-28 14:04:40 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:04:40 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:04:40 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:04:40 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:04:40 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:04:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:04:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c973790>
2026-03-28 14:04:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:04:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:04:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:04:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_eadb8ebe-5b0a-5541-a2d1-caa5b9148e41/eadb8ebe-5b0a-5541-a2d1-caa5b9148e41_image_8.jpg HTTP/1.1" 201 0
2026-03-28 14:04:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FHV69NLA%252F698729751%252F600') HTTP/1.1" 204 0
2026-03-28 14:04:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HV69NLA/698729751/600 saved to cache
2026-03-28 14:04:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item eadb8ebe-5b0a-5541-a2d1-caa5b9148e41
2026-03-28 14:04:41 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:04:41 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:04:41 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:04:41 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:04:41 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:04:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:04:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c0f2b10>
2026-03-28 14:04:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:04:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:04:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:04:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_826679c4-b83f-5ad2-b8a7-2183b5f0a082/826679c4-b83f-5ad2-b8a7-2183b5f0a082_image_9.jpg HTTP/1.1" 201 0
2026-03-28 14:04:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLD16UKX%252F699001753%252F600') HTTP/1.1" 204 0
2026-03-28 14:04:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LD16UKX/699001753/600 saved to cache
2026-03-28 14:04:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 826679c4-b83f-5ad2-b8a7-2183b5f0a082
2026-03-28 14:04:41 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:04:41 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:04:41 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:04:41 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:04:41 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:04:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:04:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c749910>
2026-03-28 14:04:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:04:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:04:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:04:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a3ad7a0d-b4c8-5ced-b470-27d0e0c9322f/a3ad7a0d-b4c8-5ced-b470-27d0e0c9322f_image_8.jpg HTTP/1.1" 201 0
2026-03-28 14:04:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FFE12WRX%252F698993276%252F600') HTTP/1.1" 204 0
2026-03-28 14:04:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FE12WRX/698993276/600 saved to cache
2026-03-28 14:04:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item a3ad7a0d-b4c8-5ced-b470-27d0e0c9322f
2026-03-28 14:04:41 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:04:41 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:04:41 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:04:41 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:04:41 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:04:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:04:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2de0abd0>
2026-03-28 14:04:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:04:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:04:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:04:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cdaa9411-8148-5f71-bb89-a031dafbf539/cdaa9411-8148-5f71-bb89-a031dafbf539_image_8.jpg HTTP/1.1" 201 0
2026-03-28 14:04:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FHV08XHP%252F698708152%252F600') HTTP/1.1" 204 0
2026-03-28 14:04:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HV08XHP/698708152/600 saved to cache
2026-03-28 14:04:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item cdaa9411-8148-5f71-bb89-a031dafbf539
2026-03-28 14:04:41 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:04:41 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:04:41 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:04:41 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:04:41 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:04:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:04:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2dd7d750>
2026-03-28 14:04:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:04:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:04:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:04:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cdaa9411-8148-5f71-bb89-a031dafbf539/cdaa9411-8148-5f71-bb89-a031dafbf539_image_7.jpg HTTP/1.1" 201 0
2026-03-28 14:04:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FHV08XHP%252F698708117%252F600') HTTP/1.1" 204 0
2026-03-28 14:04:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HV08XHP/698708117/600 saved to cache
2026-03-28 14:04:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item cdaa9411-8148-5f71-bb89-a031dafbf539
2026-03-28 14:04:41 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:04:41 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:04:41 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:04:41 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:04:41 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:04:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:04:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c0f24d0>
2026-03-28 14:04:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:04:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:04:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:04:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cdaa9411-8148-5f71-bb89-a031dafbf539/cdaa9411-8148-5f71-bb89-a031dafbf539_image_6.jpg HTTP/1.1" 201 0
2026-03-28 14:04:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FHV08XHP%252F698708079%252F600') HTTP/1.1" 204 0
2026-03-28 14:04:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HV08XHP/698708079/600 saved to cache
2026-03-28 14:04:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item cdaa9411-8148-5f71-bb89-a031dafbf539
2026-03-28 14:04:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FE12WRX/698993287/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/FE12WRX/42809715?sv=2020-08-04&st=2026-03-28T14%3A04%3A08Z&se=2026-03-28T14%3A29%3A08Z&sr=b&sp=r&sig=IhVxQK0SibgR8nCtLOUZrswprKTYcjKJBEdadhY0N3I%3D)
2026-03-28 14:04:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HV69NLA/698729767/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/HV69NLA/42810551?sv=2020-08-04&st=2026-03-28T14%3A04%3A08Z&se=2026-03-28T14%3A29%3A08Z&sr=b&sp=r&sig=sCJK6ApeU%2FoHZHPsXN72GO3cagNVfUluR%2FbC%2B%2BOeYM4%3D)
2026-03-28 14:04:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: afaeeb9b-3acc-5da6-99fb-8926c85708ce with identifier: FN64%20RAU
2026-03-28 14:04:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: afaeeb9b-3acc-5da6-99fb-8926c85708ce with identifier: FN64%20RAU
2026-03-28 14:04:41 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: afaeeb9b-3acc-5da6-99fb-8926c85708ce with identifier: FN64%20RAU to the API
2026-03-28 14:04:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:04:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:04:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=7&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 139,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=FN64%20RAU-GB',
'category': 'Car',
'color': 'red',
'currency': 'GBP',
'doors_number': 5,
'engine': '2.2L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Diesel',
'id': 'afaeeb9b-3acc-5da6-99fb-8926c85708ce',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'FN64 RAU',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=FN64%20RAU&vehicleType=*',
'listing': 'auction',
'location': 'Paddock Wood',
'make': 'JAGUAR',
'model': 'XF SPORTBRAKE',
'odometer': 90320,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2014-01-01',
'seller_name': None,
'title': 'JAGUAR XF SPORTBRAKE 2.2 D 200 PREMIUM LUXURY Estate',
'transmission': 'automatic',
'trim': 'D 200 PREMIUM LUXURY',
'vin': 'SAJAC02K2FDU59639',
'year': 2014}
2026-03-28 14:04:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FN64%2520RAU%27 HTTP/1.1" 200 None
2026-03-28 14:04:41 [bca.uk] INFO: Saving data for FN64%20RAU: {'auction_closing_time': 1774864800.0, 'created_time': 1773907378.567844, 'last_price_update_time': 1774706681.937428}
2026-03-28 14:04:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='FN64%2520RAU') HTTP/1.1" 204 0
2026-03-28 14:04:41 [bca.uk] INFO: Found listing with ID: OV14%20UEZ
2026-03-28 14:04:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27OV14%2520UEZ%27 HTTP/1.1" 200 None
2026-03-28 14:04:41 [bca.uk] INFO: Scrape type for OV14%20UEZ: 2
2026-03-28 14:04:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 41943e51-d7ea-524e-a1bf-fc14c32e1279 with identifier: OV14%20UEZ
2026-03-28 14:04:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 41943e51-d7ea-524e-a1bf-fc14c32e1279 with scrape type 2
2026-03-28 14:04:41 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 41943e51-d7ea-524e-a1bf-fc14c32e1279 with scrape type 2
2026-03-28 14:04:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 41943e51-d7ea-524e-a1bf-fc14c32e1279, identifier: OV14%20UEZ
2026-03-28 14:04:42 [bca.uk] INFO: Found listing with ID: GL20%20MWO
2026-03-28 14:04:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GL20%2520MWO%27 HTTP/1.1" 200 None
2026-03-28 14:04:42 [bca.uk] INFO: Scrape type for GL20%20MWO: 2
2026-03-28 14:04:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2e0dd0a0-b6f8-5fa2-b4f5-e19cad0e9326 with identifier: GL20%20MWO
2026-03-28 14:04:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2e0dd0a0-b6f8-5fa2-b4f5-e19cad0e9326 with scrape type 2
2026-03-28 14:04:42 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2e0dd0a0-b6f8-5fa2-b4f5-e19cad0e9326 with scrape type 2
2026-03-28 14:04:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 2e0dd0a0-b6f8-5fa2-b4f5-e19cad0e9326, identifier: GL20%20MWO
2026-03-28 14:04:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 41943e51-d7ea-524e-a1bf-fc14c32e1279 with identifier: OV14%20UEZ
2026-03-28 14:04:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 41943e51-d7ea-524e-a1bf-fc14c32e1279 with identifier: OV14%20UEZ
2026-03-28 14:04:42 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 41943e51-d7ea-524e-a1bf-fc14c32e1279 with identifier: OV14%20UEZ to the API
2026-03-28 14:04:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:04:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:04:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=8&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 119,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=OV14%20UEZ-GB',
'category': 'Car',
'color': 'silver',
'currency': 'GBP',
'doors_number': 5,
'engine': '2.0L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Diesel',
'id': '41943e51-d7ea-524e-a1bf-fc14c32e1279',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'OV14 UEZ',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=OV14%20UEZ&vehicleType=*',
'listing': 'auction',
'location': 'Nottingham',
'make': 'AUDI',
'model': 'A3 SPORTBACK',
'odometer': 101580,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2014-01-01',
'seller_name': None,
'title': 'AUDI A3 SPORTBACK 2.0 TDI 150 SPORT S-T Hatchback',
'transmission': 'automatic',
'trim': 'TDI 150 SPORT S-T',
'vin': 'WAUZZZ8V0EA152148',
'year': 2014}
2026-03-28 14:04:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27OV14%2520UEZ%27 HTTP/1.1" 200 None
2026-03-28 14:04:42 [bca.uk] INFO: Saving data for OV14%20UEZ: {'auction_closing_time': 1774864800.0, 'created_time': 1774392248.670487, 'last_price_update_time': 1774706682.628579}
2026-03-28 14:04:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='OV14%2520UEZ') HTTP/1.1" 204 0
2026-03-28 14:04:42 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LD16UKX/699001710/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699001710>
2026-03-28 14:04:42 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HV08XHP/698707943/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698707943>
2026-03-28 14:04:42 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FE12WRX/698993222/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698993222>
2026-03-28 14:04:42 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LD16UKX/699001718/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699001718>
2026-03-28 14:04:42 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WJ58DWA/697410380/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=697410380>
2026-03-28 14:04:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 2e0dd0a0-b6f8-5fa2-b4f5-e19cad0e9326 with identifier: GL20%20MWO
2026-03-28 14:04:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 2e0dd0a0-b6f8-5fa2-b4f5-e19cad0e9326 with identifier: GL20%20MWO
2026-03-28 14:04:42 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 2e0dd0a0-b6f8-5fa2-b4f5-e19cad0e9326 with identifier: GL20%20MWO to the API
2026-03-28 14:04:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:04:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:04:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=7&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 158,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=GL20%20MWO-GB',
'category': 'Car',
'color': 'grey',
'currency': 'GBP',
'doors_number': 5,
'engine': '2.0L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Diesel',
'id': '2e0dd0a0-b6f8-5fa2-b4f5-e19cad0e9326',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'GL20 MWO',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=GL20%20MWO&vehicleType=*',
'listing': 'auction',
'location': 'Paddock Wood',
'make': 'AUDI',
'model': 'Q3',
'odometer': 108146,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-01-01',
'seller_name': None,
'title': 'AUDI Q3 2.0 35 TDI S LINE S-T StationWagon',
'transmission': 'automatic',
'trim': '35 TDI S LINE S-T',
'vin': 'WAUZZZF39L1101407',
'year': 2020}
2026-03-28 14:04:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GL20%2520MWO%27 HTTP/1.1" 200 None
2026-03-28 14:04:42 [bca.uk] INFO: Saving data for GL20%20MWO: {'auction_closing_time': 1774864800.0, 'created_time': 1774391892.966003, 'last_price_update_time': 1774706682.985119}
2026-03-28 14:04:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='GL20%2520MWO') HTTP/1.1" 204 0
2026-03-28 14:04:43 [bca.uk] INFO: Found listing with ID: OY16%20UYX
2026-03-28 14:04:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27OY16%2520UYX%27 HTTP/1.1" 200 None
2026-03-28 14:04:43 [bca.uk] INFO: Scrape type for OY16%20UYX: 2
2026-03-28 14:04:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e4f67b5e-2810-5aac-a823-36afa3da2927 with identifier: OY16%20UYX
2026-03-28 14:04:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e4f67b5e-2810-5aac-a823-36afa3da2927 with scrape type 2
2026-03-28 14:04:43 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e4f67b5e-2810-5aac-a823-36afa3da2927 with scrape type 2
2026-03-28 14:04:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: e4f67b5e-2810-5aac-a823-36afa3da2927, identifier: OY16%20UYX
2026-03-28 14:04:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LD16UKX/699001742/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LD16UKX/42809855?sv=2020-08-04&st=2026-03-28T14%3A04%3A07Z&se=2026-03-28T14%3A29%3A07Z&sr=b&sp=r&sig=CHOiwblSOmf2jh7w7FrmkfA8BVi7dwLavRkRtCs3kTQ%3D)
2026-03-28 14:04:43 [bca.uk] INFO: Found listing with ID: LC17%20UBN
2026-03-28 14:04:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LC17%2520UBN%27 HTTP/1.1" 200 None
2026-03-28 14:04:43 [bca.uk] INFO: Scrape type for LC17%20UBN: 2
2026-03-28 14:04:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1ca7268c-2e5d-5c8b-9ab6-b9019331e7fc with identifier: LC17%20UBN
2026-03-28 14:04:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1ca7268c-2e5d-5c8b-9ab6-b9019331e7fc with scrape type 2
2026-03-28 14:04:43 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1ca7268c-2e5d-5c8b-9ab6-b9019331e7fc with scrape type 2
2026-03-28 14:04:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 1ca7268c-2e5d-5c8b-9ab6-b9019331e7fc, identifier: LC17%20UBN
2026-03-28 14:04:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: e4f67b5e-2810-5aac-a823-36afa3da2927 with identifier: OY16%20UYX
2026-03-28 14:04:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: e4f67b5e-2810-5aac-a823-36afa3da2927 with identifier: OY16%20UYX
2026-03-28 14:04:43 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: e4f67b5e-2810-5aac-a823-36afa3da2927 with identifier: OY16%20UYX to the API
2026-03-28 14:04:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:04:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:04:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=8&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 139,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=OY16%20UYX-GB',
'category': 'Car',
'color': 'red',
'currency': 'GBP',
'doors_number': 5,
'engine': '2.0L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Diesel',
'id': 'e4f67b5e-2810-5aac-a823-36afa3da2927',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'OY16 UYX',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=OY16%20UYX&vehicleType=*',
'listing': 'auction',
'location': 'Nottingham',
'make': 'LAND ROVER',
'model': 'DISCOVERY SPORT',
'odometer': 72324,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-01-01',
'seller_name': None,
'title': 'LAND ROVER DISCOVERY SPORT 2.0 TD4 180 HSE LUXURY StationWagon',
'transmission': 'automatic',
'trim': 'TD4 180 HSE LUXURY',
'vin': 'SALCA2AN7GH606447',
'year': 2016}
2026-03-28 14:04:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27OY16%2520UYX%27 HTTP/1.1" 200 None
2026-03-28 14:04:43 [bca.uk] INFO: Saving data for OY16%20UYX: {'auction_closing_time': 1774864800.0, 'created_time': 1774305780.955932, 'last_price_update_time': 1774706683.538522}
2026-03-28 14:04:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='OY16%2520UYX') HTTP/1.1" 204 0
2026-03-28 14:04:43 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WJ58DWA/697410369/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=697410369>
2026-03-28 14:04:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HV69NLA/698729675/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/HV69NLA/42810551?sv=2020-08-04&st=2026-03-28T14%3A04%3A08Z&se=2026-03-28T14%3A29%3A08Z&sr=b&sp=r&sig=sCJK6ApeU%2FoHZHPsXN72GO3cagNVfUluR%2FbC%2B%2BOeYM4%3D)
2026-03-28 14:04:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 1ca7268c-2e5d-5c8b-9ab6-b9019331e7fc with identifier: LC17%20UBN
2026-03-28 14:04:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 1ca7268c-2e5d-5c8b-9ab6-b9019331e7fc with identifier: LC17%20UBN
2026-03-28 14:04:43 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 1ca7268c-2e5d-5c8b-9ab6-b9019331e7fc with identifier: LC17%20UBN to the API
2026-03-28 14:04:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:04:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:04:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=7&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 115,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=LC17%20UBN-GB',
'category': 'Car',
'color': 'black',
'currency': 'GBP',
'doors_number': 5,
'engine': '2.1L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Diesel',
'id': '1ca7268c-2e5d-5c8b-9ab6-b9019331e7fc',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'LC17 UBN',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=LC17%20UBN&vehicleType=*',
'listing': 'auction',
'location': 'Paddock Wood',
'make': 'MERCEDES-BENZ',
'model': 'GLA 200 D',
'odometer': 99861,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-01-01',
'seller_name': None,
'title': 'MERCEDES-BENZ GLA 200 D 2.1 AMG LINE EXECUTIVE DCT StationWagon',
'transmission': 'automatic',
'trim': 'AMG LINE EXECUTIVE DCT',
'vin': 'WDC1569082J390329',
'year': 2017}
2026-03-28 14:04:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LC17%2520UBN%27 HTTP/1.1" 200 None
2026-03-28 14:04:43 [bca.uk] INFO: Saving data for LC17%20UBN: {'auction_closing_time': 1774864800.0, 'created_time': 1774563878.618493, 'last_price_update_time': 1774706683.949089}
2026-03-28 14:04:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='LC17%2520UBN') HTTP/1.1" 204 0
2026-03-28 14:04:43 [bca.uk] INFO: Found listing with ID: SJ17%20NRR
2026-03-28 14:04:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SJ17%2520NRR%27 HTTP/1.1" 200 None
2026-03-28 14:04:43 [bca.uk] INFO: Scrape type for SJ17%20NRR: 0
2026-03-28 14:04:43 [bca.uk] INFO: Found listing with ID: VK16%20KNM
2026-03-28 14:04:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27VK16%2520KNM%27 HTTP/1.1" 200 None
2026-03-28 14:04:43 [bca.uk] INFO: Scrape type for VK16%20KNM: 0
2026-03-28 14:04:43 [bca.uk] INFO: Found listing with ID: BF62%20JWL
2026-03-28 14:04:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BF62%2520JWL%27 HTTP/1.1" 200 None
2026-03-28 14:04:44 [bca.uk] INFO: Scrape type for BF62%20JWL: 0
2026-03-28 14:04:44 [bca.uk] INFO: Found listing with ID: EF64%20PYO
2026-03-28 14:04:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27EF64%2520PYO%27 HTTP/1.1" 200 None
2026-03-28 14:04:44 [bca.uk] INFO: Scrape type for EF64%20PYO: 2
2026-03-28 14:04:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c0c998a3-cb89-5dc3-a60c-998f84a5af45 with identifier: EF64%20PYO
2026-03-28 14:04:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c0c998a3-cb89-5dc3-a60c-998f84a5af45 with scrape type 2
2026-03-28 14:04:44 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c0c998a3-cb89-5dc3-a60c-998f84a5af45 with scrape type 2
2026-03-28 14:04:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: c0c998a3-cb89-5dc3-a60c-998f84a5af45, identifier: EF64%20PYO
2026-03-28 14:04:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:04:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c9df990>
2026-03-28 14:04:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:04:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:04:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:04:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cdaa9411-8148-5f71-bb89-a031dafbf539/cdaa9411-8148-5f71-bb89-a031dafbf539_image_5.jpg HTTP/1.1" 201 0
2026-03-28 14:04:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FHV08XHP%252F698708031%252F600') HTTP/1.1" 204 0
2026-03-28 14:04:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HV08XHP/698708031/600 saved to cache
2026-03-28 14:04:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item cdaa9411-8148-5f71-bb89-a031dafbf539
2026-03-28 14:04:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:04:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a1fe81fd0>
2026-03-28 14:04:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:04:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:04:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:04:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a3ad7a0d-b4c8-5ced-b470-27d0e0c9322f/a3ad7a0d-b4c8-5ced-b470-27d0e0c9322f_image_5.jpg HTTP/1.1" 201 0
2026-03-28 14:04:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FFE12WRX%252F698993245%252F600') HTTP/1.1" 204 0
2026-03-28 14:04:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FE12WRX/698993245/600 saved to cache
2026-03-28 14:04:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item a3ad7a0d-b4c8-5ced-b470-27d0e0c9322f
2026-03-28 14:04:44 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:04:44 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:04:44 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:04:44 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:04:44 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:04:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:04:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2ca1b890>
2026-03-28 14:04:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:04:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:04:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:04:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a3ad7a0d-b4c8-5ced-b470-27d0e0c9322f/a3ad7a0d-b4c8-5ced-b470-27d0e0c9322f_image_9.jpg HTTP/1.1" 201 0
2026-03-28 14:04:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FFE12WRX%252F698993287%252F600') HTTP/1.1" 204 0
2026-03-28 14:04:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FE12WRX/698993287/600 saved to cache
2026-03-28 14:04:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item a3ad7a0d-b4c8-5ced-b470-27d0e0c9322f
2026-03-28 14:04:44 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:04:44 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:04:44 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:04:44 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:04:44 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:04:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:04:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c8a2f10>
2026-03-28 14:04:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:04:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:04:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:04:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_eadb8ebe-5b0a-5541-a2d1-caa5b9148e41/eadb8ebe-5b0a-5541-a2d1-caa5b9148e41_image_9.jpg HTTP/1.1" 201 0
2026-03-28 14:04:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FHV69NLA%252F698729767%252F600') HTTP/1.1" 204 0
2026-03-28 14:04:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HV69NLA/698729767/600 saved to cache
2026-03-28 14:04:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item eadb8ebe-5b0a-5541-a2d1-caa5b9148e41
2026-03-28 14:04:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FE12WRX/698993239/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/FE12WRX/42809715?sv=2020-08-04&st=2026-03-28T14%3A04%3A08Z&se=2026-03-28T14%3A29%3A08Z&sr=b&sp=r&sig=IhVxQK0SibgR8nCtLOUZrswprKTYcjKJBEdadhY0N3I%3D)
2026-03-28 14:04:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LD16UKX/699001734/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LD16UKX/42809855?sv=2020-08-04&st=2026-03-28T14%3A04%3A07Z&se=2026-03-28T14%3A29%3A07Z&sr=b&sp=r&sig=CHOiwblSOmf2jh7w7FrmkfA8BVi7dwLavRkRtCs3kTQ%3D)
2026-03-28 14:04:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HV08XHP/698708000/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/HV08XHP/42810135?sv=2020-08-04&st=2026-03-28T14%3A04%3A07Z&se=2026-03-28T14%3A29%3A07Z&sr=b&sp=r&sig=nDBJaQ0d1Lnn1Q%2BoiL0EJlYO6HO0nKvJULaa1yflDpY%3D)
2026-03-28 14:04:44 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PXZ1595/698814242/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698814242>
2026-03-28 14:04:44 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/JP04STP/42809620?sv=2020-08-04&st=2026-03-28T14%3A04%3A43Z&se=2026-03-28T14%3A29%3A43Z&sr=b&sp=r&sig=au5c8GXv2vCUIG4ea67UD3YzlPMQz7%2FWxYZM6tUj%2FEo%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=JP04%20STP-GB>
2026-03-28 14:04:44 [bca.uk] INFO: Found listing with ID: OW15%20FVZ
2026-03-28 14:04:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27OW15%2520FVZ%27 HTTP/1.1" 200 None
2026-03-28 14:04:44 [bca.uk] INFO: Scrape type for OW15%20FVZ: 2
2026-03-28 14:04:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: db66c288-b638-54c1-a020-17fd64fafd90 with identifier: OW15%20FVZ
2026-03-28 14:04:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item db66c288-b638-54c1-a020-17fd64fafd90 with scrape type 2
2026-03-28 14:04:44 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item db66c288-b638-54c1-a020-17fd64fafd90 with scrape type 2
2026-03-28 14:04:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: db66c288-b638-54c1-a020-17fd64fafd90, identifier: OW15%20FVZ
2026-03-28 14:04:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: c0c998a3-cb89-5dc3-a60c-998f84a5af45 with identifier: EF64%20PYO
2026-03-28 14:04:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: c0c998a3-cb89-5dc3-a60c-998f84a5af45 with identifier: EF64%20PYO
2026-03-28 14:04:44 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: c0c998a3-cb89-5dc3-a60c-998f84a5af45 with identifier: EF64%20PYO to the API
2026-03-28 14:04:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:04:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:04:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=8&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 171,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=EF64%20PYO-GB',
'category': 'Car',
'color': 'black',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.5L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol',
'id': 'c0c998a3-cb89-5dc3-a60c-998f84a5af45',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'EF64 PYO',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=EF64%20PYO&vehicleType=*',
'listing': 'auction',
'location': 'Nottingham',
'make': 'FORD',
'model': 'KUGA',
'odometer': 91231,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2014-01-01',
'seller_name': None,
'title': 'FORD KUGA 1.5 E/B 182 4WD TITANIUM X SPORT StationWagon',
'transmission': 'automatic',
'trim': 'E/B 182 4WD TITANIUM X SPORT',
'vin': 'WF0AXXWPMAEG46263',
'year': 2014}
2026-03-28 14:04:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27EF64%2520PYO%27 HTTP/1.1" 200 None
2026-03-28 14:04:44 [bca.uk] INFO: Saving data for EF64%20PYO: {'auction_closing_time': 1774864800.0, 'created_time': 1774523242.690655, 'last_price_update_time': 1774706684.84521}
2026-03-28 14:04:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='EF64%2520PYO') HTTP/1.1" 204 0
2026-03-28 14:04:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: db66c288-b638-54c1-a020-17fd64fafd90 with identifier: OW15%20FVZ
2026-03-28 14:04:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: db66c288-b638-54c1-a020-17fd64fafd90 with identifier: OW15%20FVZ
2026-03-28 14:04:44 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: db66c288-b638-54c1-a020-17fd64fafd90 with identifier: OW15%20FVZ to the API
2026-03-28 14:04:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:04:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:04:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=7&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 111,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=OW15%20FVZ-GB',
'category': 'Car',
'color': 'silver',
'currency': 'GBP',
'doors_number': 4,
'engine': '1.6L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Diesel',
'id': 'db66c288-b638-54c1-a020-17fd64fafd90',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'OW15 FVZ',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=OW15%20FVZ&vehicleType=*',
'listing': 'auction',
'location': 'Paddock Wood',
'make': 'MERCEDES-BENZ',
'model': 'C200',
'odometer': 92293,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-01-01',
'seller_name': None,
'title': 'MERCEDES-BENZ C200 1.6 B/T SPORT Saloon',
'transmission': 'manual',
'trim': 'B/T SPORT',
'vin': 'WDD2050372R090555',
'year': 2015}
2026-03-28 14:04:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27OW15%2520FVZ%27 HTTP/1.1" 200 None
2026-03-28 14:04:45 [bca.uk] INFO: Saving data for OW15%20FVZ: {'auction_closing_time': 1774864800.0, 'created_time': 1774364393.357825, 'last_price_update_time': 1774706685.20206}
2026-03-28 14:04:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='OW15%2520FVZ') HTTP/1.1" 204 0
2026-03-28 14:04:45 [bca.uk] INFO: Found listing with ID: EX13%20UJA
2026-03-28 14:04:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27EX13%2520UJA%27 HTTP/1.1" 200 None
2026-03-28 14:04:45 [bca.uk] INFO: Scrape type for EX13%20UJA: 2
2026-03-28 14:04:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9fd84e2b-3574-5ac4-aa23-34e632dae4b3 with identifier: EX13%20UJA
2026-03-28 14:04:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9fd84e2b-3574-5ac4-aa23-34e632dae4b3 with scrape type 2
2026-03-28 14:04:45 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9fd84e2b-3574-5ac4-aa23-34e632dae4b3 with scrape type 2
2026-03-28 14:04:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 9fd84e2b-3574-5ac4-aa23-34e632dae4b3, identifier: EX13%20UJA
2026-03-28 14:04:45 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:04:45 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:04:45 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:04:45 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:04:45 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:04:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:04:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a30352610>
2026-03-28 14:04:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:04:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:04:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:04:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_826679c4-b83f-5ad2-b8a7-2183b5f0a082/826679c4-b83f-5ad2-b8a7-2183b5f0a082_image_8.jpg HTTP/1.1" 201 0
2026-03-28 14:04:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLD16UKX%252F699001742%252F600') HTTP/1.1" 204 0
2026-03-28 14:04:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LD16UKX/699001742/600 saved to cache
2026-03-28 14:04:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 826679c4-b83f-5ad2-b8a7-2183b5f0a082
2026-03-28 14:04:45 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LD16UKX/699001704/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699001704>
2026-03-28 14:04:45 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BT66DFX/698129725/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698129725>
2026-03-28 14:04:45 [bca.uk] INFO: Found listing with ID: LM62%20VCU
2026-03-28 14:04:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LM62%2520VCU%27 HTTP/1.1" 200 None
2026-03-28 14:04:45 [bca.uk] INFO: Scrape type for LM62%20VCU: 1
2026-03-28 14:04:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 91eb6f90-8171-52c3-8f50-6415c188dd75 with identifier: LM62%20VCU
2026-03-28 14:04:45 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 91eb6f90-8171-52c3-8f50-6415c188dd75
2026-03-28 14:04:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 9fd84e2b-3574-5ac4-aa23-34e632dae4b3 with identifier: EX13%20UJA
2026-03-28 14:04:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-28 14:04:45 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=gold HTTP/1.1" 200 None
2026-03-28 14:04:45 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-28 14:04:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-28 14:04:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 9fd84e2b-3574-5ac4-aa23-34e632dae4b3 with identifier: EX13%20UJA
2026-03-28 14:04:45 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 9fd84e2b-3574-5ac4-aa23-34e632dae4b3 with identifier: EX13%20UJA to the API
2026-03-28 14:04:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:04:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:04:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=8&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 149,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=EX13%20UJA-GB',
'category': 'Car',
'color': 'gold',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.6L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol',
'id': '9fd84e2b-3574-5ac4-aa23-34e632dae4b3',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'EX13 UJA',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=EX13%20UJA&vehicleType=*',
'listing': 'auction',
'location': 'Nottingham',
'make': 'FORD',
'model': 'B-MAX',
'odometer': 86922,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2013-01-01',
'seller_name': None,
'title': 'FORD B-MAX 1.6 TITANIUM P/SHIFT MPV',
'transmission': 'automatic',
'trim': 'TITANIUM P/SHIFT',
'vin': 'WF0KXXERJKDM44652',
'year': 2013}
2026-03-28 14:04:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27EX13%2520UJA%27 HTTP/1.1" 200 None
2026-03-28 14:04:45 [bca.uk] INFO: Saving data for EX13%20UJA: {'auction_closing_time': 1774864800.0, 'created_time': 1774364327.790311, 'last_price_update_time': 1774706685.913639}
2026-03-28 14:04:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='EX13%2520UJA') HTTP/1.1" 204 0
2026-03-28 14:04:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WJ58DWA/697410380/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/WJ58DWA/42809994?sv=2020-08-04&st=2026-03-28T14%3A04%3A01Z&se=2026-03-28T14%3A29%3A01Z&sr=b&sp=r&sig=WelJkUnZ%2FryduuiTM2iL%2FzPRBftp3wpY3FkYWG%2FP0gk%3D)
2026-03-28 14:04:45 [bca.uk] INFO: Found listing with ID: FY11%20SBZ
2026-03-28 14:04:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FY11%2520SBZ%27 HTTP/1.1" 200 None
2026-03-28 14:04:45 [bca.uk] INFO: Scrape type for FY11%20SBZ: 2
2026-03-28 14:04:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 59b69dc6-9f3c-581d-bbf7-cf1d9b36e64f with identifier: FY11%20SBZ
2026-03-28 14:04:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 59b69dc6-9f3c-581d-bbf7-cf1d9b36e64f with scrape type 2
2026-03-28 14:04:45 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 59b69dc6-9f3c-581d-bbf7-cf1d9b36e64f with scrape type 2
2026-03-28 14:04:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 59b69dc6-9f3c-581d-bbf7-cf1d9b36e64f, identifier: FY11%20SBZ
2026-03-28 14:04:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LD16UKX/699001718/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LD16UKX/42809855?sv=2020-08-04&st=2026-03-28T14%3A04%3A07Z&se=2026-03-28T14%3A29%3A07Z&sr=b&sp=r&sig=CHOiwblSOmf2jh7w7FrmkfA8BVi7dwLavRkRtCs3kTQ%3D)
2026-03-28 14:04:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HV08XHP/698707943/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/HV08XHP/42810135?sv=2020-08-04&st=2026-03-28T14%3A04%3A07Z&se=2026-03-28T14%3A29%3A07Z&sr=b&sp=r&sig=nDBJaQ0d1Lnn1Q%2BoiL0EJlYO6HO0nKvJULaa1yflDpY%3D)
2026-03-28 14:04:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LD16UKX/699001710/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LD16UKX/42809855?sv=2020-08-04&st=2026-03-28T14%3A04%3A07Z&se=2026-03-28T14%3A29%3A07Z&sr=b&sp=r&sig=CHOiwblSOmf2jh7w7FrmkfA8BVi7dwLavRkRtCs3kTQ%3D)
2026-03-28 14:04:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FE12WRX/698993222/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/FE12WRX/42809715?sv=2020-08-04&st=2026-03-28T14%3A04%3A08Z&se=2026-03-28T14%3A29%3A08Z&sr=b&sp=r&sig=IhVxQK0SibgR8nCtLOUZrswprKTYcjKJBEdadhY0N3I%3D)
2026-03-28 14:04:46 [bca.uk] INFO: Found listing with ID: EK63%20UCX
2026-03-28 14:04:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27EK63%2520UCX%27 HTTP/1.1" 200 None
2026-03-28 14:04:46 [bca.uk] INFO: Scrape type for EK63%20UCX: 0
2026-03-28 14:04:46 [bca.uk] INFO: Found listing with ID: HG18%20UAP
2026-03-28 14:04:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27HG18%2520UAP%27 HTTP/1.1" 200 None
2026-03-28 14:04:46 [bca.uk] INFO: Scrape type for HG18%20UAP: 2
2026-03-28 14:04:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f094f15d-0ae9-5678-a8f2-3226d9b024b2 with identifier: HG18%20UAP
2026-03-28 14:04:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f094f15d-0ae9-5678-a8f2-3226d9b024b2 with scrape type 2
2026-03-28 14:04:46 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f094f15d-0ae9-5678-a8f2-3226d9b024b2 with scrape type 2
2026-03-28 14:04:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: f094f15d-0ae9-5678-a8f2-3226d9b024b2, identifier: HG18%20UAP
2026-03-28 14:04:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 59b69dc6-9f3c-581d-bbf7-cf1d9b36e64f with identifier: FY11%20SBZ
2026-03-28 14:04:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 59b69dc6-9f3c-581d-bbf7-cf1d9b36e64f with identifier: FY11%20SBZ
2026-03-28 14:04:46 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 59b69dc6-9f3c-581d-bbf7-cf1d9b36e64f with identifier: FY11%20SBZ to the API
2026-03-28 14:04:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:04:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:04:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=8&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 146,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=FY11%20SBZ-GB',
'category': 'Car',
'color': 'silver',
'currency': 'GBP',
'doors_number': 5,
'engine': '2.0L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Diesel',
'id': '59b69dc6-9f3c-581d-bbf7-cf1d9b36e64f',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'FY11 SBZ',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=FY11%20SBZ&vehicleType=*',
'listing': 'auction',
'location': 'Nottingham',
'make': 'MERCEDES-BENZ',
'model': 'B180',
'odometer': 68018,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2011-01-01',
'seller_name': None,
'title': 'MERCEDES-BENZ B180 2.0 CDI SE Hatchback',
'transmission': 'manual',
'trim': 'CDI SE',
'vin': 'WDD2452072J686352',
'year': 2011}
2026-03-28 14:04:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FY11%2520SBZ%27 HTTP/1.1" 200 None
2026-03-28 14:04:46 [bca.uk] INFO: Saving data for FY11%20SBZ: {'auction_closing_time': 1774864800.0, 'created_time': 1774390289.970602, 'last_price_update_time': 1774706686.593493}
2026-03-28 14:04:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='FY11%2520SBZ') HTTP/1.1" 204 0
2026-03-28 14:04:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:04:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c59f910>
2026-03-28 14:04:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:04:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:04:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:04:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_eadb8ebe-5b0a-5541-a2d1-caa5b9148e41/eadb8ebe-5b0a-5541-a2d1-caa5b9148e41_image_4.jpg HTTP/1.1" 201 0
2026-03-28 14:04:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FHV69NLA%252F698729675%252F600') HTTP/1.1" 204 0
2026-03-28 14:04:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HV69NLA/698729675/600 saved to cache
2026-03-28 14:04:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item eadb8ebe-5b0a-5541-a2d1-caa5b9148e41
2026-03-28 14:04:46 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: eadb8ebe-5b0a-5541-a2d1-caa5b9148e41, skipping ID generation
2026-03-28 14:04:46 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item eadb8ebe-5b0a-5541-a2d1-caa5b9148e41 sending to next pipeline
2026-03-28 14:04:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: eadb8ebe-5b0a-5541-a2d1-caa5b9148e41, identifier: HV69%20NLA
2026-03-28 14:04:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:04:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2d853250>
2026-03-28 14:04:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:04:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:04:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:04:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a3ad7a0d-b4c8-5ced-b470-27d0e0c9322f/a3ad7a0d-b4c8-5ced-b470-27d0e0c9322f_image_4.jpg HTTP/1.1" 201 0
2026-03-28 14:04:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FFE12WRX%252F698993239%252F600') HTTP/1.1" 204 0
2026-03-28 14:04:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FE12WRX/698993239/600 saved to cache
2026-03-28 14:04:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item a3ad7a0d-b4c8-5ced-b470-27d0e0c9322f
2026-03-28 14:04:46 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:04:46 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:04:46 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:04:46 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:04:46 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:04:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:04:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2dce8110>
2026-03-28 14:04:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:04:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:04:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:04:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_826679c4-b83f-5ad2-b8a7-2183b5f0a082/826679c4-b83f-5ad2-b8a7-2183b5f0a082_image_7.jpg HTTP/1.1" 201 0
2026-03-28 14:04:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLD16UKX%252F699001734%252F600') HTTP/1.1" 204 0
2026-03-28 14:04:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LD16UKX/699001734/600 saved to cache
2026-03-28 14:04:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 826679c4-b83f-5ad2-b8a7-2183b5f0a082
2026-03-28 14:04:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:04:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2dd8ff50>
2026-03-28 14:04:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:04:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:04:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:04:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cdaa9411-8148-5f71-bb89-a031dafbf539/cdaa9411-8148-5f71-bb89-a031dafbf539_image_4.jpg HTTP/1.1" 201 0
2026-03-28 14:04:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FHV08XHP%252F698708000%252F600') HTTP/1.1" 204 0
2026-03-28 14:04:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HV08XHP/698708000/600 saved to cache
2026-03-28 14:04:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item cdaa9411-8148-5f71-bb89-a031dafbf539
2026-03-28 14:04:46 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WJ58DWA/697410359/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=697410359>
2026-03-28 14:04:46 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AK67LWT/698947264/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698947264>
2026-03-28 14:04:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WJ58DWA/697410369/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/WJ58DWA/42809994?sv=2020-08-04&st=2026-03-28T14%3A04%3A01Z&se=2026-03-28T14%3A29%3A01Z&sr=b&sp=r&sig=WelJkUnZ%2FryduuiTM2iL%2FzPRBftp3wpY3FkYWG%2FP0gk%3D)
2026-03-28 14:04:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: f094f15d-0ae9-5678-a8f2-3226d9b024b2 with identifier: HG18%20UAP
2026-03-28 14:04:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: f094f15d-0ae9-5678-a8f2-3226d9b024b2 with identifier: HG18%20UAP
2026-03-28 14:04:46 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: f094f15d-0ae9-5678-a8f2-3226d9b024b2 with identifier: HG18%20UAP to the API
2026-03-28 14:04:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:04:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:04:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=7&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 147,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=HG18%20UAP-GB',
'category': 'Car',
'color': 'white',
'currency': 'GBP',
'doors_number': 5,
'engine': '2.0L',
'expiration_date': '2026-03-29T10:00:00Z',
'fuel_type': 'Diesel',
'id': 'f094f15d-0ae9-5678-a8f2-3226d9b024b2',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'HG18 UAP',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=HG18%20UAP&vehicleType=*',
'listing': 'auction',
'location': 'Nottingham',
'make': 'JAGUAR',
'model': 'E-PACE',
'odometer': 49452,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-01-01',
'seller_name': None,
'title': 'JAGUAR E-PACE 2.0 D150 AWD S Hatchback',
'transmission': 'automatic',
'trim': 'D150 AWD S',
'vin': 'SADFA2AN7J1Z16770',
'year': 2018}
2026-03-28 14:04:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27HG18%2520UAP%27 HTTP/1.1" 200 None
2026-03-28 14:04:47 [bca.uk] INFO: Saving data for HG18%20UAP: {'auction_closing_time': 1774778400.0, 'created_time': 1774390937.001368, 'last_price_update_time': 1774706687.235695}
2026-03-28 14:04:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='HG18%2520UAP') HTTP/1.1" 204 0
2026-03-28 14:04:47 [bca.uk] INFO: Found listing with ID: OV09%20NOF
2026-03-28 14:04:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27OV09%2520NOF%27 HTTP/1.1" 200 None
2026-03-28 14:04:47 [bca.uk] INFO: Scrape type for OV09%20NOF: 2
2026-03-28 14:04:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2a7e3b69-3cd0-570f-81e3-ffa76a638ba9 with identifier: OV09%20NOF
2026-03-28 14:04:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2a7e3b69-3cd0-570f-81e3-ffa76a638ba9 with scrape type 2
2026-03-28 14:04:47 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2a7e3b69-3cd0-570f-81e3-ffa76a638ba9 with scrape type 2
2026-03-28 14:04:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 2a7e3b69-3cd0-570f-81e3-ffa76a638ba9, identifier: OV09%20NOF
2026-03-28 14:04:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: eadb8ebe-5b0a-5541-a2d1-caa5b9148e41 with identifier: HV69%20NLA
2026-03-28 14:04:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: eadb8ebe-5b0a-5541-a2d1-caa5b9148e41 with identifier: HV69%20NLA
2026-03-28 14:04:47 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: eadb8ebe-5b0a-5541-a2d1-caa5b9148e41 with identifier: HV69%20NLA to the API
2026-03-28 14:04:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:04:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:04:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HV69NLA/698729675/600>
{'auction_title': '',
'c_o_2_emission_value': 129,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_eadb8ebe-5b0a-5541-a2d1-caa5b9148e41/eadb8ebe-5b0a-5541-a2d1-caa5b9148e41_expert_report_file_fe2adbd5-30ae-4c88-9722-57ffe02e52e3.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=HV69%20NLA-GB',
'category': 'Car',
'color': 'white',
'currency': 'GBP',
'doors_number': 5,
'engine': '2.0L',
'expiration_date': '2026-03-31T10:00:00Z',
'fuel_type': 'Petrol',
'id': 'eadb8ebe-5b0a-5541-a2d1-caa5b9148e41',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'HV69 NLA',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=HV69%20NLA&vehicleType=*',
'listing': 'auction',
'location': 'Blackbushe',
'make': 'BMW',
'model': 'X1',
'odometer': 16309,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 11,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_eadb8ebe-5b0a-5541-a2d1-caa5b9148e41/eadb8ebe-5b0a-5541-a2d1-caa5b9148e41_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 55360,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HV69NLA/698729604/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_eadb8ebe-5b0a-5541-a2d1-caa5b9148e41/eadb8ebe-5b0a-5541-a2d1-caa5b9148e41_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 53115,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HV69NLA/698729623/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_eadb8ebe-5b0a-5541-a2d1-caa5b9148e41/eadb8ebe-5b0a-5541-a2d1-caa5b9148e41_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 53013,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HV69NLA/698729640/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_eadb8ebe-5b0a-5541-a2d1-caa5b9148e41/eadb8ebe-5b0a-5541-a2d1-caa5b9148e41_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 54761,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HV69NLA/698729657/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_eadb8ebe-5b0a-5541-a2d1-caa5b9148e41/eadb8ebe-5b0a-5541-a2d1-caa5b9148e41_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 55175,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HV69NLA/698729675/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_eadb8ebe-5b0a-5541-a2d1-caa5b9148e41/eadb8ebe-5b0a-5541-a2d1-caa5b9148e41_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 51966,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HV69NLA/698729689/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_eadb8ebe-5b0a-5541-a2d1-caa5b9148e41/eadb8ebe-5b0a-5541-a2d1-caa5b9148e41_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 75475,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HV69NLA/698729714/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_eadb8ebe-5b0a-5541-a2d1-caa5b9148e41/eadb8ebe-5b0a-5541-a2d1-caa5b9148e41_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 69065,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HV69NLA/698729733/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_eadb8ebe-5b0a-5541-a2d1-caa5b9148e41/eadb8ebe-5b0a-5541-a2d1-caa5b9148e41_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 76330,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HV69NLA/698729751/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_eadb8ebe-5b0a-5541-a2d1-caa5b9148e41/eadb8ebe-5b0a-5541-a2d1-caa5b9148e41_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 66914,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HV69NLA/698729767/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-01-01',
'seller_name': None,
'title': 'BMW X1 2.0 SDRIVE 20I M SPORT STEP StationWagon',
'transmission': 'automatic',
'trim': 'SDRIVE 20I M SPORT STEP',
'vin': 'WBA72AA0505N92301',
'year': 2019}
2026-03-28 14:04:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27HV69%2520NLA%27 HTTP/1.1" 200 None
2026-03-28 14:04:47 [bca.uk] INFO: Saving data for HV69%20NLA: {'created_time': 1774706687.725329, 'last_price_update_time': 1774706687.725342, 'auction_closing_time': 1774951200.0}
2026-03-28 14:04:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='HV69%2520NLA') HTTP/1.1" 204 0
2026-03-28 14:04:47 [bca.uk] INFO: Found listing with ID: BX69%20KFJ
2026-03-28 14:04:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BX69%2520KFJ%27 HTTP/1.1" 200 None
2026-03-28 14:04:47 [bca.uk] INFO: Scrape type for BX69%20KFJ: 0
2026-03-28 14:04:47 [bca.uk] INFO: Found listing with ID: GU68%20KAX
2026-03-28 14:04:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GU68%2520KAX%27 HTTP/1.1" 200 None
2026-03-28 14:04:47 [bca.uk] INFO: Scrape type for GU68%20KAX: 0
2026-03-28 14:04:47 [bca.uk] INFO: Found listing with ID: LJ68%20YWE
2026-03-28 14:04:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LJ68%2520YWE%27 HTTP/1.1" 200 None
2026-03-28 14:04:47 [bca.uk] INFO: Scrape type for LJ68%20YWE: 0
2026-03-28 14:04:47 [bca.uk] INFO: Found listing with ID: SC71%20KXX
2026-03-28 14:04:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SC71%2520KXX%27 HTTP/1.1" 200 None
2026-03-28 14:04:47 [bca.uk] INFO: Scrape type for SC71%20KXX: 0
2026-03-28 14:04:47 [bca.uk] INFO: Found listing with ID: SP19%20KZX
2026-03-28 14:04:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SP19%2520KZX%27 HTTP/1.1" 200 None
2026-03-28 14:04:47 [bca.uk] INFO: Scrape type for SP19%20KZX: 0
2026-03-28 14:04:47 [bca.uk] INFO: Found listing with ID: YK69%20PZB
2026-03-28 14:04:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YK69%2520PZB%27 HTTP/1.1" 200 None
2026-03-28 14:04:47 [bca.uk] INFO: Scrape type for YK69%20PZB: 0
2026-03-28 14:04:47 [bca.uk] INFO: Found listing with ID: AB55%20WWW
2026-03-28 14:04:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27AB55%2520WWW%27 HTTP/1.1" 200 None
2026-03-28 14:04:47 [bca.uk] INFO: Scrape type for AB55%20WWW: 0
2026-03-28 14:04:47 [bca.uk] INFO: Found listing with ID: WN68%20XXC
2026-03-28 14:04:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WN68%2520XXC%27 HTTP/1.1" 200 None
2026-03-28 14:04:48 [bca.uk] INFO: Scrape type for WN68%20XXC: 0
2026-03-28 14:04:48 [bca.uk] INFO: Found listing with ID: PX72%20KYH
2026-03-28 14:04:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27PX72%2520KYH%27 HTTP/1.1" 200 None
2026-03-28 14:04:48 [bca.uk] INFO: Scrape type for PX72%20KYH: 0
2026-03-28 14:04:48 [bca.uk] INFO: Found listing with ID: FD18%20SVU
2026-03-28 14:04:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FD18%2520SVU%27 HTTP/1.1" 200 None
2026-03-28 14:04:48 [bca.uk] INFO: Scrape type for FD18%20SVU: 0
2026-03-28 14:04:48 [bca.uk] INFO: Found listing with ID: NK17%20UZV
2026-03-28 14:04:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27NK17%2520UZV%27 HTTP/1.1" 200 None
2026-03-28 14:04:48 [bca.uk] INFO: Scrape type for NK17%20UZV: 0
2026-03-28 14:04:48 [bca.uk] INFO: Found listing with ID: NU67%20AWA
2026-03-28 14:04:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27NU67%2520AWA%27 HTTP/1.1" 200 None
2026-03-28 14:04:48 [bca.uk] INFO: Scrape type for NU67%20AWA: 2
2026-03-28 14:04:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9e05fd6a-3de7-568a-814e-ad3b0cd6fb04 with identifier: NU67%20AWA
2026-03-28 14:04:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9e05fd6a-3de7-568a-814e-ad3b0cd6fb04 with scrape type 2
2026-03-28 14:04:48 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9e05fd6a-3de7-568a-814e-ad3b0cd6fb04 with scrape type 2
2026-03-28 14:04:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 9e05fd6a-3de7-568a-814e-ad3b0cd6fb04, identifier: NU67%20AWA
2026-03-28 14:04:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 2a7e3b69-3cd0-570f-81e3-ffa76a638ba9 with identifier: OV09%20NOF
2026-03-28 14:04:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 2a7e3b69-3cd0-570f-81e3-ffa76a638ba9 with identifier: OV09%20NOF
2026-03-28 14:04:48 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 2a7e3b69-3cd0-570f-81e3-ffa76a638ba9 with identifier: OV09%20NOF to the API
2026-03-28 14:04:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:04:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:04:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=8&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 262,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=OV09%20NOF-GB',
'category': 'Car',
'color': 'black',
'currency': 'GBP',
'doors_number': 5,
'engine': '3.0L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Diesel',
'id': '2a7e3b69-3cd0-570f-81e3-ffa76a638ba9',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'OV09 NOF',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=OV09%20NOF&vehicleType=*',
'listing': 'auction',
'location': 'Nottingham',
'make': 'VOLKSWAGEN',
'model': 'TOUAREG',
'odometer': 64754,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2009-01-01',
'seller_name': None,
'title': 'VOLKSWAGEN TOUAREG 3.0 V6 TDI CR ALTITUDE TIP StationWagon',
'transmission': 'manual',
'trim': 'V6 TDI CR ALTITUDE TIP',
'vin': 'WVGZZZ7LZ9D011227',
'year': 2009}
2026-03-28 14:04:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27OV09%2520NOF%27 HTTP/1.1" 200 None
2026-03-28 14:04:48 [bca.uk] INFO: Saving data for OV09%20NOF: {'auction_closing_time': 1774864800.0, 'created_time': 1774364213.46262, 'last_price_update_time': 1774706688.508815}
2026-03-28 14:04:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='OV09%2520NOF') HTTP/1.1" 204 0
2026-03-28 14:04:48 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:04:48 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:04:48 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:04:48 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:04:48 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:04:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:04:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2ca065d0>
2026-03-28 14:04:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:04:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:04:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:04:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8413221f-7948-5093-9030-c87150f157c7/8413221f-7948-5093-9030-c87150f157c7_image_9.jpg HTTP/1.1" 201 0
2026-03-28 14:04:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FWJ58DWA%252F697410380%252F600') HTTP/1.1" 204 0
2026-03-28 14:04:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WJ58DWA/697410380/600 saved to cache
2026-03-28 14:04:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 8413221f-7948-5093-9030-c87150f157c7
2026-03-28 14:04:48 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HY65KRJ/698920420/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698920420>
2026-03-28 14:04:48 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YB63ZKP/698284400/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698284400>
2026-03-28 14:04:48 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/ST12HSO/42809912?sv=2020-08-04&st=2026-03-28T14%3A04%3A46Z&se=2026-03-28T14%3A29%3A46Z&sr=b&sp=r&sig=tOhj9TDOiYV6354bfaZJlS4RufTDvGneY43ZqD%2FSIPw%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=ST12%20HSO-GB>
2026-03-28 14:04:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 9e05fd6a-3de7-568a-814e-ad3b0cd6fb04 with identifier: NU67%20AWA
2026-03-28 14:04:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 9e05fd6a-3de7-568a-814e-ad3b0cd6fb04 with identifier: NU67%20AWA
2026-03-28 14:04:48 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 9e05fd6a-3de7-568a-814e-ad3b0cd6fb04 with identifier: NU67%20AWA to the API
2026-03-28 14:04:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:04:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:04:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=7&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 139,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=NU67%20AWA-GB',
'category': 'Car',
'color': 'white',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.6L',
'expiration_date': '2026-03-29T10:00:00Z',
'fuel_type': 'Petrol',
'id': '9e05fd6a-3de7-568a-814e-ad3b0cd6fb04',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'NU67 AWA',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=NU67%20AWA&vehicleType=*',
'listing': 'auction',
'location': 'Nottingham',
'make': 'NISSAN',
'model': 'JUKE',
'odometer': 26416,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-01-01',
'seller_name': None,
'title': 'NISSAN JUKE 1.6 ACENTA XTRONIC Hatchback',
'transmission': 'automatic',
'trim': 'ACENTA XTRONIC',
'vin': 'SJNFBAF15U7390380',
'year': 2017}
2026-03-28 14:04:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27NU67%2520AWA%27 HTTP/1.1" 200 None
2026-03-28 14:04:48 [bca.uk] INFO: Saving data for NU67%20AWA: {'auction_closing_time': 1774778400.0, 'created_time': 1774391925.881505, 'last_price_update_time': 1774706688.985253}
2026-03-28 14:04:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='NU67%2520AWA') HTTP/1.1" 204 0
2026-03-28 14:04:49 [bca.uk] INFO: Found listing with ID: WV20%20YFC
2026-03-28 14:04:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WV20%2520YFC%27 HTTP/1.1" 200 None
2026-03-28 14:04:49 [bca.uk] INFO: Scrape type for WV20%20YFC: 0
2026-03-28 14:04:49 [bca.uk] INFO: Found listing with ID: NX18%20OER
2026-03-28 14:04:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27NX18%2520OER%27 HTTP/1.1" 200 None
2026-03-28 14:04:49 [bca.uk] INFO: Scrape type for NX18%20OER: 2
2026-03-28 14:04:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3d1e2530-65a8-5fae-b5b5-8d5341862e70 with identifier: NX18%20OER
2026-03-28 14:04:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3d1e2530-65a8-5fae-b5b5-8d5341862e70 with scrape type 2
2026-03-28 14:04:49 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3d1e2530-65a8-5fae-b5b5-8d5341862e70 with scrape type 2
2026-03-28 14:04:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 3d1e2530-65a8-5fae-b5b5-8d5341862e70, identifier: NX18%20OER
2026-03-28 14:04:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PXZ1595/698814242/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/PXZ1595/42808016?sv=2020-08-04&st=2026-03-28T14%3A04%3A01Z&se=2026-03-28T14%3A29%3A01Z&sr=b&sp=r&sig=xu3OmTnGiQ74jDpi5YWrXOjZvBn7hDxoXdoCW9aef04%3D)
2026-03-28 14:04:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 3d1e2530-65a8-5fae-b5b5-8d5341862e70 with identifier: NX18%20OER
2026-03-28 14:04:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 3d1e2530-65a8-5fae-b5b5-8d5341862e70 with identifier: NX18%20OER
2026-03-28 14:04:49 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 3d1e2530-65a8-5fae-b5b5-8d5341862e70 with identifier: NX18%20OER to the API
2026-03-28 14:04:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:04:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:04:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=8&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 114,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=NX18%20OER-GB',
'category': 'Car',
'color': 'blue',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.2L',
'expiration_date': '2026-03-29T10:00:00Z',
'fuel_type': 'Petrol',
'id': '3d1e2530-65a8-5fae-b5b5-8d5341862e70',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'NX18 OER',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=NX18%20OER&vehicleType=*',
'listing': 'auction',
'location': 'Newcastle-u-Tyne',
'make': 'HYUNDAI',
'model': 'I10',
'odometer': 42610,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-01-01',
'seller_name': None,
'title': 'HYUNDAI I10 1.2 PREMIUM Hatchback',
'transmission': 'manual',
'trim': 'PREMIUM',
'vin': 'NLHA851CLJZ415381',
'year': 2018}
2026-03-28 14:04:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27NX18%2520OER%27 HTTP/1.1" 200 None
2026-03-28 14:04:49 [bca.uk] INFO: Saving data for NX18%20OER: {'auction_closing_time': 1774778400.0, 'created_time': 1774524288.554336, 'last_price_update_time': 1774706689.645236}
2026-03-28 14:04:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='NX18%2520OER') HTTP/1.1" 204 0
2026-03-28 14:04:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LD16UKX/699001704/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LD16UKX/42809855?sv=2020-08-04&st=2026-03-28T14%3A04%3A07Z&se=2026-03-28T14%3A29%3A07Z&sr=b&sp=r&sig=CHOiwblSOmf2jh7w7FrmkfA8BVi7dwLavRkRtCs3kTQ%3D)
2026-03-28 14:04:49 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LM62VCU/42807206?sv=2020-08-04&st=2026-03-28T14%3A04%3A48Z&se=2026-03-28T14%3A29%3A48Z&sr=b&sp=r&sig=Rp%2FNuRBRM1T5Pi%2BNXegpYq0Ke%2B2Lo7Tup8NKUMfBYuw%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=LM62%20VCU-GB>
2026-03-28 14:04:49 [bca.uk] INFO: Found listing with ID: NY15%20BUO
2026-03-28 14:04:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27NY15%2520BUO%27 HTTP/1.1" 200 None
2026-03-28 14:04:49 [bca.uk] INFO: Scrape type for NY15%20BUO: 2
2026-03-28 14:04:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 913f45e6-aa2c-5e38-9951-9364f5240b8c with identifier: NY15%20BUO
2026-03-28 14:04:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 913f45e6-aa2c-5e38-9951-9364f5240b8c with scrape type 2
2026-03-28 14:04:49 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 913f45e6-aa2c-5e38-9951-9364f5240b8c with scrape type 2
2026-03-28 14:04:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 913f45e6-aa2c-5e38-9951-9364f5240b8c, identifier: NY15%20BUO
2026-03-28 14:04:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:04:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c979cd0>
2026-03-28 14:04:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:04:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:04:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:04:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_826679c4-b83f-5ad2-b8a7-2183b5f0a082/826679c4-b83f-5ad2-b8a7-2183b5f0a082_image_5.jpg HTTP/1.1" 201 0
2026-03-28 14:04:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLD16UKX%252F699001718%252F600') HTTP/1.1" 204 0
2026-03-28 14:04:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LD16UKX/699001718/600 saved to cache
2026-03-28 14:04:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 826679c4-b83f-5ad2-b8a7-2183b5f0a082
2026-03-28 14:04:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:04:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2d834410>
2026-03-28 14:04:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:04:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:04:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:04:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cdaa9411-8148-5f71-bb89-a031dafbf539/cdaa9411-8148-5f71-bb89-a031dafbf539_image_2.jpg HTTP/1.1" 201 0
2026-03-28 14:04:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FHV08XHP%252F698707943%252F600') HTTP/1.1" 204 0
2026-03-28 14:04:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HV08XHP/698707943/600 saved to cache
2026-03-28 14:04:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item cdaa9411-8148-5f71-bb89-a031dafbf539
2026-03-28 14:04:49 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: cdaa9411-8148-5f71-bb89-a031dafbf539, skipping ID generation
2026-03-28 14:04:49 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item cdaa9411-8148-5f71-bb89-a031dafbf539 sending to next pipeline
2026-03-28 14:04:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: cdaa9411-8148-5f71-bb89-a031dafbf539, identifier: HV08%20XHP
2026-03-28 14:04:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:04:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2fe03550>
2026-03-28 14:04:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:04:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:04:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:04:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_826679c4-b83f-5ad2-b8a7-2183b5f0a082/826679c4-b83f-5ad2-b8a7-2183b5f0a082_image_3.jpg HTTP/1.1" 201 0
2026-03-28 14:04:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLD16UKX%252F699001710%252F600') HTTP/1.1" 204 0
2026-03-28 14:04:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LD16UKX/699001710/600 saved to cache
2026-03-28 14:04:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 826679c4-b83f-5ad2-b8a7-2183b5f0a082
2026-03-28 14:04:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:04:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2dbf5e50>
2026-03-28 14:04:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:04:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:04:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:04:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a3ad7a0d-b4c8-5ced-b470-27d0e0c9322f/a3ad7a0d-b4c8-5ced-b470-27d0e0c9322f_image_2.jpg HTTP/1.1" 201 0
2026-03-28 14:04:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FFE12WRX%252F698993222%252F600') HTTP/1.1" 204 0
2026-03-28 14:04:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FE12WRX/698993222/600 saved to cache
2026-03-28 14:04:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item a3ad7a0d-b4c8-5ced-b470-27d0e0c9322f
2026-03-28 14:04:50 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: a3ad7a0d-b4c8-5ced-b470-27d0e0c9322f, skipping ID generation
2026-03-28 14:04:50 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item a3ad7a0d-b4c8-5ced-b470-27d0e0c9322f sending to next pipeline
2026-03-28 14:04:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: a3ad7a0d-b4c8-5ced-b470-27d0e0c9322f, identifier: FE12%20WRX
2026-03-28 14:04:50 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:04:50 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:04:50 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:04:50 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:04:50 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:04:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:04:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c59efd0>
2026-03-28 14:04:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:04:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:04:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:04:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8413221f-7948-5093-9030-c87150f157c7/8413221f-7948-5093-9030-c87150f157c7_image_7.jpg HTTP/1.1" 201 0
2026-03-28 14:04:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FWJ58DWA%252F697410369%252F600') HTTP/1.1" 204 0
2026-03-28 14:04:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WJ58DWA/697410369/600 saved to cache
2026-03-28 14:04:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 8413221f-7948-5093-9030-c87150f157c7
2026-03-28 14:04:50 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PXZ1595/698814225/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698814225>
2026-03-28 14:04:50 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LD16UKX/699001701/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699001701>
2026-03-28 14:04:50 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BT66DFX/698129720/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698129720>
2026-03-28 14:04:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BT66DFX/698129725/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/BT66DFX/42810013?sv=2020-08-04&st=2026-03-28T14%3A04%3A00Z&se=2026-03-28T14%3A29%3A00Z&sr=b&sp=r&sig=Yx0iLoKJXBk4DPNXOVJLOrRp66ZUz648vIo6BTtbrJ0%3D)
2026-03-28 14:04:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 913f45e6-aa2c-5e38-9951-9364f5240b8c with identifier: NY15%20BUO
2026-03-28 14:04:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 913f45e6-aa2c-5e38-9951-9364f5240b8c with identifier: NY15%20BUO
2026-03-28 14:04:50 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 913f45e6-aa2c-5e38-9951-9364f5240b8c with identifier: NY15%20BUO to the API
2026-03-28 14:04:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:04:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:04:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=8&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 108,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=NY15%20BUO-GB',
'category': 'Car',
'color': 'white',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.0L',
'expiration_date': '2026-03-29T10:00:00Z',
'fuel_type': 'Petrol',
'id': '913f45e6-aa2c-5e38-9951-9364f5240b8c',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'NY15 BUO',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=NY15%20BUO&vehicleType=*',
'listing': 'auction',
'location': 'Newcastle-u-Tyne',
'make': 'HYUNDAI',
'model': 'I10',
'odometer': 17428,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-01-01',
'seller_name': None,
'title': 'HYUNDAI I10 1.0 S Hatchback',
'transmission': 'manual',
'trim': 'S',
'vin': 'NLHA751ALGZ164509',
'year': 2015}
2026-03-28 14:04:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27NY15%2520BUO%27 HTTP/1.1" 200 None
2026-03-28 14:04:50 [bca.uk] INFO: Saving data for NY15%20BUO: {'auction_closing_time': 1774778400.0, 'created_time': 1774524306.527362, 'last_price_update_time': 1774706690.529377}
2026-03-28 14:04:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='NY15%2520BUO') HTTP/1.1" 204 0
2026-03-28 14:04:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: cdaa9411-8148-5f71-bb89-a031dafbf539 with identifier: HV08%20XHP
2026-03-28 14:04:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: cdaa9411-8148-5f71-bb89-a031dafbf539 with identifier: HV08%20XHP
2026-03-28 14:04:50 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: cdaa9411-8148-5f71-bb89-a031dafbf539 with identifier: HV08%20XHP to the API
2026-03-28 14:04:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:04:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:04:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HV08XHP/698707943/600>
{'auction_title': '',
'c_o_2_emission_value': 192,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cdaa9411-8148-5f71-bb89-a031dafbf539/cdaa9411-8148-5f71-bb89-a031dafbf539_expert_report_file_3c27e54b-1233-4f8b-a2bb-6dc14d50ddb4.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=HV08%20XHP-GB',
'category': 'Car',
'color': 'grey',
'currency': 'GBP',
'doors_number': 5,
'engine': '2.0L',
'expiration_date': '2026-03-29T10:00:00Z',
'fuel_type': 'Petrol',
'id': 'cdaa9411-8148-5f71-bb89-a031dafbf539',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'HV08 XHP',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=HV08%20XHP&vehicleType=*',
'listing': 'auction',
'location': 'Blackbushe',
'make': 'HONDA',
'model': 'CR-V',
'odometer': 134010,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 11,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cdaa9411-8148-5f71-bb89-a031dafbf539/cdaa9411-8148-5f71-bb89-a031dafbf539_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 56739,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HV08XHP/698707901/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cdaa9411-8148-5f71-bb89-a031dafbf539/cdaa9411-8148-5f71-bb89-a031dafbf539_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 52890,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HV08XHP/698707920/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cdaa9411-8148-5f71-bb89-a031dafbf539/cdaa9411-8148-5f71-bb89-a031dafbf539_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 50868,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HV08XHP/698707943/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cdaa9411-8148-5f71-bb89-a031dafbf539/cdaa9411-8148-5f71-bb89-a031dafbf539_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 52788,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HV08XHP/698707976/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cdaa9411-8148-5f71-bb89-a031dafbf539/cdaa9411-8148-5f71-bb89-a031dafbf539_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 55369,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HV08XHP/698708000/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cdaa9411-8148-5f71-bb89-a031dafbf539/cdaa9411-8148-5f71-bb89-a031dafbf539_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 50832,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HV08XHP/698708031/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cdaa9411-8148-5f71-bb89-a031dafbf539/cdaa9411-8148-5f71-bb89-a031dafbf539_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 93763,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HV08XHP/698708079/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cdaa9411-8148-5f71-bb89-a031dafbf539/cdaa9411-8148-5f71-bb89-a031dafbf539_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 70530,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HV08XHP/698708117/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cdaa9411-8148-5f71-bb89-a031dafbf539/cdaa9411-8148-5f71-bb89-a031dafbf539_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 92318,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HV08XHP/698708152/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cdaa9411-8148-5f71-bb89-a031dafbf539/cdaa9411-8148-5f71-bb89-a031dafbf539_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 60675,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HV08XHP/698708185/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2008-01-01',
'seller_name': None,
'title': 'HONDA CR-V 2.0 I-VTEC EX Estate',
'transmission': 'manual',
'trim': 'I-VTEC EX',
'vin': 'SHSRE57708U012989',
'year': 2008}
2026-03-28 14:04:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27HV08%2520XHP%27 HTTP/1.1" 200 None
2026-03-28 14:04:50 [bca.uk] INFO: Saving data for HV08%20XHP: {'created_time': 1774706690.938022, 'last_price_update_time': 1774706690.938033, 'auction_closing_time': 1774778400.0}
2026-03-28 14:04:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='HV08%2520XHP') HTTP/1.1" 204 0
2026-03-28 14:04:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: a3ad7a0d-b4c8-5ced-b470-27d0e0c9322f with identifier: FE12%20WRX
2026-03-28 14:04:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: a3ad7a0d-b4c8-5ced-b470-27d0e0c9322f with identifier: FE12%20WRX
2026-03-28 14:04:51 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: a3ad7a0d-b4c8-5ced-b470-27d0e0c9322f with identifier: FE12%20WRX to the API
2026-03-28 14:04:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:04:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:04:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FE12WRX/698993222/600>
{'auction_title': '',
'c_o_2_emission_value': 139,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a3ad7a0d-b4c8-5ced-b470-27d0e0c9322f/a3ad7a0d-b4c8-5ced-b470-27d0e0c9322f_expert_report_file_c1170ebb-470e-436b-9a3e-94a957a120bb.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=FE12%20WRX-GB',
'category': 'Car',
'color': 'silver',
'currency': 'GBP',
'doors_number': 5,
'engine': '2.0L',
'expiration_date': '2026-03-29T10:00:00Z',
'fuel_type': 'Diesel',
'id': 'a3ad7a0d-b4c8-5ced-b470-27d0e0c9322f',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'FE12 WRX',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=FE12%20WRX&vehicleType=*',
'listing': 'auction',
'location': 'Bedford',
'make': 'FORD',
'model': 'MONDEO',
'odometer': 51519,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 13,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a3ad7a0d-b4c8-5ced-b470-27d0e0c9322f/a3ad7a0d-b4c8-5ced-b470-27d0e0c9322f_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 44528,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FE12WRX/698993191/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a3ad7a0d-b4c8-5ced-b470-27d0e0c9322f/a3ad7a0d-b4c8-5ced-b470-27d0e0c9322f_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 44024,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FE12WRX/698993215/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a3ad7a0d-b4c8-5ced-b470-27d0e0c9322f/a3ad7a0d-b4c8-5ced-b470-27d0e0c9322f_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 41714,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FE12WRX/698993222/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a3ad7a0d-b4c8-5ced-b470-27d0e0c9322f/a3ad7a0d-b4c8-5ced-b470-27d0e0c9322f_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 38758,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FE12WRX/698993234/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a3ad7a0d-b4c8-5ced-b470-27d0e0c9322f/a3ad7a0d-b4c8-5ced-b470-27d0e0c9322f_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 36689,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FE12WRX/698993239/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a3ad7a0d-b4c8-5ced-b470-27d0e0c9322f/a3ad7a0d-b4c8-5ced-b470-27d0e0c9322f_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 36360,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FE12WRX/698993245/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a3ad7a0d-b4c8-5ced-b470-27d0e0c9322f/a3ad7a0d-b4c8-5ced-b470-27d0e0c9322f_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 57982,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FE12WRX/698993255/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a3ad7a0d-b4c8-5ced-b470-27d0e0c9322f/a3ad7a0d-b4c8-5ced-b470-27d0e0c9322f_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 61866,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FE12WRX/698993267/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a3ad7a0d-b4c8-5ced-b470-27d0e0c9322f/a3ad7a0d-b4c8-5ced-b470-27d0e0c9322f_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 77237,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FE12WRX/698993276/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a3ad7a0d-b4c8-5ced-b470-27d0e0c9322f/a3ad7a0d-b4c8-5ced-b470-27d0e0c9322f_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 76438,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FE12WRX/698993287/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2012-01-01',
'seller_name': None,
'title': 'FORD MONDEO 2.0 TDCI 163 TITANIUM X Hatchback',
'transmission': 'manual',
'trim': 'TDCI 163 TITANIUM X',
'vin': 'WF0EXXGBBEBM18560',
'year': 2012}
2026-03-28 14:04:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FE12%2520WRX%27 HTTP/1.1" 200 None
2026-03-28 14:04:51 [bca.uk] INFO: Saving data for FE12%20WRX: {'created_time': 1774706691.347143, 'last_price_update_time': 1774706691.347155, 'auction_closing_time': 1774778400.0}
2026-03-28 14:04:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='FE12%2520WRX') HTTP/1.1" 204 0
2026-03-28 14:04:51 [bca.uk] INFO: Found listing with ID: SN14%20XMR
2026-03-28 14:04:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SN14%2520XMR%27 HTTP/1.1" 200 None
2026-03-28 14:04:51 [bca.uk] INFO: Scrape type for SN14%20XMR: 0
2026-03-28 14:04:51 [bca.uk] INFO: Found listing with ID: EN67%20XLH
2026-03-28 14:04:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27EN67%2520XLH%27 HTTP/1.1" 200 None
2026-03-28 14:04:51 [bca.uk] INFO: Scrape type for EN67%20XLH: 2
2026-03-28 14:04:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fa55a28e-6d3c-5194-ab57-72376a8229bd with identifier: EN67%20XLH
2026-03-28 14:04:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fa55a28e-6d3c-5194-ab57-72376a8229bd with scrape type 2
2026-03-28 14:04:51 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item fa55a28e-6d3c-5194-ab57-72376a8229bd with scrape type 2
2026-03-28 14:04:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: fa55a28e-6d3c-5194-ab57-72376a8229bd, identifier: EN67%20XLH
2026-03-28 14:04:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.bca.co.uk/api/search?q=&pageSize=100&page=9&sort=MostRecentlyAdded> (referer: https://www.bca.co.uk/search) ['zyte-api']
2026-03-28 14:04:51 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:04:51 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:04:51 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:04:51 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:04:51 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:04:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:04:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c750910>
2026-03-28 14:04:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:04:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:04:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:04:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8f3e30a4-6b64-5dd1-8e1e-6cce5d49fef3/8f3e30a4-6b64-5dd1-8e1e-6cce5d49fef3_image_8.jpg HTTP/1.1" 201 0
2026-03-28 14:04:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FPXZ1595%252F698814242%252F600') HTTP/1.1" 204 0
2026-03-28 14:04:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PXZ1595/698814242/600 saved to cache
2026-03-28 14:04:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 8f3e30a4-6b64-5dd1-8e1e-6cce5d49fef3
2026-03-28 14:04:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/JP04STP/42809620?sv=2020-08-04&st=2026-03-28T14%3A04%3A43Z&se=2026-03-28T14%3A29%3A43Z&sr=b&sp=r&sig=au5c8GXv2vCUIG4ea67UD3YzlPMQz7%2FWxYZM6tUj%2FEo%3D> (referer: https://www.bca.co.uk/)
2026-03-28 14:04:51 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WJ58DWA/697410351/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=697410351>
2026-03-28 14:04:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: fa55a28e-6d3c-5194-ab57-72376a8229bd with identifier: EN67%20XLH
2026-03-28 14:04:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: fa55a28e-6d3c-5194-ab57-72376a8229bd with identifier: EN67%20XLH
2026-03-28 14:04:51 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: fa55a28e-6d3c-5194-ab57-72376a8229bd with identifier: EN67%20XLH to the API
2026-03-28 14:04:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:04:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:04:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=8&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 115,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=EN67%20XLH-GB',
'category': 'Car',
'color': 'black',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.2L',
'expiration_date': '2026-03-29T10:00:00Z',
'fuel_type': 'Petrol',
'id': 'fa55a28e-6d3c-5194-ab57-72376a8229bd',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'EN67 XLH',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=EN67%20XLH&vehicleType=*',
'listing': 'auction',
'location': 'Newcastle-u-Tyne',
'make': 'CITROEN',
'model': 'C3 AIRCROSS',
'odometer': 46947,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-01-01',
'seller_name': None,
'title': 'CITROEN C3 AIRCROSS 1.2 P/T 110 FEEL Hatchback',
'transmission': 'manual',
'trim': 'P/T 110 FEEL',
'vin': 'VF72RHNZBJ4167628',
'year': 2018}
2026-03-28 14:04:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27EN67%2520XLH%27 HTTP/1.1" 200 None
2026-03-28 14:04:51 [bca.uk] INFO: Saving data for EN67%20XLH: {'auction_closing_time': 1774778400.0, 'created_time': 1774390900.932913, 'last_price_update_time': 1774706691.859482}
2026-03-28 14:04:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='EN67%2520XLH') HTTP/1.1" 204 0
2026-03-28 14:04:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AK67LWT/698947264/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/AK67LWT/42810366?sv=2020-08-04&st=2026-03-28T14%3A04%3A00Z&se=2026-03-28T14%3A29%3A00Z&sr=b&sp=r&sig=dnN3%2FeKHnzQfSMnyGaraMReo6SkHH2Dy4nbY3zUESfI%3D)
2026-03-28 14:04:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WJ58DWA/697410359/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/WJ58DWA/42809994?sv=2020-08-04&st=2026-03-28T14%3A04%3A01Z&se=2026-03-28T14%3A29%3A01Z&sr=b&sp=r&sig=WelJkUnZ%2FryduuiTM2iL%2FzPRBftp3wpY3FkYWG%2FP0gk%3D)
2026-03-28 14:04:51 [bca.uk] INFO: Found listing with ID: NV07%20OAE
2026-03-28 14:04:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27NV07%2520OAE%27 HTTP/1.1" 200 None
2026-03-28 14:04:51 [bca.uk] INFO: Scrape type for NV07%20OAE: 0
2026-03-28 14:04:51 [bca.uk] INFO: Found listing with ID: DL64%20RZO
2026-03-28 14:04:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DL64%2520RZO%27 HTTP/1.1" 200 None
2026-03-28 14:04:51 [bca.uk] INFO: Scrape type for DL64%20RZO: 0
2026-03-28 14:04:51 [bca.uk] INFO: Found listing with ID: NJ64%20NVR
2026-03-28 14:04:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27NJ64%2520NVR%27 HTTP/1.1" 200 None
2026-03-28 14:04:51 [bca.uk] INFO: Scrape type for NJ64%20NVR: 0
2026-03-28 14:04:51 [bca.uk] INFO: Found listing with ID: NL65%20PXC
2026-03-28 14:04:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27NL65%2520PXC%27 HTTP/1.1" 200 None
2026-03-28 14:04:51 [bca.uk] INFO: Scrape type for NL65%20PXC: 0
2026-03-28 14:04:51 [bca.uk] INFO: Found listing with ID: NX15%20OHH
2026-03-28 14:04:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27NX15%2520OHH%27 HTTP/1.1" 200 None
2026-03-28 14:04:51 [bca.uk] INFO: Scrape type for NX15%20OHH: 0
2026-03-28 14:04:51 [bca.uk] INFO: Found listing with ID: VN64%20YVX
2026-03-28 14:04:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27VN64%2520YVX%27 HTTP/1.1" 200 None
2026-03-28 14:04:51 [bca.uk] INFO: Scrape type for VN64%20YVX: 0
2026-03-28 14:04:51 [bca.uk] INFO: Found listing with ID: VO66%20FHR
2026-03-28 14:04:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27VO66%2520FHR%27 HTTP/1.1" 200 None
2026-03-28 14:04:52 [bca.uk] INFO: Scrape type for VO66%20FHR: 2
2026-03-28 14:04:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7b290c69-1b7f-568f-b12a-fca4c3f89f87 with identifier: VO66%20FHR
2026-03-28 14:04:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7b290c69-1b7f-568f-b12a-fca4c3f89f87 with scrape type 2
2026-03-28 14:04:52 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7b290c69-1b7f-568f-b12a-fca4c3f89f87 with scrape type 2
2026-03-28 14:04:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 7b290c69-1b7f-568f-b12a-fca4c3f89f87, identifier: VO66%20FHR
2026-03-28 14:04:52 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AK67LWT/698947249/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698947249>
2026-03-28 14:04:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 7b290c69-1b7f-568f-b12a-fca4c3f89f87 with identifier: VO66%20FHR
2026-03-28 14:04:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 7b290c69-1b7f-568f-b12a-fca4c3f89f87 with identifier: VO66%20FHR
2026-03-28 14:04:52 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 7b290c69-1b7f-568f-b12a-fca4c3f89f87 with identifier: VO66%20FHR to the API
2026-03-28 14:04:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:04:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:04:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=8&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 139,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=VO66%20FHR-GB',
'category': 'Car',
'color': 'grey',
'currency': 'GBP',
'doors_number': 5,
'engine': '2.0L',
'expiration_date': '2026-03-29T10:00:00Z',
'fuel_type': 'Diesel',
'id': '7b290c69-1b7f-568f-b12a-fca4c3f89f87',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'VO66 FHR',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=VO66%20FHR&vehicleType=*',
'listing': 'auction',
'location': 'Newcastle-u-Tyne',
'make': 'LAND ROVER',
'model': 'DISCOVERY SPORT',
'odometer': 85024,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-01-01',
'seller_name': None,
'title': 'LAND ROVER DISCOVERY SPORT 2.0 TD4 180 SE TECH StationWagon',
'transmission': 'manual',
'trim': 'TD4 180 SE TECH',
'vin': 'SALCA2CNXHH660615',
'year': 2016}
2026-03-28 14:04:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27VO66%2520FHR%27 HTTP/1.1" 200 None
2026-03-28 14:04:52 [bca.uk] INFO: Saving data for VO66%20FHR: {'auction_closing_time': 1774778400.0, 'created_time': 1774524199.010838, 'last_price_update_time': 1774706692.438216}
2026-03-28 14:04:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='VO66%2520FHR') HTTP/1.1" 204 0
2026-03-28 14:04:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:04:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c3d27d0>
2026-03-28 14:04:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:04:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:04:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:04:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_826679c4-b83f-5ad2-b8a7-2183b5f0a082/826679c4-b83f-5ad2-b8a7-2183b5f0a082_image_2.jpg HTTP/1.1" 201 0
2026-03-28 14:04:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLD16UKX%252F699001704%252F600') HTTP/1.1" 204 0
2026-03-28 14:04:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LD16UKX/699001704/600 saved to cache
2026-03-28 14:04:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 826679c4-b83f-5ad2-b8a7-2183b5f0a082
2026-03-28 14:04:52 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:04:52 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:04:52 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:04:52 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:04:52 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:04:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:04:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c3a23d0>
2026-03-28 14:04:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:04:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:04:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:04:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ca2c3006-0503-55ad-a26d-88f328a541b5/ca2c3006-0503-55ad-a26d-88f328a541b5_image_8.jpg HTTP/1.1" 201 0
2026-03-28 14:04:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FBT66DFX%252F698129725%252F600') HTTP/1.1" 204 0
2026-03-28 14:04:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BT66DFX/698129725/600 saved to cache
2026-03-28 14:04:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item ca2c3006-0503-55ad-a26d-88f328a541b5
2026-03-28 14:04:52 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YB63ZKP/698284395/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698284395>
2026-03-28 14:04:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YB63ZKP/698284400/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YB63ZKP/42797877?sv=2020-08-04&st=2026-03-28T14%3A04%3A00Z&se=2026-03-28T14%3A29%3A00Z&sr=b&sp=r&sig=86nclI4iCmgLh3evtZ%2BtpNUit8HkmrBcUBeJLBRYtzg%3D)
2026-03-28 14:04:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HY65KRJ/698920420/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/HY65KRJ/42809575?sv=2020-08-04&st=2026-03-28T14%3A03%3A59Z&se=2026-03-28T14%3A28%3A59Z&sr=b&sp=r&sig=qQyrthkWradfVt2c0sIhPBRny5qzj5uOjQmOciVVoMo%3D)
2026-03-28 14:04:52 [bca.uk] INFO: Found listing with ID: YP64%20FXK
2026-03-28 14:04:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YP64%2520FXK%27 HTTP/1.1" 200 None
2026-03-28 14:04:52 [bca.uk] INFO: Scrape type for YP64%20FXK: 0
2026-03-28 14:04:52 [bca.uk] INFO: Found listing with ID: NA20%20MYY
2026-03-28 14:04:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27NA20%2520MYY%27 HTTP/1.1" 200 None
2026-03-28 14:04:52 [bca.uk] INFO: Scrape type for NA20%20MYY: 0
2026-03-28 14:04:52 [bca.uk] INFO: Found listing with ID: NG17%20ZRR
2026-03-28 14:04:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27NG17%2520ZRR%27 HTTP/1.1" 200 None
2026-03-28 14:04:52 [bca.uk] INFO: Scrape type for NG17%20ZRR: 0
2026-03-28 14:04:52 [bca.uk] INFO: Found listing with ID: AF14%20UDV
2026-03-28 14:04:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27AF14%2520UDV%27 HTTP/1.1" 200 None
2026-03-28 14:04:52 [bca.uk] INFO: Scrape type for AF14%20UDV: 0
2026-03-28 14:04:52 [bca.uk] INFO: Found listing with ID: BJ17%20OUK
2026-03-28 14:04:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BJ17%2520OUK%27 HTTP/1.1" 200 None
2026-03-28 14:04:52 [bca.uk] INFO: Scrape type for BJ17%20OUK: 0
2026-03-28 14:04:52 [bca.uk] INFO: Found listing with ID: NL15%20BYY
2026-03-28 14:04:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27NL15%2520BYY%27 HTTP/1.1" 200 None
2026-03-28 14:04:52 [bca.uk] INFO: Scrape type for NL15%20BYY: 0
2026-03-28 14:04:52 [bca.uk] INFO: Found listing with ID: NV11%20WJG
2026-03-28 14:04:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27NV11%2520WJG%27 HTTP/1.1" 200 None
2026-03-28 14:04:52 [bca.uk] INFO: Scrape type for NV11%20WJG: 0
2026-03-28 14:04:52 [bca.uk] INFO: Found listing with ID: RJ18%20UXW
2026-03-28 14:04:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27RJ18%2520UXW%27 HTTP/1.1" 200 None
2026-03-28 14:04:52 [bca.uk] INFO: Scrape type for RJ18%20UXW: 0
2026-03-28 14:04:52 [bca.uk] INFO: Found listing with ID: SA15%20FDF
2026-03-28 14:04:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SA15%2520FDF%27 HTTP/1.1" 200 None
2026-03-28 14:04:52 [bca.uk] INFO: Scrape type for SA15%20FDF: 0
2026-03-28 14:04:52 [bca.uk] INFO: Found listing with ID: SM13%20YUF
2026-03-28 14:04:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SM13%2520YUF%27 HTTP/1.1" 200 None
2026-03-28 14:04:52 [bca.uk] INFO: Scrape type for SM13%20YUF: 0
2026-03-28 14:04:52 [bca.uk] INFO: Found listing with ID: SP59%20HRM
2026-03-28 14:04:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SP59%2520HRM%27 HTTP/1.1" 200 None
2026-03-28 14:04:52 [bca.uk] INFO: Scrape type for SP59%20HRM: 0
2026-03-28 14:04:52 [bca.uk] INFO: Found listing with ID: SU06%20XOV
2026-03-28 14:04:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SU06%2520XOV%27 HTTP/1.1" 200 None
2026-03-28 14:04:52 [bca.uk] INFO: Scrape type for SU06%20XOV: 0
2026-03-28 14:04:52 [bca.uk] INFO: Found listing with ID: WV62%20MWJ
2026-03-28 14:04:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WV62%2520MWJ%27 HTTP/1.1" 200 None
2026-03-28 14:04:52 [bca.uk] INFO: Scrape type for WV62%20MWJ: 0
2026-03-28 14:04:52 [bca.uk] INFO: Found listing with ID: Y7%20ECR
2026-03-28 14:04:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27Y7%2520ECR%27 HTTP/1.1" 200 None
2026-03-28 14:04:52 [bca.uk] INFO: Scrape type for Y7%20ECR: 0
2026-03-28 14:04:52 [bca.uk] INFO: Found listing with ID: YD11%20KRU
2026-03-28 14:04:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YD11%2520KRU%27 HTTP/1.1" 200 None
2026-03-28 14:04:52 [bca.uk] INFO: Scrape type for YD11%20KRU: 0
2026-03-28 14:04:52 [bca.uk] INFO: Found listing with ID: KU63%20OUW
2026-03-28 14:04:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KU63%2520OUW%27 HTTP/1.1" 200 None
2026-03-28 14:04:52 [bca.uk] INFO: Scrape type for KU63%20OUW: 0
2026-03-28 14:04:52 [bca.uk] INFO: Found listing with ID: MA07%20OEU
2026-03-28 14:04:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MA07%2520OEU%27 HTTP/1.1" 200 None
2026-03-28 14:04:52 [bca.uk] INFO: Scrape type for MA07%20OEU: 0
2026-03-28 14:04:52 [bca.uk] INFO: Found listing with ID: NA62%20FJJ
2026-03-28 14:04:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27NA62%2520FJJ%27 HTTP/1.1" 200 None
2026-03-28 14:04:52 [bca.uk] INFO: Scrape type for NA62%20FJJ: 0
2026-03-28 14:04:52 [bca.uk] INFO: Found listing with ID: NC13%20CGF
2026-03-28 14:04:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27NC13%2520CGF%27 HTTP/1.1" 200 None
2026-03-28 14:04:52 [bca.uk] INFO: Scrape type for NC13%20CGF: 0
2026-03-28 14:04:52 [bca.uk] INFO: Found listing with ID: ND58%20HME
2026-03-28 14:04:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27ND58%2520HME%27 HTTP/1.1" 200 None
2026-03-28 14:04:52 [bca.uk] INFO: Scrape type for ND58%20HME: 0
2026-03-28 14:04:52 [bca.uk] INFO: Found listing with ID: NG12%20FFB
2026-03-28 14:04:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27NG12%2520FFB%27 HTTP/1.1" 200 None
2026-03-28 14:04:52 [bca.uk] INFO: Scrape type for NG12%20FFB: 0
2026-03-28 14:04:52 [bca.uk] INFO: Found listing with ID: NL12%20SOU
2026-03-28 14:04:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27NL12%2520SOU%27 HTTP/1.1" 200 None
2026-03-28 14:04:53 [bca.uk] INFO: Scrape type for NL12%20SOU: 0
2026-03-28 14:04:53 [bca.uk] INFO: Found listing with ID: NL13%20WKA
2026-03-28 14:04:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27NL13%2520WKA%27 HTTP/1.1" 200 None
2026-03-28 14:04:53 [bca.uk] INFO: Scrape type for NL13%20WKA: 0
2026-03-28 14:04:53 [bca.uk] INFO: Found listing with ID: AJ58%20LJC
2026-03-28 14:04:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27AJ58%2520LJC%27 HTTP/1.1" 200 None
2026-03-28 14:04:53 [bca.uk] INFO: Scrape type for AJ58%20LJC: 0
2026-03-28 14:04:53 [bca.uk] INFO: Found listing with ID: BJ13%20WXR
2026-03-28 14:04:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BJ13%2520WXR%27 HTTP/1.1" 200 None
2026-03-28 14:04:53 [bca.uk] INFO: Scrape type for BJ13%20WXR: 0
2026-03-28 14:04:53 [bca.uk] INFO: Found listing with ID: DS15%20CXK
2026-03-28 14:04:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DS15%2520CXK%27 HTTP/1.1" 200 None
2026-03-28 14:04:53 [bca.uk] INFO: Scrape type for DS15%20CXK: 0
2026-03-28 14:04:53 [bca.uk] INFO: Found listing with ID: DY61%20EZV
2026-03-28 14:04:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DY61%2520EZV%27 HTTP/1.1" 200 None
2026-03-28 14:04:53 [bca.uk] INFO: Scrape type for DY61%20EZV: 0
2026-03-28 14:04:53 [bca.uk] INFO: Found listing with ID: FG63%20FHC
2026-03-28 14:04:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FG63%2520FHC%27 HTTP/1.1" 200 None
2026-03-28 14:04:53 [bca.uk] INFO: Scrape type for FG63%20FHC: 0
2026-03-28 14:04:53 [bca.uk] INFO: Found listing with ID: GJ56%20ZHY
2026-03-28 14:04:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GJ56%2520ZHY%27 HTTP/1.1" 200 None
2026-03-28 14:04:53 [bca.uk] INFO: Scrape type for GJ56%20ZHY: 2
2026-03-28 14:04:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 387e825d-9f70-5679-a276-321ddd289d76 with identifier: GJ56%20ZHY
2026-03-28 14:04:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 387e825d-9f70-5679-a276-321ddd289d76 with scrape type 2
2026-03-28 14:04:53 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 387e825d-9f70-5679-a276-321ddd289d76 with scrape type 2
2026-03-28 14:04:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 387e825d-9f70-5679-a276-321ddd289d76, identifier: GJ56%20ZHY
2026-03-28 14:04:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 387e825d-9f70-5679-a276-321ddd289d76 with identifier: GJ56%20ZHY
2026-03-28 14:04:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 387e825d-9f70-5679-a276-321ddd289d76 with identifier: GJ56%20ZHY
2026-03-28 14:04:53 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 387e825d-9f70-5679-a276-321ddd289d76 with identifier: GJ56%20ZHY to the API
2026-03-28 14:04:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:04:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:04:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=8&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 200,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=GJ56%20ZHY-GB',
'category': 'Car',
'color': 'silver',
'currency': 'GBP',
'doors_number': 4,
'engine': '1.8L',
'expiration_date': '2026-03-29T10:00:00Z',
'fuel_type': 'Petrol',
'id': '387e825d-9f70-5679-a276-321ddd289d76',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'GJ56 ZHY',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=GJ56%20ZHY&vehicleType=*',
'listing': 'auction',
'location': 'Newcastle-u-Tyne',
'make': 'MERCEDES-BENZ',
'model': 'C180',
'odometer': 166085,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2006-01-01',
'seller_name': None,
'title': 'MERCEDES-BENZ C180 1.8 K AVANTGARDE SE Saloon',
'transmission': 'manual',
'trim': 'K AVANTGARDE SE',
'vin': 'WDC2030462R240465',
'year': 2006}
2026-03-28 14:04:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GJ56%2520ZHY%27 HTTP/1.1" 200 None
2026-03-28 14:04:53 [bca.uk] INFO: Saving data for GJ56%20ZHY: {'auction_closing_time': 1774778400.0, 'created_time': 1774044274.956008, 'last_price_update_time': 1774706693.597691}
2026-03-28 14:04:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='GJ56%2520ZHY') HTTP/1.1" 204 0
2026-03-28 14:04:53 [bca.uk] INFO: Total items found: 100
2026-03-28 14:04:53 [bca.uk] INFO: Requesting URL: https://www.bca.co.uk/api/search?q=&pageSize=100&page=10&sort=MostRecentlyAdded
2026-03-28 14:04:53 [bca.uk] INFO: Sending search API request with Bearer token (length=1492)
2026-03-28 14:04:53 [scrapy_zyte_api._params] WARNING: Request <GET https://www.bca.co.uk/api/search?q=&pageSize=100&page=10&sort=MostRecentlyAdded> defines the Zyte API customHttpRequestHeaders parameter, overriding Request.headers. Use Request.headers instead.
2026-03-28 14:04:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:04:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c4d0f10>
2026-03-28 14:04:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:04:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:04:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:04:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bbc16d12-29f9-531b-8c11-9870b348d92a/bbc16d12-29f9-531b-8c11-9870b348d92a_expert_report_file_01221232-4286-4f1d-b805-53a5330d1249.pdf HTTP/1.1" 201 0
2026-03-28 14:04:53 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item bbc16d12-29f9-531b-8c11-9870b348d92a
2026-03-28 14:04:53 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: bbc16d12-29f9-531b-8c11-9870b348d92a, skipping ID generation
2026-03-28 14:04:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item bbc16d12-29f9-531b-8c11-9870b348d92a
2026-03-28 14:04:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DJP04STP-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-28 14:04:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=JP04STP-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-28 14:04:53 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:04:53 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:04:53 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:04:53 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:04:53 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:04:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:04:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2d8d9510>
2026-03-28 14:04:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:04:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:04:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:04:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_96df00f7-d862-5338-b935-5c42d63b82c0/96df00f7-d862-5338-b935-5c42d63b82c0_image_9.jpg HTTP/1.1" 201 0
2026-03-28 14:04:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FAK67LWT%252F698947264%252F600') HTTP/1.1" 204 0
2026-03-28 14:04:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AK67LWT/698947264/600 saved to cache
2026-03-28 14:04:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 96df00f7-d862-5338-b935-5c42d63b82c0
2026-03-28 14:04:53 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:04:53 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:04:53 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:04:53 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:04:53 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:04:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:04:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2dcdb650>
2026-03-28 14:04:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:04:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:04:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:04:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8413221f-7948-5093-9030-c87150f157c7/8413221f-7948-5093-9030-c87150f157c7_image_6.jpg HTTP/1.1" 201 0
2026-03-28 14:04:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FWJ58DWA%252F697410359%252F600') HTTP/1.1" 204 0
2026-03-28 14:04:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WJ58DWA/697410359/600 saved to cache
2026-03-28 14:04:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 8413221f-7948-5093-9030-c87150f157c7
2026-03-28 14:04:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LD16UKX/699001701/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LD16UKX/42809855?sv=2020-08-04&st=2026-03-28T14%3A04%3A07Z&se=2026-03-28T14%3A29%3A07Z&sr=b&sp=r&sig=CHOiwblSOmf2jh7w7FrmkfA8BVi7dwLavRkRtCs3kTQ%3D)
2026-03-28 14:04:53 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HY65KRJ/698920412/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698920412>
2026-03-28 14:04:53 [bca.uk] INFO: Found listing with ID: YP13%20AUV
2026-03-28 14:04:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YP13%2520AUV%27 HTTP/1.1" 200 None
2026-03-28 14:04:53 [bca.uk] INFO: Scrape type for YP13%20AUV: 0
2026-03-28 14:04:53 [bca.uk] INFO: Found listing with ID: KM14%20WMU
2026-03-28 14:04:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KM14%2520WMU%27 HTTP/1.1" 200 None
2026-03-28 14:04:53 [bca.uk] INFO: Scrape type for KM14%20WMU: 2
2026-03-28 14:04:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4bf87de0-cca3-528a-8e83-9827d6a08737 with identifier: KM14%20WMU
2026-03-28 14:04:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4bf87de0-cca3-528a-8e83-9827d6a08737 with scrape type 2
2026-03-28 14:04:53 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4bf87de0-cca3-528a-8e83-9827d6a08737 with scrape type 2
2026-03-28 14:04:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 4bf87de0-cca3-528a-8e83-9827d6a08737, identifier: KM14%20WMU
2026-03-28 14:04:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/ST12HSO/42809912?sv=2020-08-04&st=2026-03-28T14%3A04%3A46Z&se=2026-03-28T14%3A29%3A46Z&sr=b&sp=r&sig=tOhj9TDOiYV6354bfaZJlS4RufTDvGneY43ZqD%2FSIPw%3D> (referer: https://www.bca.co.uk/)
2026-03-28 14:04:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BT66DFX/698129720/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/BT66DFX/42810013?sv=2020-08-04&st=2026-03-28T14%3A04%3A00Z&se=2026-03-28T14%3A29%3A00Z&sr=b&sp=r&sig=Yx0iLoKJXBk4DPNXOVJLOrRp66ZUz648vIo6BTtbrJ0%3D)
2026-03-28 14:04:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 4bf87de0-cca3-528a-8e83-9827d6a08737 with identifier: KM14%20WMU
2026-03-28 14:04:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 4bf87de0-cca3-528a-8e83-9827d6a08737 with identifier: KM14%20WMU
2026-03-28 14:04:54 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 4bf87de0-cca3-528a-8e83-9827d6a08737 with identifier: KM14%20WMU to the API
2026-03-28 14:04:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:04:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:04:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=8&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 164,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=KM14%20WMU-GB',
'category': 'Car',
'color': 'blue',
'currency': 'GBP',
'doors_number': 5,
'engine': '2.0L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Diesel',
'id': '4bf87de0-cca3-528a-8e83-9827d6a08737',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'KM14 WMU',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=KM14%20WMU&vehicleType=*',
'listing': 'auction',
'location': 'Measham',
'make': 'PEUGEOT',
'model': '5008',
'odometer': 78578,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2014-01-01',
'seller_name': None,
'title': 'PEUGEOT 5008 2.0 HDI 163 ALLURE MPV',
'transmission': 'automatic',
'trim': 'HDI 163 ALLURE',
'vin': 'VF30ERHHAES082265',
'year': 2014}
2026-03-28 14:04:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KM14%2520WMU%27 HTTP/1.1" 200 None
2026-03-28 14:04:54 [bca.uk] INFO: Saving data for KM14%20WMU: {'auction_closing_time': 1774864800.0, 'created_time': 1774391463.701358, 'last_price_update_time': 1774706694.392171}
2026-03-28 14:04:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='KM14%2520WMU') HTTP/1.1" 204 0
2026-03-28 14:04:54 [bca.uk] INFO: Found listing with ID: DF66%20HMU
2026-03-28 14:04:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DF66%2520HMU%27 HTTP/1.1" 200 None
2026-03-28 14:04:54 [bca.uk] INFO: Scrape type for DF66%20HMU: 0
2026-03-28 14:04:54 [bca.uk] INFO: Found listing with ID: FH66%20SFV
2026-03-28 14:04:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FH66%2520SFV%27 HTTP/1.1" 200 None
2026-03-28 14:04:54 [bca.uk] INFO: Scrape type for FH66%20SFV: 0
2026-03-28 14:04:54 [bca.uk] INFO: Found listing with ID: GF60%20JYK
2026-03-28 14:04:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GF60%2520JYK%27 HTTP/1.1" 200 None
2026-03-28 14:04:54 [bca.uk] INFO: Scrape type for GF60%20JYK: 0
2026-03-28 14:04:54 [bca.uk] INFO: Found listing with ID: MA10%20MJF
2026-03-28 14:04:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MA10%2520MJF%27 HTTP/1.1" 200 None
2026-03-28 14:04:54 [bca.uk] INFO: Scrape type for MA10%20MJF: 0
2026-03-28 14:04:54 [bca.uk] INFO: Found listing with ID: PX13%20OFM
2026-03-28 14:04:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27PX13%2520OFM%27 HTTP/1.1" 200 None
2026-03-28 14:04:54 [bca.uk] INFO: Scrape type for PX13%20OFM: 0
2026-03-28 14:04:54 [bca.uk] INFO: Found listing with ID: C7%20WRJ
2026-03-28 14:04:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27C7%2520WRJ%27 HTTP/1.1" 200 None
2026-03-28 14:04:54 [bca.uk] INFO: Scrape type for C7%20WRJ: 0
2026-03-28 14:04:54 [bca.uk] INFO: Found listing with ID: SR68%20NWE
2026-03-28 14:04:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SR68%2520NWE%27 HTTP/1.1" 200 None
2026-03-28 14:04:54 [bca.uk] INFO: Scrape type for SR68%20NWE: 0
2026-03-28 14:04:54 [bca.uk] INFO: Found listing with ID: SG64%20KJZ
2026-03-28 14:04:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SG64%2520KJZ%27 HTTP/1.1" 200 None
2026-03-28 14:04:54 [bca.uk] INFO: Scrape type for SG64%20KJZ: 0
2026-03-28 14:04:54 [bca.uk] INFO: Found listing with ID: SV14%20VWC
2026-03-28 14:04:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SV14%2520VWC%27 HTTP/1.1" 200 None
2026-03-28 14:04:54 [bca.uk] INFO: Scrape type for SV14%20VWC: 0
2026-03-28 14:04:54 [bca.uk] INFO: Found listing with ID: FG60%20TLX
2026-03-28 14:04:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FG60%2520TLX%27 HTTP/1.1" 200 None
2026-03-28 14:04:54 [bca.uk] INFO: Scrape type for FG60%20TLX: 0
2026-03-28 14:04:54 [bca.uk] INFO: Found listing with ID: NG65%20ETD
2026-03-28 14:04:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27NG65%2520ETD%27 HTTP/1.1" 200 None
2026-03-28 14:04:54 [bca.uk] INFO: Scrape type for NG65%20ETD: 0
2026-03-28 14:04:54 [bca.uk] INFO: Found listing with ID: WV65%20EZL
2026-03-28 14:04:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WV65%2520EZL%27 HTTP/1.1" 200 None
2026-03-28 14:04:54 [bca.uk] INFO: Scrape type for WV65%20EZL: 0
2026-03-28 14:04:54 [bca.uk] INFO: Found listing with ID: SA16%20NZY
2026-03-28 14:04:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SA16%2520NZY%27 HTTP/1.1" 200 None
2026-03-28 14:04:54 [bca.uk] INFO: Scrape type for SA16%20NZY: 2
2026-03-28 14:04:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 037f01ae-f482-5421-9dbe-25ffc452a22f with identifier: SA16%20NZY
2026-03-28 14:04:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 037f01ae-f482-5421-9dbe-25ffc452a22f with scrape type 2
2026-03-28 14:04:54 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 037f01ae-f482-5421-9dbe-25ffc452a22f with scrape type 2
2026-03-28 14:04:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 037f01ae-f482-5421-9dbe-25ffc452a22f, identifier: SA16%20NZY
2026-03-28 14:04:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698929350%27 HTTP/1.1" 200 None
2026-03-28 14:04:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698929350 not downloaded yet
2026-03-28 14:04:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PXZ1595/698814225/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/PXZ1595/42808016?sv=2020-08-04&st=2026-03-28T14%3A04%3A01Z&se=2026-03-28T14%3A29%3A01Z&sr=b&sp=r&sig=xu3OmTnGiQ74jDpi5YWrXOjZvBn7hDxoXdoCW9aef04%3D)
2026-03-28 14:04:54 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/DA64AKP/42809663?sv=2020-08-04&st=2026-03-28T14%3A04%3A53Z&se=2026-03-28T14%3A29%3A53Z&sr=b&sp=r&sig=3wPHgIhe5if4C5QW2Ax45kOJMvp1eG0YQSmdcrSQVm8%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=DA64%20AKP-GB>
2026-03-28 14:04:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WJ58DWA/697410351/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/WJ58DWA/42809994?sv=2020-08-04&st=2026-03-28T14%3A04%3A01Z&se=2026-03-28T14%3A29%3A01Z&sr=b&sp=r&sig=WelJkUnZ%2FryduuiTM2iL%2FzPRBftp3wpY3FkYWG%2FP0gk%3D)
2026-03-28 14:04:54 [scrapy_zyte_api._params] WARNING: Request <GET https://www.bca.co.uk/api/search?q=&pageSize=100&page=10&sort=MostRecentlyAdded> defines the Zyte API customHttpRequestHeaders parameter, overriding Request.headers. Use Request.headers instead.
2026-03-28 14:04:54 [scrapy_zyte_api._params] WARNING: Request <GET https://www.bca.co.uk/api/search?q=&pageSize=100&page=10&sort=MostRecentlyAdded> defines the Zyte API customHttpRequestHeaders parameter, overriding Request.headers. Use Request.headers instead.
2026-03-28 14:04:54 [bca.uk] INFO: Found listing with ID: VE11%20KHY
2026-03-28 14:04:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27VE11%2520KHY%27 HTTP/1.1" 200 None
2026-03-28 14:04:54 [bca.uk] INFO: Scrape type for VE11%20KHY: 0
2026-03-28 14:04:54 [bca.uk] INFO: Found listing with ID: VK13%20XCU
2026-03-28 14:04:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27VK13%2520XCU%27 HTTP/1.1" 200 None
2026-03-28 14:04:54 [bca.uk] INFO: Scrape type for VK13%20XCU: 2
2026-03-28 14:04:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b21e5a41-3dc5-5033-b6f1-218ae02669f9 with identifier: VK13%20XCU
2026-03-28 14:04:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b21e5a41-3dc5-5033-b6f1-218ae02669f9 with scrape type 2
2026-03-28 14:04:54 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b21e5a41-3dc5-5033-b6f1-218ae02669f9 with scrape type 2
2026-03-28 14:04:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: b21e5a41-3dc5-5033-b6f1-218ae02669f9, identifier: VK13%20XCU
2026-03-28 14:04:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 037f01ae-f482-5421-9dbe-25ffc452a22f with identifier: SA16%20NZY
2026-03-28 14:04:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 037f01ae-f482-5421-9dbe-25ffc452a22f with identifier: SA16%20NZY
2026-03-28 14:04:54 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 037f01ae-f482-5421-9dbe-25ffc452a22f with identifier: SA16%20NZY to the API
2026-03-28 14:04:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:04:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:04:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=9&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 175,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=SA16%20NZY-GB',
'category': 'Car',
'color': 'white',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.6L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol',
'id': '037f01ae-f482-5421-9dbe-25ffc452a22f',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'SA16 NZY',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=SA16%20NZY&vehicleType=*',
'listing': 'auction',
'location': 'Livingston',
'make': 'KIA',
'model': 'SPORTAGE',
'odometer': 76689,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-01-01',
'seller_name': None,
'title': 'KIA SPORTAGE 1.6 T GDI AWD GT-LINE DCT StationWagon',
'transmission': 'automatic',
'trim': 'T GDI AWD GT-LINE DCT',
'vin': 'U5YPK816WGL044728',
'year': 2016}
2026-03-28 14:04:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SA16%2520NZY%27 HTTP/1.1" 200 None
2026-03-28 14:04:55 [bca.uk] INFO: Saving data for SA16%20NZY: {'auction_closing_time': 1774864800.0, 'created_time': 1774364275.269727, 'last_price_update_time': 1774706695.213626}
2026-03-28 14:04:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='SA16%2520NZY') HTTP/1.1" 204 0
2026-03-28 14:04:55 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:04:55 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:04:55 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:04:55 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:04:55 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:04:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:04:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2d8d9050>
2026-03-28 14:04:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:04:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:04:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:04:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_243a05a7-7cda-5444-ab1c-5fdc014fa410/243a05a7-7cda-5444-ab1c-5fdc014fa410_image_9.jpg HTTP/1.1" 201 0
2026-03-28 14:04:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FYB63ZKP%252F698284400%252F600') HTTP/1.1" 204 0
2026-03-28 14:04:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YB63ZKP/698284400/600 saved to cache
2026-03-28 14:04:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 243a05a7-7cda-5444-ab1c-5fdc014fa410
2026-03-28 14:04:55 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:04:55 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:04:55 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:04:55 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:04:55 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:04:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:04:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2ca6f490>
2026-03-28 14:04:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:04:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:04:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:04:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fe123a59-25d0-509d-9046-e45117da9996/fe123a59-25d0-509d-9046-e45117da9996_image_9.jpg HTTP/1.1" 201 0
2026-03-28 14:04:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FHY65KRJ%252F698920420%252F600') HTTP/1.1" 204 0
2026-03-28 14:04:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HY65KRJ/698920420/600 saved to cache
2026-03-28 14:04:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item fe123a59-25d0-509d-9046-e45117da9996
2026-03-28 14:04:55 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 14:04:55 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PXZ1595/698814207/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698814207>
2026-03-28 14:04:55 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/GD17MJV/42810643?sv=2020-08-04&st=2026-03-28T14%3A04%3A54Z&se=2026-03-28T14%3A29%3A54Z&sr=b&sp=r&sig=sr4QjIlF2HGyqigVx1Drsu7WI3QCudn9VApqSBNTMBA%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=GD17%20MJV-GB>
2026-03-28 14:04:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: b21e5a41-3dc5-5033-b6f1-218ae02669f9 with identifier: VK13%20XCU
2026-03-28 14:04:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: b21e5a41-3dc5-5033-b6f1-218ae02669f9 with identifier: VK13%20XCU
2026-03-28 14:04:55 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: b21e5a41-3dc5-5033-b6f1-218ae02669f9 with identifier: VK13%20XCU to the API
2026-03-28 14:04:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:04:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:04:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=8&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 168,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=VK13%20XCU-GB',
'category': 'Car',
'color': 'white',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.6L',
'expiration_date': '2026-03-29T10:00:00Z',
'fuel_type': 'Petrol',
'id': 'b21e5a41-3dc5-5033-b6f1-218ae02669f9',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'VK13 XCU',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=VK13%20XCU&vehicleType=*',
'listing': 'auction',
'location': 'Measham',
'make': 'MINI',
'model': 'COUNTRYMAN',
'odometer': 174806,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2013-01-01',
'seller_name': None,
'title': 'MINI COUNTRYMAN 1.6 COOPER Hatchback',
'transmission': 'automatic',
'trim': 'COOPER',
'vin': 'WMWZB32080WL96611',
'year': 2013}
2026-03-28 14:04:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27VK13%2520XCU%27 HTTP/1.1" 200 None
2026-03-28 14:04:55 [bca.uk] INFO: Saving data for VK13%20XCU: {'auction_closing_time': 1774778400.0, 'created_time': 1773828580.191181, 'last_price_update_time': 1774706695.847844}
2026-03-28 14:04:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='VK13%2520XCU') HTTP/1.1" 204 0
2026-03-28 14:04:55 [bca.uk] INFO: Found listing with ID: SP14%20TRV
2026-03-28 14:04:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SP14%2520TRV%27 HTTP/1.1" 200 None
2026-03-28 14:04:55 [bca.uk] INFO: Scrape type for SP14%20TRV: 0
2026-03-28 14:04:55 [bca.uk] INFO: Found listing with ID: WO15%20WBN
2026-03-28 14:04:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WO15%2520WBN%27 HTTP/1.1" 200 None
2026-03-28 14:04:55 [bca.uk] INFO: Scrape type for WO15%20WBN: 0
2026-03-28 14:04:55 [bca.uk] INFO: Found listing with ID: SK57%20HOJ
2026-03-28 14:04:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SK57%2520HOJ%27 HTTP/1.1" 200 None
2026-03-28 14:04:55 [bca.uk] INFO: Scrape type for SK57%20HOJ: 0
2026-03-28 14:04:55 [bca.uk] INFO: Found listing with ID: SV12%20OCC
2026-03-28 14:04:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SV12%2520OCC%27 HTTP/1.1" 200 None
2026-03-28 14:04:55 [bca.uk] INFO: Scrape type for SV12%20OCC: 2
2026-03-28 14:04:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1bf96064-f97f-5bf8-af0a-45927befe608 with identifier: SV12%20OCC
2026-03-28 14:04:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1bf96064-f97f-5bf8-af0a-45927befe608 with scrape type 2
2026-03-28 14:04:55 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1bf96064-f97f-5bf8-af0a-45927befe608 with scrape type 2
2026-03-28 14:04:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 1bf96064-f97f-5bf8-af0a-45927befe608, identifier: SV12%20OCC
2026-03-28 14:04:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698929359%27 HTTP/1.1" 200 None
2026-03-28 14:04:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698929359 not downloaded yet
2026-03-28 14:04:56 [bca.uk] INFO: Found listing with ID: YH13%20XTJ
2026-03-28 14:04:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YH13%2520XTJ%27 HTTP/1.1" 200 None
2026-03-28 14:04:56 [bca.uk] INFO: Scrape type for YH13%20XTJ: 0
2026-03-28 14:04:56 [bca.uk] INFO: Found listing with ID: BJ64%20NMF
2026-03-28 14:04:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BJ64%2520NMF%27 HTTP/1.1" 200 None
2026-03-28 14:04:56 [bca.uk] INFO: Scrape type for BJ64%20NMF: 0
2026-03-28 14:04:56 [bca.uk] INFO: Found listing with ID: CK63%20ERY
2026-03-28 14:04:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27CK63%2520ERY%27 HTTP/1.1" 200 None
2026-03-28 14:04:56 [bca.uk] INFO: Scrape type for CK63%20ERY: 0
2026-03-28 14:04:56 [bca.uk] INFO: Found listing with ID: DA12%20NKC
2026-03-28 14:04:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DA12%2520NKC%27 HTTP/1.1" 200 None
2026-03-28 14:04:56 [bca.uk] INFO: Scrape type for DA12%20NKC: 0
2026-03-28 14:04:56 [bca.uk] INFO: Found listing with ID: DV10%20LLK
2026-03-28 14:04:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DV10%2520LLK%27 HTTP/1.1" 200 None
2026-03-28 14:04:56 [bca.uk] INFO: Scrape type for DV10%20LLK: 0
2026-03-28 14:04:56 [bca.uk] INFO: Found listing with ID: FV62%20LNA
2026-03-28 14:04:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FV62%2520LNA%27 HTTP/1.1" 200 None
2026-03-28 14:04:56 [bca.uk] INFO: Scrape type for FV62%20LNA: 2
2026-03-28 14:04:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3c68b5ba-0341-5b87-a82a-aff14bba63ec with identifier: FV62%20LNA
2026-03-28 14:04:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3c68b5ba-0341-5b87-a82a-aff14bba63ec with scrape type 2
2026-03-28 14:04:56 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3c68b5ba-0341-5b87-a82a-aff14bba63ec with scrape type 2
2026-03-28 14:04:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 3c68b5ba-0341-5b87-a82a-aff14bba63ec, identifier: FV62%20LNA
2026-03-28 14:04:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 1bf96064-f97f-5bf8-af0a-45927befe608 with identifier: SV12%20OCC
2026-03-28 14:04:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 1bf96064-f97f-5bf8-af0a-45927befe608 with identifier: SV12%20OCC
2026-03-28 14:04:56 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 1bf96064-f97f-5bf8-af0a-45927befe608 with identifier: SV12%20OCC to the API
2026-03-28 14:04:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:04:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:04:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=9&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 193,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=SV12%20OCC-GB',
'category': 'Car',
'color': 'red',
'currency': 'GBP',
'doors_number': 5,
'engine': '2.0L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol',
'id': '1bf96064-f97f-5bf8-af0a-45927befe608',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'SV12 OCC',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=SV12%20OCC&vehicleType=*',
'listing': 'auction',
'location': 'Livingston',
'make': 'HONDA',
'model': 'CR-V',
'odometer': 113124,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2012-01-01',
'seller_name': None,
'title': 'HONDA CR-V 2.0 I-VTEC EX Estate',
'transmission': 'automatic',
'trim': 'I-VTEC EX',
'vin': 'SHSRE5870CU000459',
'year': 2012}
2026-03-28 14:04:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SV12%2520OCC%27 HTTP/1.1" 200 None
2026-03-28 14:04:56 [bca.uk] INFO: Saving data for SV12%20OCC: {'auction_closing_time': 1774864800.0, 'created_time': 1774305744.927525, 'last_price_update_time': 1774706696.645136}
2026-03-28 14:04:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='SV12%2520OCC') HTTP/1.1" 204 0
2026-03-28 14:04:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LM62VCU/42807206?sv=2020-08-04&st=2026-03-28T14%3A04%3A48Z&se=2026-03-28T14%3A29%3A48Z&sr=b&sp=r&sig=Rp%2FNuRBRM1T5Pi%2BNXegpYq0Ke%2B2Lo7Tup8NKUMfBYuw%3D> (referer: https://www.bca.co.uk/)
2026-03-28 14:04:56 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YD64WJN/697180946/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=697180946>
2026-03-28 14:04:56 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BT66DFX/698129715/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698129715>
2026-03-28 14:04:56 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NK64UTR/698814245/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698814245>
2026-03-28 14:04:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 3c68b5ba-0341-5b87-a82a-aff14bba63ec with identifier: FV62%20LNA
2026-03-28 14:04:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 3c68b5ba-0341-5b87-a82a-aff14bba63ec with identifier: FV62%20LNA
2026-03-28 14:04:56 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 3c68b5ba-0341-5b87-a82a-aff14bba63ec with identifier: FV62%20LNA to the API
2026-03-28 14:04:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:04:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:04:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=8&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 153,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=FV62%20LNA-GB',
'category': 'Car',
'color': 'grey',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.6L',
'expiration_date': '2026-03-29T10:00:00Z',
'fuel_type': 'Petrol',
'id': '3c68b5ba-0341-5b87-a82a-aff14bba63ec',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'FV62 LNA',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=FV62%20LNA&vehicleType=*',
'listing': 'auction',
'location': 'Measham',
'make': 'TOYOTA',
'model': 'AURIS',
'odometer': 137724,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2012-01-01',
'seller_name': None,
'title': 'TOYOTA AURIS 1.6 V-MATIC COLOUR COLLECTION Hatchback',
'transmission': 'manual',
'trim': 'V-MATIC COLOUR COLLECTION',
'vin': 'SB1KE56E80E031269',
'year': 2012}
2026-03-28 14:04:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FV62%2520LNA%27 HTTP/1.1" 200 None
2026-03-28 14:04:57 [bca.uk] INFO: Saving data for FV62%20LNA: {'auction_closing_time': 1774778400.0, 'created_time': 1774524184.572826, 'last_price_update_time': 1774706697.069315}
2026-03-28 14:04:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='FV62%2520LNA') HTTP/1.1" 204 0
2026-03-28 14:04:57 [bca.uk] INFO: Found listing with ID: EA14%20MJV
2026-03-28 14:04:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27EA14%2520MJV%27 HTTP/1.1" 200 None
2026-03-28 14:04:57 [bca.uk] INFO: Scrape type for EA14%20MJV: 0
2026-03-28 14:04:57 [bca.uk] INFO: Found listing with ID: EO61%20WGX
2026-03-28 14:04:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27EO61%2520WGX%27 HTTP/1.1" 200 None
2026-03-28 14:04:57 [bca.uk] INFO: Scrape type for EO61%20WGX: 0
2026-03-28 14:04:57 [bca.uk] INFO: Found listing with ID: LO13%20ZTR
2026-03-28 14:04:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LO13%2520ZTR%27 HTTP/1.1" 200 None
2026-03-28 14:04:57 [bca.uk] INFO: Scrape type for LO13%20ZTR: 0
2026-03-28 14:04:57 [bca.uk] INFO: Found listing with ID: NK63%20OGC
2026-03-28 14:04:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27NK63%2520OGC%27 HTTP/1.1" 200 None
2026-03-28 14:04:57 [bca.uk] INFO: Scrape type for NK63%20OGC: 0
2026-03-28 14:04:57 [bca.uk] INFO: Found listing with ID: RX57%20MKU
2026-03-28 14:04:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27RX57%2520MKU%27 HTTP/1.1" 200 None
2026-03-28 14:04:57 [bca.uk] INFO: Scrape type for RX57%20MKU: 0
2026-03-28 14:04:57 [bca.uk] INFO: Found listing with ID: SG11%20YNA
2026-03-28 14:04:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SG11%2520YNA%27 HTTP/1.1" 200 None
2026-03-28 14:04:57 [bca.uk] INFO: Scrape type for SG11%20YNA: 0
2026-03-28 14:04:57 [bca.uk] INFO: Found listing with ID: SJ13%20HUH
2026-03-28 14:04:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SJ13%2520HUH%27 HTTP/1.1" 200 None
2026-03-28 14:04:57 [bca.uk] INFO: Scrape type for SJ13%20HUH: 0
2026-03-28 14:04:57 [bca.uk] INFO: Found listing with ID: SN11%20HLZ
2026-03-28 14:04:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SN11%2520HLZ%27 HTTP/1.1" 200 None
2026-03-28 14:04:57 [bca.uk] INFO: Scrape type for SN11%20HLZ: 0
2026-03-28 14:04:57 [bca.uk] INFO: Found listing with ID: WK61%20WML
2026-03-28 14:04:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WK61%2520WML%27 HTTP/1.1" 200 None
2026-03-28 14:04:57 [bca.uk] INFO: Scrape type for WK61%20WML: 0
2026-03-28 14:04:57 [bca.uk] INFO: Found listing with ID: EK19%20ZSU
2026-03-28 14:04:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27EK19%2520ZSU%27 HTTP/1.1" 200 None
2026-03-28 14:04:57 [bca.uk] INFO: Scrape type for EK19%20ZSU: 0
2026-03-28 14:04:57 [bca.uk] INFO: Found listing with ID: YD08%20FXX
2026-03-28 14:04:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YD08%2520FXX%27 HTTP/1.1" 200 None
2026-03-28 14:04:57 [bca.uk] INFO: Scrape type for YD08%20FXX: 0
2026-03-28 14:04:57 [bca.uk] INFO: Found listing with ID: NA14%20XFF
2026-03-28 14:04:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27NA14%2520XFF%27 HTTP/1.1" 200 None
2026-03-28 14:04:57 [bca.uk] INFO: Scrape type for NA14%20XFF: 0
2026-03-28 14:04:57 [bca.uk] INFO: Found listing with ID: GU66%20BFA
2026-03-28 14:04:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GU66%2520BFA%27 HTTP/1.1" 200 None
2026-03-28 14:04:57 [bca.uk] INFO: Scrape type for GU66%20BFA: 0
2026-03-28 14:04:57 [bca.uk] INFO: Found listing with ID: MF19%20OFT
2026-03-28 14:04:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MF19%2520OFT%27 HTTP/1.1" 200 None
2026-03-28 14:04:57 [bca.uk] INFO: Scrape type for MF19%20OFT: 0
2026-03-28 14:04:57 [bca.uk] INFO: Found listing with ID: FX65%20SEY
2026-03-28 14:04:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FX65%2520SEY%27 HTTP/1.1" 200 None
2026-03-28 14:04:57 [bca.uk] INFO: Scrape type for FX65%20SEY: 2
2026-03-28 14:04:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4e550bd5-ee66-5bd1-93c3-d9ae6fed0589 with identifier: FX65%20SEY
2026-03-28 14:04:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4e550bd5-ee66-5bd1-93c3-d9ae6fed0589 with scrape type 2
2026-03-28 14:04:57 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4e550bd5-ee66-5bd1-93c3-d9ae6fed0589 with scrape type 2
2026-03-28 14:04:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 4e550bd5-ee66-5bd1-93c3-d9ae6fed0589, identifier: FX65%20SEY
2026-03-28 14:04:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698929377%27 HTTP/1.1" 200 None
2026-03-28 14:04:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698929377 not downloaded yet
2026-03-28 14:04:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:04:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2d836390>
2026-03-28 14:04:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:04:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:04:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:04:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_826679c4-b83f-5ad2-b8a7-2183b5f0a082/826679c4-b83f-5ad2-b8a7-2183b5f0a082_image_1.jpg HTTP/1.1" 201 0
2026-03-28 14:04:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLD16UKX%252F699001701%252F600') HTTP/1.1" 204 0
2026-03-28 14:04:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LD16UKX/699001701/600 saved to cache
2026-03-28 14:04:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 826679c4-b83f-5ad2-b8a7-2183b5f0a082
2026-03-28 14:04:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:04:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c910650>
2026-03-28 14:04:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:04:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:04:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:04:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d6214c2d-d518-55cf-9ab4-09004f56f218/d6214c2d-d518-55cf-9ab4-09004f56f218_expert_report_file_90e87b5a-22b4-46e0-b390-da843839c5e1.pdf HTTP/1.1" 201 0
2026-03-28 14:04:57 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item d6214c2d-d518-55cf-9ab4-09004f56f218
2026-03-28 14:04:57 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: d6214c2d-d518-55cf-9ab4-09004f56f218, skipping ID generation
2026-03-28 14:04:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item d6214c2d-d518-55cf-9ab4-09004f56f218
2026-03-28 14:04:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DST12HSO-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-28 14:04:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=ST12HSO-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-28 14:04:57 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:04:57 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:04:57 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:04:57 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:04:57 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:04:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:04:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2d892750>
2026-03-28 14:04:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:04:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:04:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:04:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ca2c3006-0503-55ad-a26d-88f328a541b5/ca2c3006-0503-55ad-a26d-88f328a541b5_image_7.jpg HTTP/1.1" 201 0
2026-03-28 14:04:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FBT66DFX%252F698129720%252F600') HTTP/1.1" 204 0
2026-03-28 14:04:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BT66DFX/698129720/600 saved to cache
2026-03-28 14:04:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item ca2c3006-0503-55ad-a26d-88f328a541b5
2026-03-28 14:04:57 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:04:57 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:04:57 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:04:57 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:04:57 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:04:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:04:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c912d90>
2026-03-28 14:04:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:04:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:04:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:04:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8f3e30a4-6b64-5dd1-8e1e-6cce5d49fef3/8f3e30a4-6b64-5dd1-8e1e-6cce5d49fef3_image_7.jpg HTTP/1.1" 201 0
2026-03-28 14:04:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FPXZ1595%252F698814225%252F600') HTTP/1.1" 204 0
2026-03-28 14:04:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PXZ1595/698814225/600 saved to cache
2026-03-28 14:04:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 8f3e30a4-6b64-5dd1-8e1e-6cce5d49fef3
2026-03-28 14:04:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:04:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2d8357d0>
2026-03-28 14:04:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:04:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:04:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:04:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8413221f-7948-5093-9030-c87150f157c7/8413221f-7948-5093-9030-c87150f157c7_image_5.jpg HTTP/1.1" 201 0
2026-03-28 14:04:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FWJ58DWA%252F697410351%252F600') HTTP/1.1" 204 0
2026-03-28 14:04:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WJ58DWA/697410351/600 saved to cache
2026-03-28 14:04:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 8413221f-7948-5093-9030-c87150f157c7
2026-03-28 14:04:57 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LD16UKX/699001695/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=LD16UKX-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-28 14:04:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YB63ZKP/698284395/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YB63ZKP/42797877?sv=2020-08-04&st=2026-03-28T14%3A04%3A00Z&se=2026-03-28T14%3A29%3A00Z&sr=b&sp=r&sig=86nclI4iCmgLh3evtZ%2BtpNUit8HkmrBcUBeJLBRYtzg%3D)
2026-03-28 14:04:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AK67LWT/698947249/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/AK67LWT/42810366?sv=2020-08-04&st=2026-03-28T14%3A04%3A00Z&se=2026-03-28T14%3A29%3A00Z&sr=b&sp=r&sig=dnN3%2FeKHnzQfSMnyGaraMReo6SkHH2Dy4nbY3zUESfI%3D)
2026-03-28 14:04:57 [bca.uk] INFO: Found listing with ID: KU63%20RYR
2026-03-28 14:04:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KU63%2520RYR%27 HTTP/1.1" 200 None
2026-03-28 14:04:57 [bca.uk] INFO: Scrape type for KU63%20RYR: 0
2026-03-28 14:04:57 [bca.uk] INFO: Found listing with ID: LD65%20WTN
2026-03-28 14:04:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LD65%2520WTN%27 HTTP/1.1" 200 None
2026-03-28 14:04:57 [bca.uk] INFO: Scrape type for LD65%20WTN: 0
2026-03-28 14:04:57 [bca.uk] INFO: Found listing with ID: LK08%20VFO
2026-03-28 14:04:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LK08%2520VFO%27 HTTP/1.1" 200 None
2026-03-28 14:04:57 [bca.uk] INFO: Scrape type for LK08%20VFO: 0
2026-03-28 14:04:57 [bca.uk] INFO: Found listing with ID: MJ14%20UDS
2026-03-28 14:04:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MJ14%2520UDS%27 HTTP/1.1" 200 None
2026-03-28 14:04:57 [bca.uk] INFO: Scrape type for MJ14%20UDS: 2
2026-03-28 14:04:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 09ac195f-548e-52b6-bdaf-1ab0ed86870c with identifier: MJ14%20UDS
2026-03-28 14:04:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 09ac195f-548e-52b6-bdaf-1ab0ed86870c with scrape type 2
2026-03-28 14:04:57 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 09ac195f-548e-52b6-bdaf-1ab0ed86870c with scrape type 2
2026-03-28 14:04:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 09ac195f-548e-52b6-bdaf-1ab0ed86870c, identifier: MJ14%20UDS
2026-03-28 14:04:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 4e550bd5-ee66-5bd1-93c3-d9ae6fed0589 with identifier: FX65%20SEY
2026-03-28 14:04:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 4e550bd5-ee66-5bd1-93c3-d9ae6fed0589 with identifier: FX65%20SEY
2026-03-28 14:04:58 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 4e550bd5-ee66-5bd1-93c3-d9ae6fed0589 with identifier: FX65%20SEY to the API
2026-03-28 14:04:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:04:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:04:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=9&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 107,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=FX65%20SEY-GB',
'category': 'Car',
'color': 'red',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.2L',
'expiration_date': '2026-03-29T10:00:00Z',
'fuel_type': 'Petrol',
'id': '4e550bd5-ee66-5bd1-93c3-d9ae6fed0589',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'FX65 SEY',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=FX65%20SEY&vehicleType=*',
'listing': 'auction',
'location': 'Leeds',
'make': 'PEUGEOT',
'model': '308',
'odometer': 80511,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-01-01',
'seller_name': None,
'title': 'PEUGEOT 308 1.2 P/T 130 SPORTIUM Hatchback',
'transmission': 'manual',
'trim': 'P/T 130 SPORTIUM',
'vin': 'VF3LPHNYHFS036092',
'year': 2015}
2026-03-28 14:04:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FX65%2520SEY%27 HTTP/1.1" 200 None
2026-03-28 14:04:58 [bca.uk] INFO: Saving data for FX65%20SEY: {'auction_closing_time': 1774778400.0, 'created_time': 1773829595.234222, 'last_price_update_time': 1774706698.340163}
2026-03-28 14:04:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='FX65%2520SEY') HTTP/1.1" 204 0
2026-03-28 14:04:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HY65KRJ/698920412/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/HY65KRJ/42809575?sv=2020-08-04&st=2026-03-28T14%3A03%3A59Z&se=2026-03-28T14%3A28%3A59Z&sr=b&sp=r&sig=qQyrthkWradfVt2c0sIhPBRny5qzj5uOjQmOciVVoMo%3D)
2026-03-28 14:04:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 09ac195f-548e-52b6-bdaf-1ab0ed86870c with identifier: MJ14%20UDS
2026-03-28 14:04:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 09ac195f-548e-52b6-bdaf-1ab0ed86870c with identifier: MJ14%20UDS
2026-03-28 14:04:58 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 09ac195f-548e-52b6-bdaf-1ab0ed86870c with identifier: MJ14%20UDS to the API
2026-03-28 14:04:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:04:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:04:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=8&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 120,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=MJ14%20UDS-GB',
'category': 'Car',
'color': 'black',
'currency': 'GBP',
'doors_number': 3,
'engine': '1.2L',
'expiration_date': '2026-03-29T10:00:00Z',
'fuel_type': 'Petrol',
'id': '09ac195f-548e-52b6-bdaf-1ab0ed86870c',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'MJ14 UDS',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=MJ14%20UDS&vehicleType=*',
'listing': 'auction',
'location': 'Measham',
'make': 'FORD',
'model': 'FIESTA',
'odometer': 156181,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2014-01-01',
'seller_name': None,
'title': 'FORD FIESTA 1.2 82 ZETEC Hatchback',
'transmission': 'manual',
'trim': '82 ZETEC',
'vin': 'WF0CXXGAKCEY47571',
'year': 2014}
2026-03-28 14:04:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MJ14%2520UDS%27 HTTP/1.1" 200 None
2026-03-28 14:04:58 [bca.uk] INFO: Saving data for MJ14%20UDS: {'auction_closing_time': 1774778400.0, 'created_time': 1774524183.008298, 'last_price_update_time': 1774706698.779977}
2026-03-28 14:04:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='MJ14%2520UDS') HTTP/1.1" 204 0
2026-03-28 14:04:58 [bca.uk] INFO: Found listing with ID: FV61%20BCF
2026-03-28 14:04:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FV61%2520BCF%27 HTTP/1.1" 200 None
2026-03-28 14:04:58 [bca.uk] INFO: Scrape type for FV61%20BCF: 0
2026-03-28 14:04:58 [bca.uk] INFO: Found listing with ID: SF63%20YSY
2026-03-28 14:04:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SF63%2520YSY%27 HTTP/1.1" 200 None
2026-03-28 14:04:58 [bca.uk] INFO: Scrape type for SF63%20YSY: 0
2026-03-28 14:04:58 [bca.uk] INFO: Found listing with ID: WJ60%20CFP
2026-03-28 14:04:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WJ60%2520CFP%27 HTTP/1.1" 200 None
2026-03-28 14:04:58 [bca.uk] INFO: Scrape type for WJ60%20CFP: 0
2026-03-28 14:04:58 [bca.uk] INFO: Found listing with ID: YG12%20VBZ
2026-03-28 14:04:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YG12%2520VBZ%27 HTTP/1.1" 200 None
2026-03-28 14:04:58 [bca.uk] INFO: Scrape type for YG12%20VBZ: 0
2026-03-28 14:04:58 [bca.uk] INFO: Found listing with ID: YX63%20FCC
2026-03-28 14:04:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YX63%2520FCC%27 HTTP/1.1" 200 None
2026-03-28 14:04:58 [bca.uk] INFO: Scrape type for YX63%20FCC: 0
2026-03-28 14:04:58 [bca.uk] INFO: Found listing with ID: AK65%20GFO
2026-03-28 14:04:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27AK65%2520GFO%27 HTTP/1.1" 200 None
2026-03-28 14:04:58 [bca.uk] INFO: Scrape type for AK65%20GFO: 0
2026-03-28 14:04:58 [bca.uk] INFO: Found listing with ID: DG64%20YKK
2026-03-28 14:04:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DG64%2520YKK%27 HTTP/1.1" 200 None
2026-03-28 14:04:58 [bca.uk] INFO: Scrape type for DG64%20YKK: 0
2026-03-28 14:04:58 [bca.uk] INFO: Found listing with ID: DV68%20LFL
2026-03-28 14:04:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DV68%2520LFL%27 HTTP/1.1" 200 None
2026-03-28 14:04:58 [bca.uk] INFO: Scrape type for DV68%20LFL: 0
2026-03-28 14:04:58 [bca.uk] INFO: Found listing with ID: SK18%20JKO
2026-03-28 14:04:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SK18%2520JKO%27 HTTP/1.1" 200 None
2026-03-28 14:04:58 [bca.uk] INFO: Scrape type for SK18%20JKO: 0
2026-03-28 14:04:58 [bca.uk] INFO: Found listing with ID: SP70%20LPC
2026-03-28 14:04:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SP70%2520LPC%27 HTTP/1.1" 200 None
2026-03-28 14:04:58 [bca.uk] INFO: Scrape type for SP70%20LPC: 2
2026-03-28 14:04:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e5e9bad6-18fc-5a61-b82d-fd5df80377f0 with identifier: SP70%20LPC
2026-03-28 14:04:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e5e9bad6-18fc-5a61-b82d-fd5df80377f0 with scrape type 2
2026-03-28 14:04:58 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e5e9bad6-18fc-5a61-b82d-fd5df80377f0 with scrape type 2
2026-03-28 14:04:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: e5e9bad6-18fc-5a61-b82d-fd5df80377f0, identifier: SP70%20LPC
2026-03-28 14:04:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698929390%27 HTTP/1.1" 200 None
2026-03-28 14:04:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698929390 not downloaded yet
2026-03-28 14:04:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698934238%27 HTTP/1.1" 200 None
2026-03-28 14:04:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698934238 not downloaded yet
2026-03-28 14:04:59 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WJ58DWA/697410348/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=697410348>
2026-03-28 14:04:59 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AK67LWT/698947231/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698947231>
2026-03-28 14:04:59 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/JP04STP/698929345/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=JP04STP-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-28 14:04:59 [bca.uk] INFO: Found listing with ID: PO61%20YTU
2026-03-28 14:04:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27PO61%2520YTU%27 HTTP/1.1" 200 None
2026-03-28 14:04:59 [bca.uk] INFO: Scrape type for PO61%20YTU: 0
2026-03-28 14:04:59 [bca.uk] INFO: Found listing with ID: SH11%20WHB
2026-03-28 14:04:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SH11%2520WHB%27 HTTP/1.1" 200 None
2026-03-28 14:04:59 [bca.uk] INFO: Scrape type for SH11%20WHB: 0
2026-03-28 14:04:59 [bca.uk] INFO: Found listing with ID: BD62%20TXJ
2026-03-28 14:04:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BD62%2520TXJ%27 HTTP/1.1" 200 None
2026-03-28 14:04:59 [bca.uk] INFO: Scrape type for BD62%20TXJ: 0
2026-03-28 14:04:59 [bca.uk] INFO: Found listing with ID: SV70%20XPL
2026-03-28 14:04:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SV70%2520XPL%27 HTTP/1.1" 200 None
2026-03-28 14:04:59 [bca.uk] INFO: Scrape type for SV70%20XPL: 0
2026-03-28 14:04:59 [bca.uk] INFO: Found listing with ID: FJ16%20NYD
2026-03-28 14:04:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FJ16%2520NYD%27 HTTP/1.1" 200 None
2026-03-28 14:04:59 [bca.uk] INFO: Scrape type for FJ16%20NYD: 2
2026-03-28 14:04:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f527bb5d-8da3-5810-83b0-cc6c33d480f7 with identifier: FJ16%20NYD
2026-03-28 14:04:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f527bb5d-8da3-5810-83b0-cc6c33d480f7 with scrape type 2
2026-03-28 14:04:59 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f527bb5d-8da3-5810-83b0-cc6c33d480f7 with scrape type 2
2026-03-28 14:04:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: f527bb5d-8da3-5810-83b0-cc6c33d480f7, identifier: FJ16%20NYD
2026-03-28 14:04:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: e5e9bad6-18fc-5a61-b82d-fd5df80377f0 with identifier: SP70%20LPC
2026-03-28 14:04:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: e5e9bad6-18fc-5a61-b82d-fd5df80377f0 with identifier: SP70%20LPC
2026-03-28 14:04:59 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: e5e9bad6-18fc-5a61-b82d-fd5df80377f0 with identifier: SP70%20LPC to the API
2026-03-28 14:04:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:04:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:04:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=9&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 202,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=SP70%20LPC-GB',
'category': 'Car',
'color': 'black',
'currency': 'GBP',
'doors_number': 5,
'engine': '2.0L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Diesel',
'id': 'e5e9bad6-18fc-5a61-b82d-fd5df80377f0',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'SP70 LPC',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=SP70%20LPC&vehicleType=*',
'listing': 'auction',
'location': 'Glasgow - East',
'make': 'MERCEDES-BENZ',
'model': 'V300 D',
'odometer': 51330,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-01-01',
'seller_name': None,
'title': 'MERCEDES-BENZ V300 D 2.0 AMG LINE 9G MPV',
'transmission': 'automatic',
'trim': 'AMG LINE 9G',
'vin': 'W1V44781123771143',
'year': 2020}
2026-03-28 14:04:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SP70%2520LPC%27 HTTP/1.1" 200 None
2026-03-28 14:04:59 [bca.uk] INFO: Saving data for SP70%20LPC: {'auction_closing_time': 1774864800.0, 'created_time': 1773907626.847618, 'last_price_update_time': 1774706699.642933}
2026-03-28 14:04:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='SP70%2520LPC') HTTP/1.1" 204 0
2026-03-28 14:04:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: f527bb5d-8da3-5810-83b0-cc6c33d480f7 with identifier: FJ16%20NYD
2026-03-28 14:04:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: f527bb5d-8da3-5810-83b0-cc6c33d480f7 with identifier: FJ16%20NYD
2026-03-28 14:04:59 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: f527bb5d-8da3-5810-83b0-cc6c33d480f7 with identifier: FJ16%20NYD to the API
2026-03-28 14:04:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:04:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:05:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=8&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': None,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=FJ16%20NYD-GB',
'category': 'Car',
'color': 'brown',
'currency': 'GBP',
'doors_number': 5,
'engine': '2.0L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol',
'id': 'f527bb5d-8da3-5810-83b0-cc6c33d480f7',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'FJ16 NYD',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=FJ16%20NYD&vehicleType=*',
'listing': 'auction',
'location': 'Measham',
'make': 'BMW',
'model': 'X1',
'odometer': 64170,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2025-01-01',
'seller_name': None,
'title': 'BMW X1 2.0 XD M35I STEP StationWagon',
'transmission': 'automatic',
'trim': 'XD M35I STEP',
'vin': 'WBAHS920705D96218',
'year': 2025}
2026-03-28 14:05:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FJ16%2520NYD%27 HTTP/1.1" 200 None
2026-03-28 14:05:00 [bca.uk] INFO: Saving data for FJ16%20NYD: {'auction_closing_time': 1774864800.0, 'created_time': 1773821528.014316, 'last_price_update_time': 1774706700.150745}
2026-03-28 14:05:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='FJ16%2520NYD') HTTP/1.1" 204 0
2026-03-28 14:05:00 [bca.uk] INFO: Found listing with ID: PO68%20KXK
2026-03-28 14:05:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27PO68%2520KXK%27 HTTP/1.1" 200 None
2026-03-28 14:05:00 [bca.uk] INFO: Scrape type for PO68%20KXK: 0
2026-03-28 14:05:00 [bca.uk] INFO: Found listing with ID: SE64%20GDF
2026-03-28 14:05:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SE64%2520GDF%27 HTTP/1.1" 200 None
2026-03-28 14:05:00 [bca.uk] INFO: Scrape type for SE64%20GDF: 0
2026-03-28 14:05:00 [bca.uk] INFO: Found listing with ID: SH15%20NPX
2026-03-28 14:05:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SH15%2520NPX%27 HTTP/1.1" 200 None
2026-03-28 14:05:00 [bca.uk] INFO: Scrape type for SH15%20NPX: 2
2026-03-28 14:05:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3ea60d59-d3f3-5feb-8a2f-e5b3de042a2b with identifier: SH15%20NPX
2026-03-28 14:05:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3ea60d59-d3f3-5feb-8a2f-e5b3de042a2b with scrape type 2
2026-03-28 14:05:00 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3ea60d59-d3f3-5feb-8a2f-e5b3de042a2b with scrape type 2
2026-03-28 14:05:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 3ea60d59-d3f3-5feb-8a2f-e5b3de042a2b, identifier: SH15%20NPX
2026-03-28 14:05:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698929404%27 HTTP/1.1" 200 None
2026-03-28 14:05:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698929404 not downloaded yet
2026-03-28 14:05:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698934249%27 HTTP/1.1" 200 None
2026-03-28 14:05:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698934249 not downloaded yet
2026-03-28 14:05:00 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YB63ZKP/698284387/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698284387>
2026-03-28 14:05:00 [bca.uk] INFO: Found listing with ID: FD19%20ARF
2026-03-28 14:05:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FD19%2520ARF%27 HTTP/1.1" 200 None
2026-03-28 14:05:00 [bca.uk] INFO: Scrape type for FD19%20ARF: 0
2026-03-28 14:05:00 [bca.uk] INFO: Found listing with ID: KY59%20LSX
2026-03-28 14:05:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KY59%2520LSX%27 HTTP/1.1" 200 None
2026-03-28 14:05:00 [bca.uk] INFO: Scrape type for KY59%20LSX: 0
2026-03-28 14:05:00 [bca.uk] INFO: Found listing with ID: BF18%20ZPB
2026-03-28 14:05:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BF18%2520ZPB%27 HTTP/1.1" 200 None
2026-03-28 14:05:00 [bca.uk] INFO: Scrape type for BF18%20ZPB: 0
2026-03-28 14:05:00 [bca.uk] INFO: Found listing with ID: BT62%20XMJ
2026-03-28 14:05:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BT62%2520XMJ%27 HTTP/1.1" 200 None
2026-03-28 14:05:00 [bca.uk] INFO: Scrape type for BT62%20XMJ: 0
2026-03-28 14:05:00 [bca.uk] INFO: Found listing with ID: LP66%20TZU
2026-03-28 14:05:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LP66%2520TZU%27 HTTP/1.1" 200 None
2026-03-28 14:05:00 [bca.uk] INFO: Scrape type for LP66%20TZU: 0
2026-03-28 14:05:00 [bca.uk] INFO: Found listing with ID: MA66%20DBU
2026-03-28 14:05:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MA66%2520DBU%27 HTTP/1.1" 200 None
2026-03-28 14:05:00 [bca.uk] INFO: Scrape type for MA66%20DBU: 0
2026-03-28 14:05:00 [bca.uk] INFO: Found listing with ID: EK58%20XAN
2026-03-28 14:05:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27EK58%2520XAN%27 HTTP/1.1" 200 None
2026-03-28 14:05:00 [bca.uk] INFO: Scrape type for EK58%20XAN: 0
2026-03-28 14:05:00 [bca.uk] INFO: Found listing with ID: GU05%20ZMV
2026-03-28 14:05:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GU05%2520ZMV%27 HTTP/1.1" 200 None
2026-03-28 14:05:00 [bca.uk] INFO: Scrape type for GU05%20ZMV: 0
2026-03-28 14:05:00 [bca.uk] INFO: Found listing with ID: GJ64%20FZB
2026-03-28 14:05:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GJ64%2520FZB%27 HTTP/1.1" 200 None
2026-03-28 14:05:00 [bca.uk] INFO: Scrape type for GJ64%20FZB: 2
2026-03-28 14:05:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ca6003d0-8b9b-5f53-aa37-03ead93a3f87 with identifier: GJ64%20FZB
2026-03-28 14:05:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ca6003d0-8b9b-5f53-aa37-03ead93a3f87 with scrape type 2
2026-03-28 14:05:00 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ca6003d0-8b9b-5f53-aa37-03ead93a3f87 with scrape type 2
2026-03-28 14:05:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: ca6003d0-8b9b-5f53-aa37-03ead93a3f87, identifier: GJ64%20FZB
2026-03-28 14:05:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 3ea60d59-d3f3-5feb-8a2f-e5b3de042a2b with identifier: SH15%20NPX
2026-03-28 14:05:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 3ea60d59-d3f3-5feb-8a2f-e5b3de042a2b with identifier: SH15%20NPX
2026-03-28 14:05:00 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 3ea60d59-d3f3-5feb-8a2f-e5b3de042a2b with identifier: SH15%20NPX to the API
2026-03-28 14:05:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:05:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:05:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=9&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 119,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=SH15%20NPX-GB',
'category': 'Car',
'color': 'white',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.2L',
'expiration_date': '2026-03-29T10:00:00Z',
'fuel_type': 'Petrol',
'id': '3ea60d59-d3f3-5feb-8a2f-e5b3de042a2b',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'SH15 NPX',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=SH15%20NPX&vehicleType=*',
'listing': 'auction',
'location': 'Glasgow - East',
'make': 'FIAT',
'model': 'PANDA',
'odometer': 21849,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-01-01',
'seller_name': None,
'title': 'FIAT PANDA 1.2 LOUNGE Hatchback',
'transmission': 'manual',
'trim': 'LOUNGE',
'vin': 'ZFA31200003474126',
'year': 2015}
2026-03-28 14:05:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SH15%2520NPX%27 HTTP/1.1" 200 None
2026-03-28 14:05:01 [bca.uk] INFO: Saving data for SH15%20NPX: {'auction_closing_time': 1774778400.0, 'created_time': 1774524268.370295, 'last_price_update_time': 1774706701.081152}
2026-03-28 14:05:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='SH15%2520NPX') HTTP/1.1" 204 0
2026-03-28 14:05:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:05:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c8c7190>
2026-03-28 14:05:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:05:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:05:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:05:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_91eb6f90-8171-52c3-8f50-6415c188dd75/91eb6f90-8171-52c3-8f50-6415c188dd75_expert_report_file_55caf430-4dee-4d91-99ca-9ac884a59f45.pdf HTTP/1.1" 201 0
2026-03-28 14:05:01 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item 91eb6f90-8171-52c3-8f50-6415c188dd75
2026-03-28 14:05:01 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 91eb6f90-8171-52c3-8f50-6415c188dd75, skipping ID generation
2026-03-28 14:05:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 91eb6f90-8171-52c3-8f50-6415c188dd75
2026-03-28 14:05:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DLM62VCU-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-28 14:05:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=LM62VCU-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-28 14:05:01 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:05:01 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:05:01 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:05:01 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:05:01 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:05:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:05:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c84c8d0>
2026-03-28 14:05:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:05:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:05:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:05:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_243a05a7-7cda-5444-ab1c-5fdc014fa410/243a05a7-7cda-5444-ab1c-5fdc014fa410_image_8.jpg HTTP/1.1" 201 0
2026-03-28 14:05:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FYB63ZKP%252F698284395%252F600') HTTP/1.1" 204 0
2026-03-28 14:05:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YB63ZKP/698284395/600 saved to cache
2026-03-28 14:05:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 243a05a7-7cda-5444-ab1c-5fdc014fa410
2026-03-28 14:05:01 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:05:01 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:05:01 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:05:01 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:05:01 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:05:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:05:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2dd95690>
2026-03-28 14:05:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:05:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:05:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:05:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_96df00f7-d862-5338-b935-5c42d63b82c0/96df00f7-d862-5338-b935-5c42d63b82c0_image_8.jpg HTTP/1.1" 201 0
2026-03-28 14:05:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FAK67LWT%252F698947249%252F600') HTTP/1.1" 204 0
2026-03-28 14:05:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AK67LWT/698947249/600 saved to cache
2026-03-28 14:05:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 96df00f7-d862-5338-b935-5c42d63b82c0
2026-03-28 14:05:01 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:05:01 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:05:01 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:05:01 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:05:01 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:05:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:05:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c62f8d0>
2026-03-28 14:05:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:05:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:05:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:05:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fe123a59-25d0-509d-9046-e45117da9996/fe123a59-25d0-509d-9046-e45117da9996_image_8.jpg HTTP/1.1" 201 0
2026-03-28 14:05:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FHY65KRJ%252F698920412%252F600') HTTP/1.1" 204 0
2026-03-28 14:05:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HY65KRJ/698920412/600 saved to cache
2026-03-28 14:05:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item fe123a59-25d0-509d-9046-e45117da9996
2026-03-28 14:05:01 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/JP04STP/698929359/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698929359>
2026-03-28 14:05:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PXZ1595/698814207/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/PXZ1595/42808016?sv=2020-08-04&st=2026-03-28T14%3A04%3A01Z&se=2026-03-28T14%3A29%3A01Z&sr=b&sp=r&sig=xu3OmTnGiQ74jDpi5YWrXOjZvBn7hDxoXdoCW9aef04%3D)
2026-03-28 14:05:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NK64UTR/698814245/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/NK64UTR/42807827?sv=2020-08-04&st=2026-03-28T14%3A04%3A00Z&se=2026-03-28T14%3A29%3A00Z&sr=b&sp=r&sig=B2djBTwUnOYzqxtI8e7WJD2j2cACy9SjmoGLE3oN2SE%3D)
2026-03-28 14:05:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: ca6003d0-8b9b-5f53-aa37-03ead93a3f87 with identifier: GJ64%20FZB
2026-03-28 14:05:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: ca6003d0-8b9b-5f53-aa37-03ead93a3f87 with identifier: GJ64%20FZB
2026-03-28 14:05:01 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: ca6003d0-8b9b-5f53-aa37-03ead93a3f87 with identifier: GJ64%20FZB to the API
2026-03-28 14:05:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:05:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:05:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=8&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 114,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=GJ64%20FZB-GB',
'category': 'Car',
'color': 'grey',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.0L',
'expiration_date': '2026-03-29T10:00:00Z',
'fuel_type': 'Petrol',
'id': 'ca6003d0-8b9b-5f53-aa37-03ead93a3f87',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'GJ64 FZB',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=GJ64%20FZB&vehicleType=*',
'listing': 'auction',
'location': 'Measham',
'make': 'FORD',
'model': 'FOCUS',
'odometer': 77626,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2014-01-01',
'seller_name': None,
'title': 'FORD FOCUS 1.0 E/B 125 TITANIUM NAVIGATOR Hatchback',
'transmission': 'manual',
'trim': 'E/B 125 TITANIUM NAVIGATOR',
'vin': 'WF0KXXGCBKEM26577',
'year': 2014}
2026-03-28 14:05:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GJ64%2520FZB%27 HTTP/1.1" 200 None
2026-03-28 14:05:01 [bca.uk] INFO: Saving data for GJ64%20FZB: {'auction_closing_time': 1774778400.0, 'created_time': 1774524213.359406, 'last_price_update_time': 1774706701.810931}
2026-03-28 14:05:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='GJ64%2520FZB') HTTP/1.1" 204 0
2026-03-28 14:05:01 [bca.uk] INFO: Found listing with ID: SL14%20FUV
2026-03-28 14:05:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SL14%2520FUV%27 HTTP/1.1" 200 None
2026-03-28 14:05:01 [bca.uk] INFO: Scrape type for SL14%20FUV: 2
2026-03-28 14:05:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4af4afff-8541-5597-ac35-e3d1f2d229bb with identifier: SL14%20FUV
2026-03-28 14:05:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4af4afff-8541-5597-ac35-e3d1f2d229bb with scrape type 2
2026-03-28 14:05:01 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4af4afff-8541-5597-ac35-e3d1f2d229bb with scrape type 2
2026-03-28 14:05:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 4af4afff-8541-5597-ac35-e3d1f2d229bb, identifier: SL14%20FUV
2026-03-28 14:05:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698929419%27 HTTP/1.1" 200 None
2026-03-28 14:05:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698929419 not downloaded yet
2026-03-28 14:05:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698934269%27 HTTP/1.1" 200 None
2026-03-28 14:05:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698934269 not downloaded yet
2026-03-28 14:05:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/DA64AKP/42809663?sv=2020-08-04&st=2026-03-28T14%3A04%3A53Z&se=2026-03-28T14%3A29%3A53Z&sr=b&sp=r&sig=3wPHgIhe5if4C5QW2Ax45kOJMvp1eG0YQSmdcrSQVm8%3D> (referer: https://www.bca.co.uk/)
2026-03-28 14:05:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/GD17MJV/42810643?sv=2020-08-04&st=2026-03-28T14%3A04%3A54Z&se=2026-03-28T14%3A29%3A54Z&sr=b&sp=r&sig=sr4QjIlF2HGyqigVx1Drsu7WI3QCudn9VApqSBNTMBA%3D> (referer: https://www.bca.co.uk/)
2026-03-28 14:05:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BT66DFX/698129715/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/BT66DFX/42810013?sv=2020-08-04&st=2026-03-28T14%3A04%3A00Z&se=2026-03-28T14%3A29%3A00Z&sr=b&sp=r&sig=Yx0iLoKJXBk4DPNXOVJLOrRp66ZUz648vIo6BTtbrJ0%3D)
2026-03-28 14:05:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YD64WJN/697180946/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YD64WJN/42809986?sv=2020-08-04&st=2026-03-28T14%3A03%3A59Z&se=2026-03-28T14%3A28%3A59Z&sr=b&sp=r&sig=5rsKGf%2F78vqwWJXVPXpM1R60yxRlhwBt0pb8A02KPMk%3D)
2026-03-28 14:05:02 [bca.uk] INFO: Found listing with ID: HX68%20KXL
2026-03-28 14:05:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27HX68%2520KXL%27 HTTP/1.1" 200 None
2026-03-28 14:05:02 [bca.uk] INFO: Scrape type for HX68%20KXL: 0
2026-03-28 14:05:02 [bca.uk] INFO: Found listing with ID: KR65%20CKN
2026-03-28 14:05:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KR65%2520CKN%27 HTTP/1.1" 200 None
2026-03-28 14:05:02 [bca.uk] INFO: Scrape type for KR65%20CKN: 0
2026-03-28 14:05:02 [bca.uk] INFO: Found listing with ID: SY65%20UOC
2026-03-28 14:05:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SY65%2520UOC%27 HTTP/1.1" 200 None
2026-03-28 14:05:02 [bca.uk] INFO: Scrape type for SY65%20UOC: 0
2026-03-28 14:05:02 [bca.uk] INFO: Found listing with ID: CK65%20BVE
2026-03-28 14:05:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27CK65%2520BVE%27 HTTP/1.1" 200 None
2026-03-28 14:05:02 [bca.uk] INFO: Scrape type for CK65%20BVE: 0
2026-03-28 14:05:02 [bca.uk] INFO: Found listing with ID: BJ66%20YWK
2026-03-28 14:05:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BJ66%2520YWK%27 HTTP/1.1" 200 None
2026-03-28 14:05:02 [bca.uk] INFO: Scrape type for BJ66%20YWK: 0
2026-03-28 14:05:02 [bca.uk] INFO: Found listing with ID: LM60%20EUZ
2026-03-28 14:05:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LM60%2520EUZ%27 HTTP/1.1" 200 None
2026-03-28 14:05:02 [bca.uk] INFO: Scrape type for LM60%20EUZ: 2
2026-03-28 14:05:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6e17d00a-a1fa-55fb-8b22-ad60bbb0f32c with identifier: LM60%20EUZ
2026-03-28 14:05:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6e17d00a-a1fa-55fb-8b22-ad60bbb0f32c with scrape type 2
2026-03-28 14:05:02 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6e17d00a-a1fa-55fb-8b22-ad60bbb0f32c with scrape type 2
2026-03-28 14:05:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 6e17d00a-a1fa-55fb-8b22-ad60bbb0f32c, identifier: LM60%20EUZ
2026-03-28 14:05:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 4af4afff-8541-5597-ac35-e3d1f2d229bb with identifier: SL14%20FUV
2026-03-28 14:05:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 4af4afff-8541-5597-ac35-e3d1f2d229bb with identifier: SL14%20FUV
2026-03-28 14:05:02 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 4af4afff-8541-5597-ac35-e3d1f2d229bb with identifier: SL14%20FUV to the API
2026-03-28 14:05:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:05:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:05:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=9&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 133,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=SL14%20FUV-GB',
'category': 'Car',
'color': 'blue',
'currency': 'GBP',
'doors_number': 2,
'engine': '1.6L',
'expiration_date': '2026-03-29T10:00:00Z',
'fuel_type': 'Petrol',
'id': '4af4afff-8541-5597-ac35-e3d1f2d229bb',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'SL14 FUV',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=SL14%20FUV&vehicleType=*',
'listing': 'auction',
'location': 'Glasgow - East',
'make': 'MINI',
'model': 'ROADSTER',
'odometer': 45542,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2014-01-01',
'seller_name': None,
'title': 'MINI ROADSTER 1.6 COOPER Roadster',
'transmission': 'manual',
'trim': 'COOPER',
'vin': 'WMWSY120X0T667397',
'year': 2014}
2026-03-28 14:05:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SL14%2520FUV%27 HTTP/1.1" 200 None
2026-03-28 14:05:02 [bca.uk] INFO: Saving data for SL14%20FUV: {'auction_closing_time': 1774778400.0, 'created_time': 1774418825.731066, 'last_price_update_time': 1774706702.640226}
2026-03-28 14:05:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='SL14%2520FUV') HTTP/1.1" 204 0
2026-03-28 14:05:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698781714%27 HTTP/1.1" 200 None
2026-03-28 14:05:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698781714 not downloaded yet
2026-03-28 14:05:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LD16UKX/699001695/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LD16UKX/42809855?sv=2020-08-04&st=2026-03-28T14%3A04%3A07Z&se=2026-03-28T14%3A29%3A07Z&sr=b&sp=r&sig=CHOiwblSOmf2jh7w7FrmkfA8BVi7dwLavRkRtCs3kTQ%3D)
2026-03-28 14:05:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 6e17d00a-a1fa-55fb-8b22-ad60bbb0f32c with identifier: LM60%20EUZ
2026-03-28 14:05:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 6e17d00a-a1fa-55fb-8b22-ad60bbb0f32c with identifier: LM60%20EUZ
2026-03-28 14:05:02 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 6e17d00a-a1fa-55fb-8b22-ad60bbb0f32c with identifier: LM60%20EUZ to the API
2026-03-28 14:05:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:05:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:05:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=8&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 195,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=LM60%20EUZ-GB',
'category': 'Car',
'color': 'white',
'currency': 'GBP',
'doors_number': 5,
'engine': '3.0L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Diesel',
'id': '6e17d00a-a1fa-55fb-8b22-ad60bbb0f32c',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'LM60 EUZ',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=LM60%20EUZ&vehicleType=*',
'listing': 'auction',
'location': 'Measham',
'make': 'AUDI',
'model': 'Q7',
'odometer': 76032,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2010-01-01',
'seller_name': None,
'title': 'AUDI Q7 3.0 TDI QUATTRO S LINE (8) StationWagon',
'transmission': 'manual',
'trim': 'TDI QUATTRO S LINE (8)',
'vin': 'WAUZZZ4L1BD009644',
'year': 2010}
2026-03-28 14:05:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LM60%2520EUZ%27 HTTP/1.1" 200 None
2026-03-28 14:05:03 [bca.uk] INFO: Saving data for LM60%20EUZ: {'auction_closing_time': 1774864800.0, 'created_time': 1774365730.839155, 'last_price_update_time': 1774706703.101645}
2026-03-28 14:05:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='LM60%2520EUZ') HTTP/1.1" 204 0
2026-03-28 14:05:03 [bca.uk] INFO: Found listing with ID: ST65%20BKF
2026-03-28 14:05:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27ST65%2520BKF%27 HTTP/1.1" 200 None
2026-03-28 14:05:03 [bca.uk] INFO: Scrape type for ST65%20BKF: 0
2026-03-28 14:05:03 [bca.uk] INFO: Found listing with ID: DX17%20SYH
2026-03-28 14:05:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DX17%2520SYH%27 HTTP/1.1" 200 None
2026-03-28 14:05:03 [bca.uk] INFO: Scrape type for DX17%20SYH: 0
2026-03-28 14:05:03 [bca.uk] INFO: Found listing with ID: SC17%20XRM
2026-03-28 14:05:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SC17%2520XRM%27 HTTP/1.1" 200 None
2026-03-28 14:05:03 [bca.uk] INFO: Scrape type for SC17%20XRM: 0
2026-03-28 14:05:03 [bca.uk] INFO: Found listing with ID: SD67%20KLC
2026-03-28 14:05:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SD67%2520KLC%27 HTTP/1.1" 200 None
2026-03-28 14:05:03 [bca.uk] INFO: Scrape type for SD67%20KLC: 0
2026-03-28 14:05:03 [bca.uk] INFO: Found listing with ID: KP65%20NNV
2026-03-28 14:05:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KP65%2520NNV%27 HTTP/1.1" 200 None
2026-03-28 14:05:03 [bca.uk] INFO: Scrape type for KP65%20NNV: 0
2026-03-28 14:05:03 [bca.uk] INFO: Found listing with ID: PJ66%20LUT
2026-03-28 14:05:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27PJ66%2520LUT%27 HTTP/1.1" 200 None
2026-03-28 14:05:03 [bca.uk] INFO: Scrape type for PJ66%20LUT: 0
2026-03-28 14:05:03 [bca.uk] INFO: Found listing with ID: LFZ%202518
2026-03-28 14:05:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LFZ%25202518%27 HTTP/1.1" 200 None
2026-03-28 14:05:03 [bca.uk] INFO: Scrape type for LFZ%202518: 0
2026-03-28 14:05:03 [bca.uk] INFO: Found listing with ID: SA10%20DVK
2026-03-28 14:05:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SA10%2520DVK%27 HTTP/1.1" 200 None
2026-03-28 14:05:03 [bca.uk] INFO: Scrape type for SA10%20DVK: 0
2026-03-28 14:05:03 [bca.uk] INFO: Found listing with ID: A5%20VHE
2026-03-28 14:05:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27A5%2520VHE%27 HTTP/1.1" 200 None
2026-03-28 14:05:03 [bca.uk] INFO: Scrape type for A5%20VHE: 2
2026-03-28 14:05:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8fdd3fdc-3c66-5122-b3ec-c1bc96405c68 with identifier: A5%20VHE
2026-03-28 14:05:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8fdd3fdc-3c66-5122-b3ec-c1bc96405c68 with scrape type 2
2026-03-28 14:05:03 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8fdd3fdc-3c66-5122-b3ec-c1bc96405c68 with scrape type 2
2026-03-28 14:05:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 8fdd3fdc-3c66-5122-b3ec-c1bc96405c68, identifier: A5%20VHE
2026-03-28 14:05:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698929433%27 HTTP/1.1" 200 None
2026-03-28 14:05:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698929433 not downloaded yet
2026-03-28 14:05:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698934285%27 HTTP/1.1" 200 None
2026-03-28 14:05:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698934285 not downloaded yet
2026-03-28 14:05:03 [bca.uk] INFO: Found listing with ID: M500%20MDC
2026-03-28 14:05:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27M500%2520MDC%27 HTTP/1.1" 200 None
2026-03-28 14:05:03 [bca.uk] INFO: Scrape type for M500%20MDC: 2
2026-03-28 14:05:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 253fa943-826b-5b82-8ded-5293d1df36cf with identifier: M500%20MDC
2026-03-28 14:05:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 253fa943-826b-5b82-8ded-5293d1df36cf with scrape type 2
2026-03-28 14:05:03 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 253fa943-826b-5b82-8ded-5293d1df36cf with scrape type 2
2026-03-28 14:05:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 253fa943-826b-5b82-8ded-5293d1df36cf, identifier: M500%20MDC
2026-03-28 14:05:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 8fdd3fdc-3c66-5122-b3ec-c1bc96405c68 with identifier: A5%20VHE
2026-03-28 14:05:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 8fdd3fdc-3c66-5122-b3ec-c1bc96405c68 with identifier: A5%20VHE
2026-03-28 14:05:03 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 8fdd3fdc-3c66-5122-b3ec-c1bc96405c68 with identifier: A5%20VHE to the API
2026-03-28 14:05:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:05:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:05:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=9&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 153,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=A5%20VHE-GB',
'category': 'Car',
'color': 'silver',
'currency': 'GBP',
'doors_number': 2,
'engine': '2.0L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Diesel',
'id': '8fdd3fdc-3c66-5122-b3ec-c1bc96405c68',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'A5 VHE',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=A5%20VHE&vehicleType=*',
'listing': 'auction',
'location': 'Glasgow - East',
'make': 'BMW',
'model': '320D',
'odometer': 95124,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2009-01-01',
'seller_name': None,
'title': 'BMW 320D 2.0 M SPORT Convertible',
'transmission': 'automatic',
'trim': 'M SPORT',
'vin': 'WBAWM32070E264538',
'year': 2009}
2026-03-28 14:05:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27A5%2520VHE%27 HTTP/1.1" 200 None
2026-03-28 14:05:04 [bca.uk] INFO: Saving data for A5%20VHE: {'auction_closing_time': 1774864800.0, 'created_time': 1774364238.107499, 'last_price_update_time': 1774706704.119222}
2026-03-28 14:05:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='A5%2520VHE') HTTP/1.1" 204 0
2026-03-28 14:05:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698781716%27 HTTP/1.1" 200 None
2026-03-28 14:05:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698781716 not downloaded yet
2026-03-28 14:05:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/JP04STP/698929345/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/JP04STP/42809620?sv=2020-08-04&st=2026-03-28T14%3A04%3A43Z&se=2026-03-28T14%3A29%3A43Z&sr=b&sp=r&sig=au5c8GXv2vCUIG4ea67UD3YzlPMQz7%2FWxYZM6tUj%2FEo%3D)
2026-03-28 14:05:04 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/JP04STP/698929377/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698929377>
2026-03-28 14:05:04 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/JP04STP/698929350/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698929350>
2026-03-28 14:05:04 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/ST12HSO/698934223/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=ST12HSO-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-28 14:05:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WJ58DWA/697410348/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/WJ58DWA/42809994?sv=2020-08-04&st=2026-03-28T14%3A04%3A01Z&se=2026-03-28T14%3A29%3A01Z&sr=b&sp=r&sig=WelJkUnZ%2FryduuiTM2iL%2FzPRBftp3wpY3FkYWG%2FP0gk%3D)
2026-03-28 14:05:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 253fa943-826b-5b82-8ded-5293d1df36cf with identifier: M500%20MDC
2026-03-28 14:05:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 253fa943-826b-5b82-8ded-5293d1df36cf with identifier: M500%20MDC
2026-03-28 14:05:04 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 253fa943-826b-5b82-8ded-5293d1df36cf with identifier: M500%20MDC to the API
2026-03-28 14:05:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:05:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:05:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=8&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 253,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=M500%20MDC-GB',
'category': 'Car',
'color': 'blue',
'currency': 'GBP',
'doors_number': 5,
'engine': '4.4L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Diesel',
'id': '253fa943-826b-5b82-8ded-5293d1df36cf',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'M500 MDC',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=M500%20MDC&vehicleType=*',
'listing': 'auction',
'location': 'Measham',
'make': 'LAND ROVER',
'model': 'RANGE ROVER',
'odometer': 117112,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2011-01-01',
'seller_name': None,
'title': 'LAND ROVER RANGE ROVER 4.4 TDV8 VOGUE StationWagon',
'transmission': 'automatic',
'trim': 'TDV8 VOGUE',
'vin': 'SALLMAMJ3BA342625',
'year': 2011}
2026-03-28 14:05:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27M500%2520MDC%27 HTTP/1.1" 200 None
2026-03-28 14:05:04 [bca.uk] INFO: Saving data for M500%20MDC: {'auction_closing_time': 1774864800.0, 'created_time': 1774391444.567174, 'last_price_update_time': 1774706704.720103}
2026-03-28 14:05:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='M500%2520MDC') HTTP/1.1" 204 0
2026-03-28 14:05:04 [bca.uk] INFO: Found listing with ID: VK14%20NPY
2026-03-28 14:05:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27VK14%2520NPY%27 HTTP/1.1" 200 None
2026-03-28 14:05:04 [bca.uk] INFO: Scrape type for VK14%20NPY: 0
2026-03-28 14:05:04 [bca.uk] INFO: Found listing with ID: YE07%20CMY
2026-03-28 14:05:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YE07%2520CMY%27 HTTP/1.1" 200 None
2026-03-28 14:05:04 [bca.uk] INFO: Scrape type for YE07%20CMY: 0
2026-03-28 14:05:04 [bca.uk] INFO: Found listing with ID: YG61%20ZTR
2026-03-28 14:05:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YG61%2520ZTR%27 HTTP/1.1" 200 None
2026-03-28 14:05:04 [bca.uk] INFO: Scrape type for YG61%20ZTR: 0
2026-03-28 14:05:04 [bca.uk] INFO: Found listing with ID: SB13%20MVJ
2026-03-28 14:05:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SB13%2520MVJ%27 HTTP/1.1" 200 None
2026-03-28 14:05:04 [bca.uk] INFO: Scrape type for SB13%20MVJ: 2
2026-03-28 14:05:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f48a7973-53b4-56e5-9505-0366d02eb330 with identifier: SB13%20MVJ
2026-03-28 14:05:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f48a7973-53b4-56e5-9505-0366d02eb330 with scrape type 2
2026-03-28 14:05:04 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f48a7973-53b4-56e5-9505-0366d02eb330 with scrape type 2
2026-03-28 14:05:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: f48a7973-53b4-56e5-9505-0366d02eb330, identifier: SB13%20MVJ
2026-03-28 14:05:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698929445%27 HTTP/1.1" 200 None
2026-03-28 14:05:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698929445 not downloaded yet
2026-03-28 14:05:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698934303%27 HTTP/1.1" 200 None
2026-03-28 14:05:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698934303 not downloaded yet
2026-03-28 14:05:04 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:05:04 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:05:04 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:05:04 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:05:04 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:05:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:05:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c41bad0>
2026-03-28 14:05:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:05:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:05:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:05:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8f3e30a4-6b64-5dd1-8e1e-6cce5d49fef3/8f3e30a4-6b64-5dd1-8e1e-6cce5d49fef3_image_6.jpg HTTP/1.1" 201 0
2026-03-28 14:05:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FPXZ1595%252F698814207%252F600') HTTP/1.1" 204 0
2026-03-28 14:05:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PXZ1595/698814207/600 saved to cache
2026-03-28 14:05:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 8f3e30a4-6b64-5dd1-8e1e-6cce5d49fef3
2026-03-28 14:05:05 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:05:05 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:05:05 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:05:05 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:05:05 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:05:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:05:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c4c8ed0>
2026-03-28 14:05:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:05:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:05:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:05:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1a399624-5154-54f6-ad94-51c45341542d/1a399624-5154-54f6-ad94-51c45341542d_image_9.jpg HTTP/1.1" 201 0
2026-03-28 14:05:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FNK64UTR%252F698814245%252F600') HTTP/1.1" 204 0
2026-03-28 14:05:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NK64UTR/698814245/600 saved to cache
2026-03-28 14:05:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 1a399624-5154-54f6-ad94-51c45341542d
2026-03-28 14:05:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:05:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c588790>
2026-03-28 14:05:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:05:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:05:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:05:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1d31f426-9911-536f-8f01-f0daf0072cc0/1d31f426-9911-536f-8f01-f0daf0072cc0_expert_report_file_08fe399c-3f48-4ca6-8a08-c4ae265ada31.pdf HTTP/1.1" 201 0
2026-03-28 14:05:05 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item 1d31f426-9911-536f-8f01-f0daf0072cc0
2026-03-28 14:05:05 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 1d31f426-9911-536f-8f01-f0daf0072cc0, skipping ID generation
2026-03-28 14:05:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 1d31f426-9911-536f-8f01-f0daf0072cc0
2026-03-28 14:05:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DDA64AKP-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-28 14:05:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=DA64AKP-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-28 14:05:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:05:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c626c90>
2026-03-28 14:05:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:05:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:05:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:05:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_df8c97f7-3f96-5220-9648-b6806ba88234/df8c97f7-3f96-5220-9648-b6806ba88234_expert_report_file_dadb1923-ee9c-4645-88c5-023c80b57c70.pdf HTTP/1.1" 201 0
2026-03-28 14:05:05 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item df8c97f7-3f96-5220-9648-b6806ba88234
2026-03-28 14:05:05 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: df8c97f7-3f96-5220-9648-b6806ba88234, skipping ID generation
2026-03-28 14:05:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item df8c97f7-3f96-5220-9648-b6806ba88234
2026-03-28 14:05:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DGD17MJV-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-28 14:05:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=GD17MJV-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-28 14:05:05 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:05:05 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:05:05 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:05:05 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:05:05 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:05:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:05:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c77b690>
2026-03-28 14:05:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:05:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:05:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:05:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ca2c3006-0503-55ad-a26d-88f328a541b5/ca2c3006-0503-55ad-a26d-88f328a541b5_image_6.jpg HTTP/1.1" 201 0
2026-03-28 14:05:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FBT66DFX%252F698129715%252F600') HTTP/1.1" 204 0
2026-03-28 14:05:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BT66DFX/698129715/600 saved to cache
2026-03-28 14:05:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item ca2c3006-0503-55ad-a26d-88f328a541b5
2026-03-28 14:05:05 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:05:05 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:05:05 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:05:05 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:05:05 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:05:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:05:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c700fd0>
2026-03-28 14:05:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:05:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:05:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:05:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a6b7695a-3dc3-56dd-a07d-29432fe9fa43/a6b7695a-3dc3-56dd-a07d-29432fe9fa43_image_9.jpg HTTP/1.1" 201 0
2026-03-28 14:05:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FYD64WJN%252F697180946%252F600') HTTP/1.1" 204 0
2026-03-28 14:05:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YD64WJN/697180946/600 saved to cache
2026-03-28 14:05:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item a6b7695a-3dc3-56dd-a07d-29432fe9fa43
2026-03-28 14:05:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/JP04STP/698929359/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/JP04STP/42809620?sv=2020-08-04&st=2026-03-28T14%3A04%3A43Z&se=2026-03-28T14%3A29%3A43Z&sr=b&sp=r&sig=au5c8GXv2vCUIG4ea67UD3YzlPMQz7%2FWxYZM6tUj%2FEo%3D)
2026-03-28 14:05:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AK67LWT/698947231/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/AK67LWT/42810366?sv=2020-08-04&st=2026-03-28T14%3A04%3A00Z&se=2026-03-28T14%3A29%3A00Z&sr=b&sp=r&sig=dnN3%2FeKHnzQfSMnyGaraMReo6SkHH2Dy4nbY3zUESfI%3D)
2026-03-28 14:05:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YB63ZKP/698284387/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YB63ZKP/42797877?sv=2020-08-04&st=2026-03-28T14%3A04%3A00Z&se=2026-03-28T14%3A29%3A00Z&sr=b&sp=r&sig=86nclI4iCmgLh3evtZ%2BtpNUit8HkmrBcUBeJLBRYtzg%3D)
2026-03-28 14:05:05 [bca.uk] INFO: Found listing with ID: YF13%20MDZ
2026-03-28 14:05:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YF13%2520MDZ%27 HTTP/1.1" 200 None
2026-03-28 14:05:05 [bca.uk] INFO: Scrape type for YF13%20MDZ: 0
2026-03-28 14:05:05 [bca.uk] INFO: Found listing with ID: BV12%20NRK
2026-03-28 14:05:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BV12%2520NRK%27 HTTP/1.1" 200 None
2026-03-28 14:05:05 [bca.uk] INFO: Scrape type for BV12%20NRK: 0
2026-03-28 14:05:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: f48a7973-53b4-56e5-9505-0366d02eb330 with identifier: SB13%20MVJ
2026-03-28 14:05:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: f48a7973-53b4-56e5-9505-0366d02eb330 with identifier: SB13%20MVJ
2026-03-28 14:05:05 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: f48a7973-53b4-56e5-9505-0366d02eb330 with identifier: SB13%20MVJ to the API
2026-03-28 14:05:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:05:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:05:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=9&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 139,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=SB13%20MVJ-GB',
'category': 'Car',
'color': 'red',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.4L',
'expiration_date': '2026-03-29T10:00:00Z',
'fuel_type': 'Petrol',
'id': 'f48a7973-53b4-56e5-9505-0366d02eb330',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'SB13 MVJ',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=SB13%20MVJ&vehicleType=*',
'listing': 'auction',
'location': 'Glasgow - East',
'make': 'NISSAN',
'model': 'NOTE',
'odometer': 52744,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2013-01-01',
'seller_name': None,
'title': 'NISSAN NOTE 1.4 N-TEC+ Hatchback',
'transmission': 'manual',
'trim': 'N-TEC+',
'vin': 'SJNFAAE11U2205111',
'year': 2013}
2026-03-28 14:05:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SB13%2520MVJ%27 HTTP/1.1" 200 None
2026-03-28 14:05:05 [bca.uk] INFO: Saving data for SB13%20MVJ: {'auction_closing_time': 1774778400.0, 'created_time': 1774016039.564449, 'last_price_update_time': 1774706705.725156}
2026-03-28 14:05:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='SB13%2520MVJ') HTTP/1.1" 204 0
2026-03-28 14:05:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698781717%27 HTTP/1.1" 200 None
2026-03-28 14:05:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698781717 not downloaded yet
2026-03-28 14:05:05 [bca.uk] INFO: Found listing with ID: SB66%20VUV
2026-03-28 14:05:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SB66%2520VUV%27 HTTP/1.1" 200 None
2026-03-28 14:05:05 [bca.uk] INFO: Scrape type for SB66%20VUV: 0
2026-03-28 14:05:05 [bca.uk] INFO: Found listing with ID: SC16%20CWE
2026-03-28 14:05:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SC16%2520CWE%27 HTTP/1.1" 200 None
2026-03-28 14:05:05 [bca.uk] INFO: Scrape type for SC16%20CWE: 0
2026-03-28 14:05:05 [bca.uk] INFO: Found listing with ID: SC53%20TDX
2026-03-28 14:05:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SC53%2520TDX%27 HTTP/1.1" 200 None
2026-03-28 14:05:05 [bca.uk] INFO: Scrape type for SC53%20TDX: 0
2026-03-28 14:05:05 [bca.uk] INFO: Found listing with ID: SD12%20KXT
2026-03-28 14:05:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SD12%2520KXT%27 HTTP/1.1" 200 None
2026-03-28 14:05:05 [bca.uk] INFO: Scrape type for SD12%20KXT: 0
2026-03-28 14:05:05 [bca.uk] INFO: Found listing with ID: SH11%20YDW
2026-03-28 14:05:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SH11%2520YDW%27 HTTP/1.1" 200 None
2026-03-28 14:05:05 [bca.uk] INFO: Scrape type for SH11%20YDW: 0
2026-03-28 14:05:05 [bca.uk] INFO: Found listing with ID: SH60%20LDZ
2026-03-28 14:05:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SH60%2520LDZ%27 HTTP/1.1" 200 None
2026-03-28 14:05:05 [bca.uk] INFO: Scrape type for SH60%20LDZ: 0
2026-03-28 14:05:05 [bca.uk] INFO: Found listing with ID: SK63%20FLJ
2026-03-28 14:05:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SK63%2520FLJ%27 HTTP/1.1" 200 None
2026-03-28 14:05:05 [bca.uk] INFO: Scrape type for SK63%20FLJ: 0
2026-03-28 14:05:05 [bca.uk] INFO: Found listing with ID: SL13%20PTX
2026-03-28 14:05:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SL13%2520PTX%27 HTTP/1.1" 200 None
2026-03-28 14:05:06 [bca.uk] INFO: Scrape type for SL13%20PTX: 0
2026-03-28 14:05:06 [bca.uk] INFO: Found listing with ID: SM13%20DLO
2026-03-28 14:05:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SM13%2520DLO%27 HTTP/1.1" 200 None
2026-03-28 14:05:06 [bca.uk] INFO: Scrape type for SM13%20DLO: 0
2026-03-28 14:05:06 [bca.uk] INFO: Found listing with ID: SM58%20EZH
2026-03-28 14:05:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SM58%2520EZH%27 HTTP/1.1" 200 None
2026-03-28 14:05:06 [bca.uk] INFO: Scrape type for SM58%20EZH: 0
2026-03-28 14:05:06 [bca.uk] INFO: Found listing with ID: SP63%20WOR
2026-03-28 14:05:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SP63%2520WOR%27 HTTP/1.1" 200 None
2026-03-28 14:05:06 [bca.uk] INFO: Scrape type for SP63%20WOR: 0
2026-03-28 14:05:06 [bca.uk] INFO: Found listing with ID: EJ14%20VWN
2026-03-28 14:05:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27EJ14%2520VWN%27 HTTP/1.1" 200 None
2026-03-28 14:05:06 [bca.uk] INFO: Scrape type for EJ14%20VWN: 0
2026-03-28 14:05:06 [bca.uk] INFO: Found listing with ID: EO60%20VMK
2026-03-28 14:05:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27EO60%2520VMK%27 HTTP/1.1" 200 None
2026-03-28 14:05:06 [bca.uk] INFO: Scrape type for EO60%20VMK: 0
2026-03-28 14:05:06 [bca.uk] INFO: Found listing with ID: FY12%20XKT
2026-03-28 14:05:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FY12%2520XKT%27 HTTP/1.1" 200 None
2026-03-28 14:05:06 [bca.uk] INFO: Scrape type for FY12%20XKT: 0
2026-03-28 14:05:06 [bca.uk] INFO: Found listing with ID: GJ68%20ELH
2026-03-28 14:05:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GJ68%2520ELH%27 HTTP/1.1" 200 None
2026-03-28 14:05:06 [bca.uk] INFO: Scrape type for GJ68%20ELH: 0
2026-03-28 14:05:06 [bca.uk] INFO: Found listing with ID: GK60%20AVB
2026-03-28 14:05:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GK60%2520AVB%27 HTTP/1.1" 200 None
2026-03-28 14:05:06 [bca.uk] INFO: Scrape type for GK60%20AVB: 0
2026-03-28 14:05:06 [bca.uk] INFO: Found listing with ID: PE11%20YJD
2026-03-28 14:05:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27PE11%2520YJD%27 HTTP/1.1" 200 None
2026-03-28 14:05:06 [bca.uk] INFO: Scrape type for PE11%20YJD: 0
2026-03-28 14:05:06 [bca.uk] INFO: Found listing with ID: R12%20TRA
2026-03-28 14:05:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27R12%2520TRA%27 HTTP/1.1" 200 None
2026-03-28 14:05:06 [bca.uk] INFO: Scrape type for R12%20TRA: 0
2026-03-28 14:05:06 [bca.uk] INFO: Found listing with ID: YK22%20RXB
2026-03-28 14:05:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YK22%2520RXB%27 HTTP/1.1" 200 None
2026-03-28 14:05:06 [bca.uk] INFO: Scrape type for YK22%20RXB: 0
2026-03-28 14:05:06 [bca.uk] INFO: Found listing with ID: SG60%20RXA
2026-03-28 14:05:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SG60%2520RXA%27 HTTP/1.1" 200 None
2026-03-28 14:05:06 [bca.uk] INFO: Scrape type for SG60%20RXA: 0
2026-03-28 14:05:06 [bca.uk] INFO: Found listing with ID: N88%20SFD
2026-03-28 14:05:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27N88%2520SFD%27 HTTP/1.1" 200 None
2026-03-28 14:05:06 [bca.uk] INFO: Scrape type for N88%20SFD: 0
2026-03-28 14:05:06 [bca.uk] INFO: Found listing with ID: WU57%20NZB
2026-03-28 14:05:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WU57%2520NZB%27 HTTP/1.1" 200 None
2026-03-28 14:05:06 [bca.uk] INFO: Scrape type for WU57%20NZB: 2
2026-03-28 14:05:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: dbe236d6-5d9f-5c15-8160-b63c3d61c0f0 with identifier: WU57%20NZB
2026-03-28 14:05:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item dbe236d6-5d9f-5c15-8160-b63c3d61c0f0 with scrape type 2
2026-03-28 14:05:06 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item dbe236d6-5d9f-5c15-8160-b63c3d61c0f0 with scrape type 2
2026-03-28 14:05:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: dbe236d6-5d9f-5c15-8160-b63c3d61c0f0, identifier: WU57%20NZB
2026-03-28 14:05:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698929454%27 HTTP/1.1" 200 None
2026-03-28 14:05:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698929454 not downloaded yet
2026-03-28 14:05:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698934329%27 HTTP/1.1" 200 None
2026-03-28 14:05:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698934329 not downloaded yet
2026-03-28 14:05:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698920122%27 HTTP/1.1" 200 None
2026-03-28 14:05:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698920122 not downloaded yet
2026-03-28 14:05:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698729613%27 HTTP/1.1" 200 None
2026-03-28 14:05:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698729613 not downloaded yet
2026-03-28 14:05:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:05:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2ca2fb90>
2026-03-28 14:05:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:05:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:05:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:05:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_826679c4-b83f-5ad2-b8a7-2183b5f0a082/826679c4-b83f-5ad2-b8a7-2183b5f0a082_image_0.jpg HTTP/1.1" 201 0
2026-03-28 14:05:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLD16UKX%252F699001695%252F600') HTTP/1.1" 204 0
2026-03-28 14:05:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LD16UKX/699001695/600 saved to cache
2026-03-28 14:05:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 826679c4-b83f-5ad2-b8a7-2183b5f0a082
2026-03-28 14:05:06 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 826679c4-b83f-5ad2-b8a7-2183b5f0a082, skipping ID generation
2026-03-28 14:05:06 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 826679c4-b83f-5ad2-b8a7-2183b5f0a082 sending to next pipeline
2026-03-28 14:05:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 826679c4-b83f-5ad2-b8a7-2183b5f0a082, identifier: LD16%20UKX
2026-03-28 14:05:06 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/ST12HSO/698934238/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698934238>
2026-03-28 14:05:06 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/JP04STP/698929404/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698929404>
2026-03-28 14:05:06 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LM62VCU/698781712/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=LM62VCU-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-28 14:05:06 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/ST12HSO/698934249/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698934249>
2026-03-28 14:05:06 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/JP04STP/698929390/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698929390>
2026-03-28 14:05:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: dbe236d6-5d9f-5c15-8160-b63c3d61c0f0 with identifier: WU57%20NZB
2026-03-28 14:05:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: dbe236d6-5d9f-5c15-8160-b63c3d61c0f0 with identifier: WU57%20NZB
2026-03-28 14:05:06 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: dbe236d6-5d9f-5c15-8160-b63c3d61c0f0 with identifier: WU57%20NZB to the API
2026-03-28 14:05:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:05:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:05:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=9&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 166,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=WU57%20NZB-GB',
'category': 'Car',
'color': 'blue',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.6L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol',
'id': 'dbe236d6-5d9f-5c15-8160-b63c3d61c0f0',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'WU57 NZB',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=WU57%20NZB&vehicleType=*',
'listing': 'auction',
'location': 'Enfield',
'make': 'NISSAN',
'model': 'NOTE',
'odometer': 91428,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2007-01-01',
'seller_name': None,
'title': 'NISSAN NOTE 1.6 TEKNA Hatchback',
'transmission': 'automatic',
'trim': 'TEKNA',
'vin': 'SJNFCAE11U1208097',
'year': 2007}
2026-03-28 14:05:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WU57%2520NZB%27 HTTP/1.1" 200 None
2026-03-28 14:05:06 [bca.uk] INFO: Saving data for WU57%20NZB: {'auction_closing_time': 1774864800.0, 'created_time': 1774523567.734525, 'last_price_update_time': 1774706706.956772}
2026-03-28 14:05:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='WU57%2520NZB') HTTP/1.1" 204 0
2026-03-28 14:05:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698781722%27 HTTP/1.1" 200 None
2026-03-28 14:05:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698781722 not downloaded yet
2026-03-28 14:05:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 826679c4-b83f-5ad2-b8a7-2183b5f0a082 with identifier: LD16%20UKX
2026-03-28 14:05:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 826679c4-b83f-5ad2-b8a7-2183b5f0a082 with identifier: LD16%20UKX
2026-03-28 14:05:07 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 826679c4-b83f-5ad2-b8a7-2183b5f0a082 with identifier: LD16%20UKX to the API
2026-03-28 14:05:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:05:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:05:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LD16UKX/699001695/600>
{'auction_title': '',
'c_o_2_emission_value': 142,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_826679c4-b83f-5ad2-b8a7-2183b5f0a082/826679c4-b83f-5ad2-b8a7-2183b5f0a082_expert_report_file_61ee616e-5686-46e4-8a39-75ea631fb813.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=LD16%20UKX-GB',
'category': 'Car',
'color': 'white',
'currency': 'GBP',
'doors_number': 3,
'engine': '1.4L',
'expiration_date': '2026-03-29T10:00:00Z',
'fuel_type': 'Petrol',
'id': '826679c4-b83f-5ad2-b8a7-2183b5f0a082',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'LD16 UKX',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=LD16%20UKX&vehicleType=*',
'listing': 'auction',
'location': 'Bedford',
'make': 'VAUXHALL',
'model': 'GTC',
'odometer': 91297,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 11,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_826679c4-b83f-5ad2-b8a7-2183b5f0a082/826679c4-b83f-5ad2-b8a7-2183b5f0a082_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 47644,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LD16UKX/699001695/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_826679c4-b83f-5ad2-b8a7-2183b5f0a082/826679c4-b83f-5ad2-b8a7-2183b5f0a082_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 45448,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LD16UKX/699001701/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_826679c4-b83f-5ad2-b8a7-2183b5f0a082/826679c4-b83f-5ad2-b8a7-2183b5f0a082_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 44184,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LD16UKX/699001704/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_826679c4-b83f-5ad2-b8a7-2183b5f0a082/826679c4-b83f-5ad2-b8a7-2183b5f0a082_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 42948,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LD16UKX/699001710/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_826679c4-b83f-5ad2-b8a7-2183b5f0a082/826679c4-b83f-5ad2-b8a7-2183b5f0a082_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 42792,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LD16UKX/699001714/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_826679c4-b83f-5ad2-b8a7-2183b5f0a082/826679c4-b83f-5ad2-b8a7-2183b5f0a082_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 41364,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LD16UKX/699001718/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_826679c4-b83f-5ad2-b8a7-2183b5f0a082/826679c4-b83f-5ad2-b8a7-2183b5f0a082_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 76079,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LD16UKX/699001725/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_826679c4-b83f-5ad2-b8a7-2183b5f0a082/826679c4-b83f-5ad2-b8a7-2183b5f0a082_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 60922,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LD16UKX/699001734/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_826679c4-b83f-5ad2-b8a7-2183b5f0a082/826679c4-b83f-5ad2-b8a7-2183b5f0a082_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 87665,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LD16UKX/699001742/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_826679c4-b83f-5ad2-b8a7-2183b5f0a082/826679c4-b83f-5ad2-b8a7-2183b5f0a082_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 93047,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LD16UKX/699001753/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-01-01',
'seller_name': None,
'title': 'VAUXHALL GTC 1.4 T 16V 140 LTD.EDITION Coupe',
'transmission': 'manual',
'trim': 'T 16V 140 LTD.EDITION',
'vin': 'W0LPF2EC3GG101738',
'year': 2016}
2026-03-28 14:05:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LD16%2520UKX%27 HTTP/1.1" 200 None
2026-03-28 14:05:07 [bca.uk] INFO: Saving data for LD16%20UKX: {'created_time': 1774706707.520654, 'last_price_update_time': 1774706707.520665, 'auction_closing_time': 1774778400.0}
2026-03-28 14:05:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='LD16%2520UKX') HTTP/1.1" 204 0
2026-03-28 14:05:07 [bca.uk] INFO: Found listing with ID: GL58%20GUC
2026-03-28 14:05:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GL58%2520GUC%27 HTTP/1.1" 200 None
2026-03-28 14:05:07 [bca.uk] INFO: Scrape type for GL58%20GUC: 2
2026-03-28 14:05:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6b6d83f3-a158-577f-82ce-d61ff100170d with identifier: GL58%20GUC
2026-03-28 14:05:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6b6d83f3-a158-577f-82ce-d61ff100170d with scrape type 2
2026-03-28 14:05:07 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6b6d83f3-a158-577f-82ce-d61ff100170d with scrape type 2
2026-03-28 14:05:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 6b6d83f3-a158-577f-82ce-d61ff100170d, identifier: GL58%20GUC
2026-03-28 14:05:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698934353%27 HTTP/1.1" 200 None
2026-03-28 14:05:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698934353 not downloaded yet
2026-03-28 14:05:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698920150%27 HTTP/1.1" 200 None
2026-03-28 14:05:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698920150 not downloaded yet
2026-03-28 14:05:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698729633%27 HTTP/1.1" 200 None
2026-03-28 14:05:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698729633 not downloaded yet
2026-03-28 14:05:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:05:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2dcda850>
2026-03-28 14:05:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:05:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:05:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:05:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bbc16d12-29f9-531b-8c11-9870b348d92a/bbc16d12-29f9-531b-8c11-9870b348d92a_image_0.jpg HTTP/1.1" 201 0
2026-03-28 14:05:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FJP04STP%252F698929345%252F600') HTTP/1.1" 204 0
2026-03-28 14:05:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/JP04STP/698929345/600 saved to cache
2026-03-28 14:05:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item bbc16d12-29f9-531b-8c11-9870b348d92a
2026-03-28 14:05:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:05:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2d8a1d90>
2026-03-28 14:05:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:05:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:05:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:05:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8413221f-7948-5093-9030-c87150f157c7/8413221f-7948-5093-9030-c87150f157c7_image_4.jpg HTTP/1.1" 201 0
2026-03-28 14:05:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FWJ58DWA%252F697410348%252F600') HTTP/1.1" 204 0
2026-03-28 14:05:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WJ58DWA/697410348/600 saved to cache
2026-03-28 14:05:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 8413221f-7948-5093-9030-c87150f157c7
2026-03-28 14:05:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:05:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2d7b7310>
2026-03-28 14:05:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:05:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:05:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:05:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bbc16d12-29f9-531b-8c11-9870b348d92a/bbc16d12-29f9-531b-8c11-9870b348d92a_image_2.jpg HTTP/1.1" 201 0
2026-03-28 14:05:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FJP04STP%252F698929359%252F600') HTTP/1.1" 204 0
2026-03-28 14:05:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/JP04STP/698929359/600 saved to cache
2026-03-28 14:05:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item bbc16d12-29f9-531b-8c11-9870b348d92a
2026-03-28 14:05:07 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:05:07 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:05:07 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:05:07 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:05:07 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:05:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:05:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2d8a2690>
2026-03-28 14:05:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:05:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:05:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:05:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_96df00f7-d862-5338-b935-5c42d63b82c0/96df00f7-d862-5338-b935-5c42d63b82c0_image_7.jpg HTTP/1.1" 201 0
2026-03-28 14:05:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FAK67LWT%252F698947231%252F600') HTTP/1.1" 204 0
2026-03-28 14:05:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AK67LWT/698947231/600 saved to cache
2026-03-28 14:05:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 96df00f7-d862-5338-b935-5c42d63b82c0
2026-03-28 14:05:07 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:05:07 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:05:07 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:05:07 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:05:07 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:05:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:05:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2d8a3b50>
2026-03-28 14:05:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:05:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:05:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:05:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_243a05a7-7cda-5444-ab1c-5fdc014fa410/243a05a7-7cda-5444-ab1c-5fdc014fa410_image_7.jpg HTTP/1.1" 201 0
2026-03-28 14:05:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FYB63ZKP%252F698284387%252F600') HTTP/1.1" 204 0
2026-03-28 14:05:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YB63ZKP/698284387/600 saved to cache
2026-03-28 14:05:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 243a05a7-7cda-5444-ab1c-5fdc014fa410
2026-03-28 14:05:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/ST12HSO/698934223/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/ST12HSO/42809912?sv=2020-08-04&st=2026-03-28T14%3A04%3A46Z&se=2026-03-28T14%3A29%3A46Z&sr=b&sp=r&sig=tOhj9TDOiYV6354bfaZJlS4RufTDvGneY43ZqD%2FSIPw%3D)
2026-03-28 14:05:07 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HY65KRJ/698920406/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698920406>
2026-03-28 14:05:07 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/ST12HSO/698934269/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698934269>
2026-03-28 14:05:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 6b6d83f3-a158-577f-82ce-d61ff100170d with identifier: GL58%20GUC
2026-03-28 14:05:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 6b6d83f3-a158-577f-82ce-d61ff100170d with identifier: GL58%20GUC
2026-03-28 14:05:08 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 6b6d83f3-a158-577f-82ce-d61ff100170d with identifier: GL58%20GUC to the API
2026-03-28 14:05:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:05:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:05:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=9&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 212,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=GL58%20GUC-GB',
'category': 'Car',
'color': 'blue',
'currency': 'GBP',
'doors_number': 4,
'engine': '2.0L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol',
'id': '6b6d83f3-a158-577f-82ce-d61ff100170d',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'GL58 GUC',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=GL58%20GUC&vehicleType=*',
'listing': 'auction',
'location': 'Enfield',
'make': 'CITROEN',
'model': 'C5',
'odometer': 74788,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2009-01-01',
'seller_name': None,
'title': 'CITROEN C5 2.0 VTR+ 16V Saloon',
'transmission': 'manual',
'trim': 'VTR+ 16V',
'vin': 'VF7RDRFJF54004898',
'year': 2009}
2026-03-28 14:05:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GL58%2520GUC%27 HTTP/1.1" 200 None
2026-03-28 14:05:08 [bca.uk] INFO: Saving data for GL58%20GUC: {'auction_closing_time': 1774864800.0, 'created_time': 1774364089.790651, 'last_price_update_time': 1774706708.30508}
2026-03-28 14:05:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='GL58%2520GUC') HTTP/1.1" 204 0
2026-03-28 14:05:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698781723%27 HTTP/1.1" 200 None
2026-03-28 14:05:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698781723 not downloaded yet
2026-03-28 14:05:08 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/JP04STP/698929433/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698929433>
2026-03-28 14:05:08 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GD17MJV/698729593/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=GD17MJV-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-28 14:05:08 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/ST12HSO/698934285/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698934285>
2026-03-28 14:05:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/JP04STP/698929350/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/JP04STP/42809620?sv=2020-08-04&st=2026-03-28T14%3A04%3A43Z&se=2026-03-28T14%3A29%3A43Z&sr=b&sp=r&sig=au5c8GXv2vCUIG4ea67UD3YzlPMQz7%2FWxYZM6tUj%2FEo%3D)
2026-03-28 14:05:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/JP04STP/698929377/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/JP04STP/42809620?sv=2020-08-04&st=2026-03-28T14%3A04%3A43Z&se=2026-03-28T14%3A29%3A43Z&sr=b&sp=r&sig=au5c8GXv2vCUIG4ea67UD3YzlPMQz7%2FWxYZM6tUj%2FEo%3D)
2026-03-28 14:05:08 [bca.uk] INFO: Found listing with ID: GF11%20ZWK
2026-03-28 14:05:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GF11%2520ZWK%27 HTTP/1.1" 200 None
2026-03-28 14:05:08 [bca.uk] INFO: Scrape type for GF11%20ZWK: 2
2026-03-28 14:05:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 52787f63-5bcf-50ef-acbc-275e06fd390c with identifier: GF11%20ZWK
2026-03-28 14:05:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 52787f63-5bcf-50ef-acbc-275e06fd390c with scrape type 2
2026-03-28 14:05:08 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 52787f63-5bcf-50ef-acbc-275e06fd390c with scrape type 2
2026-03-28 14:05:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 52787f63-5bcf-50ef-acbc-275e06fd390c, identifier: GF11%20ZWK
2026-03-28 14:05:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698934381%27 HTTP/1.1" 200 None
2026-03-28 14:05:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698934381 not downloaded yet
2026-03-28 14:05:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698920170%27 HTTP/1.1" 200 None
2026-03-28 14:05:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698920170 not downloaded yet
2026-03-28 14:05:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698729649%27 HTTP/1.1" 200 None
2026-03-28 14:05:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698729649 not downloaded yet
2026-03-28 14:05:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 52787f63-5bcf-50ef-acbc-275e06fd390c with identifier: GF11%20ZWK
2026-03-28 14:05:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 52787f63-5bcf-50ef-acbc-275e06fd390c with identifier: GF11%20ZWK
2026-03-28 14:05:08 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 52787f63-5bcf-50ef-acbc-275e06fd390c with identifier: GF11%20ZWK to the API
2026-03-28 14:05:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:05:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:05:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=9&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 113,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=GF11%20ZWK-GB',
'category': 'Car',
'color': 'grey',
'currency': 'GBP',
'doors_number': 3,
'engine': '1.2L',
'expiration_date': '2026-03-29T10:00:00Z',
'fuel_type': 'Petrol',
'id': '52787f63-5bcf-50ef-acbc-275e06fd390c',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'GF11 ZWK',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=GF11%20ZWK&vehicleType=*',
'listing': 'auction',
'location': 'Enfield',
'make': 'FIAT',
'model': '500',
'odometer': 72504,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2011-01-01',
'seller_name': None,
'title': 'FIAT 500 1.2 LOUNGE S/S Hatchback',
'transmission': 'manual',
'trim': 'LOUNGE S/S',
'vin': 'ZFA31200000722415',
'year': 2011}
2026-03-28 14:05:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GF11%2520ZWK%27 HTTP/1.1" 200 None
2026-03-28 14:05:08 [bca.uk] INFO: Saving data for GF11%20ZWK: {'auction_closing_time': 1774778400.0, 'created_time': 1774524181.180647, 'last_price_update_time': 1774706708.8212}
2026-03-28 14:05:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='GF11%2520ZWK') HTTP/1.1" 204 0
2026-03-28 14:05:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698781732%27 HTTP/1.1" 200 None
2026-03-28 14:05:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698781732 not downloaded yet
2026-03-28 14:05:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.bca.co.uk/api/search?q=&pageSize=100&page=10&sort=MostRecentlyAdded> (referer: https://www.bca.co.uk/search) ['zyte-api']
2026-03-28 14:05:08 [bca.uk] INFO: Found listing with ID: GU12%20UYL
2026-03-28 14:05:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GU12%2520UYL%27 HTTP/1.1" 200 None
2026-03-28 14:05:08 [bca.uk] INFO: Scrape type for GU12%20UYL: 0
2026-03-28 14:05:08 [bca.uk] INFO: Found listing with ID: HV57%20ETA
2026-03-28 14:05:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27HV57%2520ETA%27 HTTP/1.1" 200 None
2026-03-28 14:05:08 [bca.uk] INFO: Scrape type for HV57%20ETA: 2
2026-03-28 14:05:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d13916b6-f624-5fa7-a2d1-b3951c47c92e with identifier: HV57%20ETA
2026-03-28 14:05:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d13916b6-f624-5fa7-a2d1-b3951c47c92e with scrape type 2
2026-03-28 14:05:08 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d13916b6-f624-5fa7-a2d1-b3951c47c92e with scrape type 2
2026-03-28 14:05:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: d13916b6-f624-5fa7-a2d1-b3951c47c92e, identifier: HV57%20ETA
2026-03-28 14:05:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698934396%27 HTTP/1.1" 200 None
2026-03-28 14:05:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698934396 not downloaded yet
2026-03-28 14:05:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698920195%27 HTTP/1.1" 200 None
2026-03-28 14:05:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698920195 not downloaded yet
2026-03-28 14:05:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698729668%27 HTTP/1.1" 200 None
2026-03-28 14:05:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698729668 not downloaded yet
2026-03-28 14:05:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/ST12HSO/698934238/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/ST12HSO/42809912?sv=2020-08-04&st=2026-03-28T14%3A04%3A46Z&se=2026-03-28T14%3A29%3A46Z&sr=b&sp=r&sig=tOhj9TDOiYV6354bfaZJlS4RufTDvGneY43ZqD%2FSIPw%3D)
2026-03-28 14:05:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/ST12HSO/698934249/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/ST12HSO/42809912?sv=2020-08-04&st=2026-03-28T14%3A04%3A46Z&se=2026-03-28T14%3A29%3A46Z&sr=b&sp=r&sig=tOhj9TDOiYV6354bfaZJlS4RufTDvGneY43ZqD%2FSIPw%3D)
2026-03-28 14:05:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LM62VCU/698781712/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LM62VCU/42807206?sv=2020-08-04&st=2026-03-28T14%3A04%3A48Z&se=2026-03-28T14%3A29%3A48Z&sr=b&sp=r&sig=Rp%2FNuRBRM1T5Pi%2BNXegpYq0Ke%2B2Lo7Tup8NKUMfBYuw%3D)
2026-03-28 14:05:09 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/ST12HSO/698934303/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698934303>
2026-03-28 14:05:09 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DA64AKP/698920102/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=DA64AKP-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-28 14:05:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/JP04STP/698929404/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/JP04STP/42809620?sv=2020-08-04&st=2026-03-28T14%3A04%3A43Z&se=2026-03-28T14%3A29%3A43Z&sr=b&sp=r&sig=au5c8GXv2vCUIG4ea67UD3YzlPMQz7%2FWxYZM6tUj%2FEo%3D)
2026-03-28 14:05:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/JP04STP/698929390/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/JP04STP/42809620?sv=2020-08-04&st=2026-03-28T14%3A04%3A43Z&se=2026-03-28T14%3A29%3A43Z&sr=b&sp=r&sig=au5c8GXv2vCUIG4ea67UD3YzlPMQz7%2FWxYZM6tUj%2FEo%3D)
2026-03-28 14:05:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: d13916b6-f624-5fa7-a2d1-b3951c47c92e with identifier: HV57%20ETA
2026-03-28 14:05:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: d13916b6-f624-5fa7-a2d1-b3951c47c92e with identifier: HV57%20ETA
2026-03-28 14:05:09 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: d13916b6-f624-5fa7-a2d1-b3951c47c92e with identifier: HV57%20ETA to the API
2026-03-28 14:05:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:05:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:05:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=9&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 164,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=HV57%20ETA-GB',
'category': 'Car',
'color': 'grey',
'currency': 'GBP',
'doors_number': 5,
'engine': '2.0L',
'expiration_date': '2026-03-29T10:00:00Z',
'fuel_type': 'Diesel',
'id': 'd13916b6-f624-5fa7-a2d1-b3951c47c92e',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'HV57 ETA',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=HV57%20ETA&vehicleType=*',
'listing': 'auction',
'location': 'Enfield',
'make': 'MERCEDES-BENZ',
'model': 'B200',
'odometer': 117561,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2007-01-01',
'seller_name': None,
'title': 'MERCEDES-BENZ B200 2.0 CDI SE Hatchback',
'transmission': 'manual',
'trim': 'CDI SE',
'vin': 'WDD2452082J284015',
'year': 2007}
2026-03-28 14:05:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27HV57%2520ETA%27 HTTP/1.1" 200 None
2026-03-28 14:05:09 [bca.uk] INFO: Saving data for HV57%20ETA: {'auction_closing_time': 1774778400.0, 'created_time': 1774364107.930309, 'last_price_update_time': 1774706709.454817}
2026-03-28 14:05:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='HV57%2520ETA') HTTP/1.1" 204 0
2026-03-28 14:05:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698781744%27 HTTP/1.1" 200 None
2026-03-28 14:05:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698781744 not downloaded yet
2026-03-28 14:05:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:05:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c0fe590>
2026-03-28 14:05:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:05:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:05:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:05:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d6214c2d-d518-55cf-9ab4-09004f56f218/d6214c2d-d518-55cf-9ab4-09004f56f218_image_0.jpg HTTP/1.1" 201 0
2026-03-28 14:05:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FST12HSO%252F698934223%252F600') HTTP/1.1" 204 0
2026-03-28 14:05:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/ST12HSO/698934223/600 saved to cache
2026-03-28 14:05:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item d6214c2d-d518-55cf-9ab4-09004f56f218
2026-03-28 14:05:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:05:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c8fd210>
2026-03-28 14:05:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:05:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:05:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:05:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bbc16d12-29f9-531b-8c11-9870b348d92a/bbc16d12-29f9-531b-8c11-9870b348d92a_image_1.jpg HTTP/1.1" 201 0
2026-03-28 14:05:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FJP04STP%252F698929350%252F600') HTTP/1.1" 204 0
2026-03-28 14:05:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/JP04STP/698929350/600 saved to cache
2026-03-28 14:05:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item bbc16d12-29f9-531b-8c11-9870b348d92a
2026-03-28 14:05:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:05:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2d851250>
2026-03-28 14:05:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:05:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:05:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:05:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bbc16d12-29f9-531b-8c11-9870b348d92a/bbc16d12-29f9-531b-8c11-9870b348d92a_image_3.jpg HTTP/1.1" 201 0
2026-03-28 14:05:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FJP04STP%252F698929377%252F600') HTTP/1.1" 204 0
2026-03-28 14:05:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/JP04STP/698929377/600 saved to cache
2026-03-28 14:05:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item bbc16d12-29f9-531b-8c11-9870b348d92a
2026-03-28 14:05:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/ST12HSO/698934285/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/ST12HSO/42809912?sv=2020-08-04&st=2026-03-28T14%3A04%3A46Z&se=2026-03-28T14%3A29%3A46Z&sr=b&sp=r&sig=tOhj9TDOiYV6354bfaZJlS4RufTDvGneY43ZqD%2FSIPw%3D)
2026-03-28 14:05:09 [bca.uk] INFO: Found listing with ID: LB57%20JJE
2026-03-28 14:05:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LB57%2520JJE%27 HTTP/1.1" 200 None
2026-03-28 14:05:09 [bca.uk] INFO: Scrape type for LB57%20JJE: 0
2026-03-28 14:05:09 [bca.uk] INFO: Found listing with ID: LM12%20BXG
2026-03-28 14:05:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LM12%2520BXG%27 HTTP/1.1" 200 None
2026-03-28 14:05:09 [bca.uk] INFO: Scrape type for LM12%20BXG: 0
2026-03-28 14:05:09 [bca.uk] INFO: Found listing with ID: LV14%20AZO
2026-03-28 14:05:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LV14%2520AZO%27 HTTP/1.1" 200 None
2026-03-28 14:05:09 [bca.uk] INFO: Scrape type for LV14%20AZO: 0
2026-03-28 14:05:09 [bca.uk] INFO: Found listing with ID: AM09%20AHK
2026-03-28 14:05:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27AM09%2520AHK%27 HTTP/1.1" 200 None
2026-03-28 14:05:09 [bca.uk] INFO: Scrape type for AM09%20AHK: 0
2026-03-28 14:05:09 [bca.uk] INFO: Found listing with ID: BD61%20ZJE
2026-03-28 14:05:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BD61%2520ZJE%27 HTTP/1.1" 200 None
2026-03-28 14:05:09 [bca.uk] INFO: Scrape type for BD61%20ZJE: 0
2026-03-28 14:05:09 [bca.uk] INFO: Found listing with ID: DV60%20UEY
2026-03-28 14:05:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DV60%2520UEY%27 HTTP/1.1" 200 None
2026-03-28 14:05:09 [bca.uk] INFO: Scrape type for DV60%20UEY: 0
2026-03-28 14:05:09 [bca.uk] INFO: Found listing with ID: EA58%20FEF
2026-03-28 14:05:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27EA58%2520FEF%27 HTTP/1.1" 200 None
2026-03-28 14:05:09 [bca.uk] INFO: Scrape type for EA58%20FEF: 0
2026-03-28 14:05:09 [bca.uk] INFO: Found listing with ID: MV19%20XLX
2026-03-28 14:05:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MV19%2520XLX%27 HTTP/1.1" 200 None
2026-03-28 14:05:09 [bca.uk] INFO: Scrape type for MV19%20XLX: 0
2026-03-28 14:05:09 [bca.uk] INFO: Found listing with ID: AO71%20FNZ
2026-03-28 14:05:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27AO71%2520FNZ%27 HTTP/1.1" 200 None
2026-03-28 14:05:09 [bca.uk] INFO: Scrape type for AO71%20FNZ: 0
2026-03-28 14:05:09 [bca.uk] INFO: Found listing with ID: KS70%20JKZ
2026-03-28 14:05:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KS70%2520JKZ%27 HTTP/1.1" 200 None
2026-03-28 14:05:09 [bca.uk] INFO: Scrape type for KS70%20JKZ: 0
2026-03-28 14:05:09 [bca.uk] INFO: Found listing with ID: KY72%20BKX
2026-03-28 14:05:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KY72%2520BKX%27 HTTP/1.1" 200 None
2026-03-28 14:05:09 [bca.uk] INFO: Scrape type for KY72%20BKX: 2
2026-03-28 14:05:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 371662dd-f831-56e7-bb9e-3d15e2d0e3fa with identifier: KY72%20BKX
2026-03-28 14:05:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 371662dd-f831-56e7-bb9e-3d15e2d0e3fa with scrape type 2
2026-03-28 14:05:09 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 371662dd-f831-56e7-bb9e-3d15e2d0e3fa with scrape type 2
2026-03-28 14:05:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 371662dd-f831-56e7-bb9e-3d15e2d0e3fa, identifier: KY72%20BKX
2026-03-28 14:05:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698920211%27 HTTP/1.1" 200 None
2026-03-28 14:05:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698920211 not downloaded yet
2026-03-28 14:05:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698729683%27 HTTP/1.1" 200 None
2026-03-28 14:05:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698729683 not downloaded yet
2026-03-28 14:05:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 371662dd-f831-56e7-bb9e-3d15e2d0e3fa with identifier: KY72%20BKX
2026-03-28 14:05:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 371662dd-f831-56e7-bb9e-3d15e2d0e3fa with identifier: KY72%20BKX
2026-03-28 14:05:10 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 371662dd-f831-56e7-bb9e-3d15e2d0e3fa with identifier: KY72%20BKX to the API
2026-03-28 14:05:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:05:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:05:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=9&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': None,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=KY72%20BKX-GB',
'category': 'Car',
'color': 'black',
'currency': 'GBP',
'doors_number': 5,
'engine': '0.0L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Electric',
'id': '371662dd-f831-56e7-bb9e-3d15e2d0e3fa',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'KY72 BKX',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=KY72%20BKX&vehicleType=*',
'listing': 'auction',
'location': 'Enfield',
'make': 'PORSCHE',
'model': 'TAYCAN S/T',
'odometer': 39634,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-01-01',
'seller_name': None,
'title': 'PORSCHE TAYCAN S/T 350KW 93KWH RWD Hatchback',
'transmission': 'automatic',
'trim': '350KW 93KWH RWD',
'vin': 'WP0ZZZY1ZNSA75629',
'year': 2022}
2026-03-28 14:05:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KY72%2520BKX%27 HTTP/1.1" 200 None
2026-03-28 14:05:10 [bca.uk] INFO: Saving data for KY72%20BKX: {'auction_closing_time': 1774864800.0, 'created_time': 1774130960.412058, 'last_price_update_time': 1774706710.346512}
2026-03-28 14:05:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='KY72%2520BKX') HTTP/1.1" 204 0
2026-03-28 14:05:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698781751%27 HTTP/1.1" 200 None
2026-03-28 14:05:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698781751 not downloaded yet
2026-03-28 14:05:10 [bca.uk] INFO: Total items found: 100
2026-03-28 14:05:10 [bca.uk] INFO: Requesting URL: https://www.bca.co.uk/api/search?q=&pageSize=100&page=11&sort=MostRecentlyAdded
2026-03-28 14:05:10 [bca.uk] INFO: Sending search API request with Bearer token (length=1492)
2026-03-28 14:05:10 [scrapy_zyte_api._params] WARNING: Request <GET https://www.bca.co.uk/api/search?q=&pageSize=100&page=11&sort=MostRecentlyAdded> defines the Zyte API customHttpRequestHeaders parameter, overriding Request.headers. Use Request.headers instead.
2026-03-28 14:05:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GD17MJV/698729593/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/GD17MJV/42810643?sv=2020-08-04&st=2026-03-28T14%3A04%3A54Z&se=2026-03-28T14%3A29%3A54Z&sr=b&sp=r&sig=sr4QjIlF2HGyqigVx1Drsu7WI3QCudn9VApqSBNTMBA%3D)
2026-03-28 14:05:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/ST12HSO/698934269/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/ST12HSO/42809912?sv=2020-08-04&st=2026-03-28T14%3A04%3A46Z&se=2026-03-28T14%3A29%3A46Z&sr=b&sp=r&sig=tOhj9TDOiYV6354bfaZJlS4RufTDvGneY43ZqD%2FSIPw%3D)
2026-03-28 14:05:10 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DA64AKP/698920150/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698920150>
2026-03-28 14:05:10 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GD17MJV/698729633/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698729633>
2026-03-28 14:05:10 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/ST12HSO/698934353/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698934353>
2026-03-28 14:05:10 [bca.uk] INFO: Found listing with ID: RO18%20ZFF
2026-03-28 14:05:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27RO18%2520ZFF%27 HTTP/1.1" 200 None
2026-03-28 14:05:10 [bca.uk] INFO: Scrape type for RO18%20ZFF: 2
2026-03-28 14:05:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 064f5513-3a46-508e-bad6-4aadd57d196c with identifier: RO18%20ZFF
2026-03-28 14:05:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 064f5513-3a46-508e-bad6-4aadd57d196c with scrape type 2
2026-03-28 14:05:10 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 064f5513-3a46-508e-bad6-4aadd57d196c with scrape type 2
2026-03-28 14:05:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 064f5513-3a46-508e-bad6-4aadd57d196c, identifier: RO18%20ZFF
2026-03-28 14:05:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698920250%27 HTTP/1.1" 200 None
2026-03-28 14:05:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698920250 not downloaded yet
2026-03-28 14:05:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698729705%27 HTTP/1.1" 200 None
2026-03-28 14:05:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698729705 not downloaded yet
2026-03-28 14:05:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/JP04STP/698929433/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/JP04STP/42809620?sv=2020-08-04&st=2026-03-28T14%3A04%3A43Z&se=2026-03-28T14%3A29%3A43Z&sr=b&sp=r&sig=au5c8GXv2vCUIG4ea67UD3YzlPMQz7%2FWxYZM6tUj%2FEo%3D)
2026-03-28 14:05:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HY65KRJ/698920406/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/HY65KRJ/42809575?sv=2020-08-04&st=2026-03-28T14%3A03%3A59Z&se=2026-03-28T14%3A28%3A59Z&sr=b&sp=r&sig=qQyrthkWradfVt2c0sIhPBRny5qzj5uOjQmOciVVoMo%3D)
2026-03-28 14:05:10 [scrapy_zyte_api._params] WARNING: Request <GET https://www.bca.co.uk/api/search?q=&pageSize=100&page=11&sort=MostRecentlyAdded> defines the Zyte API customHttpRequestHeaders parameter, overriding Request.headers. Use Request.headers instead.
2026-03-28 14:05:10 [scrapy_zyte_api._params] WARNING: Request <GET https://www.bca.co.uk/api/search?q=&pageSize=100&page=11&sort=MostRecentlyAdded> defines the Zyte API customHttpRequestHeaders parameter, overriding Request.headers. Use Request.headers instead.
2026-03-28 14:05:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 064f5513-3a46-508e-bad6-4aadd57d196c with identifier: RO18%20ZFF
2026-03-28 14:05:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 064f5513-3a46-508e-bad6-4aadd57d196c with identifier: RO18%20ZFF
2026-03-28 14:05:10 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 064f5513-3a46-508e-bad6-4aadd57d196c with identifier: RO18%20ZFF to the API
2026-03-28 14:05:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:05:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:05:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=9&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 205,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=RO18%20ZFF-GB',
'category': 'Car',
'color': 'blue',
'currency': 'GBP',
'doors_number': 5,
'engine': '3.0L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol',
'id': '064f5513-3a46-508e-bad6-4aadd57d196c',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'RO18 ZFF',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=RO18%20ZFF&vehicleType=*',
'listing': 'auction',
'location': 'Enfield',
'make': 'PORSCHE',
'model': 'CAYENNE',
'odometer': 99531,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-01-01',
'seller_name': None,
'title': 'PORSCHE CAYENNE 3.0 TIPTRONIC S Estate',
'transmission': 'manual',
'trim': 'TIPTRONIC S',
'vin': 'WP1ZZZ9YZKDA01520',
'year': 2018}
2026-03-28 14:05:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27RO18%2520ZFF%27 HTTP/1.1" 200 None
2026-03-28 14:05:11 [bca.uk] INFO: Saving data for RO18%20ZFF: {'auction_closing_time': 1774864800.0, 'created_time': 1774305585.8185, 'last_price_update_time': 1774706711.068575}
2026-03-28 14:05:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='RO18%2520ZFF') HTTP/1.1" 204 0
2026-03-28 14:05:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698781759%27 HTTP/1.1" 200 None
2026-03-28 14:05:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698781759 not downloaded yet
2026-03-28 14:05:11 [bca.uk] INFO: Found listing with ID: EY04%20UCF
2026-03-28 14:05:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27EY04%2520UCF%27 HTTP/1.1" 200 None
2026-03-28 14:05:11 [bca.uk] INFO: Scrape type for EY04%20UCF: 0
2026-03-28 14:05:11 [bca.uk] INFO: Found listing with ID: GT18%20AWT
2026-03-28 14:05:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GT18%2520AWT%27 HTTP/1.1" 200 None
2026-03-28 14:05:11 [bca.uk] INFO: Scrape type for GT18%20AWT: 0
2026-03-28 14:05:11 [bca.uk] INFO: Found listing with ID: LT12%20OGV
2026-03-28 14:05:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LT12%2520OGV%27 HTTP/1.1" 200 None
2026-03-28 14:05:11 [bca.uk] INFO: Scrape type for LT12%20OGV: 0
2026-03-28 14:05:11 [bca.uk] INFO: Found listing with ID: LX64%20OPJ
2026-03-28 14:05:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LX64%2520OPJ%27 HTTP/1.1" 200 None
2026-03-28 14:05:11 [bca.uk] INFO: Scrape type for LX64%20OPJ: 0
2026-03-28 14:05:11 [bca.uk] INFO: Found listing with ID: AK08%20XKO
2026-03-28 14:05:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27AK08%2520XKO%27 HTTP/1.1" 200 None
2026-03-28 14:05:11 [bca.uk] INFO: Scrape type for AK08%20XKO: 0
2026-03-28 14:05:11 [bca.uk] INFO: Found listing with ID: LD56%20WYJ
2026-03-28 14:05:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LD56%2520WYJ%27 HTTP/1.1" 200 None
2026-03-28 14:05:11 [bca.uk] INFO: Scrape type for LD56%20WYJ: 0
2026-03-28 14:05:11 [bca.uk] INFO: Found listing with ID: LR10%20UYM
2026-03-28 14:05:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LR10%2520UYM%27 HTTP/1.1" 200 None
2026-03-28 14:05:11 [bca.uk] INFO: Scrape type for LR10%20UYM: 0
2026-03-28 14:05:11 [bca.uk] INFO: Found listing with ID: NJ10%20LNA
2026-03-28 14:05:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27NJ10%2520LNA%27 HTTP/1.1" 200 None
2026-03-28 14:05:11 [bca.uk] INFO: Scrape type for NJ10%20LNA: 0
2026-03-28 14:05:11 [bca.uk] INFO: Found listing with ID: RY55%20ZKD
2026-03-28 14:05:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27RY55%2520ZKD%27 HTTP/1.1" 200 None
2026-03-28 14:05:11 [bca.uk] INFO: Scrape type for RY55%20ZKD: 0
2026-03-28 14:05:11 [bca.uk] INFO: Found listing with ID: KS69%20YXO
2026-03-28 14:05:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KS69%2520YXO%27 HTTP/1.1" 200 None
2026-03-28 14:05:11 [bca.uk] INFO: Scrape type for KS69%20YXO: 0
2026-03-28 14:05:11 [bca.uk] INFO: Found listing with ID: PY66%20KMK
2026-03-28 14:05:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27PY66%2520KMK%27 HTTP/1.1" 200 None
2026-03-28 14:05:11 [bca.uk] INFO: Scrape type for PY66%20KMK: 0
2026-03-28 14:05:11 [bca.uk] INFO: Found listing with ID: WV20%20WDZ
2026-03-28 14:05:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WV20%2520WDZ%27 HTTP/1.1" 200 None
2026-03-28 14:05:11 [bca.uk] INFO: Scrape type for WV20%20WDZ: 0
2026-03-28 14:05:11 [bca.uk] INFO: Found listing with ID: AGZ%204435
2026-03-28 14:05:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27AGZ%25204435%27 HTTP/1.1" 200 None
2026-03-28 14:05:11 [bca.uk] INFO: Scrape type for AGZ%204435: 0
2026-03-28 14:05:11 [bca.uk] INFO: Found listing with ID: FP67%20BNL
2026-03-28 14:05:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FP67%2520BNL%27 HTTP/1.1" 200 None
2026-03-28 14:05:11 [bca.uk] INFO: Scrape type for FP67%20BNL: 0
2026-03-28 14:05:11 [bca.uk] INFO: Found listing with ID: GJ16%20DHC
2026-03-28 14:05:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GJ16%2520DHC%27 HTTP/1.1" 200 None
2026-03-28 14:05:11 [bca.uk] INFO: Scrape type for GJ16%20DHC: 0
2026-03-28 14:05:11 [bca.uk] INFO: Found listing with ID: KP15%20OKE
2026-03-28 14:05:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KP15%2520OKE%27 HTTP/1.1" 200 None
2026-03-28 14:05:11 [bca.uk] INFO: Scrape type for KP15%20OKE: 0
2026-03-28 14:05:11 [bca.uk] INFO: Found listing with ID: EA14%20UBC
2026-03-28 14:05:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27EA14%2520UBC%27 HTTP/1.1" 200 None
2026-03-28 14:05:11 [bca.uk] INFO: Scrape type for EA14%20UBC: 0
2026-03-28 14:05:11 [bca.uk] INFO: Found listing with ID: EY66%20UZM
2026-03-28 14:05:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27EY66%2520UZM%27 HTTP/1.1" 200 None
2026-03-28 14:05:11 [bca.uk] INFO: Scrape type for EY66%20UZM: 0
2026-03-28 14:05:11 [bca.uk] INFO: Found listing with ID: LV59%20HND
2026-03-28 14:05:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LV59%2520HND%27 HTTP/1.1" 200 None
2026-03-28 14:05:11 [bca.uk] INFO: Scrape type for LV59%20HND: 0
2026-03-28 14:05:11 [bca.uk] INFO: Found listing with ID: MF09%20TBZ
2026-03-28 14:05:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MF09%2520TBZ%27 HTTP/1.1" 200 None
2026-03-28 14:05:11 [bca.uk] INFO: Scrape type for MF09%20TBZ: 0
2026-03-28 14:05:11 [bca.uk] INFO: Found listing with ID: WF59%20WBN
2026-03-28 14:05:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WF59%2520WBN%27 HTTP/1.1" 200 None
2026-03-28 14:05:11 [bca.uk] INFO: Scrape type for WF59%20WBN: 0
2026-03-28 14:05:11 [bca.uk] INFO: Found listing with ID: YK18%20EUH
2026-03-28 14:05:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YK18%2520EUH%27 HTTP/1.1" 200 None
2026-03-28 14:05:11 [bca.uk] INFO: Scrape type for YK18%20EUH: 0
2026-03-28 14:05:11 [bca.uk] INFO: Found listing with ID: BK68%20ECE
2026-03-28 14:05:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BK68%2520ECE%27 HTTP/1.1" 200 None
2026-03-28 14:05:11 [bca.uk] INFO: Scrape type for BK68%20ECE: 0
2026-03-28 14:05:11 [bca.uk] INFO: Found listing with ID: BP19%20TWZ
2026-03-28 14:05:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BP19%2520TWZ%27 HTTP/1.1" 200 None
2026-03-28 14:05:11 [bca.uk] INFO: Scrape type for BP19%20TWZ: 2
2026-03-28 14:05:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f9109129-cd66-5710-a510-a4d7ba143a9e with identifier: BP19%20TWZ
2026-03-28 14:05:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f9109129-cd66-5710-a510-a4d7ba143a9e with scrape type 2
2026-03-28 14:05:11 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f9109129-cd66-5710-a510-a4d7ba143a9e with scrape type 2
2026-03-28 14:05:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: f9109129-cd66-5710-a510-a4d7ba143a9e, identifier: BP19%20TWZ
2026-03-28 14:05:11 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 14:05:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:05:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c9f3210>
2026-03-28 14:05:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:05:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:05:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:05:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d6214c2d-d518-55cf-9ab4-09004f56f218/d6214c2d-d518-55cf-9ab4-09004f56f218_image_1.jpg HTTP/1.1" 201 0
2026-03-28 14:05:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FST12HSO%252F698934238%252F600') HTTP/1.1" 204 0
2026-03-28 14:05:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/ST12HSO/698934238/600 saved to cache
2026-03-28 14:05:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item d6214c2d-d518-55cf-9ab4-09004f56f218
2026-03-28 14:05:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:05:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a1fec4a90>
2026-03-28 14:05:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:05:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:05:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:05:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d6214c2d-d518-55cf-9ab4-09004f56f218/d6214c2d-d518-55cf-9ab4-09004f56f218_image_2.jpg HTTP/1.1" 201 0
2026-03-28 14:05:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FST12HSO%252F698934249%252F600') HTTP/1.1" 204 0
2026-03-28 14:05:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/ST12HSO/698934249/600 saved to cache
2026-03-28 14:05:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item d6214c2d-d518-55cf-9ab4-09004f56f218
2026-03-28 14:05:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:05:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c136490>
2026-03-28 14:05:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:05:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:05:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:05:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_91eb6f90-8171-52c3-8f50-6415c188dd75/91eb6f90-8171-52c3-8f50-6415c188dd75_image_0.jpg HTTP/1.1" 201 0
2026-03-28 14:05:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLM62VCU%252F698781712%252F600') HTTP/1.1" 204 0
2026-03-28 14:05:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LM62VCU/698781712/600 saved to cache
2026-03-28 14:05:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 91eb6f90-8171-52c3-8f50-6415c188dd75
2026-03-28 14:05:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:05:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a1fe52fd0>
2026-03-28 14:05:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:05:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:05:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:05:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bbc16d12-29f9-531b-8c11-9870b348d92a/bbc16d12-29f9-531b-8c11-9870b348d92a_image_5.jpg HTTP/1.1" 201 0
2026-03-28 14:05:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FJP04STP%252F698929404%252F600') HTTP/1.1" 204 0
2026-03-28 14:05:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/JP04STP/698929404/600 saved to cache
2026-03-28 14:05:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item bbc16d12-29f9-531b-8c11-9870b348d92a
2026-03-28 14:05:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:05:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c9a2090>
2026-03-28 14:05:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:05:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:05:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:05:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bbc16d12-29f9-531b-8c11-9870b348d92a/bbc16d12-29f9-531b-8c11-9870b348d92a_image_4.jpg HTTP/1.1" 201 0
2026-03-28 14:05:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FJP04STP%252F698929390%252F600') HTTP/1.1" 204 0
2026-03-28 14:05:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/JP04STP/698929390/600 saved to cache
2026-03-28 14:05:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item bbc16d12-29f9-531b-8c11-9870b348d92a
2026-03-28 14:05:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:05:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2d9f8390>
2026-03-28 14:05:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:05:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:05:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:05:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d6214c2d-d518-55cf-9ab4-09004f56f218/d6214c2d-d518-55cf-9ab4-09004f56f218_image_4.jpg HTTP/1.1" 201 0
2026-03-28 14:05:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FST12HSO%252F698934285%252F600') HTTP/1.1" 204 0
2026-03-28 14:05:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/ST12HSO/698934285/600 saved to cache
2026-03-28 14:05:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item d6214c2d-d518-55cf-9ab4-09004f56f218
2026-03-28 14:05:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DA64AKP/698920102/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/DA64AKP/42809663?sv=2020-08-04&st=2026-03-28T14%3A04%3A53Z&se=2026-03-28T14%3A29%3A53Z&sr=b&sp=r&sig=3wPHgIhe5if4C5QW2Ax45kOJMvp1eG0YQSmdcrSQVm8%3D)
2026-03-28 14:05:12 [bca.uk] INFO: Found listing with ID: WG21%20DFZ
2026-03-28 14:05:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WG21%2520DFZ%27 HTTP/1.1" 200 None
2026-03-28 14:05:12 [bca.uk] INFO: Scrape type for WG21%20DFZ: 2
2026-03-28 14:05:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9c61fc3d-63a5-5abf-9a85-e79783236cc8 with identifier: WG21%20DFZ
2026-03-28 14:05:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9c61fc3d-63a5-5abf-9a85-e79783236cc8 with scrape type 2
2026-03-28 14:05:12 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9c61fc3d-63a5-5abf-9a85-e79783236cc8 with scrape type 2
2026-03-28 14:05:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 9c61fc3d-63a5-5abf-9a85-e79783236cc8, identifier: WG21%20DFZ
2026-03-28 14:05:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698920274%27 HTTP/1.1" 200 None
2026-03-28 14:05:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698920274 not downloaded yet
2026-03-28 14:05:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698729724%27 HTTP/1.1" 200 None
2026-03-28 14:05:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698729724 not downloaded yet
2026-03-28 14:05:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: f9109129-cd66-5710-a510-a4d7ba143a9e with identifier: BP19%20TWZ
2026-03-28 14:05:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: f9109129-cd66-5710-a510-a4d7ba143a9e with identifier: BP19%20TWZ
2026-03-28 14:05:12 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: f9109129-cd66-5710-a510-a4d7ba143a9e with identifier: BP19%20TWZ to the API
2026-03-28 14:05:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:05:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:05:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=10&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 107,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=BP19%20TWZ-GB',
'category': 'Car',
'color': 'grey',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.5L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Diesel',
'id': 'f9109129-cd66-5710-a510-a4d7ba143a9e',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'BP19 TWZ',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=BP19%20TWZ&vehicleType=*',
'listing': 'auction',
'location': 'Edinburgh',
'make': 'PEUGEOT',
'model': '5008',
'odometer': 91718,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-01-01',
'seller_name': None,
'title': 'PEUGEOT 5008 1.5 BLUEHDI 130 GT LINE PREMIUM StationWagon',
'transmission': 'manual',
'trim': 'BLUEHDI 130 GT LINE PREMIUM',
'vin': 'VF3MCYHZJKL026095',
'year': 2019}
2026-03-28 14:05:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BP19%2520TWZ%27 HTTP/1.1" 200 None
2026-03-28 14:05:13 [bca.uk] INFO: Saving data for BP19%20TWZ: {'auction_closing_time': 1774864800.0, 'created_time': 1774332548.148719, 'last_price_update_time': 1774706713.438263}
2026-03-28 14:05:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='BP19%2520TWZ') HTTP/1.1" 204 0
2026-03-28 14:05:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/ST12HSO/698934303/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/ST12HSO/42809912?sv=2020-08-04&st=2026-03-28T14%3A04%3A46Z&se=2026-03-28T14%3A29%3A46Z&sr=b&sp=r&sig=tOhj9TDOiYV6354bfaZJlS4RufTDvGneY43ZqD%2FSIPw%3D)
2026-03-28 14:05:13 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LM62VCU/698781732/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698781732>
2026-03-28 14:05:13 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GD17MJV/698729649/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698729649>
2026-03-28 14:05:13 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DA64AKP/698920170/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698920170>
2026-03-28 14:05:13 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/ST12HSO/698934381/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698934381>
2026-03-28 14:05:13 [scrapy.extensions.logstats] INFO: Crawled 156 pages (at 14 pages/min), scraped 240 items (at 86 items/min)
2026-03-28 14:05:13 [scrapy.extensions.memusage] INFO: Peak memory usage is 200MiB
2026-03-28 14:05:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 9c61fc3d-63a5-5abf-9a85-e79783236cc8 with identifier: WG21%20DFZ
2026-03-28 14:05:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 9c61fc3d-63a5-5abf-9a85-e79783236cc8 with identifier: WG21%20DFZ
2026-03-28 14:05:13 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 9c61fc3d-63a5-5abf-9a85-e79783236cc8 with identifier: WG21%20DFZ to the API
2026-03-28 14:05:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:05:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:05:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=9&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 171,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=WG21%20DFZ-GB',
'category': 'Car',
'color': 'black',
'currency': 'GBP',
'doors_number': 5,
'engine': '2.0L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Diesel',
'id': '9c61fc3d-63a5-5abf-9a85-e79783236cc8',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'WG21 DFZ',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=WG21%20DFZ&vehicleType=*',
'listing': 'auction',
'location': 'Enfield',
'make': 'LAND ROVER',
'model': 'R/R EVOQUE',
'odometer': 28110,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-01-01',
'seller_name': None,
'title': 'LAND ROVER R/R EVOQUE 2.0 D165 4WD S Hatchback',
'transmission': 'automatic',
'trim': 'D165 4WD S',
'vin': 'SALZA2AN8MH147080',
'year': 2021}
2026-03-28 14:05:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WG21%2520DFZ%27 HTTP/1.1" 200 None
2026-03-28 14:05:13 [bca.uk] INFO: Saving data for WG21%20DFZ: {'auction_closing_time': 1774864800.0, 'created_time': 1773843018.384064, 'last_price_update_time': 1774706713.901587}
2026-03-28 14:05:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='WG21%2520DFZ') HTTP/1.1" 204 0
2026-03-28 14:05:13 [bca.uk] INFO: Found listing with ID: SK72%20YTM
2026-03-28 14:05:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SK72%2520YTM%27 HTTP/1.1" 200 None
2026-03-28 14:05:13 [bca.uk] INFO: Scrape type for SK72%20YTM: 2
2026-03-28 14:05:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0045d710-b92f-5184-9bb3-b14268f23a12 with identifier: SK72%20YTM
2026-03-28 14:05:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0045d710-b92f-5184-9bb3-b14268f23a12 with scrape type 2
2026-03-28 14:05:13 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0045d710-b92f-5184-9bb3-b14268f23a12 with scrape type 2
2026-03-28 14:05:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 0045d710-b92f-5184-9bb3-b14268f23a12, identifier: SK72%20YTM
2026-03-28 14:05:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:05:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2dd34f50>
2026-03-28 14:05:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:05:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:05:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:05:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_df8c97f7-3f96-5220-9648-b6806ba88234/df8c97f7-3f96-5220-9648-b6806ba88234_image_0.jpg HTTP/1.1" 201 0
2026-03-28 14:05:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FGD17MJV%252F698729593%252F600') HTTP/1.1" 204 0
2026-03-28 14:05:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GD17MJV/698729593/600 saved to cache
2026-03-28 14:05:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item df8c97f7-3f96-5220-9648-b6806ba88234
2026-03-28 14:05:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:05:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2dd34410>
2026-03-28 14:05:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:05:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:05:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:05:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d6214c2d-d518-55cf-9ab4-09004f56f218/d6214c2d-d518-55cf-9ab4-09004f56f218_image_3.jpg HTTP/1.1" 201 0
2026-03-28 14:05:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FST12HSO%252F698934269%252F600') HTTP/1.1" 204 0
2026-03-28 14:05:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/ST12HSO/698934269/600 saved to cache
2026-03-28 14:05:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item d6214c2d-d518-55cf-9ab4-09004f56f218
2026-03-28 14:05:14 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LM62VCU/698781722/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698781722>
2026-03-28 14:05:14 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LM62VCU/698781723/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698781723>
2026-03-28 14:05:14 [bca.uk] INFO: Found listing with ID: EA64%20XMM
2026-03-28 14:05:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27EA64%2520XMM%27 HTTP/1.1" 200 None
2026-03-28 14:05:14 [bca.uk] INFO: Scrape type for EA64%20XMM: 0
2026-03-28 14:05:14 [bca.uk] INFO: Found listing with ID: EO72%20HNA
2026-03-28 14:05:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27EO72%2520HNA%27 HTTP/1.1" 200 None
2026-03-28 14:05:14 [bca.uk] INFO: Scrape type for EO72%20HNA: 0
2026-03-28 14:05:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698920294%27 HTTP/1.1" 200 None
2026-03-28 14:05:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698920294 not downloaded yet
2026-03-28 14:05:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698729749%27 HTTP/1.1" 200 None
2026-03-28 14:05:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698729749 not downloaded yet
2026-03-28 14:05:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 0045d710-b92f-5184-9bb3-b14268f23a12 with identifier: SK72%20YTM
2026-03-28 14:05:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 0045d710-b92f-5184-9bb3-b14268f23a12 with identifier: SK72%20YTM
2026-03-28 14:05:14 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 0045d710-b92f-5184-9bb3-b14268f23a12 with identifier: SK72%20YTM to the API
2026-03-28 14:05:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:05:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:05:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=10&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 135,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=SK72%20YTM-GB',
'category': 'Car',
'color': 'blue',
'currency': 'GBP',
'doors_number': 4,
'engine': '1.5L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol',
'id': '0045d710-b92f-5184-9bb3-b14268f23a12',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'SK72 YTM',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=SK72%20YTM&vehicleType=*',
'listing': 'auction',
'location': 'Edinburgh',
'make': 'AUDI',
'model': 'A3 SALOON',
'odometer': 19803,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-01-01',
'seller_name': None,
'title': 'AUDI A3 SALOON 1.5 35 TFSI EDITION 1 Saloon',
'transmission': 'manual',
'trim': '35 TFSI EDITION 1',
'vin': 'WAUZZZGYXPA050208',
'year': 2022}
2026-03-28 14:05:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SK72%2520YTM%27 HTTP/1.1" 200 None
2026-03-28 14:05:15 [bca.uk] INFO: Saving data for SK72%20YTM: {'auction_closing_time': 1774864800.0, 'created_time': 1773907784.630924, 'last_price_update_time': 1774706715.471336}
2026-03-28 14:05:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='SK72%2520YTM') HTTP/1.1" 204 0
2026-03-28 14:05:15 [bca.uk] INFO: Found listing with ID: EX13%20UKP
2026-03-28 14:05:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27EX13%2520UKP%27 HTTP/1.1" 200 None
2026-03-28 14:05:15 [bca.uk] INFO: Scrape type for EX13%20UKP: 0
2026-03-28 14:05:15 [bca.uk] INFO: Found listing with ID: KY64%20TVO
2026-03-28 14:05:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KY64%2520TVO%27 HTTP/1.1" 200 None
2026-03-28 14:05:15 [bca.uk] INFO: Scrape type for KY64%20TVO: 0
2026-03-28 14:05:15 [bca.uk] INFO: Found listing with ID: SC66%20FDM
2026-03-28 14:05:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SC66%2520FDM%27 HTTP/1.1" 200 None
2026-03-28 14:05:15 [bca.uk] INFO: Scrape type for SC66%20FDM: 0
2026-03-28 14:05:15 [bca.uk] INFO: Found listing with ID: SN63%20HJG
2026-03-28 14:05:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SN63%2520HJG%27 HTTP/1.1" 200 None
2026-03-28 14:05:15 [bca.uk] INFO: Scrape type for SN63%20HJG: 0
2026-03-28 14:05:15 [bca.uk] INFO: Found listing with ID: SV10%20UOD
2026-03-28 14:05:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SV10%2520UOD%27 HTTP/1.1" 200 None
2026-03-28 14:05:15 [bca.uk] INFO: Scrape type for SV10%20UOD: 0
2026-03-28 14:05:15 [bca.uk] INFO: Found listing with ID: YK68%20KNO
2026-03-28 14:05:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YK68%2520KNO%27 HTTP/1.1" 200 None
2026-03-28 14:05:15 [bca.uk] INFO: Scrape type for YK68%20KNO: 2
2026-03-28 14:05:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 46edc1cc-4b58-5151-9980-2578ca642238 with identifier: YK68%20KNO
2026-03-28 14:05:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 46edc1cc-4b58-5151-9980-2578ca642238 with scrape type 2
2026-03-28 14:05:15 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 46edc1cc-4b58-5151-9980-2578ca642238 with scrape type 2
2026-03-28 14:05:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 46edc1cc-4b58-5151-9980-2578ca642238, identifier: YK68%20KNO
2026-03-28 14:05:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DA64AKP/698920150/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/DA64AKP/42809663?sv=2020-08-04&st=2026-03-28T14%3A04%3A53Z&se=2026-03-28T14%3A29%3A53Z&sr=b&sp=r&sig=3wPHgIhe5if4C5QW2Ax45kOJMvp1eG0YQSmdcrSQVm8%3D)
2026-03-28 14:05:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GD17MJV/698729633/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/GD17MJV/42810643?sv=2020-08-04&st=2026-03-28T14%3A04%3A54Z&se=2026-03-28T14%3A29%3A54Z&sr=b&sp=r&sig=sr4QjIlF2HGyqigVx1Drsu7WI3QCudn9VApqSBNTMBA%3D)
2026-03-28 14:05:15 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LM62VCU/698781744/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698781744>
2026-03-28 14:05:15 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DA64AKP/698920211/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698920211>
2026-03-28 14:05:15 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GD17MJV/698729683/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698729683>
2026-03-28 14:05:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698920312%27 HTTP/1.1" 200 None
2026-03-28 14:05:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698920312 not downloaded yet
2026-03-28 14:05:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698729765%27 HTTP/1.1" 200 None
2026-03-28 14:05:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698729765 not downloaded yet
2026-03-28 14:05:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 46edc1cc-4b58-5151-9980-2578ca642238 with identifier: YK68%20KNO
2026-03-28 14:05:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 46edc1cc-4b58-5151-9980-2578ca642238 with identifier: YK68%20KNO
2026-03-28 14:05:15 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 46edc1cc-4b58-5151-9980-2578ca642238 with identifier: YK68%20KNO to the API
2026-03-28 14:05:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:05:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:05:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=10&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 138,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=YK68%20KNO-GB',
'category': 'Car',
'color': 'silver',
'currency': 'GBP',
'doors_number': 4,
'engine': '2.0L',
'expiration_date': '2026-03-29T10:00:00Z',
'fuel_type': 'Petrol',
'id': '46edc1cc-4b58-5151-9980-2578ca642238',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'YK68 KNO',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=YK68%20KNO&vehicleType=*',
'listing': 'auction',
'location': 'Edinburgh',
'make': 'BMW',
'model': '320I',
'odometer': 43442,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-01-01',
'seller_name': None,
'title': 'BMW 320I 2.0 T M SPORT SHADOW ED.STEP Saloon',
'transmission': 'automatic',
'trim': 'T M SPORT SHADOW ED.STEP',
'vin': 'WBA8A12060A966122',
'year': 2018}
2026-03-28 14:05:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YK68%2520KNO%27 HTTP/1.1" 200 None
2026-03-28 14:05:16 [bca.uk] INFO: Saving data for YK68%20KNO: {'auction_closing_time': 1774778400.0, 'created_time': 1774524308.309269, 'last_price_update_time': 1774706716.33039}
2026-03-28 14:05:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='YK68%2520KNO') HTTP/1.1" 204 0
2026-03-28 14:05:16 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:05:16 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:05:16 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:05:16 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:05:16 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:05:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:05:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c8b7990>
2026-03-28 14:05:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:05:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:05:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:05:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bbc16d12-29f9-531b-8c11-9870b348d92a/bbc16d12-29f9-531b-8c11-9870b348d92a_image_7.jpg HTTP/1.1" 201 0
2026-03-28 14:05:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FJP04STP%252F698929433%252F600') HTTP/1.1" 204 0
2026-03-28 14:05:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/JP04STP/698929433/600 saved to cache
2026-03-28 14:05:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item bbc16d12-29f9-531b-8c11-9870b348d92a
2026-03-28 14:05:16 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:05:16 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:05:16 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:05:16 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:05:16 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:05:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:05:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c9e7d90>
2026-03-28 14:05:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:05:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:05:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:05:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fe123a59-25d0-509d-9046-e45117da9996/fe123a59-25d0-509d-9046-e45117da9996_image_7.jpg HTTP/1.1" 201 0
2026-03-28 14:05:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FHY65KRJ%252F698920406%252F600') HTTP/1.1" 204 0
2026-03-28 14:05:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HY65KRJ/698920406/600 saved to cache
2026-03-28 14:05:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item fe123a59-25d0-509d-9046-e45117da9996
2026-03-28 14:05:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:05:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2d903c10>
2026-03-28 14:05:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:05:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:05:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:05:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1d31f426-9911-536f-8f01-f0daf0072cc0/1d31f426-9911-536f-8f01-f0daf0072cc0_image_0.jpg HTTP/1.1" 201 0
2026-03-28 14:05:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FDA64AKP%252F698920102%252F600') HTTP/1.1" 204 0
2026-03-28 14:05:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DA64AKP/698920102/600 saved to cache
2026-03-28 14:05:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 1d31f426-9911-536f-8f01-f0daf0072cc0
2026-03-28 14:05:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:05:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2ca50250>
2026-03-28 14:05:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:05:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:05:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:05:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d6214c2d-d518-55cf-9ab4-09004f56f218/d6214c2d-d518-55cf-9ab4-09004f56f218_image_5.jpg HTTP/1.1" 201 0
2026-03-28 14:05:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FST12HSO%252F698934303%252F600') HTTP/1.1" 204 0
2026-03-28 14:05:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/ST12HSO/698934303/600 saved to cache
2026-03-28 14:05:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item d6214c2d-d518-55cf-9ab4-09004f56f218
2026-03-28 14:05:16 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LM62VCU/698781751/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698781751>
2026-03-28 14:05:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/ST12HSO/698934353/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/ST12HSO/42809912?sv=2020-08-04&st=2026-03-28T14%3A04%3A46Z&se=2026-03-28T14%3A29%3A46Z&sr=b&sp=r&sig=tOhj9TDOiYV6354bfaZJlS4RufTDvGneY43ZqD%2FSIPw%3D)
2026-03-28 14:05:16 [bca.uk] INFO: Found listing with ID: SD60%20AGX
2026-03-28 14:05:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SD60%2520AGX%27 HTTP/1.1" 200 None
2026-03-28 14:05:16 [bca.uk] INFO: Scrape type for SD60%20AGX: 0
2026-03-28 14:05:16 [bca.uk] INFO: Found listing with ID: FL15%20SDZ
2026-03-28 14:05:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FL15%2520SDZ%27 HTTP/1.1" 200 None
2026-03-28 14:05:16 [bca.uk] INFO: Scrape type for FL15%20SDZ: 0
2026-03-28 14:05:16 [bca.uk] INFO: Found listing with ID: KJ18%20TUV
2026-03-28 14:05:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KJ18%2520TUV%27 HTTP/1.1" 200 None
2026-03-28 14:05:16 [bca.uk] INFO: Scrape type for KJ18%20TUV: 0
2026-03-28 14:05:16 [bca.uk] INFO: Found listing with ID: RK19%20KCU
2026-03-28 14:05:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27RK19%2520KCU%27 HTTP/1.1" 200 None
2026-03-28 14:05:16 [bca.uk] INFO: Scrape type for RK19%20KCU: 2
2026-03-28 14:05:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 38edf4e9-2afe-5e0d-88ad-35c0b9888464 with identifier: RK19%20KCU
2026-03-28 14:05:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 38edf4e9-2afe-5e0d-88ad-35c0b9888464 with scrape type 2
2026-03-28 14:05:16 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 38edf4e9-2afe-5e0d-88ad-35c0b9888464 with scrape type 2
2026-03-28 14:05:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 38edf4e9-2afe-5e0d-88ad-35c0b9888464, identifier: RK19%20KCU
2026-03-28 14:05:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/ST12HSO/698934381/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/ST12HSO/42809912?sv=2020-08-04&st=2026-03-28T14%3A04%3A46Z&se=2026-03-28T14%3A29%3A46Z&sr=b&sp=r&sig=tOhj9TDOiYV6354bfaZJlS4RufTDvGneY43ZqD%2FSIPw%3D)
2026-03-28 14:05:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 38edf4e9-2afe-5e0d-88ad-35c0b9888464 with identifier: RK19%20KCU
2026-03-28 14:05:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 38edf4e9-2afe-5e0d-88ad-35c0b9888464 with identifier: RK19%20KCU
2026-03-28 14:05:16 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 38edf4e9-2afe-5e0d-88ad-35c0b9888464 with identifier: RK19%20KCU to the API
2026-03-28 14:05:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:05:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:05:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=10&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 71,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=RK19%20KCU-GB',
'category': 'Car',
'color': 'black',
'currency': 'GBP',
'doors_number': 5,
'engine': '2.0L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol/Electric',
'id': '38edf4e9-2afe-5e0d-88ad-35c0b9888464',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'RK19 KCU',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=RK19%20KCU&vehicleType=*',
'listing': 'auction',
'location': 'Edinburgh',
'make': 'LAND ROVER',
'model': 'R/R SPORT',
'odometer': 112967,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-01-01',
'seller_name': None,
'title': 'LAND ROVER R/R SPORT 2.0 P400E AUTOBIOGRAPHY DYNAMIC StationWagon',
'transmission': 'automatic',
'trim': 'P400E AUTOBIOGRAPHY DYNAMIC',
'vin': 'SALWA2AY4KA854759',
'year': 2019}
2026-03-28 14:05:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27RK19%2520KCU%27 HTTP/1.1" 200 None
2026-03-28 14:05:17 [bca.uk] INFO: Saving data for RK19%20KCU: {'auction_closing_time': 1774864800.0, 'created_time': 1774391423.008169, 'last_price_update_time': 1774706717.172596}
2026-03-28 14:05:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='RK19%2520KCU') HTTP/1.1" 204 0
2026-03-28 14:05:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GD17MJV/698729649/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/GD17MJV/42810643?sv=2020-08-04&st=2026-03-28T14%3A04%3A54Z&se=2026-03-28T14%3A29%3A54Z&sr=b&sp=r&sig=sr4QjIlF2HGyqigVx1Drsu7WI3QCudn9VApqSBNTMBA%3D)
2026-03-28 14:05:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DA64AKP/698920170/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/DA64AKP/42809663?sv=2020-08-04&st=2026-03-28T14%3A04%3A53Z&se=2026-03-28T14%3A29%3A53Z&sr=b&sp=r&sig=3wPHgIhe5if4C5QW2Ax45kOJMvp1eG0YQSmdcrSQVm8%3D)
2026-03-28 14:05:17 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LM62VCU/698781759/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698781759>
2026-03-28 14:05:17 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GD17MJV/698729705/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698729705>
2026-03-28 14:05:17 [bca.uk] INFO: Found listing with ID: DU64%20UHM
2026-03-28 14:05:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DU64%2520UHM%27 HTTP/1.1" 200 None
2026-03-28 14:05:17 [bca.uk] INFO: Scrape type for DU64%20UHM: 2
2026-03-28 14:05:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0ec83102-82ee-54a6-accf-ebbd69658fcb with identifier: DU64%20UHM
2026-03-28 14:05:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0ec83102-82ee-54a6-accf-ebbd69658fcb with scrape type 2
2026-03-28 14:05:17 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0ec83102-82ee-54a6-accf-ebbd69658fcb with scrape type 2
2026-03-28 14:05:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 0ec83102-82ee-54a6-accf-ebbd69658fcb, identifier: DU64%20UHM
2026-03-28 14:05:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LM62VCU/698781732/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LM62VCU/42807206?sv=2020-08-04&st=2026-03-28T14%3A04%3A48Z&se=2026-03-28T14%3A29%3A48Z&sr=b&sp=r&sig=Rp%2FNuRBRM1T5Pi%2BNXegpYq0Ke%2B2Lo7Tup8NKUMfBYuw%3D)
2026-03-28 14:05:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 0ec83102-82ee-54a6-accf-ebbd69658fcb with identifier: DU64%20UHM
2026-03-28 14:05:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 0ec83102-82ee-54a6-accf-ebbd69658fcb with identifier: DU64%20UHM
2026-03-28 14:05:17 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 0ec83102-82ee-54a6-accf-ebbd69658fcb with identifier: DU64%20UHM to the API
2026-03-28 14:05:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:05:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:05:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=10&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 163,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=DU64%20UHM-GB',
'category': 'Car',
'color': 'blue',
'currency': 'GBP',
'doors_number': 5,
'engine': '3.0L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Diesel',
'id': '0ec83102-82ee-54a6-accf-ebbd69658fcb',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'DU64 UHM',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=DU64%20UHM&vehicleType=*',
'listing': 'auction',
'location': 'Edinburgh',
'make': 'JAGUAR',
'model': 'XF SPORTBRAKE',
'odometer': 118236,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2014-01-01',
'seller_name': None,
'title': 'JAGUAR XF SPORTBRAKE 3.0 D V6 240 PREMIUM LUXURY Estate',
'transmission': 'automatic',
'trim': 'D V6 240 PREMIUM LUXURY',
'vin': 'SAJAC0248FNU45658',
'year': 2014}
2026-03-28 14:05:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DU64%2520UHM%27 HTTP/1.1" 200 None
2026-03-28 14:05:17 [bca.uk] INFO: Saving data for DU64%20UHM: {'auction_closing_time': 1774864800.0, 'created_time': 1773824581.142642, 'last_price_update_time': 1774706717.784798}
2026-03-28 14:05:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='DU64%2520UHM') HTTP/1.1" 204 0
2026-03-28 14:05:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LM62VCU/698781723/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LM62VCU/42807206?sv=2020-08-04&st=2026-03-28T14%3A04%3A48Z&se=2026-03-28T14%3A29%3A48Z&sr=b&sp=r&sig=Rp%2FNuRBRM1T5Pi%2BNXegpYq0Ke%2B2Lo7Tup8NKUMfBYuw%3D)
2026-03-28 14:05:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LM62VCU/698781722/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LM62VCU/42807206?sv=2020-08-04&st=2026-03-28T14%3A04%3A48Z&se=2026-03-28T14%3A29%3A48Z&sr=b&sp=r&sig=Rp%2FNuRBRM1T5Pi%2BNXegpYq0Ke%2B2Lo7Tup8NKUMfBYuw%3D)
2026-03-28 14:05:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GD17MJV/698729683/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/GD17MJV/42810643?sv=2020-08-04&st=2026-03-28T14%3A04%3A54Z&se=2026-03-28T14%3A29%3A54Z&sr=b&sp=r&sig=sr4QjIlF2HGyqigVx1Drsu7WI3QCudn9VApqSBNTMBA%3D)
2026-03-28 14:05:17 [bca.uk] INFO: Found listing with ID: SP07%20GLF
2026-03-28 14:05:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SP07%2520GLF%27 HTTP/1.1" 200 None
2026-03-28 14:05:17 [bca.uk] INFO: Scrape type for SP07%20GLF: 2
2026-03-28 14:05:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bbe961f9-66b3-5281-8f0b-010a6cdf460f with identifier: SP07%20GLF
2026-03-28 14:05:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bbe961f9-66b3-5281-8f0b-010a6cdf460f with scrape type 2
2026-03-28 14:05:17 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item bbe961f9-66b3-5281-8f0b-010a6cdf460f with scrape type 2
2026-03-28 14:05:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: bbe961f9-66b3-5281-8f0b-010a6cdf460f, identifier: SP07%20GLF
2026-03-28 14:05:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:05:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2d75a350>
2026-03-28 14:05:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:05:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:05:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:05:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1d31f426-9911-536f-8f01-f0daf0072cc0/1d31f426-9911-536f-8f01-f0daf0072cc0_image_2.jpg HTTP/1.1" 201 0
2026-03-28 14:05:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FDA64AKP%252F698920150%252F600') HTTP/1.1" 204 0
2026-03-28 14:05:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DA64AKP/698920150/600 saved to cache
2026-03-28 14:05:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 1d31f426-9911-536f-8f01-f0daf0072cc0
2026-03-28 14:05:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:05:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c78d710>
2026-03-28 14:05:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:05:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:05:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:05:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_df8c97f7-3f96-5220-9648-b6806ba88234/df8c97f7-3f96-5220-9648-b6806ba88234_image_2.jpg HTTP/1.1" 201 0
2026-03-28 14:05:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FGD17MJV%252F698729633%252F600') HTTP/1.1" 204 0
2026-03-28 14:05:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GD17MJV/698729633/600 saved to cache
2026-03-28 14:05:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item df8c97f7-3f96-5220-9648-b6806ba88234
2026-03-28 14:05:18 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:05:18 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:05:18 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:05:18 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:05:18 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:05:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:05:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c3b60d0>
2026-03-28 14:05:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:05:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:05:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:05:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d6214c2d-d518-55cf-9ab4-09004f56f218/d6214c2d-d518-55cf-9ab4-09004f56f218_image_7.jpg HTTP/1.1" 201 0
2026-03-28 14:05:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FST12HSO%252F698934353%252F600') HTTP/1.1" 204 0
2026-03-28 14:05:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/ST12HSO/698934353/600 saved to cache
2026-03-28 14:05:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item d6214c2d-d518-55cf-9ab4-09004f56f218
2026-03-28 14:05:18 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:05:18 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:05:18 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:05:18 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:05:18 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:05:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:05:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c769090>
2026-03-28 14:05:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:05:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:05:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:05:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d6214c2d-d518-55cf-9ab4-09004f56f218/d6214c2d-d518-55cf-9ab4-09004f56f218_image_8.jpg HTTP/1.1" 201 0
2026-03-28 14:05:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FST12HSO%252F698934381%252F600') HTTP/1.1" 204 0
2026-03-28 14:05:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/ST12HSO/698934381/600 saved to cache
2026-03-28 14:05:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item d6214c2d-d518-55cf-9ab4-09004f56f218
2026-03-28 14:05:18 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DA64AKP/698920294/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698920294>
2026-03-28 14:05:18 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GD17MJV/698729749/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698729749>
2026-03-28 14:05:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DA64AKP/698920211/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/DA64AKP/42809663?sv=2020-08-04&st=2026-03-28T14%3A04%3A53Z&se=2026-03-28T14%3A29%3A53Z&sr=b&sp=r&sig=3wPHgIhe5if4C5QW2Ax45kOJMvp1eG0YQSmdcrSQVm8%3D)
2026-03-28 14:05:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: bbe961f9-66b3-5281-8f0b-010a6cdf460f with identifier: SP07%20GLF
2026-03-28 14:05:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: bbe961f9-66b3-5281-8f0b-010a6cdf460f with identifier: SP07%20GLF
2026-03-28 14:05:18 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: bbe961f9-66b3-5281-8f0b-010a6cdf460f with identifier: SP07%20GLF to the API
2026-03-28 14:05:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:05:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:05:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=10&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 195,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=SP07%20GLF-GB',
'category': 'Car',
'color': 'blue',
'currency': 'GBP',
'doors_number': 5,
'engine': '2.0L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol',
'id': 'bbe961f9-66b3-5281-8f0b-010a6cdf460f',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'SP07 GLF',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=SP07%20GLF&vehicleType=*',
'listing': 'auction',
'location': 'Edinburgh',
'make': 'HONDA',
'model': 'CR-V',
'odometer': 73341,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2007-01-01',
'seller_name': None,
'title': 'HONDA CR-V 2.0 I-VTEC ES Estate',
'transmission': 'automatic',
'trim': 'I-VTEC ES',
'vin': 'SHSRE58507U016448',
'year': 2007}
2026-03-28 14:05:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SP07%2520GLF%27 HTTP/1.1" 200 None
2026-03-28 14:05:19 [bca.uk] INFO: Saving data for SP07%20GLF: {'auction_closing_time': 1774864800.0, 'created_time': 1774364051.308302, 'last_price_update_time': 1774706719.529336}
2026-03-28 14:05:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='SP07%2520GLF') HTTP/1.1" 204 0
2026-03-28 14:05:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LM62VCU/698781744/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LM62VCU/42807206?sv=2020-08-04&st=2026-03-28T14%3A04%3A48Z&se=2026-03-28T14%3A29%3A48Z&sr=b&sp=r&sig=Rp%2FNuRBRM1T5Pi%2BNXegpYq0Ke%2B2Lo7Tup8NKUMfBYuw%3D)
2026-03-28 14:05:19 [bca.uk] INFO: Found listing with ID: CN60%20JNJ
2026-03-28 14:05:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27CN60%2520JNJ%27 HTTP/1.1" 200 None
2026-03-28 14:05:19 [bca.uk] INFO: Scrape type for CN60%20JNJ: 0
2026-03-28 14:05:19 [bca.uk] INFO: Found listing with ID: SJ12%20WND
2026-03-28 14:05:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SJ12%2520WND%27 HTTP/1.1" 200 None
2026-03-28 14:05:19 [bca.uk] INFO: Scrape type for SJ12%20WND: 0
2026-03-28 14:05:19 [bca.uk] INFO: Found listing with ID: SK06%20YHE
2026-03-28 14:05:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SK06%2520YHE%27 HTTP/1.1" 200 None
2026-03-28 14:05:19 [bca.uk] INFO: Scrape type for SK06%20YHE: 0
2026-03-28 14:05:19 [bca.uk] INFO: Found listing with ID: SP10%20OWU
2026-03-28 14:05:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SP10%2520OWU%27 HTTP/1.1" 200 None
2026-03-28 14:05:19 [bca.uk] INFO: Scrape type for SP10%20OWU: 0
2026-03-28 14:05:19 [bca.uk] INFO: Found listing with ID: SP13%20OYM
2026-03-28 14:05:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SP13%2520OYM%27 HTTP/1.1" 200 None
2026-03-28 14:05:19 [bca.uk] INFO: Scrape type for SP13%20OYM: 0
2026-03-28 14:05:19 [bca.uk] INFO: Found listing with ID: SP61%20YBE
2026-03-28 14:05:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SP61%2520YBE%27 HTTP/1.1" 200 None
2026-03-28 14:05:19 [bca.uk] INFO: Scrape type for SP61%20YBE: 0
2026-03-28 14:05:19 [bca.uk] INFO: Found listing with ID: ST61%20AZU
2026-03-28 14:05:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27ST61%2520AZU%27 HTTP/1.1" 200 None
2026-03-28 14:05:19 [bca.uk] INFO: Scrape type for ST61%20AZU: 0
2026-03-28 14:05:19 [bca.uk] INFO: Found listing with ID: SY60%20MFJ
2026-03-28 14:05:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SY60%2520MFJ%27 HTTP/1.1" 200 None
2026-03-28 14:05:19 [bca.uk] INFO: Scrape type for SY60%20MFJ: 0
2026-03-28 14:05:19 [bca.uk] INFO: Found listing with ID: WD22%20CCF
2026-03-28 14:05:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WD22%2520CCF%27 HTTP/1.1" 200 None
2026-03-28 14:05:19 [bca.uk] INFO: Scrape type for WD22%20CCF: 0
2026-03-28 14:05:19 [bca.uk] INFO: Found listing with ID: YA73%20ESV
2026-03-28 14:05:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YA73%2520ESV%27 HTTP/1.1" 200 None
2026-03-28 14:05:19 [bca.uk] INFO: Scrape type for YA73%20ESV: 0
2026-03-28 14:05:19 [bca.uk] INFO: Found listing with ID: FG68%20YMS
2026-03-28 14:05:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FG68%2520YMS%27 HTTP/1.1" 200 None
2026-03-28 14:05:19 [bca.uk] INFO: Scrape type for FG68%20YMS: 0
2026-03-28 14:05:19 [bca.uk] INFO: Found listing with ID: HY14%20HKE
2026-03-28 14:05:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27HY14%2520HKE%27 HTTP/1.1" 200 None
2026-03-28 14:05:19 [bca.uk] INFO: Scrape type for HY14%20HKE: 2
2026-03-28 14:05:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1a266e90-5a43-5bf9-84c9-d323c4a91e17 with identifier: HY14%20HKE
2026-03-28 14:05:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1a266e90-5a43-5bf9-84c9-d323c4a91e17 with scrape type 2
2026-03-28 14:05:19 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1a266e90-5a43-5bf9-84c9-d323c4a91e17 with scrape type 2
2026-03-28 14:05:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 1a266e90-5a43-5bf9-84c9-d323c4a91e17, identifier: HY14%20HKE
2026-03-28 14:05:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:05:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2ca11410>
2026-03-28 14:05:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:05:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:05:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:05:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_df8c97f7-3f96-5220-9648-b6806ba88234/df8c97f7-3f96-5220-9648-b6806ba88234_image_3.jpg HTTP/1.1" 201 0
2026-03-28 14:05:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FGD17MJV%252F698729649%252F600') HTTP/1.1" 204 0
2026-03-28 14:05:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GD17MJV/698729649/600 saved to cache
2026-03-28 14:05:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item df8c97f7-3f96-5220-9648-b6806ba88234
2026-03-28 14:05:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:05:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2dd3ced0>
2026-03-28 14:05:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:05:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:05:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:05:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1d31f426-9911-536f-8f01-f0daf0072cc0/1d31f426-9911-536f-8f01-f0daf0072cc0_image_3.jpg HTTP/1.1" 201 0
2026-03-28 14:05:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FDA64AKP%252F698920170%252F600') HTTP/1.1" 204 0
2026-03-28 14:05:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DA64AKP/698920170/600 saved to cache
2026-03-28 14:05:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 1d31f426-9911-536f-8f01-f0daf0072cc0
2026-03-28 14:05:20 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:05:20 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:05:20 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:05:20 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:05:20 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:05:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:05:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c5f0810>
2026-03-28 14:05:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:05:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:05:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:05:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_91eb6f90-8171-52c3-8f50-6415c188dd75/91eb6f90-8171-52c3-8f50-6415c188dd75_image_6.jpg HTTP/1.1" 201 0
2026-03-28 14:05:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLM62VCU%252F698781732%252F600') HTTP/1.1" 204 0
2026-03-28 14:05:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LM62VCU/698781732/600 saved to cache
2026-03-28 14:05:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 91eb6f90-8171-52c3-8f50-6415c188dd75
2026-03-28 14:05:20 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DA64AKP/698920312/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698920312>
2026-03-28 14:05:20 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GD17MJV/698729765/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698729765>
2026-03-28 14:05:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 1a266e90-5a43-5bf9-84c9-d323c4a91e17 with identifier: HY14%20HKE
2026-03-28 14:05:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 1a266e90-5a43-5bf9-84c9-d323c4a91e17 with identifier: HY14%20HKE
2026-03-28 14:05:20 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 1a266e90-5a43-5bf9-84c9-d323c4a91e17 with identifier: HY14%20HKE to the API
2026-03-28 14:05:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:05:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:05:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=10&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 192,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=HY14%20HKE-GB',
'category': 'Car',
'color': 'black',
'currency': 'GBP',
'doors_number': 2,
'engine': '2.7L',
'expiration_date': '2026-03-29T10:00:00Z',
'fuel_type': 'Petrol',
'id': '1a266e90-5a43-5bf9-84c9-d323c4a91e17',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'HY14 HKE',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=HY14%20HKE&vehicleType=*',
'listing': 'auction',
'location': 'Bristol',
'make': 'PORSCHE',
'model': 'BOXSTER',
'odometer': 54176,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2014-01-01',
'seller_name': None,
'title': 'PORSCHE BOXSTER 2.7 Roadster',
'transmission': 'manual',
'trim': '',
'vin': 'WP0ZZZ98ZES112076',
'year': 2014}
2026-03-28 14:05:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27HY14%2520HKE%27 HTTP/1.1" 200 None
2026-03-28 14:05:22 [bca.uk] INFO: Saving data for HY14%20HKE: {'auction_closing_time': 1774778400.0, 'created_time': 1774016641.87007, 'last_price_update_time': 1774706722.41411}
2026-03-28 14:05:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='HY14%2520HKE') HTTP/1.1" 204 0
2026-03-28 14:05:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LM62VCU/698781751/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LM62VCU/42807206?sv=2020-08-04&st=2026-03-28T14%3A04%3A48Z&se=2026-03-28T14%3A29%3A48Z&sr=b&sp=r&sig=Rp%2FNuRBRM1T5Pi%2BNXegpYq0Ke%2B2Lo7Tup8NKUMfBYuw%3D)
2026-03-28 14:05:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GD17MJV/698729705/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/GD17MJV/42810643?sv=2020-08-04&st=2026-03-28T14%3A04%3A54Z&se=2026-03-28T14%3A29%3A54Z&sr=b&sp=r&sig=sr4QjIlF2HGyqigVx1Drsu7WI3QCudn9VApqSBNTMBA%3D)
2026-03-28 14:05:22 [bca.uk] INFO: Found listing with ID: MM63%20YFL
2026-03-28 14:05:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MM63%2520YFL%27 HTTP/1.1" 200 None
2026-03-28 14:05:22 [bca.uk] INFO: Scrape type for MM63%20YFL: 0
2026-03-28 14:05:22 [bca.uk] INFO: Found listing with ID: OV17%20FPJ
2026-03-28 14:05:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27OV17%2520FPJ%27 HTTP/1.1" 200 None
2026-03-28 14:05:22 [bca.uk] INFO: Scrape type for OV17%20FPJ: 2
2026-03-28 14:05:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1baea2ba-022c-508a-9a59-ac7089f7a1b5 with identifier: OV17%20FPJ
2026-03-28 14:05:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1baea2ba-022c-508a-9a59-ac7089f7a1b5 with scrape type 2
2026-03-28 14:05:22 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1baea2ba-022c-508a-9a59-ac7089f7a1b5 with scrape type 2
2026-03-28 14:05:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 1baea2ba-022c-508a-9a59-ac7089f7a1b5, identifier: OV17%20FPJ
2026-03-28 14:05:22 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DA64AKP/698920250/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698920250>
2026-03-28 14:05:22 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GD17MJV/698729724/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698729724>
2026-03-28 14:05:22 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DA64AKP/698920274/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698920274>
2026-03-28 14:05:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 1baea2ba-022c-508a-9a59-ac7089f7a1b5 with identifier: OV17%20FPJ
2026-03-28 14:05:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 1baea2ba-022c-508a-9a59-ac7089f7a1b5 with identifier: OV17%20FPJ
2026-03-28 14:05:22 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 1baea2ba-022c-508a-9a59-ac7089f7a1b5 with identifier: OV17%20FPJ to the API
2026-03-28 14:05:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:05:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:05:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=10&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 119,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=OV17%20FPJ-GB',
'category': 'Car',
'color': 'black',
'currency': 'GBP',
'doors_number': 3,
'engine': '1.2L',
'expiration_date': '2026-03-29T10:00:00Z',
'fuel_type': 'Petrol',
'id': '1baea2ba-022c-508a-9a59-ac7089f7a1b5',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'OV17 FPJ',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=OV17%20FPJ&vehicleType=*',
'listing': 'auction',
'location': 'Bristol',
'make': 'HYUNDAI',
'model': 'I20',
'odometer': 32582,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-01-01',
'seller_name': None,
'title': 'HYUNDAI I20 1.2 SPORT Coupe',
'transmission': 'manual',
'trim': 'SPORT',
'vin': 'NLHB331BLJZ308083',
'year': 2017}
2026-03-28 14:05:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27OV17%2520FPJ%27 HTTP/1.1" 200 None
2026-03-28 14:05:23 [bca.uk] INFO: Saving data for OV17%20FPJ: {'auction_closing_time': 1774778400.0, 'created_time': 1774391142.580906, 'last_price_update_time': 1774706723.882428}
2026-03-28 14:05:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='OV17%2520FPJ') HTTP/1.1" 204 0
2026-03-28 14:05:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:05:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2dccbd50>
2026-03-28 14:05:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:05:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:05:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:05:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_91eb6f90-8171-52c3-8f50-6415c188dd75/91eb6f90-8171-52c3-8f50-6415c188dd75_image_5.jpg HTTP/1.1" 201 0
2026-03-28 14:05:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLM62VCU%252F698781723%252F600') HTTP/1.1" 204 0
2026-03-28 14:05:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LM62VCU/698781723/600 saved to cache
2026-03-28 14:05:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 91eb6f90-8171-52c3-8f50-6415c188dd75
2026-03-28 14:05:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:05:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a1fea0490>
2026-03-28 14:05:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:05:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:05:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:05:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_91eb6f90-8171-52c3-8f50-6415c188dd75/91eb6f90-8171-52c3-8f50-6415c188dd75_image_4.jpg HTTP/1.1" 201 0
2026-03-28 14:05:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLM62VCU%252F698781722%252F600') HTTP/1.1" 204 0
2026-03-28 14:05:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LM62VCU/698781722/600 saved to cache
2026-03-28 14:05:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 91eb6f90-8171-52c3-8f50-6415c188dd75
2026-03-28 14:05:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:05:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c58f790>
2026-03-28 14:05:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:05:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:05:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:05:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_df8c97f7-3f96-5220-9648-b6806ba88234/df8c97f7-3f96-5220-9648-b6806ba88234_image_5.jpg HTTP/1.1" 201 0
2026-03-28 14:05:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FGD17MJV%252F698729683%252F600') HTTP/1.1" 204 0
2026-03-28 14:05:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GD17MJV/698729683/600 saved to cache
2026-03-28 14:05:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item df8c97f7-3f96-5220-9648-b6806ba88234
2026-03-28 14:05:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:05:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2d80ae10>
2026-03-28 14:05:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:05:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:05:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:05:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1d31f426-9911-536f-8f01-f0daf0072cc0/1d31f426-9911-536f-8f01-f0daf0072cc0_image_5.jpg HTTP/1.1" 201 0
2026-03-28 14:05:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FDA64AKP%252F698920211%252F600') HTTP/1.1" 204 0
2026-03-28 14:05:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DA64AKP/698920211/600 saved to cache
2026-03-28 14:05:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 1d31f426-9911-536f-8f01-f0daf0072cc0
2026-03-28 14:05:24 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:05:24 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:05:24 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:05:24 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:05:24 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:05:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:05:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2d9f33d0>
2026-03-28 14:05:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:05:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:05:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:05:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_91eb6f90-8171-52c3-8f50-6415c188dd75/91eb6f90-8171-52c3-8f50-6415c188dd75_image_7.jpg HTTP/1.1" 201 0
2026-03-28 14:05:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLM62VCU%252F698781744%252F600') HTTP/1.1" 204 0
2026-03-28 14:05:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LM62VCU/698781744/600 saved to cache
2026-03-28 14:05:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 91eb6f90-8171-52c3-8f50-6415c188dd75
2026-03-28 14:05:24 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DA64AKP/698920195/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698920195>
2026-03-28 14:05:24 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GD17MJV/698729668/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698729668>
2026-03-28 14:05:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LM62VCU/698781759/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LM62VCU/42807206?sv=2020-08-04&st=2026-03-28T14%3A04%3A48Z&se=2026-03-28T14%3A29%3A48Z&sr=b&sp=r&sig=Rp%2FNuRBRM1T5Pi%2BNXegpYq0Ke%2B2Lo7Tup8NKUMfBYuw%3D)
2026-03-28 14:05:24 [bca.uk] INFO: Found listing with ID: WG65%20XOK
2026-03-28 14:05:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WG65%2520XOK%27 HTTP/1.1" 200 None
2026-03-28 14:05:24 [bca.uk] INFO: Scrape type for WG65%20XOK: 0
2026-03-28 14:05:24 [bca.uk] INFO: Found listing with ID: AO05%20HYJ
2026-03-28 14:05:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27AO05%2520HYJ%27 HTTP/1.1" 200 None
2026-03-28 14:05:24 [bca.uk] INFO: Scrape type for AO05%20HYJ: 0
2026-03-28 14:05:24 [bca.uk] INFO: Found listing with ID: OY17%20FYS
2026-03-28 14:05:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27OY17%2520FYS%27 HTTP/1.1" 200 None
2026-03-28 14:05:24 [bca.uk] INFO: Scrape type for OY17%20FYS: 2
2026-03-28 14:05:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ce2bc39c-d5cb-567f-9abb-36949738b027 with identifier: OY17%20FYS
2026-03-28 14:05:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ce2bc39c-d5cb-567f-9abb-36949738b027 with scrape type 2
2026-03-28 14:05:24 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ce2bc39c-d5cb-567f-9abb-36949738b027 with scrape type 2
2026-03-28 14:05:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: ce2bc39c-d5cb-567f-9abb-36949738b027, identifier: OY17%20FYS
2026-03-28 14:05:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: ce2bc39c-d5cb-567f-9abb-36949738b027 with identifier: OY17%20FYS
2026-03-28 14:05:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: ce2bc39c-d5cb-567f-9abb-36949738b027 with identifier: OY17%20FYS
2026-03-28 14:05:24 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: ce2bc39c-d5cb-567f-9abb-36949738b027 with identifier: OY17%20FYS to the API
2026-03-28 14:05:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:05:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:05:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=10&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 171,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=OY17%20FYS-GB',
'category': 'Car',
'color': 'black',
'currency': 'GBP',
'doors_number': 5,
'engine': '2.0L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Diesel',
'id': 'ce2bc39c-d5cb-567f-9abb-36949738b027',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'OY17 FYS',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=OY17%20FYS&vehicleType=*',
'listing': 'auction',
'location': 'Bristol',
'make': 'LAND ROVER',
'model': 'DISCOVERY',
'odometer': 64877,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-01-01',
'seller_name': None,
'title': 'LAND ROVER DISCOVERY 2.0 SD4 240 HSE StationWagon',
'transmission': 'automatic',
'trim': 'SD4 240 HSE',
'vin': 'SALRA2AN7HA001218',
'year': 2017}
2026-03-28 14:05:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27OY17%2520FYS%27 HTTP/1.1" 200 None
2026-03-28 14:05:24 [bca.uk] INFO: Saving data for OY17%20FYS: {'auction_closing_time': 1774864800.0, 'created_time': 1774391420.423465, 'last_price_update_time': 1774706724.633026}
2026-03-28 14:05:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='OY17%2520FYS') HTTP/1.1" 204 0
2026-03-28 14:05:24 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:05:24 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:05:24 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:05:24 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:05:24 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:05:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:05:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a1fea3410>
2026-03-28 14:05:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:05:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:05:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:05:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_91eb6f90-8171-52c3-8f50-6415c188dd75/91eb6f90-8171-52c3-8f50-6415c188dd75_image_8.jpg HTTP/1.1" 201 0
2026-03-28 14:05:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLM62VCU%252F698781751%252F600') HTTP/1.1" 204 0
2026-03-28 14:05:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LM62VCU/698781751/600 saved to cache
2026-03-28 14:05:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 91eb6f90-8171-52c3-8f50-6415c188dd75
2026-03-28 14:05:24 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:05:24 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:05:24 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:05:24 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:05:24 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:05:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:05:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2dcd7890>
2026-03-28 14:05:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:05:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:05:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:05:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_df8c97f7-3f96-5220-9648-b6806ba88234/df8c97f7-3f96-5220-9648-b6806ba88234_image_6.jpg HTTP/1.1" 201 0
2026-03-28 14:05:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FGD17MJV%252F698729705%252F600') HTTP/1.1" 204 0
2026-03-28 14:05:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GD17MJV/698729705/600 saved to cache
2026-03-28 14:05:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item df8c97f7-3f96-5220-9648-b6806ba88234
2026-03-28 14:05:24 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GD17MJV/698729613/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698729613>
2026-03-28 14:05:24 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DA64AKP/698920122/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698920122>
2026-03-28 14:05:24 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/ST12HSO/698934396/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698934396>
2026-03-28 14:05:24 [bca.uk] INFO: Found listing with ID: AK17%20YDS
2026-03-28 14:05:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27AK17%2520YDS%27 HTTP/1.1" 200 None
2026-03-28 14:05:24 [bca.uk] INFO: Scrape type for AK17%20YDS: 0
2026-03-28 14:05:24 [bca.uk] INFO: Found listing with ID: CF17%20BZG
2026-03-28 14:05:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27CF17%2520BZG%27 HTTP/1.1" 200 None
2026-03-28 14:05:24 [bca.uk] INFO: Scrape type for CF17%20BZG: 2
2026-03-28 14:05:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0a33dd6a-cd07-5629-8e4e-83666abdf7f9 with identifier: CF17%20BZG
2026-03-28 14:05:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0a33dd6a-cd07-5629-8e4e-83666abdf7f9 with scrape type 2
2026-03-28 14:05:24 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0a33dd6a-cd07-5629-8e4e-83666abdf7f9 with scrape type 2
2026-03-28 14:05:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 0a33dd6a-cd07-5629-8e4e-83666abdf7f9, identifier: CF17%20BZG
2026-03-28 14:05:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DA64AKP/698920294/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/DA64AKP/42809663?sv=2020-08-04&st=2026-03-28T14%3A04%3A53Z&se=2026-03-28T14%3A29%3A53Z&sr=b&sp=r&sig=3wPHgIhe5if4C5QW2Ax45kOJMvp1eG0YQSmdcrSQVm8%3D)
2026-03-28 14:05:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GD17MJV/698729749/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/GD17MJV/42810643?sv=2020-08-04&st=2026-03-28T14%3A04%3A54Z&se=2026-03-28T14%3A29%3A54Z&sr=b&sp=r&sig=sr4QjIlF2HGyqigVx1Drsu7WI3QCudn9VApqSBNTMBA%3D)
2026-03-28 14:05:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 0a33dd6a-cd07-5629-8e4e-83666abdf7f9 with identifier: CF17%20BZG
2026-03-28 14:05:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 0a33dd6a-cd07-5629-8e4e-83666abdf7f9 with identifier: CF17%20BZG
2026-03-28 14:05:24 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 0a33dd6a-cd07-5629-8e4e-83666abdf7f9 with identifier: CF17%20BZG to the API
2026-03-28 14:05:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:05:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:05:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=10&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 134,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=CF17%20BZG-GB',
'category': 'Car',
'color': 'grey',
'currency': 'GBP',
'doors_number': 5,
'engine': '2.0L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Diesel',
'id': '0a33dd6a-cd07-5629-8e4e-83666abdf7f9',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'CF17 BZG',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=CF17%20BZG&vehicleType=*',
'listing': 'auction',
'location': 'Bristol',
'make': 'LAND ROVER',
'model': 'R/R EVOQUE',
'odometer': 91571,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-01-01',
'seller_name': None,
'title': 'LAND ROVER R/R EVOQUE 2.0 TD4 180 4WD HSE DYNAMIC LUX Hatchback',
'transmission': 'automatic',
'trim': 'TD4 180 4WD HSE DYNAMIC LUX',
'vin': 'SALVA2AN5HH243706',
'year': 2017}
2026-03-28 14:05:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27CF17%2520BZG%27 HTTP/1.1" 200 None
2026-03-28 14:05:25 [bca.uk] INFO: Saving data for CF17%20BZG: {'auction_closing_time': 1774864800.0, 'created_time': 1773957817.322495, 'last_price_update_time': 1774706725.214592}
2026-03-28 14:05:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='CF17%2520BZG') HTTP/1.1" 204 0
2026-03-28 14:05:25 [bca.uk] INFO: Found listing with ID: CV65%20ZBZ
2026-03-28 14:05:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27CV65%2520ZBZ%27 HTTP/1.1" 200 None
2026-03-28 14:05:25 [bca.uk] INFO: Scrape type for CV65%20ZBZ: 0
2026-03-28 14:05:25 [bca.uk] INFO: Found listing with ID: FA52%20BEL
2026-03-28 14:05:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FA52%2520BEL%27 HTTP/1.1" 200 None
2026-03-28 14:05:25 [bca.uk] INFO: Scrape type for FA52%20BEL: 2
2026-03-28 14:05:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c19f0b02-9e78-5c62-bc17-788048ae4ef2 with identifier: FA52%20BEL
2026-03-28 14:05:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c19f0b02-9e78-5c62-bc17-788048ae4ef2 with scrape type 2
2026-03-28 14:05:25 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c19f0b02-9e78-5c62-bc17-788048ae4ef2 with scrape type 2
2026-03-28 14:05:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: c19f0b02-9e78-5c62-bc17-788048ae4ef2, identifier: FA52%20BEL
2026-03-28 14:05:25 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:05:25 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:05:25 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:05:25 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:05:25 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:05:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:05:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2dcd2790>
2026-03-28 14:05:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:05:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:05:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:05:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_91eb6f90-8171-52c3-8f50-6415c188dd75/91eb6f90-8171-52c3-8f50-6415c188dd75_image_9.jpg HTTP/1.1" 201 0
2026-03-28 14:05:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLM62VCU%252F698781759%252F600') HTTP/1.1" 204 0
2026-03-28 14:05:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LM62VCU/698781759/600 saved to cache
2026-03-28 14:05:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 91eb6f90-8171-52c3-8f50-6415c188dd75
2026-03-28 14:05:25 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/ST12HSO/698934329/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698934329>
2026-03-28 14:05:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DA64AKP/698920274/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/DA64AKP/42809663?sv=2020-08-04&st=2026-03-28T14%3A04%3A53Z&se=2026-03-28T14%3A29%3A53Z&sr=b&sp=r&sig=3wPHgIhe5if4C5QW2Ax45kOJMvp1eG0YQSmdcrSQVm8%3D)
2026-03-28 14:05:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DA64AKP/698920312/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/DA64AKP/42809663?sv=2020-08-04&st=2026-03-28T14%3A04%3A53Z&se=2026-03-28T14%3A29%3A53Z&sr=b&sp=r&sig=3wPHgIhe5if4C5QW2Ax45kOJMvp1eG0YQSmdcrSQVm8%3D)
2026-03-28 14:05:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GD17MJV/698729765/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/GD17MJV/42810643?sv=2020-08-04&st=2026-03-28T14%3A04%3A54Z&se=2026-03-28T14%3A29%3A54Z&sr=b&sp=r&sig=sr4QjIlF2HGyqigVx1Drsu7WI3QCudn9VApqSBNTMBA%3D)
2026-03-28 14:05:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: c19f0b02-9e78-5c62-bc17-788048ae4ef2 with identifier: FA52%20BEL
2026-03-28 14:05:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: c19f0b02-9e78-5c62-bc17-788048ae4ef2 with identifier: FA52%20BEL
2026-03-28 14:05:25 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: c19f0b02-9e78-5c62-bc17-788048ae4ef2 with identifier: FA52%20BEL to the API
2026-03-28 14:05:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:05:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:05:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=10&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 270,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=FA52%20BEL-GB',
'category': 'Car',
'color': 'black',
'currency': 'GBP',
'doors_number': 5,
'engine': '4.8L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol',
'id': 'c19f0b02-9e78-5c62-bc17-788048ae4ef2',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'FA52 BEL',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=FA52%20BEL&vehicleType=*',
'listing': 'auction',
'location': 'Bristol',
'make': 'PORSCHE',
'model': 'CAYENNE',
'odometer': 107786,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2014-01-01',
'seller_name': None,
'title': 'PORSCHE CAYENNE 4.8 TURBO TIPTRONIC S Estate',
'transmission': 'manual',
'trim': 'TURBO TIPTRONIC S',
'vin': 'WP1ZZZ92ZELA80681',
'year': 2014}
2026-03-28 14:05:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FA52%2520BEL%27 HTTP/1.1" 200 None
2026-03-28 14:05:25 [bca.uk] INFO: Saving data for FA52%20BEL: {'auction_closing_time': 1774864800.0, 'created_time': 1773907829.244832, 'last_price_update_time': 1774706725.814946}
2026-03-28 14:05:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='FA52%2520BEL') HTTP/1.1" 204 0
2026-03-28 14:05:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GD17MJV/698729724/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/GD17MJV/42810643?sv=2020-08-04&st=2026-03-28T14%3A04%3A54Z&se=2026-03-28T14%3A29%3A54Z&sr=b&sp=r&sig=sr4QjIlF2HGyqigVx1Drsu7WI3QCudn9VApqSBNTMBA%3D)
2026-03-28 14:05:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DA64AKP/698920250/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/DA64AKP/42809663?sv=2020-08-04&st=2026-03-28T14%3A04%3A53Z&se=2026-03-28T14%3A29%3A53Z&sr=b&sp=r&sig=3wPHgIhe5if4C5QW2Ax45kOJMvp1eG0YQSmdcrSQVm8%3D)
2026-03-28 14:05:25 [bca.uk] INFO: Found listing with ID: FE65%20VCD
2026-03-28 14:05:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FE65%2520VCD%27 HTTP/1.1" 200 None
2026-03-28 14:05:25 [bca.uk] INFO: Scrape type for FE65%20VCD: 0
2026-03-28 14:05:25 [bca.uk] INFO: Found listing with ID: K40%20VNB
2026-03-28 14:05:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27K40%2520VNB%27 HTTP/1.1" 200 None
2026-03-28 14:05:25 [bca.uk] INFO: Scrape type for K40%20VNB: 0
2026-03-28 14:05:25 [bca.uk] INFO: Found listing with ID: MF16%20GHO
2026-03-28 14:05:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MF16%2520GHO%27 HTTP/1.1" 200 None
2026-03-28 14:05:25 [bca.uk] INFO: Scrape type for MF16%20GHO: 0
2026-03-28 14:05:25 [bca.uk] INFO: Found listing with ID: HX05%20UJS
2026-03-28 14:05:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27HX05%2520UJS%27 HTTP/1.1" 200 None
2026-03-28 14:05:25 [bca.uk] INFO: Scrape type for HX05%20UJS: 0
2026-03-28 14:05:25 [bca.uk] INFO: Found listing with ID: KR09%20WWZ
2026-03-28 14:05:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KR09%2520WWZ%27 HTTP/1.1" 200 None
2026-03-28 14:05:25 [bca.uk] INFO: Scrape type for KR09%20WWZ: 2
2026-03-28 14:05:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5274ef56-07c0-56b2-9002-d352b127fbb9 with identifier: KR09%20WWZ
2026-03-28 14:05:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5274ef56-07c0-56b2-9002-d352b127fbb9 with scrape type 2
2026-03-28 14:05:25 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5274ef56-07c0-56b2-9002-d352b127fbb9 with scrape type 2
2026-03-28 14:05:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 5274ef56-07c0-56b2-9002-d352b127fbb9, identifier: KR09%20WWZ
2026-03-28 14:05:26 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:05:26 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:05:26 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:05:26 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:05:26 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:05:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:05:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2dda9110>
2026-03-28 14:05:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:05:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:05:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:05:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1d31f426-9911-536f-8f01-f0daf0072cc0/1d31f426-9911-536f-8f01-f0daf0072cc0_image_8.jpg HTTP/1.1" 201 0
2026-03-28 14:05:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FDA64AKP%252F698920294%252F600') HTTP/1.1" 204 0
2026-03-28 14:05:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DA64AKP/698920294/600 saved to cache
2026-03-28 14:05:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 1d31f426-9911-536f-8f01-f0daf0072cc0
2026-03-28 14:05:26 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:05:26 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:05:26 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:05:26 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:05:26 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:05:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:05:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2de35310>
2026-03-28 14:05:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:05:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:05:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:05:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_df8c97f7-3f96-5220-9648-b6806ba88234/df8c97f7-3f96-5220-9648-b6806ba88234_image_8.jpg HTTP/1.1" 201 0
2026-03-28 14:05:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FGD17MJV%252F698729749%252F600') HTTP/1.1" 204 0
2026-03-28 14:05:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GD17MJV/698729749/600 saved to cache
2026-03-28 14:05:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item df8c97f7-3f96-5220-9648-b6806ba88234
2026-03-28 14:05:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GD17MJV/698729668/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/GD17MJV/42810643?sv=2020-08-04&st=2026-03-28T14%3A04%3A54Z&se=2026-03-28T14%3A29%3A54Z&sr=b&sp=r&sig=sr4QjIlF2HGyqigVx1Drsu7WI3QCudn9VApqSBNTMBA%3D)
2026-03-28 14:05:26 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/JP04STP/698929454/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698929454>
2026-03-28 14:05:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 5274ef56-07c0-56b2-9002-d352b127fbb9 with identifier: KR09%20WWZ
2026-03-28 14:05:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 5274ef56-07c0-56b2-9002-d352b127fbb9 with identifier: KR09%20WWZ
2026-03-28 14:05:26 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 5274ef56-07c0-56b2-9002-d352b127fbb9 with identifier: KR09%20WWZ to the API
2026-03-28 14:05:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:05:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:05:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=10&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 246,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=KR09%20WWZ-GB',
'category': 'Car',
'color': 'silver',
'currency': 'GBP',
'doors_number': 5,
'engine': '3.0L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Diesel',
'id': '5274ef56-07c0-56b2-9002-d352b127fbb9',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'KR09 WWZ',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=KR09%20WWZ&vehicleType=*',
'listing': 'auction',
'location': 'Bristol',
'make': 'MERCEDES-BENZ',
'model': 'ML320',
'odometer': 110441,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2009-01-01',
'seller_name': None,
'title': 'MERCEDES-BENZ ML320 3.0 CDI SE TIP StationWagon',
'transmission': 'manual',
'trim': 'CDI SE TIP',
'vin': 'WDC1641222A481433',
'year': 2009}
2026-03-28 14:05:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KR09%2520WWZ%27 HTTP/1.1" 200 None
2026-03-28 14:05:26 [bca.uk] INFO: Saving data for KR09%20WWZ: {'auction_closing_time': 1774864800.0, 'created_time': 1773959643.239326, 'last_price_update_time': 1774706726.485472}
2026-03-28 14:05:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='KR09%2520WWZ') HTTP/1.1" 204 0
2026-03-28 14:05:26 [bca.uk] INFO: Found listing with ID: LG11%20BUP
2026-03-28 14:05:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LG11%2520BUP%27 HTTP/1.1" 200 None
2026-03-28 14:05:26 [bca.uk] INFO: Scrape type for LG11%20BUP: 2
2026-03-28 14:05:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 70bf5269-eaf8-5b84-be33-98a7c5930674 with identifier: LG11%20BUP
2026-03-28 14:05:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 70bf5269-eaf8-5b84-be33-98a7c5930674 with scrape type 2
2026-03-28 14:05:26 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 70bf5269-eaf8-5b84-be33-98a7c5930674 with scrape type 2
2026-03-28 14:05:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 70bf5269-eaf8-5b84-be33-98a7c5930674, identifier: LG11%20BUP
2026-03-28 14:05:26 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:05:26 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:05:26 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:05:26 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:05:26 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:05:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:05:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2dd183d0>
2026-03-28 14:05:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:05:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:05:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:05:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1d31f426-9911-536f-8f01-f0daf0072cc0/1d31f426-9911-536f-8f01-f0daf0072cc0_image_7.jpg HTTP/1.1" 201 0
2026-03-28 14:05:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FDA64AKP%252F698920274%252F600') HTTP/1.1" 204 0
2026-03-28 14:05:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DA64AKP/698920274/600 saved to cache
2026-03-28 14:05:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 1d31f426-9911-536f-8f01-f0daf0072cc0
2026-03-28 14:05:26 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:05:26 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:05:26 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:05:26 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:05:26 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:05:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:05:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2ddab3d0>
2026-03-28 14:05:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:05:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:05:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:05:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1d31f426-9911-536f-8f01-f0daf0072cc0/1d31f426-9911-536f-8f01-f0daf0072cc0_image_9.jpg HTTP/1.1" 201 0
2026-03-28 14:05:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FDA64AKP%252F698920312%252F600') HTTP/1.1" 204 0
2026-03-28 14:05:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DA64AKP/698920312/600 saved to cache
2026-03-28 14:05:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 1d31f426-9911-536f-8f01-f0daf0072cc0
2026-03-28 14:05:26 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:05:26 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:05:26 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:05:26 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:05:26 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:05:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:05:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a3011f390>
2026-03-28 14:05:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:05:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:05:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:05:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_df8c97f7-3f96-5220-9648-b6806ba88234/df8c97f7-3f96-5220-9648-b6806ba88234_image_9.jpg HTTP/1.1" 201 0
2026-03-28 14:05:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FGD17MJV%252F698729765%252F600') HTTP/1.1" 204 0
2026-03-28 14:05:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GD17MJV/698729765/600 saved to cache
2026-03-28 14:05:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item df8c97f7-3f96-5220-9648-b6806ba88234
2026-03-28 14:05:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GD17MJV/698729613/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/GD17MJV/42810643?sv=2020-08-04&st=2026-03-28T14%3A04%3A54Z&se=2026-03-28T14%3A29%3A54Z&sr=b&sp=r&sig=sr4QjIlF2HGyqigVx1Drsu7WI3QCudn9VApqSBNTMBA%3D)
2026-03-28 14:05:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DA64AKP/698920122/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/DA64AKP/42809663?sv=2020-08-04&st=2026-03-28T14%3A04%3A53Z&se=2026-03-28T14%3A29%3A53Z&sr=b&sp=r&sig=3wPHgIhe5if4C5QW2Ax45kOJMvp1eG0YQSmdcrSQVm8%3D)
2026-03-28 14:05:26 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/JP04STP/698929445/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698929445>
2026-03-28 14:05:26 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LM62VCU/698781717/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698781717>
2026-03-28 14:05:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DA64AKP/698920195/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/DA64AKP/42809663?sv=2020-08-04&st=2026-03-28T14%3A04%3A53Z&se=2026-03-28T14%3A29%3A53Z&sr=b&sp=r&sig=3wPHgIhe5if4C5QW2Ax45kOJMvp1eG0YQSmdcrSQVm8%3D)
2026-03-28 14:05:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 70bf5269-eaf8-5b84-be33-98a7c5930674 with identifier: LG11%20BUP
2026-03-28 14:05:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 70bf5269-eaf8-5b84-be33-98a7c5930674 with identifier: LG11%20BUP
2026-03-28 14:05:26 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 70bf5269-eaf8-5b84-be33-98a7c5930674 with identifier: LG11%20BUP to the API
2026-03-28 14:05:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:05:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:05:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=10&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 159,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=LG11%20BUP-GB',
'category': 'Car',
'color': 'grey',
'currency': 'GBP',
'doors_number': 2,
'engine': '2.0L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol',
'id': '70bf5269-eaf8-5b84-be33-98a7c5930674',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'LG11 BUP',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=LG11%20BUP&vehicleType=*',
'listing': 'auction',
'location': 'Bristol',
'make': 'BMW',
'model': '320I',
'odometer': 62662,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2011-01-01',
'seller_name': None,
'title': 'BMW 320I 2.0 M SPORT Coupe',
'transmission': 'automatic',
'trim': 'M SPORT',
'vin': 'WBAKD720X0E246296',
'year': 2011}
2026-03-28 14:05:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LG11%2520BUP%27 HTTP/1.1" 200 None
2026-03-28 14:05:27 [bca.uk] INFO: Saving data for LG11%20BUP: {'auction_closing_time': 1774864800.0, 'created_time': 1773831489.609155, 'last_price_update_time': 1774706727.22286}
2026-03-28 14:05:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='LG11%2520BUP') HTTP/1.1" 204 0
2026-03-28 14:05:27 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:05:27 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:05:27 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:05:27 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:05:27 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:05:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:05:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2dda9610>
2026-03-28 14:05:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:05:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:05:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:05:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_df8c97f7-3f96-5220-9648-b6806ba88234/df8c97f7-3f96-5220-9648-b6806ba88234_image_7.jpg HTTP/1.1" 201 0
2026-03-28 14:05:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FGD17MJV%252F698729724%252F600') HTTP/1.1" 204 0
2026-03-28 14:05:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GD17MJV/698729724/600 saved to cache
2026-03-28 14:05:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item df8c97f7-3f96-5220-9648-b6806ba88234
2026-03-28 14:05:27 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:05:27 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:05:27 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:05:27 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:05:27 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:05:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:05:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c76a910>
2026-03-28 14:05:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:05:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:05:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:05:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1d31f426-9911-536f-8f01-f0daf0072cc0/1d31f426-9911-536f-8f01-f0daf0072cc0_image_6.jpg HTTP/1.1" 201 0
2026-03-28 14:05:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FDA64AKP%252F698920250%252F600') HTTP/1.1" 204 0
2026-03-28 14:05:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DA64AKP/698920250/600 saved to cache
2026-03-28 14:05:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 1d31f426-9911-536f-8f01-f0daf0072cc0
2026-03-28 14:05:27 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LM62VCU/698781716/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698781716>
2026-03-28 14:05:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/ST12HSO/698934396/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/ST12HSO/42809912?sv=2020-08-04&st=2026-03-28T14%3A04%3A46Z&se=2026-03-28T14%3A29%3A46Z&sr=b&sp=r&sig=tOhj9TDOiYV6354bfaZJlS4RufTDvGneY43ZqD%2FSIPw%3D)
2026-03-28 14:05:27 [bca.uk] INFO: Found listing with ID: LT56%20FLZ
2026-03-28 14:05:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LT56%2520FLZ%27 HTTP/1.1" 200 None
2026-03-28 14:05:27 [bca.uk] INFO: Scrape type for LT56%20FLZ: 2
2026-03-28 14:05:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b7710d43-e492-50d6-b389-cb63cd288165 with identifier: LT56%20FLZ
2026-03-28 14:05:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b7710d43-e492-50d6-b389-cb63cd288165 with scrape type 2
2026-03-28 14:05:27 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b7710d43-e492-50d6-b389-cb63cd288165 with scrape type 2
2026-03-28 14:05:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: b7710d43-e492-50d6-b389-cb63cd288165, identifier: LT56%20FLZ
2026-03-28 14:05:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/ST12HSO/698934329/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/ST12HSO/42809912?sv=2020-08-04&st=2026-03-28T14%3A04%3A46Z&se=2026-03-28T14%3A29%3A46Z&sr=b&sp=r&sig=tOhj9TDOiYV6354bfaZJlS4RufTDvGneY43ZqD%2FSIPw%3D)
2026-03-28 14:05:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: b7710d43-e492-50d6-b389-cb63cd288165 with identifier: LT56%20FLZ
2026-03-28 14:05:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: b7710d43-e492-50d6-b389-cb63cd288165 with identifier: LT56%20FLZ
2026-03-28 14:05:27 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: b7710d43-e492-50d6-b389-cb63cd288165 with identifier: LT56%20FLZ to the API
2026-03-28 14:05:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:05:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:05:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=10&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 218,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=LT56%20FLZ-GB',
'category': 'Car',
'color': 'black',
'currency': 'GBP',
'doors_number': 4,
'engine': '2.5L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol',
'id': 'b7710d43-e492-50d6-b389-cb63cd288165',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'LT56 FLZ',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=LT56%20FLZ&vehicleType=*',
'listing': 'auction',
'location': 'Bristol',
'make': 'BMW',
'model': '325I',
'odometer': 88631,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2006-01-01',
'seller_name': None,
'title': 'BMW 325I 2.5 SE Saloon',
'transmission': 'automatic',
'trim': 'SE',
'vin': 'WBAVB12010KU97967',
'year': 2006}
2026-03-28 14:05:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LT56%2520FLZ%27 HTTP/1.1" 200 None
2026-03-28 14:05:27 [bca.uk] INFO: Saving data for LT56%20FLZ: {'auction_closing_time': 1774864800.0, 'created_time': 1774391387.623002, 'last_price_update_time': 1774706727.831593}
2026-03-28 14:05:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='LT56%2520FLZ') HTTP/1.1" 204 0
2026-03-28 14:05:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:05:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c42b050>
2026-03-28 14:05:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:05:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:05:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:05:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_df8c97f7-3f96-5220-9648-b6806ba88234/df8c97f7-3f96-5220-9648-b6806ba88234_image_4.jpg HTTP/1.1" 201 0
2026-03-28 14:05:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FGD17MJV%252F698729668%252F600') HTTP/1.1" 204 0
2026-03-28 14:05:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GD17MJV/698729668/600 saved to cache
2026-03-28 14:05:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item df8c97f7-3f96-5220-9648-b6806ba88234
2026-03-28 14:05:27 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PXZ1595/698814180/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698814180>
2026-03-28 14:05:27 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LM62VCU/698781714/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698781714>
2026-03-28 14:05:27 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/JP04STP/698929419/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698929419>
2026-03-28 14:05:27 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/BU67HNA/42810584?sv=2020-08-04&st=2026-03-28T14%3A05%3A27Z&se=2026-03-28T14%3A30%3A27Z&sr=b&sp=r&sig=jvqWs0bbwwPNyCuILhTmpoSOvgJ5gvo7FW1OJ3cgP4I%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=BU67%20HNA-GB>
2026-03-28 14:05:27 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LD57FXL/42810412?sv=2020-08-04&st=2026-03-28T14%3A05%3A27Z&se=2026-03-28T14%3A30%3A27Z&sr=b&sp=r&sig=SrrbefNVxYUh04mJFXEMP7I6EJU13XfRB%2BYQXtzw2lU%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=LD57%20FXL-GB>
2026-03-28 14:05:27 [bca.uk] INFO: Found listing with ID: SG11%20EMV
2026-03-28 14:05:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SG11%2520EMV%27 HTTP/1.1" 200 None
2026-03-28 14:05:27 [bca.uk] INFO: Scrape type for SG11%20EMV: 2
2026-03-28 14:05:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 217cd029-b2ff-5a4f-b9df-471ffb93213e with identifier: SG11%20EMV
2026-03-28 14:05:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 217cd029-b2ff-5a4f-b9df-471ffb93213e with scrape type 2
2026-03-28 14:05:27 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 217cd029-b2ff-5a4f-b9df-471ffb93213e with scrape type 2
2026-03-28 14:05:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 217cd029-b2ff-5a4f-b9df-471ffb93213e, identifier: SG11%20EMV
2026-03-28 14:05:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.bca.co.uk/api/search?q=&pageSize=100&page=11&sort=MostRecentlyAdded> (referer: https://www.bca.co.uk/search) ['zyte-api']
2026-03-28 14:05:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 217cd029-b2ff-5a4f-b9df-471ffb93213e with identifier: SG11%20EMV
2026-03-28 14:05:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 217cd029-b2ff-5a4f-b9df-471ffb93213e with identifier: SG11%20EMV
2026-03-28 14:05:28 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 217cd029-b2ff-5a4f-b9df-471ffb93213e with identifier: SG11%20EMV to the API
2026-03-28 14:05:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:05:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:05:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=10&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 159,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=SG11%20EMV-GB',
'category': 'Car',
'color': 'blue',
'currency': 'GBP',
'doors_number': 5,
'engine': '2.0L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Diesel',
'id': '217cd029-b2ff-5a4f-b9df-471ffb93213e',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'SG11 EMV',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=SG11%20EMV&vehicleType=*',
'listing': 'auction',
'location': 'Bristol',
'make': 'FORD',
'model': 'GALAXY',
'odometer': 108739,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2011-01-01',
'seller_name': None,
'title': 'FORD GALAXY 2.0 TDCI 140 TITANIUM X P/SHIFT MPV',
'transmission': 'automatic',
'trim': 'TDCI 140 TITANIUM X P/SHIFT',
'vin': 'WF0MXXGBWMBC48512',
'year': 2011}
2026-03-28 14:05:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SG11%2520EMV%27 HTTP/1.1" 200 None
2026-03-28 14:05:28 [bca.uk] INFO: Saving data for SG11%20EMV: {'auction_closing_time': 1774864800.0, 'created_time': 1774364068.014644, 'last_price_update_time': 1774706728.431272}
2026-03-28 14:05:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='SG11%2520EMV') HTTP/1.1" 204 0
2026-03-28 14:05:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LM62VCU/698781717/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LM62VCU/42807206?sv=2020-08-04&st=2026-03-28T14%3A04%3A48Z&se=2026-03-28T14%3A29%3A48Z&sr=b&sp=r&sig=Rp%2FNuRBRM1T5Pi%2BNXegpYq0Ke%2B2Lo7Tup8NKUMfBYuw%3D)
2026-03-28 14:05:28 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BT66DFX/698129712/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698129712>
2026-03-28 14:05:28 [bca.uk] INFO: Found listing with ID: CA57%20XLV
2026-03-28 14:05:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27CA57%2520XLV%27 HTTP/1.1" 200 None
2026-03-28 14:05:28 [bca.uk] INFO: Scrape type for CA57%20XLV: 0
2026-03-28 14:05:28 [bca.uk] INFO: Found listing with ID: SD67%20OYC
2026-03-28 14:05:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SD67%2520OYC%27 HTTP/1.1" 200 None
2026-03-28 14:05:28 [bca.uk] INFO: Scrape type for SD67%20OYC: 0
2026-03-28 14:05:28 [bca.uk] INFO: Found listing with ID: BN07%20XHP
2026-03-28 14:05:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BN07%2520XHP%27 HTTP/1.1" 200 None
2026-03-28 14:05:28 [bca.uk] INFO: Scrape type for BN07%20XHP: 0
2026-03-28 14:05:28 [bca.uk] INFO: Found listing with ID: FL60%20TTX
2026-03-28 14:05:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FL60%2520TTX%27 HTTP/1.1" 200 None
2026-03-28 14:05:28 [bca.uk] INFO: Scrape type for FL60%20TTX: 0
2026-03-28 14:05:28 [bca.uk] INFO: Found listing with ID: KN09%20JZF
2026-03-28 14:05:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KN09%2520JZF%27 HTTP/1.1" 200 None
2026-03-28 14:05:28 [bca.uk] INFO: Scrape type for KN09%20JZF: 0
2026-03-28 14:05:28 [bca.uk] INFO: Found listing with ID: WV59%20TZE
2026-03-28 14:05:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WV59%2520TZE%27 HTTP/1.1" 200 None
2026-03-28 14:05:28 [bca.uk] INFO: Scrape type for WV59%20TZE: 0
2026-03-28 14:05:28 [bca.uk] INFO: Found listing with ID: OV66%20CPY
2026-03-28 14:05:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27OV66%2520CPY%27 HTTP/1.1" 200 None
2026-03-28 14:05:28 [bca.uk] INFO: Scrape type for OV66%20CPY: 0
2026-03-28 14:05:28 [bca.uk] INFO: Found listing with ID: WJ63%20NXK
2026-03-28 14:05:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WJ63%2520NXK%27 HTTP/1.1" 200 None
2026-03-28 14:05:28 [bca.uk] INFO: Scrape type for WJ63%20NXK: 0
2026-03-28 14:05:28 [bca.uk] INFO: Found listing with ID: EF13%20FLN
2026-03-28 14:05:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27EF13%2520FLN%27 HTTP/1.1" 200 None
2026-03-28 14:05:28 [bca.uk] INFO: Scrape type for EF13%20FLN: 0
2026-03-28 14:05:28 [bca.uk] INFO: Found listing with ID: EO16%20KUU
2026-03-28 14:05:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27EO16%2520KUU%27 HTTP/1.1" 200 None
2026-03-28 14:05:28 [bca.uk] INFO: Scrape type for EO16%20KUU: 0
2026-03-28 14:05:28 [bca.uk] INFO: Found listing with ID: FH12%20SXS
2026-03-28 14:05:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FH12%2520SXS%27 HTTP/1.1" 200 None
2026-03-28 14:05:28 [bca.uk] INFO: Scrape type for FH12%20SXS: 0
2026-03-28 14:05:28 [bca.uk] INFO: Found listing with ID: HK57%20YCH
2026-03-28 14:05:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27HK57%2520YCH%27 HTTP/1.1" 200 None
2026-03-28 14:05:28 [bca.uk] INFO: Scrape type for HK57%20YCH: 0
2026-03-28 14:05:28 [bca.uk] INFO: Found listing with ID: HV64%20ZMX
2026-03-28 14:05:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27HV64%2520ZMX%27 HTTP/1.1" 200 None
2026-03-28 14:05:28 [bca.uk] INFO: Scrape type for HV64%20ZMX: 0
2026-03-28 14:05:28 [bca.uk] INFO: Found listing with ID: LT61%20FNW
2026-03-28 14:05:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LT61%2520FNW%27 HTTP/1.1" 200 None
2026-03-28 14:05:28 [bca.uk] INFO: Scrape type for LT61%20FNW: 0
2026-03-28 14:05:28 [bca.uk] INFO: Found listing with ID: MF58%20FJO
2026-03-28 14:05:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MF58%2520FJO%27 HTTP/1.1" 200 None
2026-03-28 14:05:28 [bca.uk] INFO: Scrape type for MF58%20FJO: 0
2026-03-28 14:05:28 [bca.uk] INFO: Found listing with ID: MJ09%20GNP
2026-03-28 14:05:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MJ09%2520GNP%27 HTTP/1.1" 200 None
2026-03-28 14:05:28 [bca.uk] INFO: Scrape type for MJ09%20GNP: 0
2026-03-28 14:05:28 [bca.uk] INFO: Found listing with ID: ML66%20WYO
2026-03-28 14:05:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27ML66%2520WYO%27 HTTP/1.1" 200 None
2026-03-28 14:05:28 [bca.uk] INFO: Scrape type for ML66%20WYO: 0
2026-03-28 14:05:28 [bca.uk] INFO: Found listing with ID: ND12%20LBP
2026-03-28 14:05:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27ND12%2520LBP%27 HTTP/1.1" 200 None
2026-03-28 14:05:28 [bca.uk] INFO: Scrape type for ND12%20LBP: 0
2026-03-28 14:05:28 [bca.uk] INFO: Found listing with ID: CV56%20YXN
2026-03-28 14:05:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27CV56%2520YXN%27 HTTP/1.1" 200 None
2026-03-28 14:05:28 [bca.uk] INFO: Scrape type for CV56%20YXN: 2
2026-03-28 14:05:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ed2af835-b65b-5ff3-8723-08a4c90782c6 with identifier: CV56%20YXN
2026-03-28 14:05:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ed2af835-b65b-5ff3-8723-08a4c90782c6 with scrape type 2
2026-03-28 14:05:28 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ed2af835-b65b-5ff3-8723-08a4c90782c6 with scrape type 2
2026-03-28 14:05:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: ed2af835-b65b-5ff3-8723-08a4c90782c6, identifier: CV56%20YXN
2026-03-28 14:05:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:05:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2ddb2250>
2026-03-28 14:05:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:05:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:05:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:05:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_df8c97f7-3f96-5220-9648-b6806ba88234/df8c97f7-3f96-5220-9648-b6806ba88234_image_1.jpg HTTP/1.1" 201 0
2026-03-28 14:05:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FGD17MJV%252F698729613%252F600') HTTP/1.1" 204 0
2026-03-28 14:05:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GD17MJV/698729613/600 saved to cache
2026-03-28 14:05:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item df8c97f7-3f96-5220-9648-b6806ba88234
2026-03-28 14:05:28 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: df8c97f7-3f96-5220-9648-b6806ba88234, skipping ID generation
2026-03-28 14:05:28 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item df8c97f7-3f96-5220-9648-b6806ba88234 sending to next pipeline
2026-03-28 14:05:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: df8c97f7-3f96-5220-9648-b6806ba88234, identifier: GD17%20MJV
2026-03-28 14:05:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:05:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c3a2350>
2026-03-28 14:05:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:05:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:05:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:05:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1d31f426-9911-536f-8f01-f0daf0072cc0/1d31f426-9911-536f-8f01-f0daf0072cc0_image_1.jpg HTTP/1.1" 201 0
2026-03-28 14:05:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FDA64AKP%252F698920122%252F600') HTTP/1.1" 204 0
2026-03-28 14:05:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DA64AKP/698920122/600 saved to cache
2026-03-28 14:05:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 1d31f426-9911-536f-8f01-f0daf0072cc0
2026-03-28 14:05:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:05:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2de02150>
2026-03-28 14:05:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:05:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:05:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:05:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1d31f426-9911-536f-8f01-f0daf0072cc0/1d31f426-9911-536f-8f01-f0daf0072cc0_image_4.jpg HTTP/1.1" 201 0
2026-03-28 14:05:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FDA64AKP%252F698920195%252F600') HTTP/1.1" 204 0
2026-03-28 14:05:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DA64AKP/698920195/600 saved to cache
2026-03-28 14:05:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 1d31f426-9911-536f-8f01-f0daf0072cc0
2026-03-28 14:05:29 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 1d31f426-9911-536f-8f01-f0daf0072cc0, skipping ID generation
2026-03-28 14:05:29 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 1d31f426-9911-536f-8f01-f0daf0072cc0 sending to next pipeline
2026-03-28 14:05:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 1d31f426-9911-536f-8f01-f0daf0072cc0, identifier: DA64%20AKP
2026-03-28 14:05:29 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:05:29 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:05:29 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:05:29 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:05:29 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:05:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:05:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c428210>
2026-03-28 14:05:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:05:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:05:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:05:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d6214c2d-d518-55cf-9ab4-09004f56f218/d6214c2d-d518-55cf-9ab4-09004f56f218_image_9.jpg HTTP/1.1" 201 0
2026-03-28 14:05:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FST12HSO%252F698934396%252F600') HTTP/1.1" 204 0
2026-03-28 14:05:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/ST12HSO/698934396/600 saved to cache
2026-03-28 14:05:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item d6214c2d-d518-55cf-9ab4-09004f56f218
2026-03-28 14:05:29 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:05:29 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:05:29 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:05:29 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:05:29 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:05:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:05:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2dcd5b90>
2026-03-28 14:05:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:05:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:05:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:05:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d6214c2d-d518-55cf-9ab4-09004f56f218/d6214c2d-d518-55cf-9ab4-09004f56f218_image_6.jpg HTTP/1.1" 201 0
2026-03-28 14:05:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FST12HSO%252F698934329%252F600') HTTP/1.1" 204 0
2026-03-28 14:05:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/ST12HSO/698934329/600 saved to cache
2026-03-28 14:05:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item d6214c2d-d518-55cf-9ab4-09004f56f218
2026-03-28 14:05:29 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: d6214c2d-d518-55cf-9ab4-09004f56f218, skipping ID generation
2026-03-28 14:05:29 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item d6214c2d-d518-55cf-9ab4-09004f56f218 sending to next pipeline
2026-03-28 14:05:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: d6214c2d-d518-55cf-9ab4-09004f56f218, identifier: ST12%20HSO
2026-03-28 14:05:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LM62VCU/698781716/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LM62VCU/42807206?sv=2020-08-04&st=2026-03-28T14%3A04%3A48Z&se=2026-03-28T14%3A29%3A48Z&sr=b&sp=r&sig=Rp%2FNuRBRM1T5Pi%2BNXegpYq0Ke%2B2Lo7Tup8NKUMfBYuw%3D)
2026-03-28 14:05:29 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YD64WJN/697180911/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=697180911>
2026-03-28 14:05:29 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AK67LWT/698947215/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698947215>
2026-03-28 14:05:29 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NK64UTR/698814227/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698814227>
2026-03-28 14:05:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/JP04STP/698929454/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/JP04STP/42809620?sv=2020-08-04&st=2026-03-28T14%3A04%3A43Z&se=2026-03-28T14%3A29%3A43Z&sr=b&sp=r&sig=au5c8GXv2vCUIG4ea67UD3YzlPMQz7%2FWxYZM6tUj%2FEo%3D)
2026-03-28 14:05:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: ed2af835-b65b-5ff3-8723-08a4c90782c6 with identifier: CV56%20YXN
2026-03-28 14:05:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: ed2af835-b65b-5ff3-8723-08a4c90782c6 with identifier: CV56%20YXN
2026-03-28 14:05:29 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: ed2af835-b65b-5ff3-8723-08a4c90782c6 with identifier: CV56%20YXN to the API
2026-03-28 14:05:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:05:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:05:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=10&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 184,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=CV56%20YXN-GB',
'category': 'Car',
'color': 'black',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.6L',
'expiration_date': '2026-03-29T10:00:00Z',
'fuel_type': 'Petrol',
'id': 'ed2af835-b65b-5ff3-8723-08a4c90782c6',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'CV56 YXN',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=CV56%20YXN&vehicleType=*',
'listing': 'auction',
'location': 'Bridgwater',
'make': 'FORD',
'model': 'FOCUS',
'odometer': 128843,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2006-01-01',
'seller_name': None,
'title': 'FORD FOCUS 1.6 ZETEC CLIMATE Hatchback',
'transmission': 'automatic',
'trim': 'ZETEC CLIMATE',
'vin': 'WF05XXWPD56B00550',
'year': 2006}
2026-03-28 14:05:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27CV56%2520YXN%27 HTTP/1.1" 200 None
2026-03-28 14:05:29 [bca.uk] INFO: Saving data for CV56%20YXN: {'auction_closing_time': 1774778400.0, 'created_time': 1774524508.522268, 'last_price_update_time': 1774706729.823674}
2026-03-28 14:05:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='CV56%2520YXN') HTTP/1.1" 204 0
2026-03-28 14:05:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: df8c97f7-3f96-5220-9648-b6806ba88234 with identifier: GD17%20MJV
2026-03-28 14:05:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: df8c97f7-3f96-5220-9648-b6806ba88234 with identifier: GD17%20MJV
2026-03-28 14:05:30 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: df8c97f7-3f96-5220-9648-b6806ba88234 with identifier: GD17%20MJV to the API
2026-03-28 14:05:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:05:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:05:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GD17MJV/698729613/600>
{'auction_title': '',
'c_o_2_emission_value': 112,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_df8c97f7-3f96-5220-9648-b6806ba88234/df8c97f7-3f96-5220-9648-b6806ba88234_expert_report_file_dadb1923-ee9c-4645-88c5-023c80b57c70.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=GD17%20MJV-GB',
'category': 'Car',
'color': 'grey',
'currency': 'GBP',
'doors_number': 5,
'engine': '2.0L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Diesel',
'id': 'df8c97f7-3f96-5220-9648-b6806ba88234',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'GD17 MJV',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=GD17%20MJV&vehicleType=*',
'listing': 'auction',
'location': 'Blackbushe',
'make': 'AUDI',
'model': 'A5 SPORTBACK',
'odometer': 115012,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 11,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_df8c97f7-3f96-5220-9648-b6806ba88234/df8c97f7-3f96-5220-9648-b6806ba88234_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 56327,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GD17MJV/698729593/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_df8c97f7-3f96-5220-9648-b6806ba88234/df8c97f7-3f96-5220-9648-b6806ba88234_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 52827,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GD17MJV/698729613/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_df8c97f7-3f96-5220-9648-b6806ba88234/df8c97f7-3f96-5220-9648-b6806ba88234_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 51438,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GD17MJV/698729633/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_df8c97f7-3f96-5220-9648-b6806ba88234/df8c97f7-3f96-5220-9648-b6806ba88234_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 54325,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GD17MJV/698729649/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_df8c97f7-3f96-5220-9648-b6806ba88234/df8c97f7-3f96-5220-9648-b6806ba88234_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 53238,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GD17MJV/698729668/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_df8c97f7-3f96-5220-9648-b6806ba88234/df8c97f7-3f96-5220-9648-b6806ba88234_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 48658,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GD17MJV/698729683/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_df8c97f7-3f96-5220-9648-b6806ba88234/df8c97f7-3f96-5220-9648-b6806ba88234_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 78028,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GD17MJV/698729705/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_df8c97f7-3f96-5220-9648-b6806ba88234/df8c97f7-3f96-5220-9648-b6806ba88234_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 79526,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GD17MJV/698729724/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_df8c97f7-3f96-5220-9648-b6806ba88234/df8c97f7-3f96-5220-9648-b6806ba88234_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 91013,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GD17MJV/698729749/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_df8c97f7-3f96-5220-9648-b6806ba88234/df8c97f7-3f96-5220-9648-b6806ba88234_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 73707,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GD17MJV/698729765/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-01-01',
'seller_name': None,
'title': 'AUDI A5 SPORTBACK 2.0 TDI ULTRA 190 S LINE S-T Hatchback',
'transmission': 'automatic',
'trim': 'TDI ULTRA 190 S LINE S-T',
'vin': 'WAUZZZF57HA037005',
'year': 2017}
2026-03-28 14:05:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GD17%2520MJV%27 HTTP/1.1" 200 None
2026-03-28 14:05:30 [bca.uk] INFO: Saving data for GD17%20MJV: {'created_time': 1774706730.378064, 'last_price_update_time': 1774706730.378078, 'auction_closing_time': 1774864800.0}
2026-03-28 14:05:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='GD17%2520MJV') HTTP/1.1" 204 0
2026-03-28 14:05:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 1d31f426-9911-536f-8f01-f0daf0072cc0 with identifier: DA64%20AKP
2026-03-28 14:05:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 1d31f426-9911-536f-8f01-f0daf0072cc0 with identifier: DA64%20AKP
2026-03-28 14:05:30 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 1d31f426-9911-536f-8f01-f0daf0072cc0 with identifier: DA64%20AKP to the API
2026-03-28 14:05:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:05:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:05:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DA64AKP/698920195/600>
{'auction_title': '',
'c_o_2_emission_value': 138,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1d31f426-9911-536f-8f01-f0daf0072cc0/1d31f426-9911-536f-8f01-f0daf0072cc0_expert_report_file_08fe399c-3f48-4ca6-8a08-c4ae265ada31.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=DA64%20AKP-GB',
'category': 'Car',
'color': 'black',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.6L',
'expiration_date': '2026-03-31T10:00:00Z',
'fuel_type': 'Petrol',
'id': '1d31f426-9911-536f-8f01-f0daf0072cc0',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'DA64 AKP',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=DA64%20AKP&vehicleType=*',
'listing': 'auction',
'location': 'Paddock Wood',
'make': 'FORD',
'model': 'FIESTA',
'odometer': 93693,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 11,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1d31f426-9911-536f-8f01-f0daf0072cc0/1d31f426-9911-536f-8f01-f0daf0072cc0_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 52298,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DA64AKP/698920102/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1d31f426-9911-536f-8f01-f0daf0072cc0/1d31f426-9911-536f-8f01-f0daf0072cc0_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 53019,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DA64AKP/698920122/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1d31f426-9911-536f-8f01-f0daf0072cc0/1d31f426-9911-536f-8f01-f0daf0072cc0_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 50374,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DA64AKP/698920150/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1d31f426-9911-536f-8f01-f0daf0072cc0/1d31f426-9911-536f-8f01-f0daf0072cc0_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 47375,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DA64AKP/698920170/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1d31f426-9911-536f-8f01-f0daf0072cc0/1d31f426-9911-536f-8f01-f0daf0072cc0_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 47051,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DA64AKP/698920195/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1d31f426-9911-536f-8f01-f0daf0072cc0/1d31f426-9911-536f-8f01-f0daf0072cc0_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 47984,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DA64AKP/698920211/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1d31f426-9911-536f-8f01-f0daf0072cc0/1d31f426-9911-536f-8f01-f0daf0072cc0_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 94063,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DA64AKP/698920250/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1d31f426-9911-536f-8f01-f0daf0072cc0/1d31f426-9911-536f-8f01-f0daf0072cc0_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 68247,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DA64AKP/698920274/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1d31f426-9911-536f-8f01-f0daf0072cc0/1d31f426-9911-536f-8f01-f0daf0072cc0_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 81801,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DA64AKP/698920294/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1d31f426-9911-536f-8f01-f0daf0072cc0/1d31f426-9911-536f-8f01-f0daf0072cc0_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 85296,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DA64AKP/698920312/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2014-01-01',
'seller_name': None,
'title': 'FORD FIESTA 1.6 ZETEC P/SHIFT Hatchback',
'transmission': 'automatic',
'trim': 'ZETEC P/SHIFT',
'vin': 'WF0DXXGAKDEP56293',
'year': 2014}
2026-03-28 14:05:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DA64%2520AKP%27 HTTP/1.1" 200 None
2026-03-28 14:05:30 [bca.uk] INFO: Saving data for DA64%20AKP: {'created_time': 1774706730.779929, 'last_price_update_time': 1774706730.779939, 'auction_closing_time': 1774951200.0}
2026-03-28 14:05:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='DA64%2520AKP') HTTP/1.1" 204 0
2026-03-28 14:05:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: d6214c2d-d518-55cf-9ab4-09004f56f218 with identifier: ST12%20HSO
2026-03-28 14:05:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: d6214c2d-d518-55cf-9ab4-09004f56f218 with identifier: ST12%20HSO
2026-03-28 14:05:30 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: d6214c2d-d518-55cf-9ab4-09004f56f218 with identifier: ST12%20HSO to the API
2026-03-28 14:05:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:05:31 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:05:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/ST12HSO/698934329/600>
{'auction_title': '',
'c_o_2_emission_value': 127,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d6214c2d-d518-55cf-9ab4-09004f56f218/d6214c2d-d518-55cf-9ab4-09004f56f218_expert_report_file_90e87b5a-22b4-46e0-b390-da843839c5e1.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=ST12%20HSO-GB',
'category': 'Car',
'color': 'white',
'currency': 'GBP',
'doors_number': 3,
'engine': '1.2L',
'expiration_date': '2026-03-31T10:00:00Z',
'fuel_type': 'Petrol',
'id': 'd6214c2d-d518-55cf-9ab4-09004f56f218',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'ST12 HSO',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=ST12%20HSO&vehicleType=*',
'listing': 'auction',
'location': 'Manchester',
'make': 'FORD',
'model': 'FIESTA',
'odometer': 133057,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 11,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d6214c2d-d518-55cf-9ab4-09004f56f218/d6214c2d-d518-55cf-9ab4-09004f56f218_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 44288,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/ST12HSO/698934223/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d6214c2d-d518-55cf-9ab4-09004f56f218/d6214c2d-d518-55cf-9ab4-09004f56f218_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 44099,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/ST12HSO/698934238/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d6214c2d-d518-55cf-9ab4-09004f56f218/d6214c2d-d518-55cf-9ab4-09004f56f218_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 43235,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/ST12HSO/698934249/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d6214c2d-d518-55cf-9ab4-09004f56f218/d6214c2d-d518-55cf-9ab4-09004f56f218_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 43192,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/ST12HSO/698934269/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d6214c2d-d518-55cf-9ab4-09004f56f218/d6214c2d-d518-55cf-9ab4-09004f56f218_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 43690,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/ST12HSO/698934285/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d6214c2d-d518-55cf-9ab4-09004f56f218/d6214c2d-d518-55cf-9ab4-09004f56f218_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 43544,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/ST12HSO/698934303/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d6214c2d-d518-55cf-9ab4-09004f56f218/d6214c2d-d518-55cf-9ab4-09004f56f218_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 92285,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/ST12HSO/698934329/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d6214c2d-d518-55cf-9ab4-09004f56f218/d6214c2d-d518-55cf-9ab4-09004f56f218_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 66213,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/ST12HSO/698934353/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d6214c2d-d518-55cf-9ab4-09004f56f218/d6214c2d-d518-55cf-9ab4-09004f56f218_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 78172,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/ST12HSO/698934381/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d6214c2d-d518-55cf-9ab4-09004f56f218/d6214c2d-d518-55cf-9ab4-09004f56f218_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 98613,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/ST12HSO/698934396/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2012-01-01',
'seller_name': None,
'title': 'FORD FIESTA 1.2 EDGE Hatchback',
'transmission': 'manual',
'trim': 'EDGE',
'vin': 'WF0GXXGAJGCB45775',
'year': 2012}
2026-03-28 14:05:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27ST12%2520HSO%27 HTTP/1.1" 200 None
2026-03-28 14:05:31 [bca.uk] INFO: Saving data for ST12%20HSO: {'created_time': 1774706731.501294, 'last_price_update_time': 1774706731.501306, 'auction_closing_time': 1774951200.0}
2026-03-28 14:05:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='ST12%2520HSO') HTTP/1.1" 204 0
2026-03-28 14:05:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/JP04STP/698929445/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/JP04STP/42809620?sv=2020-08-04&st=2026-03-28T14%3A04%3A43Z&se=2026-03-28T14%3A29%3A43Z&sr=b&sp=r&sig=au5c8GXv2vCUIG4ea67UD3YzlPMQz7%2FWxYZM6tUj%2FEo%3D)
2026-03-28 14:05:31 [bca.uk] INFO: Found listing with ID: DE64%20BFP
2026-03-28 14:05:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DE64%2520BFP%27 HTTP/1.1" 200 None
2026-03-28 14:05:31 [bca.uk] INFO: Scrape type for DE64%20BFP: 0
2026-03-28 14:05:31 [bca.uk] INFO: Found listing with ID: DG11%20EGJ
2026-03-28 14:05:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DG11%2520EGJ%27 HTTP/1.1" 200 None
2026-03-28 14:05:31 [bca.uk] INFO: Scrape type for DG11%20EGJ: 0
2026-03-28 14:05:31 [bca.uk] INFO: Found listing with ID: KM18%20ZYB
2026-03-28 14:05:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KM18%2520ZYB%27 HTTP/1.1" 200 None
2026-03-28 14:05:31 [bca.uk] INFO: Scrape type for KM18%20ZYB: 0
2026-03-28 14:05:31 [bca.uk] INFO: Found listing with ID: LA10%20WZY
2026-03-28 14:05:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LA10%2520WZY%27 HTTP/1.1" 200 None
2026-03-28 14:05:31 [bca.uk] INFO: Scrape type for LA10%20WZY: 0
2026-03-28 14:05:31 [bca.uk] INFO: Found listing with ID: WF61%20VPM
2026-03-28 14:05:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WF61%2520VPM%27 HTTP/1.1" 200 None
2026-03-28 14:05:31 [bca.uk] INFO: Scrape type for WF61%20VPM: 0
2026-03-28 14:05:31 [bca.uk] INFO: Found listing with ID: WJ58%20ZNU
2026-03-28 14:05:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WJ58%2520ZNU%27 HTTP/1.1" 200 None
2026-03-28 14:05:31 [bca.uk] INFO: Scrape type for WJ58%20ZNU: 0
2026-03-28 14:05:31 [bca.uk] INFO: Found listing with ID: DH66%20OBL
2026-03-28 14:05:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DH66%2520OBL%27 HTTP/1.1" 200 None
2026-03-28 14:05:31 [bca.uk] INFO: Scrape type for DH66%20OBL: 0
2026-03-28 14:05:31 [bca.uk] INFO: Found listing with ID: KX64%20WYR
2026-03-28 14:05:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KX64%2520WYR%27 HTTP/1.1" 200 None
2026-03-28 14:05:31 [bca.uk] INFO: Scrape type for KX64%20WYR: 0
2026-03-28 14:05:31 [bca.uk] INFO: Found listing with ID: WG09%20CXU
2026-03-28 14:05:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WG09%2520CXU%27 HTTP/1.1" 200 None
2026-03-28 14:05:31 [bca.uk] INFO: Scrape type for WG09%20CXU: 0
2026-03-28 14:05:31 [bca.uk] INFO: Found listing with ID: BW15%20UPM
2026-03-28 14:05:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BW15%2520UPM%27 HTTP/1.1" 200 None
2026-03-28 14:05:31 [bca.uk] INFO: Scrape type for BW15%20UPM: 0
2026-03-28 14:05:31 [bca.uk] INFO: Found listing with ID: VN67%20AUR
2026-03-28 14:05:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27VN67%2520AUR%27 HTTP/1.1" 200 None
2026-03-28 14:05:31 [bca.uk] INFO: Scrape type for VN67%20AUR: 0
2026-03-28 14:05:31 [bca.uk] INFO: Found listing with ID: AV56%20LPL
2026-03-28 14:05:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27AV56%2520LPL%27 HTTP/1.1" 200 None
2026-03-28 14:05:31 [bca.uk] INFO: Scrape type for AV56%20LPL: 0
2026-03-28 14:05:31 [bca.uk] INFO: Found listing with ID: RO63%20LZW
2026-03-28 14:05:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27RO63%2520LZW%27 HTTP/1.1" 200 None
2026-03-28 14:05:31 [bca.uk] INFO: Scrape type for RO63%20LZW: 0
2026-03-28 14:05:31 [bca.uk] INFO: Found listing with ID: WF60%20EZT
2026-03-28 14:05:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WF60%2520EZT%27 HTTP/1.1" 200 None
2026-03-28 14:05:31 [bca.uk] INFO: Scrape type for WF60%20EZT: 0
2026-03-28 14:05:31 [bca.uk] INFO: Found listing with ID: YK18%20XZB
2026-03-28 14:05:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YK18%2520XZB%27 HTTP/1.1" 200 None
2026-03-28 14:05:31 [bca.uk] INFO: Scrape type for YK18%20XZB: 0
2026-03-28 14:05:31 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HY65KRJ/698920398/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698920398>
2026-03-28 14:05:31 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YB63ZKP/698284382/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698284382>
2026-03-28 14:05:31 [bca.uk] INFO: Total items found: 100
2026-03-28 14:05:31 [bca.uk] INFO: Requesting URL: https://www.bca.co.uk/api/search?q=&pageSize=100&page=12&sort=MostRecentlyAdded
2026-03-28 14:05:31 [bca.uk] INFO: Sending search API request with Bearer token (length=1492)
2026-03-28 14:05:31 [scrapy_zyte_api._params] WARNING: Request <GET https://www.bca.co.uk/api/search?q=&pageSize=100&page=12&sort=MostRecentlyAdded> defines the Zyte API customHttpRequestHeaders parameter, overriding Request.headers. Use Request.headers instead.
2026-03-28 14:05:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:05:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c9bd890>
2026-03-28 14:05:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:05:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:05:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:05:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_91eb6f90-8171-52c3-8f50-6415c188dd75/91eb6f90-8171-52c3-8f50-6415c188dd75_image_3.jpg HTTP/1.1" 201 0
2026-03-28 14:05:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLM62VCU%252F698781717%252F600') HTTP/1.1" 204 0
2026-03-28 14:05:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LM62VCU/698781717/600 saved to cache
2026-03-28 14:05:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 91eb6f90-8171-52c3-8f50-6415c188dd75
2026-03-28 14:05:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LM62VCU/698781714/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LM62VCU/42807206?sv=2020-08-04&st=2026-03-28T14%3A04%3A48Z&se=2026-03-28T14%3A29%3A48Z&sr=b&sp=r&sig=Rp%2FNuRBRM1T5Pi%2BNXegpYq0Ke%2B2Lo7Tup8NKUMfBYuw%3D)
2026-03-28 14:05:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PXZ1595/698814180/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/PXZ1595/42808016?sv=2020-08-04&st=2026-03-28T14%3A04%3A01Z&se=2026-03-28T14%3A29%3A01Z&sr=b&sp=r&sig=xu3OmTnGiQ74jDpi5YWrXOjZvBn7hDxoXdoCW9aef04%3D)
2026-03-28 14:05:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/JP04STP/698929419/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/JP04STP/42809620?sv=2020-08-04&st=2026-03-28T14%3A04%3A43Z&se=2026-03-28T14%3A29%3A43Z&sr=b&sp=r&sig=au5c8GXv2vCUIG4ea67UD3YzlPMQz7%2FWxYZM6tUj%2FEo%3D)
2026-03-28 14:05:31 [scrapy_zyte_api._params] WARNING: Request <GET https://www.bca.co.uk/api/search?q=&pageSize=100&page=12&sort=MostRecentlyAdded> defines the Zyte API customHttpRequestHeaders parameter, overriding Request.headers. Use Request.headers instead.
2026-03-28 14:05:31 [scrapy_zyte_api._params] WARNING: Request <GET https://www.bca.co.uk/api/search?q=&pageSize=100&page=12&sort=MostRecentlyAdded> defines the Zyte API customHttpRequestHeaders parameter, overriding Request.headers. Use Request.headers instead.
2026-03-28 14:05:31 [bca.uk] INFO: Found listing with ID: DU18%20WDR
2026-03-28 14:05:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DU18%2520WDR%27 HTTP/1.1" 200 None
2026-03-28 14:05:32 [bca.uk] INFO: Scrape type for DU18%20WDR: 0
2026-03-28 14:05:32 [bca.uk] INFO: Found listing with ID: HV67%20OHJ
2026-03-28 14:05:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27HV67%2520OHJ%27 HTTP/1.1" 200 None
2026-03-28 14:05:32 [bca.uk] INFO: Scrape type for HV67%20OHJ: 0
2026-03-28 14:05:32 [bca.uk] INFO: Found listing with ID: LC16%20CKE
2026-03-28 14:05:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LC16%2520CKE%27 HTTP/1.1" 200 None
2026-03-28 14:05:32 [bca.uk] INFO: Scrape type for LC16%20CKE: 2
2026-03-28 14:05:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b7e0a8cf-39d5-5baf-a8bd-acc89bf60342 with identifier: LC16%20CKE
2026-03-28 14:05:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b7e0a8cf-39d5-5baf-a8bd-acc89bf60342 with scrape type 2
2026-03-28 14:05:32 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b7e0a8cf-39d5-5baf-a8bd-acc89bf60342 with scrape type 2
2026-03-28 14:05:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: b7e0a8cf-39d5-5baf-a8bd-acc89bf60342, identifier: LC16%20CKE
2026-03-28 14:05:32 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 14:05:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:05:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c753450>
2026-03-28 14:05:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:05:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:05:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:05:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_91eb6f90-8171-52c3-8f50-6415c188dd75/91eb6f90-8171-52c3-8f50-6415c188dd75_image_2.jpg HTTP/1.1" 201 0
2026-03-28 14:05:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLM62VCU%252F698781716%252F600') HTTP/1.1" 204 0
2026-03-28 14:05:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LM62VCU/698781716/600 saved to cache
2026-03-28 14:05:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 91eb6f90-8171-52c3-8f50-6415c188dd75
2026-03-28 14:05:32 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:05:32 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:05:32 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:05:32 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:05:32 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:05:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:05:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2d802590>
2026-03-28 14:05:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:05:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:05:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:05:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bbc16d12-29f9-531b-8c11-9870b348d92a/bbc16d12-29f9-531b-8c11-9870b348d92a_image_9.jpg HTTP/1.1" 201 0
2026-03-28 14:05:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FJP04STP%252F698929454%252F600') HTTP/1.1" 204 0
2026-03-28 14:05:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/JP04STP/698929454/600 saved to cache
2026-03-28 14:05:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item bbc16d12-29f9-531b-8c11-9870b348d92a
2026-03-28 14:05:32 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:05:32 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:05:32 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:05:32 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:05:32 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:05:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:05:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2d952890>
2026-03-28 14:05:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:05:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:05:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:05:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bbc16d12-29f9-531b-8c11-9870b348d92a/bbc16d12-29f9-531b-8c11-9870b348d92a_image_8.jpg HTTP/1.1" 201 0
2026-03-28 14:05:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FJP04STP%252F698929445%252F600') HTTP/1.1" 204 0
2026-03-28 14:05:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/JP04STP/698929445/600 saved to cache
2026-03-28 14:05:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item bbc16d12-29f9-531b-8c11-9870b348d92a
2026-03-28 14:05:32 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LD06WNS/42809781?sv=2020-08-04&st=2026-03-28T14%3A05%3A31Z&se=2026-03-28T14%3A30%3A31Z&sr=b&sp=r&sig=OTvnKFmvSmD2QJ4F%2F503KbBKEXfjVzDNMqEsXfGzuJ0%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=LD06%20WNS-GB>
2026-03-28 14:05:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BT66DFX/698129712/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/BT66DFX/42810013?sv=2020-08-04&st=2026-03-28T14%3A04%3A00Z&se=2026-03-28T14%3A29%3A00Z&sr=b&sp=r&sig=Yx0iLoKJXBk4DPNXOVJLOrRp66ZUz648vIo6BTtbrJ0%3D)
2026-03-28 14:05:32 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/SA60NYT/42810538?sv=2020-08-04&st=2026-03-28T14%3A05%3A31Z&se=2026-03-28T14%3A30%3A31Z&sr=b&sp=r&sig=E2aZntMhZA%2B%2F8gu6iOIeQUHtNbnCVBf4tuK50ckRu0U%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=SA60%20NYT-GB>
2026-03-28 14:05:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: b7e0a8cf-39d5-5baf-a8bd-acc89bf60342 with identifier: LC16%20CKE
2026-03-28 14:05:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: b7e0a8cf-39d5-5baf-a8bd-acc89bf60342 with identifier: LC16%20CKE
2026-03-28 14:05:32 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: b7e0a8cf-39d5-5baf-a8bd-acc89bf60342 with identifier: LC16%20CKE to the API
2026-03-28 14:05:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:05:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:05:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=11&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 109,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=LC16%20CKE-GB',
'category': 'Car',
'color': 'red',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.6L',
'expiration_date': '2026-03-29T10:00:00Z',
'fuel_type': 'Diesel',
'id': 'b7e0a8cf-39d5-5baf-a8bd-acc89bf60342',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'LC16 CKE',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=LC16%20CKE&vehicleType=*',
'listing': 'auction',
'location': 'Brighouse',
'make': 'KIA',
'model': 'CEED SW',
'odometer': 32205,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-01-01',
'seller_name': None,
'title': 'KIA CEED SW 1.6 CRDI 134 2 ISG DCT Estate',
'transmission': 'automatic',
'trim': 'CRDI 134 2 ISG DCT',
'vin': 'U5YHN816VGL181751',
'year': 2016}
2026-03-28 14:05:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LC16%2520CKE%27 HTTP/1.1" 200 None
2026-03-28 14:05:32 [bca.uk] INFO: Saving data for LC16%20CKE: {'auction_closing_time': 1774778400.0, 'created_time': 1774365593.393724, 'last_price_update_time': 1774706732.795536}
2026-03-28 14:05:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='LC16%2520CKE') HTTP/1.1" 204 0
2026-03-28 14:05:32 [bca.uk] INFO: Found listing with ID: MT61%20EPD
2026-03-28 14:05:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MT61%2520EPD%27 HTTP/1.1" 200 None
2026-03-28 14:05:32 [bca.uk] INFO: Scrape type for MT61%20EPD: 2
2026-03-28 14:05:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f6ddf7fe-7d12-5e3c-82ad-1cc5d628d3ff with identifier: MT61%20EPD
2026-03-28 14:05:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f6ddf7fe-7d12-5e3c-82ad-1cc5d628d3ff with scrape type 2
2026-03-28 14:05:32 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f6ddf7fe-7d12-5e3c-82ad-1cc5d628d3ff with scrape type 2
2026-03-28 14:05:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: f6ddf7fe-7d12-5e3c-82ad-1cc5d628d3ff, identifier: MT61%20EPD
2026-03-28 14:05:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/BU67HNA/42810584?sv=2020-08-04&st=2026-03-28T14%3A05%3A27Z&se=2026-03-28T14%3A30%3A27Z&sr=b&sp=r&sig=jvqWs0bbwwPNyCuILhTmpoSOvgJ5gvo7FW1OJ3cgP4I%3D> (referer: https://www.bca.co.uk/)
2026-03-28 14:05:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LD57FXL/42810412?sv=2020-08-04&st=2026-03-28T14%3A05%3A27Z&se=2026-03-28T14%3A30%3A27Z&sr=b&sp=r&sig=SrrbefNVxYUh04mJFXEMP7I6EJU13XfRB%2BYQXtzw2lU%3D> (referer: https://www.bca.co.uk/)
2026-03-28 14:05:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: f6ddf7fe-7d12-5e3c-82ad-1cc5d628d3ff with identifier: MT61%20EPD
2026-03-28 14:05:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: f6ddf7fe-7d12-5e3c-82ad-1cc5d628d3ff with identifier: MT61%20EPD
2026-03-28 14:05:33 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: f6ddf7fe-7d12-5e3c-82ad-1cc5d628d3ff with identifier: MT61%20EPD to the API
2026-03-28 14:05:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:05:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:05:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=11&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 175,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=MT61%20EPD-GB',
'category': 'Car',
'color': 'white',
'currency': 'GBP',
'doors_number': 2,
'engine': '1.6L',
'expiration_date': '2026-03-29T10:00:00Z',
'fuel_type': 'Petrol',
'id': 'f6ddf7fe-7d12-5e3c-82ad-1cc5d628d3ff',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'MT61 EPD',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=MT61%20EPD&vehicleType=*',
'listing': 'auction',
'location': 'Brighouse',
'make': 'RENAULT',
'model': 'MEGANE CC',
'odometer': 37911,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2011-01-01',
'seller_name': None,
'title': 'RENAULT MEGANE CC 1.6 16V 110 DYNAMIQUE TOM TOM Convertible',
'transmission': 'manual',
'trim': '16V 110 DYNAMIQUE TOM TOM',
'vin': 'VF1EZ1U0646485002',
'year': 2011}
2026-03-28 14:05:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MT61%2520EPD%27 HTTP/1.1" 200 None
2026-03-28 14:05:33 [bca.uk] INFO: Saving data for MT61%20EPD: {'auction_closing_time': 1774778400.0, 'created_time': 1774391983.022979, 'last_price_update_time': 1774706733.401305}
2026-03-28 14:05:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='MT61%2520EPD') HTTP/1.1" 204 0
2026-03-28 14:05:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:05:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a1fea0c50>
2026-03-28 14:05:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:05:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:05:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:05:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_91eb6f90-8171-52c3-8f50-6415c188dd75/91eb6f90-8171-52c3-8f50-6415c188dd75_image_1.jpg HTTP/1.1" 201 0
2026-03-28 14:05:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLM62VCU%252F698781714%252F600') HTTP/1.1" 204 0
2026-03-28 14:05:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LM62VCU/698781714/600 saved to cache
2026-03-28 14:05:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 91eb6f90-8171-52c3-8f50-6415c188dd75
2026-03-28 14:05:33 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 91eb6f90-8171-52c3-8f50-6415c188dd75, skipping ID generation
2026-03-28 14:05:33 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 91eb6f90-8171-52c3-8f50-6415c188dd75 sending to next pipeline
2026-03-28 14:05:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 91eb6f90-8171-52c3-8f50-6415c188dd75, identifier: LM62%20VCU
2026-03-28 14:05:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:05:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c8e25d0>
2026-03-28 14:05:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:05:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:05:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:05:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8f3e30a4-6b64-5dd1-8e1e-6cce5d49fef3/8f3e30a4-6b64-5dd1-8e1e-6cce5d49fef3_image_5.jpg HTTP/1.1" 201 0
2026-03-28 14:05:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FPXZ1595%252F698814180%252F600') HTTP/1.1" 204 0
2026-03-28 14:05:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PXZ1595/698814180/600 saved to cache
2026-03-28 14:05:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 8f3e30a4-6b64-5dd1-8e1e-6cce5d49fef3
2026-03-28 14:05:33 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:05:33 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:05:33 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:05:33 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:05:33 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:05:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:05:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c125390>
2026-03-28 14:05:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:05:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:05:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:05:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bbc16d12-29f9-531b-8c11-9870b348d92a/bbc16d12-29f9-531b-8c11-9870b348d92a_image_6.jpg HTTP/1.1" 201 0
2026-03-28 14:05:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FJP04STP%252F698929419%252F600') HTTP/1.1" 204 0
2026-03-28 14:05:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/JP04STP/698929419/600 saved to cache
2026-03-28 14:05:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item bbc16d12-29f9-531b-8c11-9870b348d92a
2026-03-28 14:05:33 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: bbc16d12-29f9-531b-8c11-9870b348d92a, skipping ID generation
2026-03-28 14:05:33 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item bbc16d12-29f9-531b-8c11-9870b348d92a sending to next pipeline
2026-03-28 14:05:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: bbc16d12-29f9-531b-8c11-9870b348d92a, identifier: JP04%20STP
2026-03-28 14:05:33 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BT66DFX/698129708/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698129708>
2026-03-28 14:05:33 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PXZ1595/698814161/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698814161>
2026-03-28 14:05:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YD64WJN/697180911/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YD64WJN/42809986?sv=2020-08-04&st=2026-03-28T14%3A03%3A59Z&se=2026-03-28T14%3A28%3A59Z&sr=b&sp=r&sig=5rsKGf%2F78vqwWJXVPXpM1R60yxRlhwBt0pb8A02KPMk%3D)
2026-03-28 14:05:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NK64UTR/698814227/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/NK64UTR/42807827?sv=2020-08-04&st=2026-03-28T14%3A04%3A00Z&se=2026-03-28T14%3A29%3A00Z&sr=b&sp=r&sig=B2djBTwUnOYzqxtI8e7WJD2j2cACy9SjmoGLE3oN2SE%3D)
2026-03-28 14:05:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AK67LWT/698947215/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/AK67LWT/42810366?sv=2020-08-04&st=2026-03-28T14%3A04%3A00Z&se=2026-03-28T14%3A29%3A00Z&sr=b&sp=r&sig=dnN3%2FeKHnzQfSMnyGaraMReo6SkHH2Dy4nbY3zUESfI%3D)
2026-03-28 14:05:33 [bca.uk] INFO: Found listing with ID: YA67%20SYU
2026-03-28 14:05:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YA67%2520SYU%27 HTTP/1.1" 200 None
2026-03-28 14:05:33 [bca.uk] INFO: Scrape type for YA67%20SYU: 0
2026-03-28 14:05:33 [bca.uk] INFO: Found listing with ID: FV17%20CRF
2026-03-28 14:05:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FV17%2520CRF%27 HTTP/1.1" 200 None
2026-03-28 14:05:33 [bca.uk] INFO: Scrape type for FV17%20CRF: 2
2026-03-28 14:05:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f1deac91-2dac-5193-ad93-3e0f8d321ebb with identifier: FV17%20CRF
2026-03-28 14:05:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f1deac91-2dac-5193-ad93-3e0f8d321ebb with scrape type 2
2026-03-28 14:05:33 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f1deac91-2dac-5193-ad93-3e0f8d321ebb with scrape type 2
2026-03-28 14:05:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: f1deac91-2dac-5193-ad93-3e0f8d321ebb, identifier: FV17%20CRF
2026-03-28 14:05:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 91eb6f90-8171-52c3-8f50-6415c188dd75 with identifier: LM62%20VCU
2026-03-28 14:05:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 91eb6f90-8171-52c3-8f50-6415c188dd75 with identifier: LM62%20VCU
2026-03-28 14:05:34 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 91eb6f90-8171-52c3-8f50-6415c188dd75 with identifier: LM62%20VCU to the API
2026-03-28 14:05:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:05:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:05:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LM62VCU/698781714/600>
{'auction_title': '',
'c_o_2_emission_value': 214,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_91eb6f90-8171-52c3-8f50-6415c188dd75/91eb6f90-8171-52c3-8f50-6415c188dd75_expert_report_file_55caf430-4dee-4d91-99ca-9ac884a59f45.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=LM62%20VCU-GB',
'category': 'Car',
'color': 'silver',
'currency': 'GBP',
'doors_number': 5,
'engine': '2.1L',
'expiration_date': '2026-03-31T10:00:00Z',
'fuel_type': 'Diesel',
'id': '91eb6f90-8171-52c3-8f50-6415c188dd75',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'LM62 VCU',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=LM62%20VCU&vehicleType=*',
'listing': 'auction',
'location': 'Paddock Wood',
'make': 'MERCEDES-BENZ',
'model': 'VIANO',
'odometer': 80022,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 11,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_91eb6f90-8171-52c3-8f50-6415c188dd75/91eb6f90-8171-52c3-8f50-6415c188dd75_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 58256,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LM62VCU/698781712/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_91eb6f90-8171-52c3-8f50-6415c188dd75/91eb6f90-8171-52c3-8f50-6415c188dd75_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 55322,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LM62VCU/698781714/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_91eb6f90-8171-52c3-8f50-6415c188dd75/91eb6f90-8171-52c3-8f50-6415c188dd75_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 53118,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LM62VCU/698781716/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_91eb6f90-8171-52c3-8f50-6415c188dd75/91eb6f90-8171-52c3-8f50-6415c188dd75_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 52984,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LM62VCU/698781717/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_91eb6f90-8171-52c3-8f50-6415c188dd75/91eb6f90-8171-52c3-8f50-6415c188dd75_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 55158,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LM62VCU/698781722/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_91eb6f90-8171-52c3-8f50-6415c188dd75/91eb6f90-8171-52c3-8f50-6415c188dd75_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 51242,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LM62VCU/698781723/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_91eb6f90-8171-52c3-8f50-6415c188dd75/91eb6f90-8171-52c3-8f50-6415c188dd75_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 79486,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LM62VCU/698781732/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_91eb6f90-8171-52c3-8f50-6415c188dd75/91eb6f90-8171-52c3-8f50-6415c188dd75_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 79714,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LM62VCU/698781744/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_91eb6f90-8171-52c3-8f50-6415c188dd75/91eb6f90-8171-52c3-8f50-6415c188dd75_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 89611,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LM62VCU/698781751/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_91eb6f90-8171-52c3-8f50-6415c188dd75/91eb6f90-8171-52c3-8f50-6415c188dd75_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 84173,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LM62VCU/698781759/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2012-01-01',
'seller_name': None,
'title': 'MERCEDES-BENZ VIANO 2.1 CDI 165 AMBIENTE TIP MPV',
'transmission': 'manual',
'trim': 'CDI 165 AMBIENTE TIP',
'vin': 'WDF63981323782269',
'year': 2012}
2026-03-28 14:05:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LM62%2520VCU%27 HTTP/1.1" 200 None
2026-03-28 14:05:34 [bca.uk] INFO: Saving data for LM62%20VCU: {'created_time': 1774706734.385256, 'last_price_update_time': 1774706734.385268, 'auction_closing_time': 1774951200.0}
2026-03-28 14:05:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='LM62%2520VCU') HTTP/1.1" 204 0
2026-03-28 14:05:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: bbc16d12-29f9-531b-8c11-9870b348d92a with identifier: JP04%20STP
2026-03-28 14:05:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: bbc16d12-29f9-531b-8c11-9870b348d92a with identifier: JP04%20STP
2026-03-28 14:05:34 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: bbc16d12-29f9-531b-8c11-9870b348d92a with identifier: JP04%20STP to the API
2026-03-28 14:05:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:05:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:05:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/JP04STP/698929419/600>
{'auction_title': '',
'c_o_2_emission_value': 139,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bbc16d12-29f9-531b-8c11-9870b348d92a/bbc16d12-29f9-531b-8c11-9870b348d92a_expert_report_file_01221232-4286-4f1d-b805-53a5330d1249.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=JP04%20STP-GB',
'category': 'Car',
'color': 'red',
'currency': 'GBP',
'doors_number': 3,
'engine': '1.6L',
'expiration_date': '2026-03-31T10:00:00Z',
'fuel_type': 'Petrol',
'id': 'bbc16d12-29f9-531b-8c11-9870b348d92a',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'JP04 STP',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=JP04%20STP&vehicleType=*',
'listing': 'auction',
'location': 'Bristol',
'make': 'CITROEN',
'model': 'DS3',
'odometer': 72907,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 11,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bbc16d12-29f9-531b-8c11-9870b348d92a/bbc16d12-29f9-531b-8c11-9870b348d92a_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 48184,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/JP04STP/698929345/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bbc16d12-29f9-531b-8c11-9870b348d92a/bbc16d12-29f9-531b-8c11-9870b348d92a_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 48343,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/JP04STP/698929350/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bbc16d12-29f9-531b-8c11-9870b348d92a/bbc16d12-29f9-531b-8c11-9870b348d92a_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 44039,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/JP04STP/698929359/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bbc16d12-29f9-531b-8c11-9870b348d92a/bbc16d12-29f9-531b-8c11-9870b348d92a_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 44788,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/JP04STP/698929377/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bbc16d12-29f9-531b-8c11-9870b348d92a/bbc16d12-29f9-531b-8c11-9870b348d92a_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 43580,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/JP04STP/698929390/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bbc16d12-29f9-531b-8c11-9870b348d92a/bbc16d12-29f9-531b-8c11-9870b348d92a_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 43191,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/JP04STP/698929404/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bbc16d12-29f9-531b-8c11-9870b348d92a/bbc16d12-29f9-531b-8c11-9870b348d92a_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 96993,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/JP04STP/698929419/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bbc16d12-29f9-531b-8c11-9870b348d92a/bbc16d12-29f9-531b-8c11-9870b348d92a_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 81015,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/JP04STP/698929433/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bbc16d12-29f9-531b-8c11-9870b348d92a/bbc16d12-29f9-531b-8c11-9870b348d92a_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 96872,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/JP04STP/698929445/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bbc16d12-29f9-531b-8c11-9870b348d92a/bbc16d12-29f9-531b-8c11-9870b348d92a_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 106764,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/JP04STP/698929454/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2013-01-01',
'seller_name': None,
'title': 'CITROEN DS3 1.6 THP 155 DSPORT PLUS Hatchback',
'transmission': 'manual',
'trim': 'THP 155 DSPORT PLUS',
'vin': 'VF7SA5FV8CW604380',
'year': 2013}
2026-03-28 14:05:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27JP04%2520STP%27 HTTP/1.1" 200 None
2026-03-28 14:05:34 [bca.uk] INFO: Saving data for JP04%20STP: {'created_time': 1774706734.841283, 'last_price_update_time': 1774706734.841298, 'auction_closing_time': 1774951200.0}
2026-03-28 14:05:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='JP04%2520STP') HTTP/1.1" 204 0
2026-03-28 14:05:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YB63ZKP/698284382/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YB63ZKP/42797877?sv=2020-08-04&st=2026-03-28T14%3A04%3A00Z&se=2026-03-28T14%3A29%3A00Z&sr=b&sp=r&sig=86nclI4iCmgLh3evtZ%2BtpNUit8HkmrBcUBeJLBRYtzg%3D)
2026-03-28 14:05:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: f1deac91-2dac-5193-ad93-3e0f8d321ebb with identifier: FV17%20CRF
2026-03-28 14:05:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: f1deac91-2dac-5193-ad93-3e0f8d321ebb with identifier: FV17%20CRF
2026-03-28 14:05:34 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: f1deac91-2dac-5193-ad93-3e0f8d321ebb with identifier: FV17%20CRF to the API
2026-03-28 14:05:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:05:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:05:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=11&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 41,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=FV17%20CRF-GB',
'category': 'Car',
'color': 'white',
'currency': 'GBP',
'doors_number': 5,
'engine': '2.0L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol/Electric',
'id': 'f1deac91-2dac-5193-ad93-3e0f8d321ebb',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'FV17 CRF',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=FV17%20CRF&vehicleType=*',
'listing': 'auction',
'location': 'Brighouse',
'make': 'MITSUBISHI',
'model': 'OUTLANDER',
'odometer': 64206,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-01-01',
'seller_name': None,
'title': 'MITSUBISHI OUTLANDER 2.0 PHEV 4H 4WD StationWagon',
'transmission': 'automatic',
'trim': 'PHEV 4H 4WD',
'vin': 'JMAXDGG2WHZ004294',
'year': 2017}
2026-03-28 14:05:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FV17%2520CRF%27 HTTP/1.1" 200 None
2026-03-28 14:05:35 [bca.uk] INFO: Saving data for FV17%20CRF: {'auction_closing_time': 1774864800.0, 'created_time': 1774523221.03607, 'last_price_update_time': 1774706735.190551}
2026-03-28 14:05:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='FV17%2520CRF') HTTP/1.1" 204 0
2026-03-28 14:05:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:05:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2d9d24d0>
2026-03-28 14:05:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:05:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:05:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:05:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ca2c3006-0503-55ad-a26d-88f328a541b5/ca2c3006-0503-55ad-a26d-88f328a541b5_image_5.jpg HTTP/1.1" 201 0
2026-03-28 14:05:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FBT66DFX%252F698129712%252F600') HTTP/1.1" 204 0
2026-03-28 14:05:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BT66DFX/698129712/600 saved to cache
2026-03-28 14:05:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item ca2c3006-0503-55ad-a26d-88f328a541b5
2026-03-28 14:05:35 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NK64UTR/698814200/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698814200>
2026-03-28 14:05:35 [bca.uk] INFO: Found listing with ID: PG68%20MPV
2026-03-28 14:05:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27PG68%2520MPV%27 HTTP/1.1" 200 None
2026-03-28 14:05:35 [bca.uk] INFO: Scrape type for PG68%20MPV: 0
2026-03-28 14:05:35 [bca.uk] INFO: Found listing with ID: AK58%20VZY
2026-03-28 14:05:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27AK58%2520VZY%27 HTTP/1.1" 200 None
2026-03-28 14:05:35 [bca.uk] INFO: Scrape type for AK58%20VZY: 0
2026-03-28 14:05:35 [bca.uk] INFO: Found listing with ID: J17%20SDL
2026-03-28 14:05:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27J17%2520SDL%27 HTTP/1.1" 200 None
2026-03-28 14:05:35 [bca.uk] INFO: Scrape type for J17%20SDL: 2
2026-03-28 14:05:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e55d6238-7344-58c3-be6d-dbfc38670e08 with identifier: J17%20SDL
2026-03-28 14:05:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e55d6238-7344-58c3-be6d-dbfc38670e08 with scrape type 2
2026-03-28 14:05:35 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e55d6238-7344-58c3-be6d-dbfc38670e08 with scrape type 2
2026-03-28 14:05:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: e55d6238-7344-58c3-be6d-dbfc38670e08, identifier: J17%20SDL
2026-03-28 14:05:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HY65KRJ/698920398/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/HY65KRJ/42809575?sv=2020-08-04&st=2026-03-28T14%3A03%3A59Z&se=2026-03-28T14%3A28%3A59Z&sr=b&sp=r&sig=qQyrthkWradfVt2c0sIhPBRny5qzj5uOjQmOciVVoMo%3D)
2026-03-28 14:05:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: e55d6238-7344-58c3-be6d-dbfc38670e08 with identifier: J17%20SDL
2026-03-28 14:05:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: e55d6238-7344-58c3-be6d-dbfc38670e08 with identifier: J17%20SDL
2026-03-28 14:05:35 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: e55d6238-7344-58c3-be6d-dbfc38670e08 with identifier: J17%20SDL to the API
2026-03-28 14:05:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:05:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:05:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=11&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 299,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=J17%20SDL-GB',
'category': 'Car',
'color': 'silver',
'currency': 'GBP',
'doors_number': 5,
'engine': '3.6L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Diesel',
'id': 'e55d6238-7344-58c3-be6d-dbfc38670e08',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'J17 SDL',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=J17%20SDL&vehicleType=*',
'listing': 'auction',
'location': 'Brighouse',
'make': 'LAND ROVER',
'model': 'RANGE ROVER',
'odometer': 109571,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2006-01-01',
'seller_name': None,
'title': 'LAND ROVER RANGE ROVER 3.6 TDV8 VOGUE StationWagon',
'transmission': 'automatic',
'trim': 'TDV8 VOGUE',
'vin': 'SALLMAM237A240151',
'year': 2006}
2026-03-28 14:05:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27J17%2520SDL%27 HTTP/1.1" 200 None
2026-03-28 14:05:35 [bca.uk] INFO: Saving data for J17%20SDL: {'auction_closing_time': 1774864800.0, 'created_time': 1774305717.361129, 'last_price_update_time': 1774706735.822124}
2026-03-28 14:05:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='J17%2520SDL') HTTP/1.1" 204 0
2026-03-28 14:05:35 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YD64WJN/697180879/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=697180879>
2026-03-28 14:05:35 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AK67LWT/698947195/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698947195>
2026-03-28 14:05:35 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WJ58DWA/697410338/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=697410338>
2026-03-28 14:05:35 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YB63ZKP/698284376/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698284376>
2026-03-28 14:05:35 [bca.uk] INFO: Found listing with ID: LW02%20GAV
2026-03-28 14:05:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LW02%2520GAV%27 HTTP/1.1" 200 None
2026-03-28 14:05:35 [bca.uk] INFO: Scrape type for LW02%20GAV: 0
2026-03-28 14:05:35 [bca.uk] INFO: Found listing with ID: YH62%20JFG
2026-03-28 14:05:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YH62%2520JFG%27 HTTP/1.1" 200 None
2026-03-28 14:05:35 [bca.uk] INFO: Scrape type for YH62%20JFG: 0
2026-03-28 14:05:35 [bca.uk] INFO: Found listing with ID: YC13%20HCU
2026-03-28 14:05:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YC13%2520HCU%27 HTTP/1.1" 200 None
2026-03-28 14:05:35 [bca.uk] INFO: Scrape type for YC13%20HCU: 0
2026-03-28 14:05:35 [bca.uk] INFO: Found listing with ID: YG63%20XGU
2026-03-28 14:05:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YG63%2520XGU%27 HTTP/1.1" 200 None
2026-03-28 14:05:35 [bca.uk] INFO: Scrape type for YG63%20XGU: 0
2026-03-28 14:05:35 [bca.uk] INFO: Found listing with ID: YG64%20YTB
2026-03-28 14:05:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YG64%2520YTB%27 HTTP/1.1" 200 None
2026-03-28 14:05:35 [bca.uk] INFO: Scrape type for YG64%20YTB: 0
2026-03-28 14:05:35 [bca.uk] INFO: Found listing with ID: EF13%20OTV
2026-03-28 14:05:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27EF13%2520OTV%27 HTTP/1.1" 200 None
2026-03-28 14:05:35 [bca.uk] INFO: Scrape type for EF13%20OTV: 0
2026-03-28 14:05:35 [bca.uk] INFO: Found listing with ID: FJ15%20XZU
2026-03-28 14:05:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FJ15%2520XZU%27 HTTP/1.1" 200 None
2026-03-28 14:05:35 [bca.uk] INFO: Scrape type for FJ15%20XZU: 0
2026-03-28 14:05:35 [bca.uk] INFO: Found listing with ID: GF62%20UBR
2026-03-28 14:05:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GF62%2520UBR%27 HTTP/1.1" 200 None
2026-03-28 14:05:36 [bca.uk] INFO: Scrape type for GF62%20UBR: 0
2026-03-28 14:05:36 [bca.uk] INFO: Found listing with ID: HV62%20WPN
2026-03-28 14:05:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27HV62%2520WPN%27 HTTP/1.1" 200 None
2026-03-28 14:05:36 [bca.uk] INFO: Scrape type for HV62%20WPN: 2
2026-03-28 14:05:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d803d35c-629e-5593-8c51-fb16542ba0c6 with identifier: HV62%20WPN
2026-03-28 14:05:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d803d35c-629e-5593-8c51-fb16542ba0c6 with scrape type 2
2026-03-28 14:05:36 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d803d35c-629e-5593-8c51-fb16542ba0c6 with scrape type 2
2026-03-28 14:05:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: d803d35c-629e-5593-8c51-fb16542ba0c6, identifier: HV62%20WPN
2026-03-28 14:05:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:05:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a30e8f950>
2026-03-28 14:05:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:05:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:05:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:05:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e5b1ecb7-cfa8-5758-b32f-ed9093a37d21/e5b1ecb7-cfa8-5758-b32f-ed9093a37d21_expert_report_file_c4eb7c7e-a963-4451-b3f5-dd2c1dc491ea.pdf HTTP/1.1" 201 0
2026-03-28 14:05:36 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item e5b1ecb7-cfa8-5758-b32f-ed9093a37d21
2026-03-28 14:05:36 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: e5b1ecb7-cfa8-5758-b32f-ed9093a37d21, skipping ID generation
2026-03-28 14:05:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item e5b1ecb7-cfa8-5758-b32f-ed9093a37d21
2026-03-28 14:05:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DBU67HNA-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-28 14:05:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=BU67HNA-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-28 14:05:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:05:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a1fe87290>
2026-03-28 14:05:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:05:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:05:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:05:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_64e95b6e-a78f-537e-8c08-58f1a7f0a9cb/64e95b6e-a78f-537e-8c08-58f1a7f0a9cb_expert_report_file_77fc66f9-d63e-4972-8cf9-03fe5dabcbc8.pdf HTTP/1.1" 201 0
2026-03-28 14:05:36 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item 64e95b6e-a78f-537e-8c08-58f1a7f0a9cb
2026-03-28 14:05:36 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 64e95b6e-a78f-537e-8c08-58f1a7f0a9cb, skipping ID generation
2026-03-28 14:05:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 64e95b6e-a78f-537e-8c08-58f1a7f0a9cb
2026-03-28 14:05:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DLD57FXL-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-28 14:05:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=LD57FXL-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-28 14:05:36 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:05:36 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:05:36 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:05:36 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:05:36 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:05:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:05:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a3011f0d0>
2026-03-28 14:05:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:05:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:05:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:05:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a6b7695a-3dc3-56dd-a07d-29432fe9fa43/a6b7695a-3dc3-56dd-a07d-29432fe9fa43_image_8.jpg HTTP/1.1" 201 0
2026-03-28 14:05:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FYD64WJN%252F697180911%252F600') HTTP/1.1" 204 0
2026-03-28 14:05:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YD64WJN/697180911/600 saved to cache
2026-03-28 14:05:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item a6b7695a-3dc3-56dd-a07d-29432fe9fa43
2026-03-28 14:05:36 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:05:36 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:05:36 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:05:36 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:05:36 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:05:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:05:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2de02050>
2026-03-28 14:05:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:05:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:05:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:05:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1a399624-5154-54f6-ad94-51c45341542d/1a399624-5154-54f6-ad94-51c45341542d_image_8.jpg HTTP/1.1" 201 0
2026-03-28 14:05:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FNK64UTR%252F698814227%252F600') HTTP/1.1" 204 0
2026-03-28 14:05:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NK64UTR/698814227/600 saved to cache
2026-03-28 14:05:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 1a399624-5154-54f6-ad94-51c45341542d
2026-03-28 14:05:36 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:05:36 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:05:36 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:05:36 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:05:36 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:05:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:05:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c9e4190>
2026-03-28 14:05:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:05:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:05:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:05:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_96df00f7-d862-5338-b935-5c42d63b82c0/96df00f7-d862-5338-b935-5c42d63b82c0_image_6.jpg HTTP/1.1" 201 0
2026-03-28 14:05:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FAK67LWT%252F698947215%252F600') HTTP/1.1" 204 0
2026-03-28 14:05:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AK67LWT/698947215/600 saved to cache
2026-03-28 14:05:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 96df00f7-d862-5338-b935-5c42d63b82c0
2026-03-28 14:05:36 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:05:36 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:05:36 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:05:36 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:05:36 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:05:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:05:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c12ed90>
2026-03-28 14:05:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:05:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:05:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:05:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_243a05a7-7cda-5444-ab1c-5fdc014fa410/243a05a7-7cda-5444-ab1c-5fdc014fa410_image_6.jpg HTTP/1.1" 201 0
2026-03-28 14:05:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FYB63ZKP%252F698284382%252F600') HTTP/1.1" 204 0
2026-03-28 14:05:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YB63ZKP/698284382/600 saved to cache
2026-03-28 14:05:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 243a05a7-7cda-5444-ab1c-5fdc014fa410
2026-03-28 14:05:36 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HY65KRJ/698920390/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698920390>
2026-03-28 14:05:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: d803d35c-629e-5593-8c51-fb16542ba0c6 with identifier: HV62%20WPN
2026-03-28 14:05:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: d803d35c-629e-5593-8c51-fb16542ba0c6 with identifier: HV62%20WPN
2026-03-28 14:05:36 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: d803d35c-629e-5593-8c51-fb16542ba0c6 with identifier: HV62%20WPN to the API
2026-03-28 14:05:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:05:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:05:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=11&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 113,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=HV62%20WPN-GB',
'category': 'Car',
'color': 'white',
'currency': 'GBP',
'doors_number': 3,
'engine': '1.2L',
'expiration_date': '2026-03-29T10:00:00Z',
'fuel_type': 'Petrol',
'id': 'd803d35c-629e-5593-8c51-fb16542ba0c6',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'HV62 WPN',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=HV62%20WPN&vehicleType=*',
'listing': 'auction',
'location': 'Brighouse',
'make': 'FIAT',
'model': '500',
'odometer': 92049,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2012-01-01',
'seller_name': None,
'title': 'FIAT 500 1.2 POP S/S Hatchback',
'transmission': 'manual',
'trim': 'POP S/S',
'vin': 'ZFA31200000903255',
'year': 2012}
2026-03-28 14:05:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27HV62%2520WPN%27 HTTP/1.1" 200 None
2026-03-28 14:05:36 [bca.uk] INFO: Saving data for HV62%20WPN: {'auction_closing_time': 1774778400.0, 'created_time': 1774017208.823869, 'last_price_update_time': 1774706736.934823}
2026-03-28 14:05:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='HV62%2520WPN') HTTP/1.1" 204 0
2026-03-28 14:05:37 [bca.uk] INFO: Found listing with ID: MT61%20NXP
2026-03-28 14:05:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MT61%2520NXP%27 HTTP/1.1" 200 None
2026-03-28 14:05:37 [bca.uk] INFO: Scrape type for MT61%20NXP: 0
2026-03-28 14:05:37 [bca.uk] INFO: Found listing with ID: PK58%20XAE
2026-03-28 14:05:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27PK58%2520XAE%27 HTTP/1.1" 200 None
2026-03-28 14:05:37 [bca.uk] INFO: Scrape type for PK58%20XAE: 0
2026-03-28 14:05:37 [bca.uk] INFO: Found listing with ID: SL12%20MFA
2026-03-28 14:05:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SL12%2520MFA%27 HTTP/1.1" 200 None
2026-03-28 14:05:37 [bca.uk] INFO: Scrape type for SL12%20MFA: 0
2026-03-28 14:05:37 [bca.uk] INFO: Found listing with ID: WN60%20THG
2026-03-28 14:05:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WN60%2520THG%27 HTTP/1.1" 200 None
2026-03-28 14:05:37 [bca.uk] INFO: Scrape type for WN60%20THG: 0
2026-03-28 14:05:37 [bca.uk] INFO: Found listing with ID: AO60%20TNJ
2026-03-28 14:05:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27AO60%2520TNJ%27 HTTP/1.1" 200 None
2026-03-28 14:05:37 [bca.uk] INFO: Scrape type for AO60%20TNJ: 0
2026-03-28 14:05:37 [bca.uk] INFO: Found listing with ID: CE12%20XPW
2026-03-28 14:05:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27CE12%2520XPW%27 HTTP/1.1" 200 None
2026-03-28 14:05:37 [bca.uk] INFO: Scrape type for CE12%20XPW: 0
2026-03-28 14:05:37 [bca.uk] INFO: Found listing with ID: DS62%20KGV
2026-03-28 14:05:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DS62%2520KGV%27 HTTP/1.1" 200 None
2026-03-28 14:05:37 [bca.uk] INFO: Scrape type for DS62%20KGV: 0
2026-03-28 14:05:37 [bca.uk] INFO: Found listing with ID: RV57%20WUJ
2026-03-28 14:05:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27RV57%2520WUJ%27 HTTP/1.1" 200 None
2026-03-28 14:05:37 [bca.uk] INFO: Scrape type for RV57%20WUJ: 0
2026-03-28 14:05:37 [bca.uk] INFO: Found listing with ID: SV59%20YZL
2026-03-28 14:05:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SV59%2520YZL%27 HTTP/1.1" 200 None
2026-03-28 14:05:37 [bca.uk] INFO: Scrape type for SV59%20YZL: 2
2026-03-28 14:05:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 09dee0d8-0269-5c37-bcc5-2b8f4abaf71e with identifier: SV59%20YZL
2026-03-28 14:05:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 09dee0d8-0269-5c37-bcc5-2b8f4abaf71e with scrape type 2
2026-03-28 14:05:37 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 09dee0d8-0269-5c37-bcc5-2b8f4abaf71e with scrape type 2
2026-03-28 14:05:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 09dee0d8-0269-5c37-bcc5-2b8f4abaf71e, identifier: SV59%20YZL
2026-03-28 14:05:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698729606%27 HTTP/1.1" 200 None
2026-03-28 14:05:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698729606 not downloaded yet
2026-03-28 14:05:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698933908%27 HTTP/1.1" 200 None
2026-03-28 14:05:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698933908 not downloaded yet
2026-03-28 14:05:37 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:05:37 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:05:37 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:05:37 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:05:37 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:05:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:05:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c74af10>
2026-03-28 14:05:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:05:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:05:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:05:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fe123a59-25d0-509d-9046-e45117da9996/fe123a59-25d0-509d-9046-e45117da9996_image_6.jpg HTTP/1.1" 201 0
2026-03-28 14:05:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FHY65KRJ%252F698920398%252F600') HTTP/1.1" 204 0
2026-03-28 14:05:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HY65KRJ/698920398/600 saved to cache
2026-03-28 14:05:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item fe123a59-25d0-509d-9046-e45117da9996
2026-03-28 14:05:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PXZ1595/698814161/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/PXZ1595/42808016?sv=2020-08-04&st=2026-03-28T14%3A04%3A01Z&se=2026-03-28T14%3A29%3A01Z&sr=b&sp=r&sig=xu3OmTnGiQ74jDpi5YWrXOjZvBn7hDxoXdoCW9aef04%3D)
2026-03-28 14:05:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BT66DFX/698129708/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/BT66DFX/42810013?sv=2020-08-04&st=2026-03-28T14%3A04%3A00Z&se=2026-03-28T14%3A29%3A00Z&sr=b&sp=r&sig=Yx0iLoKJXBk4DPNXOVJLOrRp66ZUz648vIo6BTtbrJ0%3D)
2026-03-28 14:05:37 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YD64WJN/697180844/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=697180844>
2026-03-28 14:05:37 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NK64UTR/698814175/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698814175>
2026-03-28 14:05:37 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LJ24UKC/42810350?sv=2020-08-04&st=2026-03-28T14%3A05%3A36Z&se=2026-03-28T14%3A30%3A36Z&sr=b&sp=r&sig=cuxyo0kEMI6Rf8WOKAH0rgALMpgPmn%2FBYgPsLsWZGdY%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=LJ24%20UKC-GB>
2026-03-28 14:05:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 09dee0d8-0269-5c37-bcc5-2b8f4abaf71e with identifier: SV59%20YZL
2026-03-28 14:05:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 09dee0d8-0269-5c37-bcc5-2b8f4abaf71e with identifier: SV59%20YZL
2026-03-28 14:05:37 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 09dee0d8-0269-5c37-bcc5-2b8f4abaf71e with identifier: SV59%20YZL to the API
2026-03-28 14:05:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:05:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:05:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=11&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 159,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=SV59%20YZL-GB',
'category': 'Car',
'color': 'red',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.6L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol',
'id': '09dee0d8-0269-5c37-bcc5-2b8f4abaf71e',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'SV59 YZL',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=SV59%20YZL&vehicleType=*',
'listing': 'auction',
'location': 'Blackbushe',
'make': 'NISSAN',
'model': 'NOTE',
'odometer': 118033,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2009-01-01',
'seller_name': None,
'title': 'NISSAN NOTE 1.6 N-TEC Hatchback',
'transmission': 'automatic',
'trim': 'N-TEC',
'vin': 'SJNFCAE11U2038090',
'year': 2009}
2026-03-28 14:05:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SV59%2520YZL%27 HTTP/1.1" 200 None
2026-03-28 14:05:38 [bca.uk] INFO: Saving data for SV59%20YZL: {'auction_closing_time': 1774864800.0, 'created_time': 1774365172.690892, 'last_price_update_time': 1774706738.333945}
2026-03-28 14:05:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='SV59%2520YZL') HTTP/1.1" 204 0
2026-03-28 14:05:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LD06WNS/42809781?sv=2020-08-04&st=2026-03-28T14%3A05%3A31Z&se=2026-03-28T14%3A30%3A31Z&sr=b&sp=r&sig=OTvnKFmvSmD2QJ4F%2F503KbBKEXfjVzDNMqEsXfGzuJ0%3D> (referer: https://www.bca.co.uk/)
2026-03-28 14:05:38 [bca.uk] INFO: Found listing with ID: W22%20JED
2026-03-28 14:05:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27W22%2520JED%27 HTTP/1.1" 200 None
2026-03-28 14:05:38 [bca.uk] INFO: Scrape type for W22%20JED: 2
2026-03-28 14:05:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2e4677b3-6ce4-521e-b68e-e0326a1d7c9c with identifier: W22%20JED
2026-03-28 14:05:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2e4677b3-6ce4-521e-b68e-e0326a1d7c9c with scrape type 2
2026-03-28 14:05:38 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2e4677b3-6ce4-521e-b68e-e0326a1d7c9c with scrape type 2
2026-03-28 14:05:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 2e4677b3-6ce4-521e-b68e-e0326a1d7c9c, identifier: W22%20JED
2026-03-28 14:05:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698729626%27 HTTP/1.1" 200 None
2026-03-28 14:05:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698729626 not downloaded yet
2026-03-28 14:05:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698933925%27 HTTP/1.1" 200 None
2026-03-28 14:05:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698933925 not downloaded yet
2026-03-28 14:05:38 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YB63ZKP/698284372/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698284372>
2026-03-28 14:05:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 2e4677b3-6ce4-521e-b68e-e0326a1d7c9c with identifier: W22%20JED
2026-03-28 14:05:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 2e4677b3-6ce4-521e-b68e-e0326a1d7c9c with identifier: W22%20JED
2026-03-28 14:05:38 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 2e4677b3-6ce4-521e-b68e-e0326a1d7c9c with identifier: W22%20JED to the API
2026-03-28 14:05:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:05:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:05:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=11&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 164,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=W22%20JED-GB',
'category': 'Car',
'color': 'blue',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.5L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol',
'id': '2e4677b3-6ce4-521e-b68e-e0326a1d7c9c',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'W22 JED',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=W22%20JED&vehicleType=*',
'listing': 'auction',
'location': 'Blackbushe',
'make': 'MERCEDES-BENZ',
'model': 'A160',
'odometer': 67656,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2011-01-01',
'seller_name': None,
'title': 'MERCEDES-BENZ A160 1.5 AVANTGARDE SE Hatchback',
'transmission': 'automatic',
'trim': 'AVANTGARDE SE',
'vin': 'WDD1690312J961414',
'year': 2011}
2026-03-28 14:05:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27W22%2520JED%27 HTTP/1.1" 200 None
2026-03-28 14:05:38 [bca.uk] INFO: Saving data for W22%20JED: {'auction_closing_time': 1774864800.0, 'created_time': 1774364887.439654, 'last_price_update_time': 1774706738.876842}
2026-03-28 14:05:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='W22%2520JED') HTTP/1.1" 204 0
2026-03-28 14:05:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/SA60NYT/42810538?sv=2020-08-04&st=2026-03-28T14%3A05%3A31Z&se=2026-03-28T14%3A30%3A31Z&sr=b&sp=r&sig=E2aZntMhZA%2B%2F8gu6iOIeQUHtNbnCVBf4tuK50ckRu0U%3D> (referer: https://www.bca.co.uk/)
2026-03-28 14:05:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WJ58DWA/697410338/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/WJ58DWA/42809994?sv=2020-08-04&st=2026-03-28T14%3A04%3A01Z&se=2026-03-28T14%3A29%3A01Z&sr=b&sp=r&sig=WelJkUnZ%2FryduuiTM2iL%2FzPRBftp3wpY3FkYWG%2FP0gk%3D)
2026-03-28 14:05:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YD64WJN/697180879/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YD64WJN/42809986?sv=2020-08-04&st=2026-03-28T14%3A03%3A59Z&se=2026-03-28T14%3A28%3A59Z&sr=b&sp=r&sig=5rsKGf%2F78vqwWJXVPXpM1R60yxRlhwBt0pb8A02KPMk%3D)
2026-03-28 14:05:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AK67LWT/698947195/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/AK67LWT/42810366?sv=2020-08-04&st=2026-03-28T14%3A04%3A00Z&se=2026-03-28T14%3A29%3A00Z&sr=b&sp=r&sig=dnN3%2FeKHnzQfSMnyGaraMReo6SkHH2Dy4nbY3zUESfI%3D)
2026-03-28 14:05:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YB63ZKP/698284376/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YB63ZKP/42797877?sv=2020-08-04&st=2026-03-28T14%3A04%3A00Z&se=2026-03-28T14%3A29%3A00Z&sr=b&sp=r&sig=86nclI4iCmgLh3evtZ%2BtpNUit8HkmrBcUBeJLBRYtzg%3D)
2026-03-28 14:05:38 [bca.uk] INFO: Found listing with ID: YR63%20WBM
2026-03-28 14:05:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YR63%2520WBM%27 HTTP/1.1" 200 None
2026-03-28 14:05:38 [bca.uk] INFO: Scrape type for YR63%20WBM: 0
2026-03-28 14:05:38 [bca.uk] INFO: Found listing with ID: GN63%20YUK
2026-03-28 14:05:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GN63%2520YUK%27 HTTP/1.1" 200 None
2026-03-28 14:05:38 [bca.uk] INFO: Scrape type for GN63%20YUK: 0
2026-03-28 14:05:38 [bca.uk] INFO: Found listing with ID: H9%20HBE
2026-03-28 14:05:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27H9%2520HBE%27 HTTP/1.1" 200 None
2026-03-28 14:05:38 [bca.uk] INFO: Scrape type for H9%20HBE: 0
2026-03-28 14:05:38 [bca.uk] INFO: Found listing with ID: HF13%20ONH
2026-03-28 14:05:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27HF13%2520ONH%27 HTTP/1.1" 200 None
2026-03-28 14:05:38 [bca.uk] INFO: Scrape type for HF13%20ONH: 0
2026-03-28 14:05:38 [bca.uk] INFO: Found listing with ID: KJ02%20AAA
2026-03-28 14:05:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KJ02%2520AAA%27 HTTP/1.1" 200 None
2026-03-28 14:05:38 [bca.uk] INFO: Scrape type for KJ02%20AAA: 0
2026-03-28 14:05:38 [bca.uk] INFO: Found listing with ID: KU07%20ERA
2026-03-28 14:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KU07%2520ERA%27 HTTP/1.1" 200 None
2026-03-28 14:05:39 [bca.uk] INFO: Scrape type for KU07%20ERA: 2
2026-03-28 14:05:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6c14d4f7-c4a8-5c0d-b2f6-3586c019b6fe with identifier: KU07%20ERA
2026-03-28 14:05:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6c14d4f7-c4a8-5c0d-b2f6-3586c019b6fe with scrape type 2
2026-03-28 14:05:39 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6c14d4f7-c4a8-5c0d-b2f6-3586c019b6fe with scrape type 2
2026-03-28 14:05:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 6c14d4f7-c4a8-5c0d-b2f6-3586c019b6fe, identifier: KU07%20ERA
2026-03-28 14:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698729644%27 HTTP/1.1" 200 None
2026-03-28 14:05:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698729644 not downloaded yet
2026-03-28 14:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698933934%27 HTTP/1.1" 200 None
2026-03-28 14:05:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698933934 not downloaded yet
2026-03-28 14:05:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NK64UTR/698814200/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/NK64UTR/42807827?sv=2020-08-04&st=2026-03-28T14%3A04%3A00Z&se=2026-03-28T14%3A29%3A00Z&sr=b&sp=r&sig=B2djBTwUnOYzqxtI8e7WJD2j2cACy9SjmoGLE3oN2SE%3D)
2026-03-28 14:05:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 6c14d4f7-c4a8-5c0d-b2f6-3586c019b6fe with identifier: KU07%20ERA
2026-03-28 14:05:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 6c14d4f7-c4a8-5c0d-b2f6-3586c019b6fe with identifier: KU07%20ERA
2026-03-28 14:05:39 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 6c14d4f7-c4a8-5c0d-b2f6-3586c019b6fe with identifier: KU07%20ERA to the API
2026-03-28 14:05:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:05:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:05:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=11&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 193,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=KU07%20ERA-GB',
'category': 'Car',
'color': 'silver',
'currency': 'GBP',
'doors_number': 4,
'engine': '1.8L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol',
'id': '6c14d4f7-c4a8-5c0d-b2f6-3586c019b6fe',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'KU07 ERA',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=KU07%20ERA&vehicleType=*',
'listing': 'auction',
'location': 'Blackbushe',
'make': 'MERCEDES-BENZ',
'model': 'C180',
'odometer': 85119,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2007-01-01',
'seller_name': None,
'title': 'MERCEDES-BENZ C180 1.8 K CLASSIC SE Saloon',
'transmission': 'manual',
'trim': 'K CLASSIC SE',
'vin': 'WDC2030462R258069',
'year': 2007}
2026-03-28 14:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KU07%2520ERA%27 HTTP/1.1" 200 None
2026-03-28 14:05:39 [bca.uk] INFO: Saving data for KU07%20ERA: {'auction_closing_time': 1774864800.0, 'created_time': 1774523262.330617, 'last_price_update_time': 1774706739.533038}
2026-03-28 14:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='KU07%2520ERA') HTTP/1.1" 204 0
2026-03-28 14:05:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HY65KRJ/698920390/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/HY65KRJ/42809575?sv=2020-08-04&st=2026-03-28T14%3A03%3A59Z&se=2026-03-28T14%3A28%3A59Z&sr=b&sp=r&sig=qQyrthkWradfVt2c0sIhPBRny5qzj5uOjQmOciVVoMo%3D)
2026-03-28 14:05:39 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HY65KRJ/698920388/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698920388>
2026-03-28 14:05:39 [bca.uk] INFO: Found listing with ID: LT58%20VMH
2026-03-28 14:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LT58%2520VMH%27 HTTP/1.1" 200 None
2026-03-28 14:05:39 [bca.uk] INFO: Scrape type for LT58%20VMH: 0
2026-03-28 14:05:39 [bca.uk] INFO: Found listing with ID: LV10%20NJJ
2026-03-28 14:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LV10%2520NJJ%27 HTTP/1.1" 200 None
2026-03-28 14:05:39 [bca.uk] INFO: Scrape type for LV10%20NJJ: 2
2026-03-28 14:05:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5428cfab-56f8-5427-bc71-831e6db8ed3d with identifier: LV10%20NJJ
2026-03-28 14:05:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5428cfab-56f8-5427-bc71-831e6db8ed3d with scrape type 2
2026-03-28 14:05:39 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5428cfab-56f8-5427-bc71-831e6db8ed3d with scrape type 2
2026-03-28 14:05:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 5428cfab-56f8-5427-bc71-831e6db8ed3d, identifier: LV10%20NJJ
2026-03-28 14:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698729656%27 HTTP/1.1" 200 None
2026-03-28 14:05:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698729656 not downloaded yet
2026-03-28 14:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698933945%27 HTTP/1.1" 200 None
2026-03-28 14:05:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698933945 not downloaded yet
2026-03-28 14:05:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:05:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c5e1710>
2026-03-28 14:05:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:05:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:05:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:05:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8f3e30a4-6b64-5dd1-8e1e-6cce5d49fef3/8f3e30a4-6b64-5dd1-8e1e-6cce5d49fef3_image_4.jpg HTTP/1.1" 201 0
2026-03-28 14:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FPXZ1595%252F698814161%252F600') HTTP/1.1" 204 0
2026-03-28 14:05:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PXZ1595/698814161/600 saved to cache
2026-03-28 14:05:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 8f3e30a4-6b64-5dd1-8e1e-6cce5d49fef3
2026-03-28 14:05:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:05:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c19d1d0>
2026-03-28 14:05:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:05:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:05:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:05:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ca2c3006-0503-55ad-a26d-88f328a541b5/ca2c3006-0503-55ad-a26d-88f328a541b5_image_4.jpg HTTP/1.1" 201 0
2026-03-28 14:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FBT66DFX%252F698129708%252F600') HTTP/1.1" 204 0
2026-03-28 14:05:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BT66DFX/698129708/600 saved to cache
2026-03-28 14:05:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item ca2c3006-0503-55ad-a26d-88f328a541b5
2026-03-28 14:05:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:05:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2d7804d0>
2026-03-28 14:05:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:05:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:05:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:05:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bbfa1477-6876-5cb3-8bcc-b863e9aae5b2/bbfa1477-6876-5cb3-8bcc-b863e9aae5b2_expert_report_file_1d6e59ed-5669-401d-b2c4-e18cb42c7602.pdf HTTP/1.1" 201 0
2026-03-28 14:05:39 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item bbfa1477-6876-5cb3-8bcc-b863e9aae5b2
2026-03-28 14:05:39 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: bbfa1477-6876-5cb3-8bcc-b863e9aae5b2, skipping ID generation
2026-03-28 14:05:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 9 photos for item bbfa1477-6876-5cb3-8bcc-b863e9aae5b2
2026-03-28 14:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DLD06WNS-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-28 14:05:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=LD06WNS-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-28 14:05:40 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LD57FXL/698933900/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=LD57FXL-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-28 14:05:40 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BU67HNA/698729591/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=BU67HNA-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-28 14:05:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 5428cfab-56f8-5427-bc71-831e6db8ed3d with identifier: LV10%20NJJ
2026-03-28 14:05:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 5428cfab-56f8-5427-bc71-831e6db8ed3d with identifier: LV10%20NJJ
2026-03-28 14:05:40 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 5428cfab-56f8-5427-bc71-831e6db8ed3d with identifier: LV10%20NJJ to the API
2026-03-28 14:05:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:05:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:05:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=11&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 249,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=LV10%20NJJ-GB',
'category': 'Car',
'color': 'silver',
'currency': 'GBP',
'doors_number': 4,
'engine': '3.0L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol',
'id': '5428cfab-56f8-5427-bc71-831e6db8ed3d',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'LV10 NJJ',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=LV10%20NJJ&vehicleType=*',
'listing': 'auction',
'location': 'Blackbushe',
'make': 'JAGUAR',
'model': 'XF',
'odometer': 73963,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2010-01-01',
'seller_name': None,
'title': 'JAGUAR XF 3.0 V6 LUXURY Saloon',
'transmission': 'automatic',
'trim': 'V6 LUXURY',
'vin': 'SAJAC05H2AFR75156',
'year': 2010}
2026-03-28 14:05:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LV10%2520NJJ%27 HTTP/1.1" 200 None
2026-03-28 14:05:40 [bca.uk] INFO: Saving data for LV10%20NJJ: {'auction_closing_time': 1774864800.0, 'created_time': 1774523263.53808, 'last_price_update_time': 1774706740.3636}
2026-03-28 14:05:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='LV10%2520NJJ') HTTP/1.1" 204 0
2026-03-28 14:05:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YD64WJN/697180844/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YD64WJN/42809986?sv=2020-08-04&st=2026-03-28T14%3A03%3A59Z&se=2026-03-28T14%3A28%3A59Z&sr=b&sp=r&sig=5rsKGf%2F78vqwWJXVPXpM1R60yxRlhwBt0pb8A02KPMk%3D)
2026-03-28 14:05:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NK64UTR/698814175/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/NK64UTR/42807827?sv=2020-08-04&st=2026-03-28T14%3A04%3A00Z&se=2026-03-28T14%3A29%3A00Z&sr=b&sp=r&sig=B2djBTwUnOYzqxtI8e7WJD2j2cACy9SjmoGLE3oN2SE%3D)
2026-03-28 14:05:40 [bca.uk] INFO: Found listing with ID: MC53%20GXE
2026-03-28 14:05:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MC53%2520GXE%27 HTTP/1.1" 200 None
2026-03-28 14:05:40 [bca.uk] INFO: Scrape type for MC53%20GXE: 0
2026-03-28 14:05:40 [bca.uk] INFO: Found listing with ID: P60%20NPR
2026-03-28 14:05:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27P60%2520NPR%27 HTTP/1.1" 200 None
2026-03-28 14:05:40 [bca.uk] INFO: Scrape type for P60%20NPR: 2
2026-03-28 14:05:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c2c1cd4e-d2b4-5600-8583-1ef1a77f0132 with identifier: P60%20NPR
2026-03-28 14:05:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c2c1cd4e-d2b4-5600-8583-1ef1a77f0132 with scrape type 2
2026-03-28 14:05:40 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c2c1cd4e-d2b4-5600-8583-1ef1a77f0132 with scrape type 2
2026-03-28 14:05:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: c2c1cd4e-d2b4-5600-8583-1ef1a77f0132, identifier: P60%20NPR
2026-03-28 14:05:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698729674%27 HTTP/1.1" 200 None
2026-03-28 14:05:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698729674 not downloaded yet
2026-03-28 14:05:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698933964%27 HTTP/1.1" 200 None
2026-03-28 14:05:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698933964 not downloaded yet
2026-03-28 14:05:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698920811%27 HTTP/1.1" 200 None
2026-03-28 14:05:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698920811 not downloaded yet
2026-03-28 14:05:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:05:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c8b6e50>
2026-03-28 14:05:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:05:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:05:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:05:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_389368a0-4349-5257-9e72-f8c2c2fc01c4/389368a0-4349-5257-9e72-f8c2c2fc01c4_expert_report_file_a373ca16-f136-4d11-929a-89565f1acd47.pdf HTTP/1.1" 201 0
2026-03-28 14:05:40 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item 389368a0-4349-5257-9e72-f8c2c2fc01c4
2026-03-28 14:05:40 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 389368a0-4349-5257-9e72-f8c2c2fc01c4, skipping ID generation
2026-03-28 14:05:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 389368a0-4349-5257-9e72-f8c2c2fc01c4
2026-03-28 14:05:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DSA60NYT-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-28 14:05:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=SA60NYT-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-28 14:05:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:05:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2d9f3010>
2026-03-28 14:05:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:05:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:05:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:05:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8413221f-7948-5093-9030-c87150f157c7/8413221f-7948-5093-9030-c87150f157c7_image_2.jpg HTTP/1.1" 201 0
2026-03-28 14:05:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FWJ58DWA%252F697410338%252F600') HTTP/1.1" 204 0
2026-03-28 14:05:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WJ58DWA/697410338/600 saved to cache
2026-03-28 14:05:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 8413221f-7948-5093-9030-c87150f157c7
2026-03-28 14:05:40 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 8413221f-7948-5093-9030-c87150f157c7, skipping ID generation
2026-03-28 14:05:40 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 8413221f-7948-5093-9030-c87150f157c7 sending to next pipeline
2026-03-28 14:05:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 8413221f-7948-5093-9030-c87150f157c7, identifier: WJ58%20DWA
2026-03-28 14:05:40 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:05:40 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:05:40 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:05:40 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:05:40 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:05:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:05:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2d781390>
2026-03-28 14:05:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:05:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:05:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:05:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a6b7695a-3dc3-56dd-a07d-29432fe9fa43/a6b7695a-3dc3-56dd-a07d-29432fe9fa43_image_7.jpg HTTP/1.1" 201 0
2026-03-28 14:05:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FYD64WJN%252F697180879%252F600') HTTP/1.1" 204 0
2026-03-28 14:05:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YD64WJN/697180879/600 saved to cache
2026-03-28 14:05:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item a6b7695a-3dc3-56dd-a07d-29432fe9fa43
2026-03-28 14:05:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:05:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c9977d0>
2026-03-28 14:05:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:05:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:05:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:05:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_96df00f7-d862-5338-b935-5c42d63b82c0/96df00f7-d862-5338-b935-5c42d63b82c0_image_5.jpg HTTP/1.1" 201 0
2026-03-28 14:05:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FAK67LWT%252F698947195%252F600') HTTP/1.1" 204 0
2026-03-28 14:05:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AK67LWT/698947195/600 saved to cache
2026-03-28 14:05:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 96df00f7-d862-5338-b935-5c42d63b82c0
2026-03-28 14:05:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:05:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c76dad0>
2026-03-28 14:05:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:05:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:05:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:05:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_243a05a7-7cda-5444-ab1c-5fdc014fa410/243a05a7-7cda-5444-ab1c-5fdc014fa410_image_5.jpg HTTP/1.1" 201 0
2026-03-28 14:05:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FYB63ZKP%252F698284376%252F600') HTTP/1.1" 204 0
2026-03-28 14:05:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YB63ZKP/698284376/600 saved to cache
2026-03-28 14:05:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 243a05a7-7cda-5444-ab1c-5fdc014fa410
2026-03-28 14:05:40 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:05:40 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:05:40 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:05:40 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:05:40 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:05:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:05:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2d9f1990>
2026-03-28 14:05:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:05:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:05:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:05:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1a399624-5154-54f6-ad94-51c45341542d/1a399624-5154-54f6-ad94-51c45341542d_image_7.jpg HTTP/1.1" 201 0
2026-03-28 14:05:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FNK64UTR%252F698814200%252F600') HTTP/1.1" 204 0
2026-03-28 14:05:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NK64UTR/698814200/600 saved to cache
2026-03-28 14:05:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 1a399624-5154-54f6-ad94-51c45341542d
2026-03-28 14:05:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YB63ZKP/698284372/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YB63ZKP/42797877?sv=2020-08-04&st=2026-03-28T14%3A04%3A00Z&se=2026-03-28T14%3A29%3A00Z&sr=b&sp=r&sig=86nclI4iCmgLh3evtZ%2BtpNUit8HkmrBcUBeJLBRYtzg%3D)
2026-03-28 14:05:40 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LD57FXL/698933908/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698933908>
2026-03-28 14:05:40 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LD57FXL/698933925/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698933925>
2026-03-28 14:05:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: c2c1cd4e-d2b4-5600-8583-1ef1a77f0132 with identifier: P60%20NPR
2026-03-28 14:05:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: c2c1cd4e-d2b4-5600-8583-1ef1a77f0132 with identifier: P60%20NPR
2026-03-28 14:05:41 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: c2c1cd4e-d2b4-5600-8583-1ef1a77f0132 with identifier: P60%20NPR to the API
2026-03-28 14:05:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:05:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:05:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=11&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 299,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=P60%20NPR-GB',
'category': 'Car',
'color': 'blue',
'currency': 'GBP',
'doors_number': 5,
'engine': '3.6L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Diesel',
'id': 'c2c1cd4e-d2b4-5600-8583-1ef1a77f0132',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'P60 NPR',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=P60%20NPR&vehicleType=*',
'listing': 'auction',
'location': 'Blackbushe',
'make': 'LAND ROVER',
'model': 'RANGE ROVER',
'odometer': 102622,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2007-01-01',
'seller_name': None,
'title': 'LAND ROVER RANGE ROVER 3.6 TDV8 VOGUE SE StationWagon',
'transmission': 'automatic',
'trim': 'TDV8 VOGUE SE',
'vin': 'SALLMAM237A257766',
'year': 2007}
2026-03-28 14:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27P60%2520NPR%27 HTTP/1.1" 200 None
2026-03-28 14:05:41 [bca.uk] INFO: Saving data for P60%20NPR: {'auction_closing_time': 1774864800.0, 'created_time': 1773909521.819016, 'last_price_update_time': 1774706741.346934}
2026-03-28 14:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='P60%2520NPR') HTTP/1.1" 204 0
2026-03-28 14:05:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 8413221f-7948-5093-9030-c87150f157c7 with identifier: WJ58%20DWA
2026-03-28 14:05:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 8413221f-7948-5093-9030-c87150f157c7 with identifier: WJ58%20DWA
2026-03-28 14:05:41 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 8413221f-7948-5093-9030-c87150f157c7 with identifier: WJ58%20DWA to the API
2026-03-28 14:05:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:05:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:05:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WJ58DWA/697410338/600>
{'auction_title': '',
'c_o_2_emission_value': 200,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8413221f-7948-5093-9030-c87150f157c7/8413221f-7948-5093-9030-c87150f157c7_expert_report_file_a4b1ba2b-35cb-49a4-bc22-ba4907b39e06.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=WJ58%20DWA-GB',
'category': 'Car',
'color': 'silver',
'currency': 'GBP',
'doors_number': 4,
'engine': '3.0L',
'expiration_date': '2026-03-29T10:00:00Z',
'fuel_type': 'Diesel',
'id': '8413221f-7948-5093-9030-c87150f157c7',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'WJ58 DWA',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=WJ58%20DWA&vehicleType=*',
'listing': 'auction',
'location': 'Brighouse',
'make': 'MERCEDES-BENZ',
'model': 'CLS 320',
'odometer': 132233,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 11,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8413221f-7948-5093-9030-c87150f157c7/8413221f-7948-5093-9030-c87150f157c7_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 49562,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WJ58DWA/697410325/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8413221f-7948-5093-9030-c87150f157c7/8413221f-7948-5093-9030-c87150f157c7_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 48117,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WJ58DWA/697410328/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8413221f-7948-5093-9030-c87150f157c7/8413221f-7948-5093-9030-c87150f157c7_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 45346,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WJ58DWA/697410338/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8413221f-7948-5093-9030-c87150f157c7/8413221f-7948-5093-9030-c87150f157c7_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 45341,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WJ58DWA/697410343/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8413221f-7948-5093-9030-c87150f157c7/8413221f-7948-5093-9030-c87150f157c7_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 44217,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WJ58DWA/697410348/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8413221f-7948-5093-9030-c87150f157c7/8413221f-7948-5093-9030-c87150f157c7_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 43496,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WJ58DWA/697410351/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8413221f-7948-5093-9030-c87150f157c7/8413221f-7948-5093-9030-c87150f157c7_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 81968,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WJ58DWA/697410359/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8413221f-7948-5093-9030-c87150f157c7/8413221f-7948-5093-9030-c87150f157c7_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 80672,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WJ58DWA/697410369/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8413221f-7948-5093-9030-c87150f157c7/8413221f-7948-5093-9030-c87150f157c7_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 82626,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WJ58DWA/697410373/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8413221f-7948-5093-9030-c87150f157c7/8413221f-7948-5093-9030-c87150f157c7_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 85236,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WJ58DWA/697410380/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2008-01-01',
'seller_name': None,
'title': 'MERCEDES-BENZ CLS 320 3.0 CDI TIP Coupe',
'transmission': 'manual',
'trim': 'CDI TIP',
'vin': 'WDD2193222A151112',
'year': 2008}
2026-03-28 14:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WJ58%2520DWA%27 HTTP/1.1" 200 None
2026-03-28 14:05:41 [bca.uk] INFO: Saving data for WJ58%20DWA: {'created_time': 1774706741.747321, 'last_price_update_time': 1774706741.747333, 'auction_closing_time': 1774778400.0}
2026-03-28 14:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='WJ58%2520DWA') HTTP/1.1" 204 0
2026-03-28 14:05:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LJ24UKC/42810350?sv=2020-08-04&st=2026-03-28T14%3A05%3A36Z&se=2026-03-28T14%3A30%3A36Z&sr=b&sp=r&sig=cuxyo0kEMI6Rf8WOKAH0rgALMpgPmn%2FBYgPsLsWZGdY%3D> (referer: https://www.bca.co.uk/)
2026-03-28 14:05:41 [bca.uk] INFO: Found listing with ID: AN09%20KEE
2026-03-28 14:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27AN09%2520KEE%27 HTTP/1.1" 200 None
2026-03-28 14:05:41 [bca.uk] INFO: Scrape type for AN09%20KEE: 0
2026-03-28 14:05:41 [bca.uk] INFO: Found listing with ID: BV13%20ZYW
2026-03-28 14:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BV13%2520ZYW%27 HTTP/1.1" 200 None
2026-03-28 14:05:41 [bca.uk] INFO: Scrape type for BV13%20ZYW: 2
2026-03-28 14:05:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d8999e9c-b1ab-5c71-a884-ff53f3a76e36 with identifier: BV13%20ZYW
2026-03-28 14:05:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d8999e9c-b1ab-5c71-a884-ff53f3a76e36 with scrape type 2
2026-03-28 14:05:41 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d8999e9c-b1ab-5c71-a884-ff53f3a76e36 with scrape type 2
2026-03-28 14:05:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: d8999e9c-b1ab-5c71-a884-ff53f3a76e36, identifier: BV13%20ZYW
2026-03-28 14:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698729695%27 HTTP/1.1" 200 None
2026-03-28 14:05:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698729695 not downloaded yet
2026-03-28 14:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698934001%27 HTTP/1.1" 200 None
2026-03-28 14:05:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698934001 not downloaded yet
2026-03-28 14:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698920815%27 HTTP/1.1" 200 None
2026-03-28 14:05:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698920815 not downloaded yet
2026-03-28 14:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698946982%27 HTTP/1.1" 200 None
2026-03-28 14:05:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698946982 not downloaded yet
2026-03-28 14:05:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:05:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c5d26d0>
2026-03-28 14:05:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:05:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:05:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:05:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fe123a59-25d0-509d-9046-e45117da9996/fe123a59-25d0-509d-9046-e45117da9996_image_5.jpg HTTP/1.1" 201 0
2026-03-28 14:05:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FHY65KRJ%252F698920390%252F600') HTTP/1.1" 204 0
2026-03-28 14:05:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HY65KRJ/698920390/600 saved to cache
2026-03-28 14:05:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item fe123a59-25d0-509d-9046-e45117da9996
2026-03-28 14:05:42 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PXZ1595/698814130/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698814130>
2026-03-28 14:05:42 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BU67HNA/698729626/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698729626>
2026-03-28 14:05:42 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BU67HNA/698729606/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698729606>
2026-03-28 14:05:42 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/OW69BUU/42810360?sv=2020-08-04&st=2026-03-28T14%3A05%3A41Z&se=2026-03-28T14%3A30%3A41Z&sr=b&sp=r&sig=K9lRxvrb31NcTkLXgZADadn3Empdjh1%2BI4o9SeNOjN0%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=OW69%20BUU-GB>
2026-03-28 14:05:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: d8999e9c-b1ab-5c71-a884-ff53f3a76e36 with identifier: BV13%20ZYW
2026-03-28 14:05:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: d8999e9c-b1ab-5c71-a884-ff53f3a76e36 with identifier: BV13%20ZYW
2026-03-28 14:05:42 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: d8999e9c-b1ab-5c71-a884-ff53f3a76e36 with identifier: BV13%20ZYW to the API
2026-03-28 14:05:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:05:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:05:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=11&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 199,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=BV13%20ZYW-GB',
'category': 'Car',
'color': 'white',
'currency': 'GBP',
'doors_number': 5,
'engine': '2.4L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol',
'id': 'd8999e9c-b1ab-5c71-a884-ff53f3a76e36',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'BV13 ZYW',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=BV13%20ZYW&vehicleType=*',
'listing': 'auction',
'location': 'Blackbushe',
'make': 'JEEP',
'model': 'COMPASS',
'odometer': 105383,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2013-01-01',
'seller_name': None,
'title': 'JEEP COMPASS 2.4 LIMITED 4WD StationWagon',
'transmission': 'automatic',
'trim': 'LIMITED 4WD',
'vin': '1C4NJDDB3DD122534',
'year': 2013}
2026-03-28 14:05:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BV13%2520ZYW%27 HTTP/1.1" 200 None
2026-03-28 14:05:42 [bca.uk] INFO: Saving data for BV13%20ZYW: {'auction_closing_time': 1774864800.0, 'created_time': 1774364753.866645, 'last_price_update_time': 1774706742.433136}
2026-03-28 14:05:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='BV13%2520ZYW') HTTP/1.1" 204 0
2026-03-28 14:05:42 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:05:42 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:05:42 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:05:42 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:05:42 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:05:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:05:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c9642d0>
2026-03-28 14:05:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:05:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:05:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:05:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a6b7695a-3dc3-56dd-a07d-29432fe9fa43/a6b7695a-3dc3-56dd-a07d-29432fe9fa43_image_6.jpg HTTP/1.1" 201 0
2026-03-28 14:05:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FYD64WJN%252F697180844%252F600') HTTP/1.1" 204 0
2026-03-28 14:05:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YD64WJN/697180844/600 saved to cache
2026-03-28 14:05:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item a6b7695a-3dc3-56dd-a07d-29432fe9fa43
2026-03-28 14:05:42 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:05:42 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:05:42 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:05:42 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:05:42 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:05:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:05:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c88ec10>
2026-03-28 14:05:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:05:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:05:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:05:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1a399624-5154-54f6-ad94-51c45341542d/1a399624-5154-54f6-ad94-51c45341542d_image_6.jpg HTTP/1.1" 201 0
2026-03-28 14:05:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FNK64UTR%252F698814175%252F600') HTTP/1.1" 204 0
2026-03-28 14:05:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NK64UTR/698814175/600 saved to cache
2026-03-28 14:05:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 1a399624-5154-54f6-ad94-51c45341542d
2026-03-28 14:05:42 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BU67HNA/698729644/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698729644>
2026-03-28 14:05:42 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LD57FXL/698933934/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698933934>
2026-03-28 14:05:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HY65KRJ/698920388/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/HY65KRJ/42809575?sv=2020-08-04&st=2026-03-28T14%3A03%3A59Z&se=2026-03-28T14%3A28%3A59Z&sr=b&sp=r&sig=qQyrthkWradfVt2c0sIhPBRny5qzj5uOjQmOciVVoMo%3D)
2026-03-28 14:05:42 [bca.uk] INFO: Found listing with ID: BF08%20KPJ
2026-03-28 14:05:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BF08%2520KPJ%27 HTTP/1.1" 200 None
2026-03-28 14:05:42 [bca.uk] INFO: Scrape type for BF08%20KPJ: 0
2026-03-28 14:05:42 [bca.uk] INFO: Found listing with ID: BJ07%20JAO
2026-03-28 14:05:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BJ07%2520JAO%27 HTTP/1.1" 200 None
2026-03-28 14:05:42 [bca.uk] INFO: Scrape type for BJ07%20JAO: 0
2026-03-28 14:05:42 [bca.uk] INFO: Found listing with ID: GJ58%20HSC
2026-03-28 14:05:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GJ58%2520HSC%27 HTTP/1.1" 200 None
2026-03-28 14:05:42 [bca.uk] INFO: Scrape type for GJ58%20HSC: 0
2026-03-28 14:05:42 [bca.uk] INFO: Found listing with ID: GK61%20NMX
2026-03-28 14:05:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GK61%2520NMX%27 HTTP/1.1" 200 None
2026-03-28 14:05:42 [bca.uk] INFO: Scrape type for GK61%20NMX: 0
2026-03-28 14:05:42 [bca.uk] INFO: Found listing with ID: LG08%20RMU
2026-03-28 14:05:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LG08%2520RMU%27 HTTP/1.1" 200 None
2026-03-28 14:05:42 [bca.uk] INFO: Scrape type for LG08%20RMU: 0
2026-03-28 14:05:42 [bca.uk] INFO: Found listing with ID: LL61%20ZWT
2026-03-28 14:05:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LL61%2520ZWT%27 HTTP/1.1" 200 None
2026-03-28 14:05:42 [bca.uk] INFO: Scrape type for LL61%20ZWT: 0
2026-03-28 14:05:42 [bca.uk] INFO: Found listing with ID: MF51%20EOS
2026-03-28 14:05:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MF51%2520EOS%27 HTTP/1.1" 200 None
2026-03-28 14:05:42 [bca.uk] INFO: Scrape type for MF51%20EOS: 0
2026-03-28 14:05:42 [bca.uk] INFO: Found listing with ID: VK16%20BTV
2026-03-28 14:05:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27VK16%2520BTV%27 HTTP/1.1" 200 None
2026-03-28 14:05:42 [bca.uk] INFO: Scrape type for VK16%20BTV: 0
2026-03-28 14:05:42 [bca.uk] INFO: Found listing with ID: RX18%20LZV
2026-03-28 14:05:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27RX18%2520LZV%27 HTTP/1.1" 200 None
2026-03-28 14:05:42 [bca.uk] INFO: Scrape type for RX18%20LZV: 0
2026-03-28 14:05:42 [bca.uk] INFO: Found listing with ID: GR21%20HBF
2026-03-28 14:05:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GR21%2520HBF%27 HTTP/1.1" 200 None
2026-03-28 14:05:42 [bca.uk] INFO: Scrape type for GR21%20HBF: 0
2026-03-28 14:05:42 [bca.uk] INFO: Found listing with ID: DX70%20UBS
2026-03-28 14:05:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DX70%2520UBS%27 HTTP/1.1" 200 None
2026-03-28 14:05:42 [bca.uk] INFO: Scrape type for DX70%20UBS: 0
2026-03-28 14:05:42 [bca.uk] INFO: Found listing with ID: EU19%20RWF
2026-03-28 14:05:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27EU19%2520RWF%27 HTTP/1.1" 200 None
2026-03-28 14:05:42 [bca.uk] INFO: Scrape type for EU19%20RWF: 0
2026-03-28 14:05:42 [bca.uk] INFO: Found listing with ID: FD18%20CVW
2026-03-28 14:05:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FD18%2520CVW%27 HTTP/1.1" 200 None
2026-03-28 14:05:42 [bca.uk] INFO: Scrape type for FD18%20CVW: 0
2026-03-28 14:05:42 [bca.uk] INFO: Found listing with ID: FL20%20CPY
2026-03-28 14:05:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FL20%2520CPY%27 HTTP/1.1" 200 None
2026-03-28 14:05:42 [bca.uk] INFO: Scrape type for FL20%20CPY: 0
2026-03-28 14:05:42 [bca.uk] INFO: Found listing with ID: HY06%20NAU
2026-03-28 14:05:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27HY06%2520NAU%27 HTTP/1.1" 200 None
2026-03-28 14:05:42 [bca.uk] INFO: Scrape type for HY06%20NAU: 0
2026-03-28 14:05:42 [bca.uk] INFO: Found listing with ID: LM17%20JWJ
2026-03-28 14:05:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LM17%2520JWJ%27 HTTP/1.1" 200 None
2026-03-28 14:05:42 [bca.uk] INFO: Scrape type for LM17%20JWJ: 0
2026-03-28 14:05:42 [bca.uk] INFO: Found listing with ID: LX17%20OGL
2026-03-28 14:05:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LX17%2520OGL%27 HTTP/1.1" 200 None
2026-03-28 14:05:42 [bca.uk] INFO: Scrape type for LX17%20OGL: 0
2026-03-28 14:05:42 [bca.uk] INFO: Found listing with ID: RK16%20MEU
2026-03-28 14:05:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27RK16%2520MEU%27 HTTP/1.1" 200 None
2026-03-28 14:05:42 [bca.uk] INFO: Scrape type for RK16%20MEU: 0
2026-03-28 14:05:42 [bca.uk] INFO: Found listing with ID: WL54%20NHF
2026-03-28 14:05:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WL54%2520NHF%27 HTTP/1.1" 200 None
2026-03-28 14:05:42 [bca.uk] INFO: Scrape type for WL54%20NHF: 0
2026-03-28 14:05:42 [bca.uk] INFO: Found listing with ID: WR11%20HHA
2026-03-28 14:05:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WR11%2520HHA%27 HTTP/1.1" 200 None
2026-03-28 14:05:42 [bca.uk] INFO: Scrape type for WR11%20HHA: 0
2026-03-28 14:05:42 [bca.uk] INFO: Found listing with ID: YL17%20SVO
2026-03-28 14:05:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YL17%2520SVO%27 HTTP/1.1" 200 None
2026-03-28 14:05:42 [bca.uk] INFO: Scrape type for YL17%20SVO: 0
2026-03-28 14:05:42 [bca.uk] INFO: Found listing with ID: HG09%20ZSN
2026-03-28 14:05:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27HG09%2520ZSN%27 HTTP/1.1" 200 None
2026-03-28 14:05:42 [bca.uk] INFO: Scrape type for HG09%20ZSN: 0
2026-03-28 14:05:42 [bca.uk] INFO: Found listing with ID: HV15%20LXE
2026-03-28 14:05:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27HV15%2520LXE%27 HTTP/1.1" 200 None
2026-03-28 14:05:42 [bca.uk] INFO: Scrape type for HV15%20LXE: 0
2026-03-28 14:05:42 [bca.uk] INFO: Found listing with ID: HY57%20KMG
2026-03-28 14:05:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27HY57%2520KMG%27 HTTP/1.1" 200 None
2026-03-28 14:05:42 [bca.uk] INFO: Scrape type for HY57%20KMG: 2
2026-03-28 14:05:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ab756b39-43fa-5fe7-8f31-c7670e3f9d15 with identifier: HY57%20KMG
2026-03-28 14:05:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ab756b39-43fa-5fe7-8f31-c7670e3f9d15 with scrape type 2
2026-03-28 14:05:42 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ab756b39-43fa-5fe7-8f31-c7670e3f9d15 with scrape type 2
2026-03-28 14:05:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: ab756b39-43fa-5fe7-8f31-c7670e3f9d15, identifier: HY57%20KMG
2026-03-28 14:05:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698729718%27 HTTP/1.1" 200 None
2026-03-28 14:05:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698729718 not downloaded yet
2026-03-28 14:05:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698934025%27 HTTP/1.1" 200 None
2026-03-28 14:05:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698934025 not downloaded yet
2026-03-28 14:05:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698920822%27 HTTP/1.1" 200 None
2026-03-28 14:05:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698920822 not downloaded yet
2026-03-28 14:05:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698946995%27 HTTP/1.1" 200 None
2026-03-28 14:05:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698946995 not downloaded yet
2026-03-28 14:05:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BU67HNA/698729591/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/BU67HNA/42810584?sv=2020-08-04&st=2026-03-28T14%3A05%3A27Z&se=2026-03-28T14%3A30%3A27Z&sr=b&sp=r&sig=jvqWs0bbwwPNyCuILhTmpoSOvgJ5gvo7FW1OJ3cgP4I%3D)
2026-03-28 14:05:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: ab756b39-43fa-5fe7-8f31-c7670e3f9d15 with identifier: HY57%20KMG
2026-03-28 14:05:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: ab756b39-43fa-5fe7-8f31-c7670e3f9d15 with identifier: HY57%20KMG
2026-03-28 14:05:43 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: ab756b39-43fa-5fe7-8f31-c7670e3f9d15 with identifier: HY57%20KMG to the API
2026-03-28 14:05:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:05:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:05:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=11&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 181,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=HY57%20KMG-GB',
'category': 'Car',
'color': 'black',
'currency': 'GBP',
'doors_number': 2,
'engine': '2.0L',
'expiration_date': '2026-03-29T10:00:00Z',
'fuel_type': 'Petrol',
'id': 'ab756b39-43fa-5fe7-8f31-c7670e3f9d15',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'HY57 KMG',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=HY57%20KMG&vehicleType=*',
'listing': 'auction',
'location': 'Blackbushe',
'make': 'BMW',
'model': 'Z4',
'odometer': 55873,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2007-01-01',
'seller_name': None,
'title': 'BMW Z4 2.0 SE Roadster',
'transmission': 'manual',
'trim': 'SE',
'vin': 'WBABZ12060LY61857',
'year': 2007}
2026-03-28 14:05:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27HY57%2520KMG%27 HTTP/1.1" 200 None
2026-03-28 14:05:43 [bca.uk] INFO: Saving data for HY57%20KMG: {'auction_closing_time': 1774778400.0, 'created_time': 1774391960.179668, 'last_price_update_time': 1774706743.450609}
2026-03-28 14:05:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='HY57%2520KMG') HTTP/1.1" 204 0
2026-03-28 14:05:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.bca.co.uk/api/search?q=&pageSize=100&page=12&sort=MostRecentlyAdded> (referer: https://www.bca.co.uk/search) ['zyte-api']
2026-03-28 14:05:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:05:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c502190>
2026-03-28 14:05:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:05:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:05:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:05:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_243a05a7-7cda-5444-ab1c-5fdc014fa410/243a05a7-7cda-5444-ab1c-5fdc014fa410_image_4.jpg HTTP/1.1" 201 0
2026-03-28 14:05:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FYB63ZKP%252F698284372%252F600') HTTP/1.1" 204 0
2026-03-28 14:05:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YB63ZKP/698284372/600 saved to cache
2026-03-28 14:05:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 243a05a7-7cda-5444-ab1c-5fdc014fa410
2026-03-28 14:05:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:05:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c14d150>
2026-03-28 14:05:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:05:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:05:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:05:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e21ba6d8-ccbd-5912-bd24-f51d3dc89889/e21ba6d8-ccbd-5912-bd24-f51d3dc89889_expert_report_file_52b6718e-3afc-4ffb-a77c-c75d89aa5b8f.pdf HTTP/1.1" 201 0
2026-03-28 14:05:43 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item e21ba6d8-ccbd-5912-bd24-f51d3dc89889
2026-03-28 14:05:43 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: e21ba6d8-ccbd-5912-bd24-f51d3dc89889, skipping ID generation
2026-03-28 14:05:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item e21ba6d8-ccbd-5912-bd24-f51d3dc89889
2026-03-28 14:05:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DLJ24UKC-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-28 14:05:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=LJ24UKC-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-28 14:05:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LD57FXL/698933900/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LD57FXL/42810412?sv=2020-08-04&st=2026-03-28T14%3A05%3A27Z&se=2026-03-28T14%3A30%3A27Z&sr=b&sp=r&sig=SrrbefNVxYUh04mJFXEMP7I6EJU13XfRB%2BYQXtzw2lU%3D)
2026-03-28 14:05:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LD57FXL/698933925/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LD57FXL/42810412?sv=2020-08-04&st=2026-03-28T14%3A05%3A27Z&se=2026-03-28T14%3A30%3A27Z&sr=b&sp=r&sig=SrrbefNVxYUh04mJFXEMP7I6EJU13XfRB%2BYQXtzw2lU%3D)
2026-03-28 14:05:43 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LD57FXL/698933945/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698933945>
2026-03-28 14:05:43 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LD06WNS/698920809/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=LD06WNS-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-28 14:05:43 [bca.uk] INFO: Found listing with ID: PN17%20YAG
2026-03-28 14:05:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27PN17%2520YAG%27 HTTP/1.1" 200 None
2026-03-28 14:05:43 [bca.uk] INFO: Scrape type for PN17%20YAG: 0
2026-03-28 14:05:43 [bca.uk] INFO: Found listing with ID: VE67%20VVT
2026-03-28 14:05:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27VE67%2520VVT%27 HTTP/1.1" 200 None
2026-03-28 14:05:43 [bca.uk] INFO: Scrape type for VE67%20VVT: 0
2026-03-28 14:05:43 [bca.uk] INFO: Found listing with ID: YB65%20ELU
2026-03-28 14:05:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YB65%2520ELU%27 HTTP/1.1" 200 None
2026-03-28 14:05:43 [bca.uk] INFO: Scrape type for YB65%20ELU: 0
2026-03-28 14:05:43 [bca.uk] INFO: Found listing with ID: DN64%20GYD
2026-03-28 14:05:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DN64%2520GYD%27 HTTP/1.1" 200 None
2026-03-28 14:05:43 [bca.uk] INFO: Scrape type for DN64%20GYD: 2
2026-03-28 14:05:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c7955749-0af2-5edc-8a43-691feedd0c24 with identifier: DN64%20GYD
2026-03-28 14:05:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c7955749-0af2-5edc-8a43-691feedd0c24 with scrape type 2
2026-03-28 14:05:43 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c7955749-0af2-5edc-8a43-691feedd0c24 with scrape type 2
2026-03-28 14:05:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: c7955749-0af2-5edc-8a43-691feedd0c24, identifier: DN64%20GYD
2026-03-28 14:05:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698729735%27 HTTP/1.1" 200 None
2026-03-28 14:05:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698729735 not downloaded yet
2026-03-28 14:05:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698934051%27 HTTP/1.1" 200 None
2026-03-28 14:05:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698934051 not downloaded yet
2026-03-28 14:05:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698920825%27 HTTP/1.1" 200 None
2026-03-28 14:05:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698920825 not downloaded yet
2026-03-28 14:05:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698947003%27 HTTP/1.1" 200 None
2026-03-28 14:05:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698947003 not downloaded yet
2026-03-28 14:05:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: c7955749-0af2-5edc-8a43-691feedd0c24 with identifier: DN64%20GYD
2026-03-28 14:05:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: c7955749-0af2-5edc-8a43-691feedd0c24 with identifier: DN64%20GYD
2026-03-28 14:05:43 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: c7955749-0af2-5edc-8a43-691feedd0c24 with identifier: DN64%20GYD to the API
2026-03-28 14:05:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:05:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:05:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=11&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 142,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=DN64%20GYD-GB',
'category': 'Car',
'color': 'blue',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.2L',
'expiration_date': '2026-03-29T10:00:00Z',
'fuel_type': 'Petrol',
'id': 'c7955749-0af2-5edc-8a43-691feedd0c24',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'DN64 GYD',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=DN64%20GYD&vehicleType=*',
'listing': 'auction',
'location': 'Blackbushe',
'make': 'HYUNDAI',
'model': 'I10',
'odometer': 28776,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-01-01',
'seller_name': None,
'title': 'HYUNDAI I10 1.2 PREMIUM Hatchback',
'transmission': 'automatic',
'trim': 'PREMIUM',
'vin': 'NLHA851CMFZ108486',
'year': 2015}
2026-03-28 14:05:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DN64%2520GYD%27 HTTP/1.1" 200 None
2026-03-28 14:05:44 [bca.uk] INFO: Saving data for DN64%20GYD: {'auction_closing_time': 1774778400.0, 'created_time': 1774524259.163118, 'last_price_update_time': 1774706744.218736}
2026-03-28 14:05:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='DN64%2520GYD') HTTP/1.1" 204 0
2026-03-28 14:05:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698717152%27 HTTP/1.1" 200 None
2026-03-28 14:05:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698717152 not downloaded yet
2026-03-28 14:05:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LD57FXL/698933908/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LD57FXL/42810412?sv=2020-08-04&st=2026-03-28T14%3A05%3A27Z&se=2026-03-28T14%3A30%3A27Z&sr=b&sp=r&sig=SrrbefNVxYUh04mJFXEMP7I6EJU13XfRB%2BYQXtzw2lU%3D)
2026-03-28 14:05:44 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BU67HNA/698729656/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698729656>
2026-03-28 14:05:44 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SA60NYT/698946973/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=SA60NYT-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-28 14:05:44 [bca.uk] INFO: Found listing with ID: GU62%20NWF
2026-03-28 14:05:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GU62%2520NWF%27 HTTP/1.1" 200 None
2026-03-28 14:05:44 [bca.uk] INFO: Scrape type for GU62%20NWF: 0
2026-03-28 14:05:44 [bca.uk] INFO: Found listing with ID: HF57%20DZO
2026-03-28 14:05:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27HF57%2520DZO%27 HTTP/1.1" 200 None
2026-03-28 14:05:44 [bca.uk] INFO: Scrape type for HF57%20DZO: 0
2026-03-28 14:05:44 [bca.uk] INFO: Found listing with ID: GL09%20EWC
2026-03-28 14:05:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GL09%2520EWC%27 HTTP/1.1" 200 None
2026-03-28 14:05:44 [bca.uk] INFO: Scrape type for GL09%20EWC: 0
2026-03-28 14:05:44 [bca.uk] INFO: Found listing with ID: HW03%20GOA
2026-03-28 14:05:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27HW03%2520GOA%27 HTTP/1.1" 200 None
2026-03-28 14:05:44 [bca.uk] INFO: Scrape type for HW03%20GOA: 0
2026-03-28 14:05:44 [bca.uk] INFO: Found listing with ID: Y856%20RRD
2026-03-28 14:05:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27Y856%2520RRD%27 HTTP/1.1" 200 None
2026-03-28 14:05:44 [bca.uk] INFO: Scrape type for Y856%20RRD: 0
2026-03-28 14:05:44 [bca.uk] INFO: Found listing with ID: BX16%20DHC
2026-03-28 14:05:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BX16%2520DHC%27 HTTP/1.1" 200 None
2026-03-28 14:05:44 [bca.uk] INFO: Scrape type for BX16%20DHC: 2
2026-03-28 14:05:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 90e39e5b-0377-549a-8717-10383b5e0fda with identifier: BX16%20DHC
2026-03-28 14:05:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 90e39e5b-0377-549a-8717-10383b5e0fda with scrape type 2
2026-03-28 14:05:44 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 90e39e5b-0377-549a-8717-10383b5e0fda with scrape type 2
2026-03-28 14:05:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 90e39e5b-0377-549a-8717-10383b5e0fda, identifier: BX16%20DHC
2026-03-28 14:05:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698729755%27 HTTP/1.1" 200 None
2026-03-28 14:05:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698729755 not downloaded yet
2026-03-28 14:05:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698934069%27 HTTP/1.1" 200 None
2026-03-28 14:05:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698934069 not downloaded yet
2026-03-28 14:05:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698920830%27 HTTP/1.1" 200 None
2026-03-28 14:05:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698920830 not downloaded yet
2026-03-28 14:05:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698947015%27 HTTP/1.1" 200 None
2026-03-28 14:05:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698947015 not downloaded yet
2026-03-28 14:05:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:05:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c1aa810>
2026-03-28 14:05:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:05:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:05:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:05:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fe123a59-25d0-509d-9046-e45117da9996/fe123a59-25d0-509d-9046-e45117da9996_image_4.jpg HTTP/1.1" 201 0
2026-03-28 14:05:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FHY65KRJ%252F698920388%252F600') HTTP/1.1" 204 0
2026-03-28 14:05:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HY65KRJ/698920388/600 saved to cache
2026-03-28 14:05:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item fe123a59-25d0-509d-9046-e45117da9996
2026-03-28 14:05:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:05:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c1ab810>
2026-03-28 14:05:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:05:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:05:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:05:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e5b1ecb7-cfa8-5758-b32f-ed9093a37d21/e5b1ecb7-cfa8-5758-b32f-ed9093a37d21_image_0.jpg HTTP/1.1" 201 0
2026-03-28 14:05:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FBU67HNA%252F698729591%252F600') HTTP/1.1" 204 0
2026-03-28 14:05:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BU67HNA/698729591/600 saved to cache
2026-03-28 14:05:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item e5b1ecb7-cfa8-5758-b32f-ed9093a37d21
2026-03-28 14:05:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BU67HNA/698729626/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/BU67HNA/42810584?sv=2020-08-04&st=2026-03-28T14%3A05%3A27Z&se=2026-03-28T14%3A30%3A27Z&sr=b&sp=r&sig=jvqWs0bbwwPNyCuILhTmpoSOvgJ5gvo7FW1OJ3cgP4I%3D)
2026-03-28 14:05:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BU67HNA/698729606/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/BU67HNA/42810584?sv=2020-08-04&st=2026-03-28T14%3A05%3A27Z&se=2026-03-28T14%3A30%3A27Z&sr=b&sp=r&sig=jvqWs0bbwwPNyCuILhTmpoSOvgJ5gvo7FW1OJ3cgP4I%3D)
2026-03-28 14:05:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PXZ1595/698814130/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/PXZ1595/42808016?sv=2020-08-04&st=2026-03-28T14%3A04%3A01Z&se=2026-03-28T14%3A29%3A01Z&sr=b&sp=r&sig=xu3OmTnGiQ74jDpi5YWrXOjZvBn7hDxoXdoCW9aef04%3D)
2026-03-28 14:05:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LD57FXL/698933934/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LD57FXL/42810412?sv=2020-08-04&st=2026-03-28T14%3A05%3A27Z&se=2026-03-28T14%3A30%3A27Z&sr=b&sp=r&sig=SrrbefNVxYUh04mJFXEMP7I6EJU13XfRB%2BYQXtzw2lU%3D)
2026-03-28 14:05:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/OW69BUU/42810360?sv=2020-08-04&st=2026-03-28T14%3A05%3A41Z&se=2026-03-28T14%3A30%3A41Z&sr=b&sp=r&sig=K9lRxvrb31NcTkLXgZADadn3Empdjh1%2BI4o9SeNOjN0%3D> (referer: https://www.bca.co.uk/)
2026-03-28 14:05:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 90e39e5b-0377-549a-8717-10383b5e0fda with identifier: BX16%20DHC
2026-03-28 14:05:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 90e39e5b-0377-549a-8717-10383b5e0fda with identifier: BX16%20DHC
2026-03-28 14:05:44 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 90e39e5b-0377-549a-8717-10383b5e0fda with identifier: BX16%20DHC to the API
2026-03-28 14:05:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:05:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:05:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=11&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 147,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=BX16%20DHC-GB',
'category': 'Car',
'color': 'black',
'currency': 'GBP',
'doors_number': 5,
'engine': '2.0L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Diesel',
'id': '90e39e5b-0377-549a-8717-10383b5e0fda',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'BX16 DHC',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=BX16%20DHC&vehicleType=*',
'listing': 'auction',
'location': 'Blackbushe',
'make': 'VAUXHALL',
'model': 'INSIGNIA',
'odometer': 88777,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-01-01',
'seller_name': None,
'title': 'VAUXHALL INSIGNIA 2.0 CDTI 170 ELITE Hatchback',
'transmission': 'automatic',
'trim': 'CDTI 170 ELITE',
'vin': 'W0LGT6E13G1059315',
'year': 2016}
2026-03-28 14:05:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BX16%2520DHC%27 HTTP/1.1" 200 None
2026-03-28 14:05:44 [bca.uk] INFO: Saving data for BX16%20DHC: {'auction_closing_time': 1774864800.0, 'created_time': 1774564149.127689, 'last_price_update_time': 1774706744.974798}
2026-03-28 14:05:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='BX16%2520DHC') HTTP/1.1" 204 0
2026-03-28 14:05:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698717176%27 HTTP/1.1" 200 None
2026-03-28 14:05:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698717176 not downloaded yet
2026-03-28 14:05:45 [bca.uk] INFO: Found listing with ID: EA14%20EOC
2026-03-28 14:05:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27EA14%2520EOC%27 HTTP/1.1" 200 None
2026-03-28 14:05:45 [bca.uk] INFO: Scrape type for EA14%20EOC: 2
2026-03-28 14:05:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 32f0f4be-36ca-54d0-aa06-c9faf05cac79 with identifier: EA14%20EOC
2026-03-28 14:05:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 32f0f4be-36ca-54d0-aa06-c9faf05cac79 with scrape type 2
2026-03-28 14:05:45 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 32f0f4be-36ca-54d0-aa06-c9faf05cac79 with scrape type 2
2026-03-28 14:05:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 32f0f4be-36ca-54d0-aa06-c9faf05cac79, identifier: EA14%20EOC
2026-03-28 14:05:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698920835%27 HTTP/1.1" 200 None
2026-03-28 14:05:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698920835 not downloaded yet
2026-03-28 14:05:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698947025%27 HTTP/1.1" 200 None
2026-03-28 14:05:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698947025 not downloaded yet
2026-03-28 14:05:45 [bca.uk] INFO: Total items found: 100
2026-03-28 14:05:45 [bca.uk] INFO: Requesting URL: https://www.bca.co.uk/api/search?q=&pageSize=100&page=13&sort=MostRecentlyAdded
2026-03-28 14:05:45 [bca.uk] INFO: Sending search API request with Bearer token (length=1492)
2026-03-28 14:05:45 [scrapy_zyte_api._params] WARNING: Request <GET https://www.bca.co.uk/api/search?q=&pageSize=100&page=13&sort=MostRecentlyAdded> defines the Zyte API customHttpRequestHeaders parameter, overriding Request.headers. Use Request.headers instead.
2026-03-28 14:05:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:05:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c537ed0>
2026-03-28 14:05:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:05:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:05:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:05:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_64e95b6e-a78f-537e-8c08-58f1a7f0a9cb/64e95b6e-a78f-537e-8c08-58f1a7f0a9cb_image_0.jpg HTTP/1.1" 201 0
2026-03-28 14:05:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLD57FXL%252F698933900%252F600') HTTP/1.1" 204 0
2026-03-28 14:05:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LD57FXL/698933900/600 saved to cache
2026-03-28 14:05:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 64e95b6e-a78f-537e-8c08-58f1a7f0a9cb
2026-03-28 14:05:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:05:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c898ed0>
2026-03-28 14:05:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:05:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:05:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:05:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_64e95b6e-a78f-537e-8c08-58f1a7f0a9cb/64e95b6e-a78f-537e-8c08-58f1a7f0a9cb_image_2.jpg HTTP/1.1" 201 0
2026-03-28 14:05:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLD57FXL%252F698933925%252F600') HTTP/1.1" 204 0
2026-03-28 14:05:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LD57FXL/698933925/600 saved to cache
2026-03-28 14:05:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 64e95b6e-a78f-537e-8c08-58f1a7f0a9cb
2026-03-28 14:05:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BU67HNA/698729644/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/BU67HNA/42810584?sv=2020-08-04&st=2026-03-28T14%3A05%3A27Z&se=2026-03-28T14%3A30%3A27Z&sr=b&sp=r&sig=jvqWs0bbwwPNyCuILhTmpoSOvgJ5gvo7FW1OJ3cgP4I%3D)
2026-03-28 14:05:45 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LD06WNS/698920815/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698920815>
2026-03-28 14:05:45 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SA60NYT/698946982/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698946982>
2026-03-28 14:05:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 32f0f4be-36ca-54d0-aa06-c9faf05cac79 with identifier: EA14%20EOC
2026-03-28 14:05:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 32f0f4be-36ca-54d0-aa06-c9faf05cac79 with identifier: EA14%20EOC
2026-03-28 14:05:45 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 32f0f4be-36ca-54d0-aa06-c9faf05cac79 with identifier: EA14%20EOC to the API
2026-03-28 14:05:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:05:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:05:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=11&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 130,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=EA14%20EOC-GB',
'category': 'Car',
'color': 'white',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.6L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol',
'id': '32f0f4be-36ca-54d0-aa06-c9faf05cac79',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'EA14 EOC',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=EA14%20EOC&vehicleType=*',
'listing': 'auction',
'location': 'Blackbushe',
'make': 'SUZUKI',
'model': 'SX4 S CROSS',
'odometer': 66270,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2014-01-01',
'seller_name': None,
'title': 'SUZUKI SX4 S CROSS 1.6 SZ5 ALLGRIP Hatchback',
'transmission': 'automatic',
'trim': 'SZ5 ALLGRIP',
'vin': 'TSMJYB22S00154805',
'year': 2014}
2026-03-28 14:05:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27EA14%2520EOC%27 HTTP/1.1" 200 None
2026-03-28 14:05:45 [bca.uk] INFO: Saving data for EA14%20EOC: {'auction_closing_time': 1774864800.0, 'created_time': 1774364678.602339, 'last_price_update_time': 1774706745.728198}
2026-03-28 14:05:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='EA14%2520EOC') HTTP/1.1" 204 0
2026-03-28 14:05:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698717195%27 HTTP/1.1" 200 None
2026-03-28 14:05:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698717195 not downloaded yet
2026-03-28 14:05:45 [bca.uk] INFO: Found listing with ID: EF16%20EOM
2026-03-28 14:05:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27EF16%2520EOM%27 HTTP/1.1" 200 None
2026-03-28 14:05:45 [bca.uk] INFO: Scrape type for EF16%20EOM: 2
2026-03-28 14:05:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b355e521-6bf3-578c-9641-50bb80545919 with identifier: EF16%20EOM
2026-03-28 14:05:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b355e521-6bf3-578c-9641-50bb80545919 with scrape type 2
2026-03-28 14:05:45 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b355e521-6bf3-578c-9641-50bb80545919 with scrape type 2
2026-03-28 14:05:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: b355e521-6bf3-578c-9641-50bb80545919, identifier: EF16%20EOM
2026-03-28 14:05:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698920839%27 HTTP/1.1" 200 None
2026-03-28 14:05:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698920839 not downloaded yet
2026-03-28 14:05:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698947050%27 HTTP/1.1" 200 None
2026-03-28 14:05:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698947050 not downloaded yet
2026-03-28 14:05:46 [bca.uk] INFO: Found listing with ID: M500%20MGW
2026-03-28 14:05:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27M500%2520MGW%27 HTTP/1.1" 200 None
2026-03-28 14:05:46 [bca.uk] INFO: Scrape type for M500%20MGW: 0
2026-03-28 14:05:46 [bca.uk] INFO: Found listing with ID: MD07%20PTY
2026-03-28 14:05:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MD07%2520PTY%27 HTTP/1.1" 200 None
2026-03-28 14:05:46 [bca.uk] INFO: Scrape type for MD07%20PTY: 2
2026-03-28 14:05:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c5e60606-5214-5adb-b802-66734a1dcf9f with identifier: MD07%20PTY
2026-03-28 14:05:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c5e60606-5214-5adb-b802-66734a1dcf9f with scrape type 2
2026-03-28 14:05:46 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c5e60606-5214-5adb-b802-66734a1dcf9f with scrape type 2
2026-03-28 14:05:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: c5e60606-5214-5adb-b802-66734a1dcf9f, identifier: MD07%20PTY
2026-03-28 14:05:46 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SA60NYT/698946995/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698946995>
2026-03-28 14:05:46 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LD06WNS/698920822/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698920822>
2026-03-28 14:05:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LD57FXL/698933945/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LD57FXL/42810412?sv=2020-08-04&st=2026-03-28T14%3A05%3A27Z&se=2026-03-28T14%3A30%3A27Z&sr=b&sp=r&sig=SrrbefNVxYUh04mJFXEMP7I6EJU13XfRB%2BYQXtzw2lU%3D)
2026-03-28 14:05:46 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LD57FXL/698934025/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698934025>
2026-03-28 14:05:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: b355e521-6bf3-578c-9641-50bb80545919 with identifier: EF16%20EOM
2026-03-28 14:05:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: b355e521-6bf3-578c-9641-50bb80545919 with identifier: EF16%20EOM
2026-03-28 14:05:46 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: b355e521-6bf3-578c-9641-50bb80545919 with identifier: EF16%20EOM to the API
2026-03-28 14:05:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:05:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:05:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=11&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 166,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=EF16%20EOM-GB',
'category': 'Car',
'color': 'brown',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.4L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol',
'id': 'b355e521-6bf3-578c-9641-50bb80545919',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'EF16 EOM',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=EF16%20EOM&vehicleType=*',
'listing': 'auction',
'location': 'Blackbushe',
'make': 'VAUXHALL',
'model': 'MERIVA',
'odometer': 70926,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-01-01',
'seller_name': None,
'title': 'VAUXHALL MERIVA 1.4 T 16V 120 SE MPV',
'transmission': 'automatic',
'trim': 'T 16V 120 SE',
'vin': 'W0LSH9EM8G4023903',
'year': 2016}
2026-03-28 14:05:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27EF16%2520EOM%27 HTTP/1.1" 200 None
2026-03-28 14:05:46 [bca.uk] INFO: Saving data for EF16%20EOM: {'auction_closing_time': 1774864800.0, 'created_time': 1774564147.578119, 'last_price_update_time': 1774706746.601139}
2026-03-28 14:05:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='EF16%2520EOM') HTTP/1.1" 204 0
2026-03-28 14:05:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698717217%27 HTTP/1.1" 200 None
2026-03-28 14:05:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698717217 not downloaded yet
2026-03-28 14:05:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: c5e60606-5214-5adb-b802-66734a1dcf9f with identifier: MD07%20PTY
2026-03-28 14:05:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: c5e60606-5214-5adb-b802-66734a1dcf9f with identifier: MD07%20PTY
2026-03-28 14:05:46 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: c5e60606-5214-5adb-b802-66734a1dcf9f with identifier: MD07%20PTY to the API
2026-03-28 14:05:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:05:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:05:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=12&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 166,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=MD07%20PTY-GB',
'category': 'Car',
'color': 'silver',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.6L',
'expiration_date': '2026-03-29T10:00:00Z',
'fuel_type': 'Petrol',
'id': 'c5e60606-5214-5adb-b802-66734a1dcf9f',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'MD07 PTY',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=MD07%20PTY&vehicleType=*',
'listing': 'auction',
'location': 'Manchester',
'make': 'TOYOTA',
'model': 'AURIS',
'odometer': 103096,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2007-01-01',
'seller_name': None,
'title': 'TOYOTA AURIS 1.6 VVTI TR Hatchback',
'transmission': 'manual',
'trim': 'VVTI TR',
'vin': 'SB1KV56E50F021387',
'year': 2007}
2026-03-28 14:05:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MD07%2520PTY%27 HTTP/1.1" 200 None
2026-03-28 14:05:47 [bca.uk] INFO: Saving data for MD07%20PTY: {'auction_closing_time': 1774778400.0, 'created_time': 1774524389.827863, 'last_price_update_time': 1774706747.002661}
2026-03-28 14:05:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='MD07%2520PTY') HTTP/1.1" 204 0
2026-03-28 14:05:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:05:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c604750>
2026-03-28 14:05:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:05:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:05:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:05:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_64e95b6e-a78f-537e-8c08-58f1a7f0a9cb/64e95b6e-a78f-537e-8c08-58f1a7f0a9cb_image_1.jpg HTTP/1.1" 201 0
2026-03-28 14:05:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLD57FXL%252F698933908%252F600') HTTP/1.1" 204 0
2026-03-28 14:05:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LD57FXL/698933908/600 saved to cache
2026-03-28 14:05:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 64e95b6e-a78f-537e-8c08-58f1a7f0a9cb
2026-03-28 14:05:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:05:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c7f4050>
2026-03-28 14:05:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:05:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:05:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:05:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e5b1ecb7-cfa8-5758-b32f-ed9093a37d21/e5b1ecb7-cfa8-5758-b32f-ed9093a37d21_image_2.jpg HTTP/1.1" 201 0
2026-03-28 14:05:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FBU67HNA%252F698729626%252F600') HTTP/1.1" 204 0
2026-03-28 14:05:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BU67HNA/698729626/600 saved to cache
2026-03-28 14:05:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item e5b1ecb7-cfa8-5758-b32f-ed9093a37d21
2026-03-28 14:05:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:05:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2d886550>
2026-03-28 14:05:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:05:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:05:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:05:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e5b1ecb7-cfa8-5758-b32f-ed9093a37d21/e5b1ecb7-cfa8-5758-b32f-ed9093a37d21_image_1.jpg HTTP/1.1" 201 0
2026-03-28 14:05:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FBU67HNA%252F698729606%252F600') HTTP/1.1" 204 0
2026-03-28 14:05:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BU67HNA/698729606/600 saved to cache
2026-03-28 14:05:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item e5b1ecb7-cfa8-5758-b32f-ed9093a37d21
2026-03-28 14:05:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:05:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2ca52810>
2026-03-28 14:05:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:05:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:05:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:05:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8f3e30a4-6b64-5dd1-8e1e-6cce5d49fef3/8f3e30a4-6b64-5dd1-8e1e-6cce5d49fef3_image_2.jpg HTTP/1.1" 201 0
2026-03-28 14:05:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FPXZ1595%252F698814130%252F600') HTTP/1.1" 204 0
2026-03-28 14:05:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PXZ1595/698814130/600 saved to cache
2026-03-28 14:05:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 8f3e30a4-6b64-5dd1-8e1e-6cce5d49fef3
2026-03-28 14:05:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:05:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2dbe5750>
2026-03-28 14:05:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:05:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:05:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:05:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_64e95b6e-a78f-537e-8c08-58f1a7f0a9cb/64e95b6e-a78f-537e-8c08-58f1a7f0a9cb_image_3.jpg HTTP/1.1" 201 0
2026-03-28 14:05:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLD57FXL%252F698933934%252F600') HTTP/1.1" 204 0
2026-03-28 14:05:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LD57FXL/698933934/600 saved to cache
2026-03-28 14:05:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 64e95b6e-a78f-537e-8c08-58f1a7f0a9cb
2026-03-28 14:05:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:05:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a1fe13390>
2026-03-28 14:05:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:05:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:05:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:05:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0d569b1a-e283-5140-bff5-8b0083b89ad4/0d569b1a-e283-5140-bff5-8b0083b89ad4_expert_report_file_b1e5d033-2225-47d9-8cde-ab766714444c.pdf HTTP/1.1" 201 0
2026-03-28 14:05:47 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item 0d569b1a-e283-5140-bff5-8b0083b89ad4
2026-03-28 14:05:47 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 0d569b1a-e283-5140-bff5-8b0083b89ad4, skipping ID generation
2026-03-28 14:05:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 0d569b1a-e283-5140-bff5-8b0083b89ad4
2026-03-28 14:05:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DOW69BUU-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-28 14:05:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=OW69BUU-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-28 14:05:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BU67HNA/698729656/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/BU67HNA/42810584?sv=2020-08-04&st=2026-03-28T14%3A05%3A27Z&se=2026-03-28T14%3A30%3A27Z&sr=b&sp=r&sig=jvqWs0bbwwPNyCuILhTmpoSOvgJ5gvo7FW1OJ3cgP4I%3D)
2026-03-28 14:05:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SA60NYT/698946973/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/SA60NYT/42810538?sv=2020-08-04&st=2026-03-28T14%3A05%3A31Z&se=2026-03-28T14%3A30%3A31Z&sr=b&sp=r&sig=E2aZntMhZA%2B%2F8gu6iOIeQUHtNbnCVBf4tuK50ckRu0U%3D)
2026-03-28 14:05:47 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SA60NYT/698947003/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698947003>
2026-03-28 14:05:47 [bca.uk] INFO: Found listing with ID: RF18%20ATV
2026-03-28 14:05:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27RF18%2520ATV%27 HTTP/1.1" 200 None
2026-03-28 14:05:47 [bca.uk] INFO: Scrape type for RF18%20ATV: 0
2026-03-28 14:05:47 [bca.uk] INFO: Found listing with ID: RV17%20VJG
2026-03-28 14:05:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27RV17%2520VJG%27 HTTP/1.1" 200 None
2026-03-28 14:05:47 [bca.uk] INFO: Scrape type for RV17%20VJG: 2
2026-03-28 14:05:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: dbca3122-2823-58fd-9676-4e41b0355a6c with identifier: RV17%20VJG
2026-03-28 14:05:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item dbca3122-2823-58fd-9676-4e41b0355a6c with scrape type 2
2026-03-28 14:05:47 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item dbca3122-2823-58fd-9676-4e41b0355a6c with scrape type 2
2026-03-28 14:05:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: dbca3122-2823-58fd-9676-4e41b0355a6c, identifier: RV17%20VJG
2026-03-28 14:05:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698920845%27 HTTP/1.1" 200 None
2026-03-28 14:05:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698920845 not downloaded yet
2026-03-28 14:05:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698947090%27 HTTP/1.1" 200 None
2026-03-28 14:05:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698947090 not downloaded yet
2026-03-28 14:05:47 [bca.uk] INFO: Found listing with ID: MF10%20UFT
2026-03-28 14:05:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MF10%2520UFT%27 HTTP/1.1" 200 None
2026-03-28 14:05:47 [bca.uk] INFO: Scrape type for MF10%20UFT: 2
2026-03-28 14:05:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 65110073-fd7d-5e60-a00d-1c442f744d6e with identifier: MF10%20UFT
2026-03-28 14:05:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 65110073-fd7d-5e60-a00d-1c442f744d6e with scrape type 2
2026-03-28 14:05:47 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 65110073-fd7d-5e60-a00d-1c442f744d6e with scrape type 2
2026-03-28 14:05:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 65110073-fd7d-5e60-a00d-1c442f744d6e, identifier: MF10%20UFT
2026-03-28 14:05:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LD06WNS/698920809/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LD06WNS/42809781?sv=2020-08-04&st=2026-03-28T14%3A05%3A31Z&se=2026-03-28T14%3A30%3A31Z&sr=b&sp=r&sig=OTvnKFmvSmD2QJ4F%2F503KbBKEXfjVzDNMqEsXfGzuJ0%3D)
2026-03-28 14:05:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: dbca3122-2823-58fd-9676-4e41b0355a6c with identifier: RV17%20VJG
2026-03-28 14:05:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: dbca3122-2823-58fd-9676-4e41b0355a6c with identifier: RV17%20VJG
2026-03-28 14:05:47 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: dbca3122-2823-58fd-9676-4e41b0355a6c with identifier: RV17%20VJG to the API
2026-03-28 14:05:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:05:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:05:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=11&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 185,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=RV17%20VJG-GB',
'category': 'Car',
'color': 'grey',
'currency': 'GBP',
'doors_number': 5,
'engine': '3.0L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Diesel',
'id': 'dbca3122-2823-58fd-9676-4e41b0355a6c',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'RV17 VJG',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=RV17%20VJG&vehicleType=*',
'listing': 'auction',
'location': 'Blackbushe',
'make': 'LAND ROVER',
'model': 'R/R SPORT',
'odometer': 81671,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-01-01',
'seller_name': None,
'title': 'LAND ROVER R/R SPORT 3.0 SDV6 306 HSE StationWagon',
'transmission': 'manual',
'trim': 'SDV6 306 HSE',
'vin': 'SALWA2EK9HA673008',
'year': 2017}
2026-03-28 14:05:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27RV17%2520VJG%27 HTTP/1.1" 200 None
2026-03-28 14:05:48 [bca.uk] INFO: Saving data for RV17%20VJG: {'auction_closing_time': 1774864800.0, 'created_time': 1773908938.802077, 'last_price_update_time': 1774706748.020611}
2026-03-28 14:05:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='RV17%2520VJG') HTTP/1.1" 204 0
2026-03-28 14:05:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698717232%27 HTTP/1.1" 200 None
2026-03-28 14:05:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698717232 not downloaded yet
2026-03-28 14:05:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 65110073-fd7d-5e60-a00d-1c442f744d6e with identifier: MF10%20UFT
2026-03-28 14:05:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 65110073-fd7d-5e60-a00d-1c442f744d6e with identifier: MF10%20UFT
2026-03-28 14:05:48 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 65110073-fd7d-5e60-a00d-1c442f744d6e with identifier: MF10%20UFT to the API
2026-03-28 14:05:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:05:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:05:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=12&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 155,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=MF10%20UFT-GB',
'category': 'Car',
'color': 'red',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.6L',
'expiration_date': '2026-03-29T10:00:00Z',
'fuel_type': 'Petrol',
'id': '65110073-fd7d-5e60-a00d-1c442f744d6e',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'MF10 UFT',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=MF10%20UFT&vehicleType=*',
'listing': 'auction',
'location': 'Manchester',
'make': 'VAUXHALL',
'model': 'ASTRA',
'odometer': 93805,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2010-01-01',
'seller_name': None,
'title': 'VAUXHALL ASTRA 1.6 VVT 115 LIFE Hatchback',
'transmission': 'manual',
'trim': 'VVT 115 LIFE',
'vin': 'W0L0AHL48A2075425',
'year': 2010}
2026-03-28 14:05:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MF10%2520UFT%27 HTTP/1.1" 200 None
2026-03-28 14:05:48 [bca.uk] INFO: Saving data for MF10%20UFT: {'auction_closing_time': 1774778400.0, 'created_time': 1774524473.166399, 'last_price_update_time': 1774706748.375317}
2026-03-28 14:05:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='MF10%2520UFT') HTTP/1.1" 204 0
2026-03-28 14:05:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D697928846%27 HTTP/1.1" 200 None
2026-03-28 14:05:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=697928846 not downloaded yet
2026-03-28 14:05:48 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LD06WNS/698920830/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698920830>
2026-03-28 14:05:48 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LD57FXL/698934069/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698934069>
2026-03-28 14:05:48 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SA60NYT/698947015/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698947015>
2026-03-28 14:05:48 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BU67HNA/698729755/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698729755>
2026-03-28 14:05:48 [bca.uk] INFO: Found listing with ID: DX16%20UVK
2026-03-28 14:05:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DX16%2520UVK%27 HTTP/1.1" 200 None
2026-03-28 14:05:48 [bca.uk] INFO: Scrape type for DX16%20UVK: 2
2026-03-28 14:05:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2d4d1944-6581-554d-bf85-73c96aab2877 with identifier: DX16%20UVK
2026-03-28 14:05:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2d4d1944-6581-554d-bf85-73c96aab2877 with scrape type 2
2026-03-28 14:05:48 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2d4d1944-6581-554d-bf85-73c96aab2877 with scrape type 2
2026-03-28 14:05:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 2d4d1944-6581-554d-bf85-73c96aab2877, identifier: DX16%20UVK
2026-03-28 14:05:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698947119%27 HTTP/1.1" 200 None
2026-03-28 14:05:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698947119 not downloaded yet
2026-03-28 14:05:48 [bca.uk] INFO: Found listing with ID: MF17%20NRO
2026-03-28 14:05:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MF17%2520NRO%27 HTTP/1.1" 200 None
2026-03-28 14:05:48 [bca.uk] INFO: Scrape type for MF17%20NRO: 0
2026-03-28 14:05:48 [bca.uk] INFO: Found listing with ID: MK62%20DZU
2026-03-28 14:05:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MK62%2520DZU%27 HTTP/1.1" 200 None
2026-03-28 14:05:48 [bca.uk] INFO: Scrape type for MK62%20DZU: 0
2026-03-28 14:05:48 [bca.uk] INFO: Found listing with ID: YH09%20BCO
2026-03-28 14:05:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YH09%2520BCO%27 HTTP/1.1" 200 None
2026-03-28 14:05:48 [bca.uk] INFO: Scrape type for YH09%20BCO: 0
2026-03-28 14:05:48 [bca.uk] INFO: Found listing with ID: BJ10%20UWH
2026-03-28 14:05:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BJ10%2520UWH%27 HTTP/1.1" 200 None
2026-03-28 14:05:48 [bca.uk] INFO: Scrape type for BJ10%20UWH: 0
2026-03-28 14:05:48 [bca.uk] INFO: Found listing with ID: MM69%20SVE
2026-03-28 14:05:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MM69%2520SVE%27 HTTP/1.1" 200 None
2026-03-28 14:05:48 [bca.uk] INFO: Scrape type for MM69%20SVE: 2
2026-03-28 14:05:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7cd4e224-c25f-56fd-8a13-77b1a6baa327 with identifier: MM69%20SVE
2026-03-28 14:05:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7cd4e224-c25f-56fd-8a13-77b1a6baa327 with scrape type 2
2026-03-28 14:05:48 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7cd4e224-c25f-56fd-8a13-77b1a6baa327 with scrape type 2
2026-03-28 14:05:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 7cd4e224-c25f-56fd-8a13-77b1a6baa327, identifier: MM69%20SVE
2026-03-28 14:05:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:05:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a1fe00110>
2026-03-28 14:05:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:05:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:05:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:05:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e5b1ecb7-cfa8-5758-b32f-ed9093a37d21/e5b1ecb7-cfa8-5758-b32f-ed9093a37d21_image_3.jpg HTTP/1.1" 201 0
2026-03-28 14:05:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FBU67HNA%252F698729644%252F600') HTTP/1.1" 204 0
2026-03-28 14:05:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BU67HNA/698729644/600 saved to cache
2026-03-28 14:05:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item e5b1ecb7-cfa8-5758-b32f-ed9093a37d21
2026-03-28 14:05:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:05:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c923790>
2026-03-28 14:05:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:05:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:05:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:05:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_64e95b6e-a78f-537e-8c08-58f1a7f0a9cb/64e95b6e-a78f-537e-8c08-58f1a7f0a9cb_image_4.jpg HTTP/1.1" 201 0
2026-03-28 14:05:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLD57FXL%252F698933945%252F600') HTTP/1.1" 204 0
2026-03-28 14:05:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LD57FXL/698933945/600 saved to cache
2026-03-28 14:05:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 64e95b6e-a78f-537e-8c08-58f1a7f0a9cb
2026-03-28 14:05:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SA60NYT/698946982/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/SA60NYT/42810538?sv=2020-08-04&st=2026-03-28T14%3A05%3A31Z&se=2026-03-28T14%3A30%3A31Z&sr=b&sp=r&sig=E2aZntMhZA%2B%2F8gu6iOIeQUHtNbnCVBf4tuK50ckRu0U%3D)
2026-03-28 14:05:48 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LJ24UKC/698717152/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698717152>
2026-03-28 14:05:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 2d4d1944-6581-554d-bf85-73c96aab2877 with identifier: DX16%20UVK
2026-03-28 14:05:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 2d4d1944-6581-554d-bf85-73c96aab2877 with identifier: DX16%20UVK
2026-03-28 14:05:48 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 2d4d1944-6581-554d-bf85-73c96aab2877 with identifier: DX16%20UVK to the API
2026-03-28 14:05:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:05:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:05:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=11&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 111,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=DX16%20UVK-GB',
'category': 'Car',
'color': 'white',
'currency': 'GBP',
'doors_number': 4,
'engine': '1.6L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Diesel',
'id': '2d4d1944-6581-554d-bf85-73c96aab2877',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'DX16 UVK',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=DX16%20UVK&vehicleType=*',
'listing': 'auction',
'location': 'Blackbushe',
'make': 'MERCEDES-BENZ',
'model': 'C200 D',
'odometer': 117075,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-01-01',
'seller_name': None,
'title': 'MERCEDES-BENZ C200 D 1.6 SPORT PREMIUM Saloon',
'transmission': 'manual',
'trim': 'SPORT PREMIUM',
'vin': 'WDD2050372R148672',
'year': 2016}
2026-03-28 14:05:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DX16%2520UVK%27 HTTP/1.1" 200 None
2026-03-28 14:05:49 [bca.uk] INFO: Saving data for DX16%20UVK: {'auction_closing_time': 1774864800.0, 'created_time': 1773832093.478319, 'last_price_update_time': 1774706749.12526}
2026-03-28 14:05:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='DX16%2520UVK') HTTP/1.1" 204 0
2026-03-28 14:05:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698717262%27 HTTP/1.1" 200 None
2026-03-28 14:05:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698717262 not downloaded yet
2026-03-28 14:05:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 7cd4e224-c25f-56fd-8a13-77b1a6baa327 with identifier: MM69%20SVE
2026-03-28 14:05:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 7cd4e224-c25f-56fd-8a13-77b1a6baa327 with identifier: MM69%20SVE
2026-03-28 14:05:49 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 7cd4e224-c25f-56fd-8a13-77b1a6baa327 with identifier: MM69%20SVE to the API
2026-03-28 14:05:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:05:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:05:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=12&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 113,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=MM69%20SVE-GB',
'category': 'Car',
'color': 'black',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.0L',
'expiration_date': '2026-03-29T10:00:00Z',
'fuel_type': 'Petrol',
'id': '7cd4e224-c25f-56fd-8a13-77b1a6baa327',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'MM69 SVE',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=MM69%20SVE&vehicleType=*',
'listing': 'auction',
'location': 'Manchester',
'make': 'FORD',
'model': 'FIESTA ACTIVE',
'odometer': 30493,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-01-01',
'seller_name': None,
'title': 'FORD FIESTA ACTIVE 1.0 E/B 100 X Hatchback',
'transmission': 'manual',
'trim': 'E/B 100 X',
'vin': 'WF0JXXGAHJKS24565',
'year': 2020}
2026-03-28 14:05:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MM69%2520SVE%27 HTTP/1.1" 200 None
2026-03-28 14:05:49 [bca.uk] INFO: Saving data for MM69%20SVE: {'auction_closing_time': 1774778400.0, 'created_time': 1774418747.59233, 'last_price_update_time': 1774706749.593078}
2026-03-28 14:05:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='MM69%2520SVE') HTTP/1.1" 204 0
2026-03-28 14:05:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D697928852%27 HTTP/1.1" 200 None
2026-03-28 14:05:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=697928852 not downloaded yet
2026-03-28 14:05:49 [bca.uk] INFO: Found listing with ID: AV09%20GXU
2026-03-28 14:05:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27AV09%2520GXU%27 HTTP/1.1" 200 None
2026-03-28 14:05:49 [bca.uk] INFO: Scrape type for AV09%20GXU: 2
2026-03-28 14:05:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4f6f340e-f54d-5a5f-a637-cf3ca53d42f6 with identifier: AV09%20GXU
2026-03-28 14:05:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4f6f340e-f54d-5a5f-a637-cf3ca53d42f6 with scrape type 2
2026-03-28 14:05:49 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4f6f340e-f54d-5a5f-a637-cf3ca53d42f6 with scrape type 2
2026-03-28 14:05:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 4f6f340e-f54d-5a5f-a637-cf3ca53d42f6, identifier: AV09%20GXU
2026-03-28 14:05:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698947154%27 HTTP/1.1" 200 None
2026-03-28 14:05:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698947154 not downloaded yet
2026-03-28 14:05:49 [bca.uk] INFO: Found listing with ID: KW19%20WVM
2026-03-28 14:05:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KW19%2520WVM%27 HTTP/1.1" 200 None
2026-03-28 14:05:49 [bca.uk] INFO: Scrape type for KW19%20WVM: 0
2026-03-28 14:05:49 [bca.uk] INFO: Found listing with ID: NY19%20XSW
2026-03-28 14:05:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27NY19%2520XSW%27 HTTP/1.1" 200 None
2026-03-28 14:05:49 [bca.uk] INFO: Scrape type for NY19%20XSW: 0
2026-03-28 14:05:49 [bca.uk] INFO: Found listing with ID: OV20%20OKU
2026-03-28 14:05:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27OV20%2520OKU%27 HTTP/1.1" 200 None
2026-03-28 14:05:49 [bca.uk] INFO: Scrape type for OV20%20OKU: 0
2026-03-28 14:05:49 [bca.uk] INFO: Found listing with ID: FD21%20HBN
2026-03-28 14:05:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FD21%2520HBN%27 HTTP/1.1" 200 None
2026-03-28 14:05:49 [bca.uk] INFO: Scrape type for FD21%20HBN: 0
2026-03-28 14:05:49 [bca.uk] INFO: Found listing with ID: DP21%20OWH
2026-03-28 14:05:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DP21%2520OWH%27 HTTP/1.1" 200 None
2026-03-28 14:05:49 [bca.uk] INFO: Scrape type for DP21%20OWH: 0
2026-03-28 14:05:49 [bca.uk] INFO: Found listing with ID: WO18%20YOD
2026-03-28 14:05:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WO18%2520YOD%27 HTTP/1.1" 200 None
2026-03-28 14:05:49 [bca.uk] INFO: Scrape type for WO18%20YOD: 0
2026-03-28 14:05:49 [bca.uk] INFO: Found listing with ID: MA17%20CVN
2026-03-28 14:05:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MA17%2520CVN%27 HTTP/1.1" 200 None
2026-03-28 14:05:49 [bca.uk] INFO: Scrape type for MA17%20CVN: 0
2026-03-28 14:05:49 [bca.uk] INFO: Found listing with ID: MJ15%20AVR
2026-03-28 14:05:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MJ15%2520AVR%27 HTTP/1.1" 200 None
2026-03-28 14:05:49 [bca.uk] INFO: Scrape type for MJ15%20AVR: 0
2026-03-28 14:05:49 [bca.uk] INFO: Found listing with ID: SN66%20TXZ
2026-03-28 14:05:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SN66%2520TXZ%27 HTTP/1.1" 200 None
2026-03-28 14:05:49 [bca.uk] INFO: Scrape type for SN66%20TXZ: 0
2026-03-28 14:05:49 [bca.uk] INFO: Found listing with ID: BN02%20DLN
2026-03-28 14:05:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BN02%2520DLN%27 HTTP/1.1" 200 None
2026-03-28 14:05:49 [bca.uk] INFO: Scrape type for BN02%20DLN: 0
2026-03-28 14:05:49 [bca.uk] INFO: Found listing with ID: EF66%20URS
2026-03-28 14:05:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27EF66%2520URS%27 HTTP/1.1" 200 None
2026-03-28 14:05:49 [bca.uk] INFO: Scrape type for EF66%20URS: 0
2026-03-28 14:05:49 [bca.uk] INFO: Found listing with ID: LB17%20HFF
2026-03-28 14:05:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LB17%2520HFF%27 HTTP/1.1" 200 None
2026-03-28 14:05:49 [bca.uk] INFO: Scrape type for LB17%20HFF: 0
2026-03-28 14:05:49 [bca.uk] INFO: Found listing with ID: PF66%20DZV
2026-03-28 14:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27PF66%2520DZV%27 HTTP/1.1" 200 None
2026-03-28 14:05:50 [bca.uk] INFO: Scrape type for PF66%20DZV: 0
2026-03-28 14:05:50 [bca.uk] INFO: Found listing with ID: EK10%20VKV
2026-03-28 14:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27EK10%2520VKV%27 HTTP/1.1" 200 None
2026-03-28 14:05:50 [bca.uk] INFO: Scrape type for EK10%20VKV: 0
2026-03-28 14:05:50 [bca.uk] INFO: Found listing with ID: GR55%20ULB
2026-03-28 14:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GR55%2520ULB%27 HTTP/1.1" 200 None
2026-03-28 14:05:50 [bca.uk] INFO: Scrape type for GR55%20ULB: 0
2026-03-28 14:05:50 [bca.uk] INFO: Found listing with ID: ML11%20YCS
2026-03-28 14:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27ML11%2520YCS%27 HTTP/1.1" 200 None
2026-03-28 14:05:50 [bca.uk] INFO: Scrape type for ML11%20YCS: 0
2026-03-28 14:05:50 [bca.uk] INFO: Found listing with ID: BD66%20EUB
2026-03-28 14:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BD66%2520EUB%27 HTTP/1.1" 200 None
2026-03-28 14:05:50 [bca.uk] INFO: Scrape type for BD66%20EUB: 0
2026-03-28 14:05:50 [bca.uk] INFO: Found listing with ID: LD65%20HPZ
2026-03-28 14:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LD65%2520HPZ%27 HTTP/1.1" 200 None
2026-03-28 14:05:50 [bca.uk] INFO: Scrape type for LD65%20HPZ: 0
2026-03-28 14:05:50 [bca.uk] INFO: Found listing with ID: NV64%20RDZ
2026-03-28 14:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27NV64%2520RDZ%27 HTTP/1.1" 200 None
2026-03-28 14:05:50 [bca.uk] INFO: Scrape type for NV64%20RDZ: 0
2026-03-28 14:05:50 [bca.uk] INFO: Found listing with ID: BF65%20EKA
2026-03-28 14:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BF65%2520EKA%27 HTTP/1.1" 200 None
2026-03-28 14:05:50 [bca.uk] INFO: Scrape type for BF65%20EKA: 0
2026-03-28 14:05:50 [bca.uk] INFO: Found listing with ID: DE15%20YKD
2026-03-28 14:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DE15%2520YKD%27 HTTP/1.1" 200 None
2026-03-28 14:05:50 [bca.uk] INFO: Scrape type for DE15%20YKD: 2
2026-03-28 14:05:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 80e2559f-932b-58ac-9739-191c586f1464 with identifier: DE15%20YKD
2026-03-28 14:05:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 80e2559f-932b-58ac-9739-191c586f1464 with scrape type 2
2026-03-28 14:05:50 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 80e2559f-932b-58ac-9739-191c586f1464 with scrape type 2
2026-03-28 14:05:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 80e2559f-932b-58ac-9739-191c586f1464, identifier: DE15%20YKD
2026-03-28 14:05:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LD06WNS/698920815/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LD06WNS/42809781?sv=2020-08-04&st=2026-03-28T14%3A05%3A31Z&se=2026-03-28T14%3A30%3A31Z&sr=b&sp=r&sig=OTvnKFmvSmD2QJ4F%2F503KbBKEXfjVzDNMqEsXfGzuJ0%3D)
2026-03-28 14:05:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SA60NYT/698946995/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/SA60NYT/42810538?sv=2020-08-04&st=2026-03-28T14%3A05%3A31Z&se=2026-03-28T14%3A30%3A31Z&sr=b&sp=r&sig=E2aZntMhZA%2B%2F8gu6iOIeQUHtNbnCVBf4tuK50ckRu0U%3D)
2026-03-28 14:05:50 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LJ24UKC/698717176/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698717176>
2026-03-28 14:05:50 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LJ24UKC/698717195/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698717195>
2026-03-28 14:05:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 4f6f340e-f54d-5a5f-a637-cf3ca53d42f6 with identifier: AV09%20GXU
2026-03-28 14:05:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 4f6f340e-f54d-5a5f-a637-cf3ca53d42f6 with identifier: AV09%20GXU
2026-03-28 14:05:50 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 4f6f340e-f54d-5a5f-a637-cf3ca53d42f6 with identifier: AV09%20GXU to the API
2026-03-28 14:05:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:05:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:05:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=11&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 119,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=AV09%20GXU-GB',
'category': 'Car',
'color': 'white',
'currency': 'GBP',
'doors_number': 3,
'engine': '1.2L',
'expiration_date': '2026-03-29T10:00:00Z',
'fuel_type': 'Petrol',
'id': '4f6f340e-f54d-5a5f-a637-cf3ca53d42f6',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'AV09 GXU',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=AV09%20GXU&vehicleType=*',
'listing': 'auction',
'location': 'Blackbushe',
'make': 'FIAT',
'model': '500',
'odometer': 16390,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2009-01-01',
'seller_name': None,
'title': 'FIAT 500 1.2 LOUNGE Hatchback',
'transmission': 'manual',
'trim': 'LOUNGE',
'vin': 'ZFA31200000292977',
'year': 2009}
2026-03-28 14:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27AV09%2520GXU%27 HTTP/1.1" 200 None
2026-03-28 14:05:50 [bca.uk] INFO: Saving data for AV09%20GXU: {'auction_closing_time': 1774778400.0, 'created_time': 1774476822.75009, 'last_price_update_time': 1774706750.612096}
2026-03-28 14:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='AV09%2520GXU') HTTP/1.1" 204 0
2026-03-28 14:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698717287%27 HTTP/1.1" 200 None
2026-03-28 14:05:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698717287 not downloaded yet
2026-03-28 14:05:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 80e2559f-932b-58ac-9739-191c586f1464 with identifier: DE15%20YKD
2026-03-28 14:05:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 80e2559f-932b-58ac-9739-191c586f1464 with identifier: DE15%20YKD
2026-03-28 14:05:50 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 80e2559f-932b-58ac-9739-191c586f1464 with identifier: DE15%20YKD to the API
2026-03-28 14:05:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:05:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:05:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=12&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 164,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=DE15%20YKD-GB',
'category': 'Car',
'color': 'black',
'currency': 'GBP',
'doors_number': 5,
'engine': '2.0L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Diesel',
'id': '80e2559f-932b-58ac-9739-191c586f1464',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'DE15 YKD',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=DE15%20YKD&vehicleType=*',
'listing': 'auction',
'location': 'Manchester',
'make': 'SKODA',
'model': 'YETI',
'odometer': 95802,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-01-01',
'seller_name': None,
'title': 'SKODA YETI 2.0 TDI CR 140 BLACK ED. 4X4 DSG Estate',
'transmission': 'automatic',
'trim': 'TDI CR 140 BLACK ED. 4X4 DSG',
'vin': 'TMBMD75L9F6027141',
'year': 2015}
2026-03-28 14:05:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DE15%2520YKD%27 HTTP/1.1" 200 None
2026-03-28 14:05:51 [bca.uk] INFO: Saving data for DE15%20YKD: {'auction_closing_time': 1774864800.0, 'created_time': 1774523214.113987, 'last_price_update_time': 1774706751.066086}
2026-03-28 14:05:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='DE15%2520YKD') HTTP/1.1" 204 0
2026-03-28 14:05:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D697928854%27 HTTP/1.1" 200 None
2026-03-28 14:05:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=697928854 not downloaded yet
2026-03-28 14:05:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:05:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c4d1c10>
2026-03-28 14:05:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:05:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:05:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:05:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e5b1ecb7-cfa8-5758-b32f-ed9093a37d21/e5b1ecb7-cfa8-5758-b32f-ed9093a37d21_image_4.jpg HTTP/1.1" 201 0
2026-03-28 14:05:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FBU67HNA%252F698729656%252F600') HTTP/1.1" 204 0
2026-03-28 14:05:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BU67HNA/698729656/600 saved to cache
2026-03-28 14:05:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item e5b1ecb7-cfa8-5758-b32f-ed9093a37d21
2026-03-28 14:05:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:05:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c980150>
2026-03-28 14:05:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:05:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:05:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:05:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_389368a0-4349-5257-9e72-f8c2c2fc01c4/389368a0-4349-5257-9e72-f8c2c2fc01c4_image_0.jpg HTTP/1.1" 201 0
2026-03-28 14:05:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FSA60NYT%252F698946973%252F600') HTTP/1.1" 204 0
2026-03-28 14:05:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SA60NYT/698946973/600 saved to cache
2026-03-28 14:05:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 389368a0-4349-5257-9e72-f8c2c2fc01c4
2026-03-28 14:05:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:05:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2ca7f590>
2026-03-28 14:05:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:05:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:05:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:05:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bbfa1477-6876-5cb3-8bcc-b863e9aae5b2/bbfa1477-6876-5cb3-8bcc-b863e9aae5b2_image_0.jpg HTTP/1.1" 201 0
2026-03-28 14:05:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLD06WNS%252F698920809%252F600') HTTP/1.1" 204 0
2026-03-28 14:05:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LD06WNS/698920809/600 saved to cache
2026-03-28 14:05:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item bbfa1477-6876-5cb3-8bcc-b863e9aae5b2
2026-03-28 14:05:51 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SA60NYT/698947050/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698947050>
2026-03-28 14:05:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SA60NYT/698947003/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/SA60NYT/42810538?sv=2020-08-04&st=2026-03-28T14%3A05%3A31Z&se=2026-03-28T14%3A30%3A31Z&sr=b&sp=r&sig=E2aZntMhZA%2B%2F8gu6iOIeQUHtNbnCVBf4tuK50ckRu0U%3D)
2026-03-28 14:05:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LD57FXL/698934025/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LD57FXL/42810412?sv=2020-08-04&st=2026-03-28T14%3A05%3A27Z&se=2026-03-28T14%3A30%3A27Z&sr=b&sp=r&sig=SrrbefNVxYUh04mJFXEMP7I6EJU13XfRB%2BYQXtzw2lU%3D)
2026-03-28 14:05:51 [bca.uk] INFO: Found listing with ID: EN10%20PWV
2026-03-28 14:05:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27EN10%2520PWV%27 HTTP/1.1" 200 None
2026-03-28 14:05:51 [bca.uk] INFO: Scrape type for EN10%20PWV: 1
2026-03-28 14:05:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1da598bb-916d-5198-a760-5aef625fcf96 with identifier: EN10%20PWV
2026-03-28 14:05:51 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 1da598bb-916d-5198-a760-5aef625fcf96
2026-03-28 14:05:51 [bca.uk] INFO: Found listing with ID: KO17%20XBK
2026-03-28 14:05:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KO17%2520XBK%27 HTTP/1.1" 200 None
2026-03-28 14:05:51 [bca.uk] INFO: Scrape type for KO17%20XBK: 0
2026-03-28 14:05:51 [bca.uk] INFO: Found listing with ID: LL14%20KEK
2026-03-28 14:05:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LL14%2520KEK%27 HTTP/1.1" 200 None
2026-03-28 14:05:51 [bca.uk] INFO: Scrape type for LL14%20KEK: 0
2026-03-28 14:05:51 [bca.uk] INFO: Found listing with ID: MD16%20BFY
2026-03-28 14:05:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MD16%2520BFY%27 HTTP/1.1" 200 None
2026-03-28 14:05:51 [bca.uk] INFO: Scrape type for MD16%20BFY: 0
2026-03-28 14:05:51 [bca.uk] INFO: Found listing with ID: VHZ%203476
2026-03-28 14:05:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27VHZ%25203476%27 HTTP/1.1" 200 None
2026-03-28 14:05:51 [bca.uk] INFO: Scrape type for VHZ%203476: 0
2026-03-28 14:05:51 [bca.uk] INFO: Found listing with ID: YL67%20NGU
2026-03-28 14:05:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YL67%2520NGU%27 HTTP/1.1" 200 None
2026-03-28 14:05:51 [bca.uk] INFO: Scrape type for YL67%20NGU: 0
2026-03-28 14:05:51 [bca.uk] INFO: Found listing with ID: SV21%20ZGG
2026-03-28 14:05:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SV21%2520ZGG%27 HTTP/1.1" 200 None
2026-03-28 14:05:51 [bca.uk] INFO: Scrape type for SV21%20ZGG: 2
2026-03-28 14:05:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: acdef680-c502-5c14-a8a9-edb45a48a003 with identifier: SV21%20ZGG
2026-03-28 14:05:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item acdef680-c502-5c14-a8a9-edb45a48a003 with scrape type 2
2026-03-28 14:05:51 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item acdef680-c502-5c14-a8a9-edb45a48a003 with scrape type 2
2026-03-28 14:05:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: acdef680-c502-5c14-a8a9-edb45a48a003, identifier: SV21%20ZGG
2026-03-28 14:05:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LD06WNS/698920822/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LD06WNS/42809781?sv=2020-08-04&st=2026-03-28T14%3A05%3A31Z&se=2026-03-28T14%3A30%3A31Z&sr=b&sp=r&sig=OTvnKFmvSmD2QJ4F%2F503KbBKEXfjVzDNMqEsXfGzuJ0%3D)
2026-03-28 14:05:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698717312%27 HTTP/1.1" 200 None
2026-03-28 14:05:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698717312 not downloaded yet
2026-03-28 14:05:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: acdef680-c502-5c14-a8a9-edb45a48a003 with identifier: SV21%20ZGG
2026-03-28 14:05:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: acdef680-c502-5c14-a8a9-edb45a48a003 with identifier: SV21%20ZGG
2026-03-28 14:05:51 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: acdef680-c502-5c14-a8a9-edb45a48a003 with identifier: SV21%20ZGG to the API
2026-03-28 14:05:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:05:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:05:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=12&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 183,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=SV21%20ZGG-GB',
'category': 'Car',
'color': 'blue',
'currency': 'GBP',
'doors_number': 5,
'engine': '2.0L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Diesel',
'id': 'acdef680-c502-5c14-a8a9-edb45a48a003',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'SV21 ZGG',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=SV21%20ZGG&vehicleType=*',
'listing': 'auction',
'location': 'Manchester',
'make': 'LAND ROVER',
'model': 'DISCOVERY SPORT',
'odometer': 84059,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-01-01',
'seller_name': None,
'title': 'LAND ROVER DISCOVERY SPORT 2.0 D200 R-DYNAMIC SE (7ST) StationWagon',
'transmission': 'automatic',
'trim': 'D200 R-DYNAMIC SE (7ST)',
'vin': 'SALCA2AN2MH887813',
'year': 2021}
2026-03-28 14:05:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SV21%2520ZGG%27 HTTP/1.1" 200 None
2026-03-28 14:05:51 [bca.uk] INFO: Saving data for SV21%20ZGG: {'auction_closing_time': 1774864800.0, 'created_time': 1774305575.653971, 'last_price_update_time': 1774706751.799926}
2026-03-28 14:05:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='SV21%2520ZGG') HTTP/1.1" 204 0
2026-03-28 14:05:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D697928857%27 HTTP/1.1" 200 None
2026-03-28 14:05:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=697928857 not downloaded yet
2026-03-28 14:05:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:05:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2ca2c290>
2026-03-28 14:05:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:05:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:05:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:05:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_389368a0-4349-5257-9e72-f8c2c2fc01c4/389368a0-4349-5257-9e72-f8c2c2fc01c4_image_1.jpg HTTP/1.1" 201 0
2026-03-28 14:05:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FSA60NYT%252F698946982%252F600') HTTP/1.1" 204 0
2026-03-28 14:05:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SA60NYT/698946982/600 saved to cache
2026-03-28 14:05:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 389368a0-4349-5257-9e72-f8c2c2fc01c4
2026-03-28 14:05:51 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LD06WNS/698920839/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698920839>
2026-03-28 14:05:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SA60NYT/698947015/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/SA60NYT/42810538?sv=2020-08-04&st=2026-03-28T14%3A05%3A31Z&se=2026-03-28T14%3A30%3A31Z&sr=b&sp=r&sig=E2aZntMhZA%2B%2F8gu6iOIeQUHtNbnCVBf4tuK50ckRu0U%3D)
2026-03-28 14:05:51 [bca.uk] INFO: Found listing with ID: HY60%20RUC
2026-03-28 14:05:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27HY60%2520RUC%27 HTTP/1.1" 200 None
2026-03-28 14:05:51 [bca.uk] INFO: Scrape type for HY60%20RUC: 1
2026-03-28 14:05:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c8897eb2-3293-514c-86a5-f8c7210c23b1 with identifier: HY60%20RUC
2026-03-28 14:05:51 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item c8897eb2-3293-514c-86a5-f8c7210c23b1
2026-03-28 14:05:51 [bca.uk] INFO: Found listing with ID: KE18%20FBA
2026-03-28 14:05:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KE18%2520FBA%27 HTTP/1.1" 200 None
2026-03-28 14:05:51 [bca.uk] INFO: Scrape type for KE18%20FBA: 0
2026-03-28 14:05:51 [bca.uk] INFO: Found listing with ID: YP18%20HSO
2026-03-28 14:05:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YP18%2520HSO%27 HTTP/1.1" 200 None
2026-03-28 14:05:51 [bca.uk] INFO: Scrape type for YP18%20HSO: 0
2026-03-28 14:05:51 [bca.uk] INFO: Found listing with ID: FH18%20LKJ
2026-03-28 14:05:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FH18%2520LKJ%27 HTTP/1.1" 200 None
2026-03-28 14:05:51 [bca.uk] INFO: Scrape type for FH18%20LKJ: 0
2026-03-28 14:05:51 [bca.uk] INFO: Found listing with ID: HV54%20YKM
2026-03-28 14:05:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27HV54%2520YKM%27 HTTP/1.1" 200 None
2026-03-28 14:05:51 [bca.uk] INFO: Scrape type for HV54%20YKM: 0
2026-03-28 14:05:51 [bca.uk] INFO: Found listing with ID: LF64%20ZKW
2026-03-28 14:05:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LF64%2520ZKW%27 HTTP/1.1" 200 None
2026-03-28 14:05:51 [bca.uk] INFO: Scrape type for LF64%20ZKW: 0
2026-03-28 14:05:51 [bca.uk] INFO: Found listing with ID: SH16%20FAF
2026-03-28 14:05:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SH16%2520FAF%27 HTTP/1.1" 200 None
2026-03-28 14:05:51 [bca.uk] INFO: Scrape type for SH16%20FAF: 0
2026-03-28 14:05:51 [bca.uk] INFO: Found listing with ID: SP17%20UUO
2026-03-28 14:05:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SP17%2520UUO%27 HTTP/1.1" 200 None
2026-03-28 14:05:51 [bca.uk] INFO: Scrape type for SP17%20UUO: 2
2026-03-28 14:05:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0e742a26-740e-56a5-b6f1-5afea372aced with identifier: SP17%20UUO
2026-03-28 14:05:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0e742a26-740e-56a5-b6f1-5afea372aced with scrape type 2
2026-03-28 14:05:51 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0e742a26-740e-56a5-b6f1-5afea372aced with scrape type 2
2026-03-28 14:05:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 0e742a26-740e-56a5-b6f1-5afea372aced, identifier: SP17%20UUO
2026-03-28 14:05:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:05:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2d984c90>
2026-03-28 14:05:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:05:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:05:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:05:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bbfa1477-6876-5cb3-8bcc-b863e9aae5b2/bbfa1477-6876-5cb3-8bcc-b863e9aae5b2_image_2.jpg HTTP/1.1" 201 0
2026-03-28 14:05:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLD06WNS%252F698920815%252F600') HTTP/1.1" 204 0
2026-03-28 14:05:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LD06WNS/698920815/600 saved to cache
2026-03-28 14:05:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item bbfa1477-6876-5cb3-8bcc-b863e9aae5b2
2026-03-28 14:05:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:05:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c4d3e90>
2026-03-28 14:05:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:05:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:05:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:05:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_389368a0-4349-5257-9e72-f8c2c2fc01c4/389368a0-4349-5257-9e72-f8c2c2fc01c4_image_2.jpg HTTP/1.1" 201 0
2026-03-28 14:05:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FSA60NYT%252F698946995%252F600') HTTP/1.1" 204 0
2026-03-28 14:05:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SA60NYT/698946995/600 saved to cache
2026-03-28 14:05:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 389368a0-4349-5257-9e72-f8c2c2fc01c4
2026-03-28 14:05:52 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SA60NYT/698947090/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698947090>
2026-03-28 14:05:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LJ24UKC/698717152/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LJ24UKC/42810350?sv=2020-08-04&st=2026-03-28T14%3A05%3A36Z&se=2026-03-28T14%3A30%3A36Z&sr=b&sp=r&sig=cuxyo0kEMI6Rf8WOKAH0rgALMpgPmn%2FBYgPsLsWZGdY%3D)
2026-03-28 14:05:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BU67HNA/698729755/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/BU67HNA/42810584?sv=2020-08-04&st=2026-03-28T14%3A05%3A27Z&se=2026-03-28T14%3A30%3A27Z&sr=b&sp=r&sig=jvqWs0bbwwPNyCuILhTmpoSOvgJ5gvo7FW1OJ3cgP4I%3D)
2026-03-28 14:05:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LD57FXL/698934069/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LD57FXL/42810412?sv=2020-08-04&st=2026-03-28T14%3A05%3A27Z&se=2026-03-28T14%3A30%3A27Z&sr=b&sp=r&sig=SrrbefNVxYUh04mJFXEMP7I6EJU13XfRB%2BYQXtzw2lU%3D)
2026-03-28 14:05:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698717332%27 HTTP/1.1" 200 None
2026-03-28 14:05:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698717332 not downloaded yet
2026-03-28 14:05:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 0e742a26-740e-56a5-b6f1-5afea372aced with identifier: SP17%20UUO
2026-03-28 14:05:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 0e742a26-740e-56a5-b6f1-5afea372aced with identifier: SP17%20UUO
2026-03-28 14:05:52 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 0e742a26-740e-56a5-b6f1-5afea372aced with identifier: SP17%20UUO to the API
2026-03-28 14:05:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:05:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:05:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=12&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 162,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=SP17%20UUO-GB',
'category': 'Car',
'color': 'white',
'currency': 'GBP',
'doors_number': 5,
'engine': '2.0L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Diesel',
'id': '0e742a26-740e-56a5-b6f1-5afea372aced',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'SP17 UUO',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=SP17%20UUO&vehicleType=*',
'listing': 'auction',
'location': 'Bedford',
'make': 'NISSAN',
'model': 'X-TRAIL',
'odometer': 88732,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-01-01',
'seller_name': None,
'title': 'NISSAN X-TRAIL 2.0 DCI 175 4WD TEKNA (7ST) X-T StationWagon',
'transmission': 'automatic',
'trim': 'DCI 175 4WD TEKNA (7ST) X-T',
'vin': 'JN1JFNT32U0000389',
'year': 2017}
2026-03-28 14:05:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SP17%2520UUO%27 HTTP/1.1" 200 None
2026-03-28 14:05:52 [bca.uk] INFO: Saving data for SP17%20UUO: {'auction_closing_time': 1774864800.0, 'created_time': 1773960305.732048, 'last_price_update_time': 1774706752.577743}
2026-03-28 14:05:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='SP17%2520UUO') HTTP/1.1" 204 0
2026-03-28 14:05:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D697928859%27 HTTP/1.1" 200 None
2026-03-28 14:05:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=697928859 not downloaded yet
2026-03-28 14:05:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:05:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c62b090>
2026-03-28 14:05:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:05:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:05:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:05:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_389368a0-4349-5257-9e72-f8c2c2fc01c4/389368a0-4349-5257-9e72-f8c2c2fc01c4_image_3.jpg HTTP/1.1" 201 0
2026-03-28 14:05:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FSA60NYT%252F698947003%252F600') HTTP/1.1" 204 0
2026-03-28 14:05:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SA60NYT/698947003/600 saved to cache
2026-03-28 14:05:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 389368a0-4349-5257-9e72-f8c2c2fc01c4
2026-03-28 14:05:52 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:05:52 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:05:52 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:05:52 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:05:52 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:05:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:05:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c4d3910>
2026-03-28 14:05:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:05:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:05:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:05:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_64e95b6e-a78f-537e-8c08-58f1a7f0a9cb/64e95b6e-a78f-537e-8c08-58f1a7f0a9cb_image_7.jpg HTTP/1.1" 201 0
2026-03-28 14:05:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLD57FXL%252F698934025%252F600') HTTP/1.1" 204 0
2026-03-28 14:05:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LD57FXL/698934025/600 saved to cache
2026-03-28 14:05:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 64e95b6e-a78f-537e-8c08-58f1a7f0a9cb
2026-03-28 14:05:52 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/OW69BUU/697928846/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=697928846>
2026-03-28 14:05:52 [bca.uk] INFO: Found listing with ID: KN15%20KNH
2026-03-28 14:05:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KN15%2520KNH%27 HTTP/1.1" 200 None
2026-03-28 14:05:52 [bca.uk] INFO: Scrape type for KN15%20KNH: 2
2026-03-28 14:05:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ca5f7f48-f04f-5de2-8650-ab115398ba06 with identifier: KN15%20KNH
2026-03-28 14:05:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ca5f7f48-f04f-5de2-8650-ab115398ba06 with scrape type 2
2026-03-28 14:05:52 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ca5f7f48-f04f-5de2-8650-ab115398ba06 with scrape type 2
2026-03-28 14:05:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: ca5f7f48-f04f-5de2-8650-ab115398ba06, identifier: KN15%20KNH
2026-03-28 14:05:52 [bca.uk] INFO: Found listing with ID: YC17%20HBJ
2026-03-28 14:05:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YC17%2520HBJ%27 HTTP/1.1" 200 None
2026-03-28 14:05:52 [bca.uk] INFO: Scrape type for YC17%20HBJ: 2
2026-03-28 14:05:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 96b1bede-a211-5ff3-9f97-5b8bce4990e8 with identifier: YC17%20HBJ
2026-03-28 14:05:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 96b1bede-a211-5ff3-9f97-5b8bce4990e8 with scrape type 2
2026-03-28 14:05:52 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 96b1bede-a211-5ff3-9f97-5b8bce4990e8 with scrape type 2
2026-03-28 14:05:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 96b1bede-a211-5ff3-9f97-5b8bce4990e8, identifier: YC17%20HBJ
2026-03-28 14:05:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:05:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2dcd7f90>
2026-03-28 14:05:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:05:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:05:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:05:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bbfa1477-6876-5cb3-8bcc-b863e9aae5b2/bbfa1477-6876-5cb3-8bcc-b863e9aae5b2_image_3.jpg HTTP/1.1" 201 0
2026-03-28 14:05:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLD06WNS%252F698920822%252F600') HTTP/1.1" 204 0
2026-03-28 14:05:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LD06WNS/698920822/600 saved to cache
2026-03-28 14:05:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item bbfa1477-6876-5cb3-8bcc-b863e9aae5b2
2026-03-28 14:05:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LD06WNS/698920830/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LD06WNS/42809781?sv=2020-08-04&st=2026-03-28T14%3A05%3A31Z&se=2026-03-28T14%3A30%3A31Z&sr=b&sp=r&sig=OTvnKFmvSmD2QJ4F%2F503KbBKEXfjVzDNMqEsXfGzuJ0%3D)
2026-03-28 14:05:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LJ24UKC/698717195/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LJ24UKC/42810350?sv=2020-08-04&st=2026-03-28T14%3A05%3A36Z&se=2026-03-28T14%3A30%3A36Z&sr=b&sp=r&sig=cuxyo0kEMI6Rf8WOKAH0rgALMpgPmn%2FBYgPsLsWZGdY%3D)
2026-03-28 14:05:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LJ24UKC/698717176/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LJ24UKC/42810350?sv=2020-08-04&st=2026-03-28T14%3A05%3A36Z&se=2026-03-28T14%3A30%3A36Z&sr=b&sp=r&sig=cuxyo0kEMI6Rf8WOKAH0rgALMpgPmn%2FBYgPsLsWZGdY%3D)
2026-03-28 14:05:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: ca5f7f48-f04f-5de2-8650-ab115398ba06 with identifier: KN15%20KNH
2026-03-28 14:05:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: ca5f7f48-f04f-5de2-8650-ab115398ba06 with identifier: KN15%20KNH
2026-03-28 14:05:53 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: ca5f7f48-f04f-5de2-8650-ab115398ba06 with identifier: KN15%20KNH to the API
2026-03-28 14:05:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:05:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:05:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=11&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 145,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=KN15%20KNH-GB',
'category': 'Car',
'color': 'blue',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.6L',
'expiration_date': '2026-03-29T10:00:00Z',
'fuel_type': 'Petrol',
'id': 'ca5f7f48-f04f-5de2-8650-ab115398ba06',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'KN15 KNH',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=KN15%20KNH&vehicleType=*',
'listing': 'auction',
'location': 'Blackbushe',
'make': 'NISSAN',
'model': 'JUKE',
'odometer': 43285,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-01-01',
'seller_name': None,
'title': 'NISSAN JUKE 1.6 TEKNA XTRONIC Hatchback',
'transmission': 'automatic',
'trim': 'TEKNA XTRONIC',
'vin': 'SJNFBAF15U7103038',
'year': 2015}
2026-03-28 14:05:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KN15%2520KNH%27 HTTP/1.1" 200 None
2026-03-28 14:05:53 [bca.uk] INFO: Saving data for KN15%20KNH: {'auction_closing_time': 1774778400.0, 'created_time': 1774592198.523838, 'last_price_update_time': 1774706753.436818}
2026-03-28 14:05:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='KN15%2520KNH') HTTP/1.1" 204 0
2026-03-28 14:05:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 96b1bede-a211-5ff3-9f97-5b8bce4990e8 with identifier: YC17%20HBJ
2026-03-28 14:05:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 96b1bede-a211-5ff3-9f97-5b8bce4990e8 with identifier: YC17%20HBJ
2026-03-28 14:05:53 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 96b1bede-a211-5ff3-9f97-5b8bce4990e8 with identifier: YC17%20HBJ to the API
2026-03-28 14:05:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:05:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:05:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=12&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 115,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=YC17%20HBJ-GB',
'category': 'Car',
'color': 'grey',
'currency': 'GBP',
'doors_number': 5,
'engine': '2.0L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Diesel',
'id': '96b1bede-a211-5ff3-9f97-5b8bce4990e8',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'YC17 HBJ',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=YC17%20HBJ&vehicleType=*',
'listing': 'auction',
'location': 'Bedford',
'make': 'BMW',
'model': '2 GRAN TOURER',
'odometer': 70067,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-01-01',
'seller_name': None,
'title': 'BMW 2 GRAN TOURER 2.0 218D SE STEP MPV',
'transmission': 'automatic',
'trim': '218D SE STEP',
'vin': 'WBA2E520605C96018',
'year': 2017}
2026-03-28 14:05:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YC17%2520HBJ%27 HTTP/1.1" 200 None
2026-03-28 14:05:53 [bca.uk] INFO: Saving data for YC17%20HBJ: {'auction_closing_time': 1774864800.0, 'created_time': 1773822794.301799, 'last_price_update_time': 1774706753.765252}
2026-03-28 14:05:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='YC17%2520HBJ') HTTP/1.1" 204 0
2026-03-28 14:05:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D697928863%27 HTTP/1.1" 200 None
2026-03-28 14:05:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=697928863 not downloaded yet
2026-03-28 14:05:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:05:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c3a0c10>
2026-03-28 14:05:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:05:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:05:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:05:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_389368a0-4349-5257-9e72-f8c2c2fc01c4/389368a0-4349-5257-9e72-f8c2c2fc01c4_image_4.jpg HTTP/1.1" 201 0
2026-03-28 14:05:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FSA60NYT%252F698947015%252F600') HTTP/1.1" 204 0
2026-03-28 14:05:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SA60NYT/698947015/600 saved to cache
2026-03-28 14:05:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 389368a0-4349-5257-9e72-f8c2c2fc01c4
2026-03-28 14:05:53 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SA60NYT/698947154/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698947154>
2026-03-28 14:05:53 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/OW69BUU/697928852/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=697928852>
2026-03-28 14:05:53 [bca.uk] INFO: Found listing with ID: SA68%20XMR
2026-03-28 14:05:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SA68%2520XMR%27 HTTP/1.1" 200 None
2026-03-28 14:05:53 [bca.uk] INFO: Scrape type for SA68%20XMR: 2
2026-03-28 14:05:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fe862e28-2c15-5126-bca2-b8e27750cdaf with identifier: SA68%20XMR
2026-03-28 14:05:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fe862e28-2c15-5126-bca2-b8e27750cdaf with scrape type 2
2026-03-28 14:05:53 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item fe862e28-2c15-5126-bca2-b8e27750cdaf with scrape type 2
2026-03-28 14:05:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: fe862e28-2c15-5126-bca2-b8e27750cdaf, identifier: SA68%20XMR
2026-03-28 14:05:53 [bca.uk] INFO: Found listing with ID: EY66%20AWF
2026-03-28 14:05:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27EY66%2520AWF%27 HTTP/1.1" 200 None
2026-03-28 14:05:54 [bca.uk] INFO: Scrape type for EY66%20AWF: 2
2026-03-28 14:05:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b3e5b45e-38b7-554f-b247-0a065c20dfa3 with identifier: EY66%20AWF
2026-03-28 14:05:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b3e5b45e-38b7-554f-b247-0a065c20dfa3 with scrape type 2
2026-03-28 14:05:54 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b3e5b45e-38b7-554f-b247-0a065c20dfa3 with scrape type 2
2026-03-28 14:05:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: b3e5b45e-38b7-554f-b247-0a065c20dfa3, identifier: EY66%20AWF
2026-03-28 14:05:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:05:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2de0b850>
2026-03-28 14:05:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:05:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:05:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:05:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e21ba6d8-ccbd-5912-bd24-f51d3dc89889/e21ba6d8-ccbd-5912-bd24-f51d3dc89889_image_1.jpg HTTP/1.1" 201 0
2026-03-28 14:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLJ24UKC%252F698717152%252F600') HTTP/1.1" 204 0
2026-03-28 14:05:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LJ24UKC/698717152/600 saved to cache
2026-03-28 14:05:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item e21ba6d8-ccbd-5912-bd24-f51d3dc89889
2026-03-28 14:05:54 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:05:54 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:05:54 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:05:54 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:05:54 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:05:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:05:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c3a6510>
2026-03-28 14:05:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:05:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:05:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:05:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e5b1ecb7-cfa8-5758-b32f-ed9093a37d21/e5b1ecb7-cfa8-5758-b32f-ed9093a37d21_image_9.jpg HTTP/1.1" 201 0
2026-03-28 14:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FBU67HNA%252F698729755%252F600') HTTP/1.1" 204 0
2026-03-28 14:05:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BU67HNA/698729755/600 saved to cache
2026-03-28 14:05:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item e5b1ecb7-cfa8-5758-b32f-ed9093a37d21
2026-03-28 14:05:54 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:05:54 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:05:54 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:05:54 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:05:54 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:05:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:05:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c62a710>
2026-03-28 14:05:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:05:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:05:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:05:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_64e95b6e-a78f-537e-8c08-58f1a7f0a9cb/64e95b6e-a78f-537e-8c08-58f1a7f0a9cb_image_9.jpg HTTP/1.1" 201 0
2026-03-28 14:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLD57FXL%252F698934069%252F600') HTTP/1.1" 204 0
2026-03-28 14:05:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LD57FXL/698934069/600 saved to cache
2026-03-28 14:05:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 64e95b6e-a78f-537e-8c08-58f1a7f0a9cb
2026-03-28 14:05:54 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LJ24UKC/698717262/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698717262>
2026-03-28 14:05:54 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SA60NYT/698947119/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698947119>
2026-03-28 14:05:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SA60NYT/698947050/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/SA60NYT/42810538?sv=2020-08-04&st=2026-03-28T14%3A05%3A31Z&se=2026-03-28T14%3A30%3A31Z&sr=b&sp=r&sig=E2aZntMhZA%2B%2F8gu6iOIeQUHtNbnCVBf4tuK50ckRu0U%3D)
2026-03-28 14:05:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: fe862e28-2c15-5126-bca2-b8e27750cdaf with identifier: SA68%20XMR
2026-03-28 14:05:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: fe862e28-2c15-5126-bca2-b8e27750cdaf with identifier: SA68%20XMR
2026-03-28 14:05:54 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: fe862e28-2c15-5126-bca2-b8e27750cdaf with identifier: SA68%20XMR to the API
2026-03-28 14:05:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:05:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:05:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=11&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 109,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=SA68%20XMR-GB',
'category': 'Car',
'color': 'black',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.2L',
'expiration_date': '2026-03-29T10:00:00Z',
'fuel_type': 'Petrol',
'id': 'fe862e28-2c15-5126-bca2-b8e27750cdaf',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'SA68 XMR',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=SA68%20XMR&vehicleType=*',
'listing': 'auction',
'location': 'Birmingham - Perry Barr',
'make': 'CITROEN',
'model': 'C3 AIRCROSS',
'odometer': 86925,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-01-01',
'seller_name': None,
'title': 'CITROEN C3 AIRCROSS 1.2 P/T 110 FEEL (6) Hatchback',
'transmission': 'manual',
'trim': 'P/T 110 FEEL (6)',
'vin': 'VF72RHNPJJ4417924',
'year': 2018}
2026-03-28 14:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SA68%2520XMR%27 HTTP/1.1" 200 None
2026-03-28 14:05:54 [bca.uk] INFO: Saving data for SA68%20XMR: {'auction_closing_time': 1774778400.0, 'created_time': 1774045669.21633, 'last_price_update_time': 1774706754.56686}
2026-03-28 14:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='SA68%2520XMR') HTTP/1.1" 204 0
2026-03-28 14:05:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: b3e5b45e-38b7-554f-b247-0a065c20dfa3 with identifier: EY66%20AWF
2026-03-28 14:05:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: b3e5b45e-38b7-554f-b247-0a065c20dfa3 with identifier: EY66%20AWF
2026-03-28 14:05:54 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: b3e5b45e-38b7-554f-b247-0a065c20dfa3 with identifier: EY66%20AWF to the API
2026-03-28 14:05:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:05:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:05:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=12&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 111,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=EY66%20AWF-GB',
'category': 'Car',
'color': 'white',
'currency': 'GBP',
'doors_number': 4,
'engine': '1.6L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Diesel',
'id': 'b3e5b45e-38b7-554f-b247-0a065c20dfa3',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'EY66 AWF',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=EY66%20AWF&vehicleType=*',
'listing': 'auction',
'location': 'Bedford',
'make': 'MERCEDES-BENZ',
'model': 'C200 D',
'odometer': 90584,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-01-01',
'seller_name': None,
'title': 'MERCEDES-BENZ C200 D 1.6 SPORT Saloon',
'transmission': 'manual',
'trim': 'SPORT',
'vin': 'WDD2050372R233076',
'year': 2016}
2026-03-28 14:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27EY66%2520AWF%27 HTTP/1.1" 200 None
2026-03-28 14:05:54 [bca.uk] INFO: Saving data for EY66%20AWF: {'auction_closing_time': 1774864800.0, 'created_time': 1773822811.851359, 'last_price_update_time': 1774706754.930632}
2026-03-28 14:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='EY66%2520AWF') HTTP/1.1" 204 0
2026-03-28 14:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D697928869%27 HTTP/1.1" 200 None
2026-03-28 14:05:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=697928869 not downloaded yet
2026-03-28 14:05:54 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/EN10PWV/42809685?sv=2020-08-04&st=2026-03-28T14%3A05%3A53Z&se=2026-03-28T14%3A30%3A53Z&sr=b&sp=r&sig=0bUhTFZOWsPha81YwFXHCk91lxzBfSWRH%2BlFeQKDFV0%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=EN10%20PWV-GB>
2026-03-28 14:05:54 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/OW69BUU/697928854/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=697928854>
2026-03-28 14:05:54 [bca.uk] INFO: Found listing with ID: DE67%20URY
2026-03-28 14:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DE67%2520URY%27 HTTP/1.1" 200 None
2026-03-28 14:05:54 [bca.uk] INFO: Scrape type for DE67%20URY: 2
2026-03-28 14:05:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5bed7e35-47a1-5300-8006-fa9f8379b6dc with identifier: DE67%20URY
2026-03-28 14:05:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5bed7e35-47a1-5300-8006-fa9f8379b6dc with scrape type 2
2026-03-28 14:05:54 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5bed7e35-47a1-5300-8006-fa9f8379b6dc with scrape type 2
2026-03-28 14:05:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 5bed7e35-47a1-5300-8006-fa9f8379b6dc, identifier: DE67%20URY
2026-03-28 14:05:55 [bca.uk] INFO: Found listing with ID: AV56%20FEX
2026-03-28 14:05:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27AV56%2520FEX%27 HTTP/1.1" 200 None
2026-03-28 14:05:55 [bca.uk] INFO: Scrape type for AV56%20FEX: 0
2026-03-28 14:05:55 [bca.uk] INFO: Found listing with ID: EK63%20ZDN
2026-03-28 14:05:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27EK63%2520ZDN%27 HTTP/1.1" 200 None
2026-03-28 14:05:55 [bca.uk] INFO: Scrape type for EK63%20ZDN: 0
2026-03-28 14:05:55 [bca.uk] INFO: Found listing with ID: GY61%20XPC
2026-03-28 14:05:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GY61%2520XPC%27 HTTP/1.1" 200 None
2026-03-28 14:05:55 [bca.uk] INFO: Scrape type for GY61%20XPC: 0
2026-03-28 14:05:55 [bca.uk] INFO: Found listing with ID: LC16%20BCV
2026-03-28 14:05:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LC16%2520BCV%27 HTTP/1.1" 200 None
2026-03-28 14:05:55 [bca.uk] INFO: Scrape type for LC16%20BCV: 0
2026-03-28 14:05:55 [bca.uk] INFO: Found listing with ID: LO13%20NYW
2026-03-28 14:05:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LO13%2520NYW%27 HTTP/1.1" 200 None
2026-03-28 14:05:55 [bca.uk] INFO: Scrape type for LO13%20NYW: 0
2026-03-28 14:05:55 [bca.uk] INFO: Found listing with ID: ND21%20TWM
2026-03-28 14:05:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27ND21%2520TWM%27 HTTP/1.1" 200 None
2026-03-28 14:05:55 [bca.uk] INFO: Scrape type for ND21%20TWM: 0
2026-03-28 14:05:55 [bca.uk] INFO: Found listing with ID: OV62%20USF
2026-03-28 14:05:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27OV62%2520USF%27 HTTP/1.1" 200 None
2026-03-28 14:05:55 [bca.uk] INFO: Scrape type for OV62%20USF: 0
2026-03-28 14:05:55 [bca.uk] INFO: Found listing with ID: YR18%20HBP
2026-03-28 14:05:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YR18%2520HBP%27 HTTP/1.1" 200 None
2026-03-28 14:05:55 [bca.uk] INFO: Scrape type for YR18%20HBP: 0
2026-03-28 14:05:55 [bca.uk] INFO: Found listing with ID: LG65%20ZPF
2026-03-28 14:05:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LG65%2520ZPF%27 HTTP/1.1" 200 None
2026-03-28 14:05:55 [bca.uk] INFO: Scrape type for LG65%20ZPF: 0
2026-03-28 14:05:55 [bca.uk] INFO: Found listing with ID: JE51%20XXE
2026-03-28 14:05:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27JE51%2520XXE%27 HTTP/1.1" 200 None
2026-03-28 14:05:55 [bca.uk] INFO: Scrape type for JE51%20XXE: 0
2026-03-28 14:05:55 [bca.uk] INFO: Found listing with ID: YP67%20WCD
2026-03-28 14:05:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YP67%2520WCD%27 HTTP/1.1" 200 None
2026-03-28 14:05:55 [bca.uk] INFO: Scrape type for YP67%20WCD: 0
2026-03-28 14:05:55 [bca.uk] INFO: Found listing with ID: MM14%20NXE
2026-03-28 14:05:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MM14%2520NXE%27 HTTP/1.1" 200 None
2026-03-28 14:05:55 [bca.uk] INFO: Scrape type for MM14%20NXE: 0
2026-03-28 14:05:55 [bca.uk] INFO: Found listing with ID: YW15%20NRU
2026-03-28 14:05:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YW15%2520NRU%27 HTTP/1.1" 200 None
2026-03-28 14:05:55 [bca.uk] INFO: Scrape type for YW15%20NRU: 2
2026-03-28 14:05:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3d631b39-8739-5305-90c2-2d03d8b8dce4 with identifier: YW15%20NRU
2026-03-28 14:05:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3d631b39-8739-5305-90c2-2d03d8b8dce4 with scrape type 2
2026-03-28 14:05:55 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3d631b39-8739-5305-90c2-2d03d8b8dce4 with scrape type 2
2026-03-28 14:05:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 3d631b39-8739-5305-90c2-2d03d8b8dce4, identifier: YW15%20NRU
2026-03-28 14:05:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:05:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2d8517d0>
2026-03-28 14:05:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:05:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:05:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:05:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bbfa1477-6876-5cb3-8bcc-b863e9aae5b2/bbfa1477-6876-5cb3-8bcc-b863e9aae5b2_image_5.jpg HTTP/1.1" 201 0
2026-03-28 14:05:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLD06WNS%252F698920830%252F600') HTTP/1.1" 204 0
2026-03-28 14:05:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LD06WNS/698920830/600 saved to cache
2026-03-28 14:05:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item bbfa1477-6876-5cb3-8bcc-b863e9aae5b2
2026-03-28 14:05:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:05:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2d9031d0>
2026-03-28 14:05:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:05:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:05:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:05:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e21ba6d8-ccbd-5912-bd24-f51d3dc89889/e21ba6d8-ccbd-5912-bd24-f51d3dc89889_image_3.jpg HTTP/1.1" 201 0
2026-03-28 14:05:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLJ24UKC%252F698717195%252F600') HTTP/1.1" 204 0
2026-03-28 14:05:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LJ24UKC/698717195/600 saved to cache
2026-03-28 14:05:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item e21ba6d8-ccbd-5912-bd24-f51d3dc89889
2026-03-28 14:05:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:05:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2ca5edd0>
2026-03-28 14:05:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:05:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:05:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:05:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e21ba6d8-ccbd-5912-bd24-f51d3dc89889/e21ba6d8-ccbd-5912-bd24-f51d3dc89889_image_2.jpg HTTP/1.1" 201 0
2026-03-28 14:05:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLJ24UKC%252F698717176%252F600') HTTP/1.1" 204 0
2026-03-28 14:05:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LJ24UKC/698717176/600 saved to cache
2026-03-28 14:05:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item e21ba6d8-ccbd-5912-bd24-f51d3dc89889
2026-03-28 14:05:55 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/OW69BUU/697928857/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=697928857>
2026-03-28 14:05:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 5bed7e35-47a1-5300-8006-fa9f8379b6dc with identifier: DE67%20URY
2026-03-28 14:05:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 5bed7e35-47a1-5300-8006-fa9f8379b6dc with identifier: DE67%20URY
2026-03-28 14:05:55 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 5bed7e35-47a1-5300-8006-fa9f8379b6dc with identifier: DE67%20URY to the API
2026-03-28 14:05:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:05:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:05:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=11&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 128,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=DE67%20URY-GB',
'category': 'Car',
'color': 'silver',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.4L',
'expiration_date': '2026-03-29T10:00:00Z',
'fuel_type': 'Petrol',
'id': '5bed7e35-47a1-5300-8006-fa9f8379b6dc',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'DE67 URY',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=DE67%20URY&vehicleType=*',
'listing': 'auction',
'location': 'Birmingham - Perry Barr',
'make': 'VAUXHALL',
'model': 'ASTRA',
'odometer': 19972,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-01-01',
'seller_name': None,
'title': 'VAUXHALL ASTRA 1.4 T 16V 150 SRI Hatchback',
'transmission': 'manual',
'trim': 'T 16V 150 SRI',
'vin': 'W0VBF6EC1JG031365',
'year': 2017}
2026-03-28 14:05:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DE67%2520URY%27 HTTP/1.1" 200 None
2026-03-28 14:05:56 [bca.uk] INFO: Saving data for DE67%20URY: {'auction_closing_time': 1774778400.0, 'created_time': 1774524253.041124, 'last_price_update_time': 1774706756.912833}
2026-03-28 14:05:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='DE67%2520URY') HTTP/1.1" 204 0
2026-03-28 14:05:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 3d631b39-8739-5305-90c2-2d03d8b8dce4 with identifier: YW15%20NRU
2026-03-28 14:05:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 3d631b39-8739-5305-90c2-2d03d8b8dce4 with identifier: YW15%20NRU
2026-03-28 14:05:57 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 3d631b39-8739-5305-90c2-2d03d8b8dce4 with identifier: YW15%20NRU to the API
2026-03-28 14:05:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:05:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:05:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=12&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 99,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=YW15%20NRU-GB',
'category': 'Car',
'color': 'red',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.0L',
'expiration_date': '2026-03-29T10:00:00Z',
'fuel_type': 'Petrol',
'id': '3d631b39-8739-5305-90c2-2d03d8b8dce4',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'YW15 NRU',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=YW15%20NRU&vehicleType=*',
'listing': 'auction',
'location': 'Nottingham',
'make': 'FORD',
'model': 'FIESTA',
'odometer': 96753,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-01-01',
'seller_name': None,
'title': 'FORD FIESTA 1.0 E/B 100 ZETEC Hatchback',
'transmission': 'manual',
'trim': 'E/B 100 ZETEC',
'vin': 'WF0DXXGAKDFD67995',
'year': 2015}
2026-03-28 14:05:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YW15%2520NRU%27 HTTP/1.1" 200 None
2026-03-28 14:05:57 [bca.uk] INFO: Saving data for YW15%20NRU: {'auction_closing_time': 1774778400.0, 'created_time': 1774522971.46165, 'last_price_update_time': 1774706757.421499}
2026-03-28 14:05:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='YW15%2520NRU') HTTP/1.1" 204 0
2026-03-28 14:05:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D697928872%27 HTTP/1.1" 200 None
2026-03-28 14:05:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=697928872 not downloaded yet
2026-03-28 14:05:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LD06WNS/698920839/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LD06WNS/42809781?sv=2020-08-04&st=2026-03-28T14%3A05%3A31Z&se=2026-03-28T14%3A30%3A31Z&sr=b&sp=r&sig=OTvnKFmvSmD2QJ4F%2F503KbBKEXfjVzDNMqEsXfGzuJ0%3D)
2026-03-28 14:05:57 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LJ24UKC/698717287/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698717287>
2026-03-28 14:05:57 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LJ24UKC/698717312/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698717312>
2026-03-28 14:05:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/OW69BUU/697928846/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/OW69BUU/42810360?sv=2020-08-04&st=2026-03-28T14%3A05%3A41Z&se=2026-03-28T14%3A30%3A41Z&sr=b&sp=r&sig=K9lRxvrb31NcTkLXgZADadn3Empdjh1%2BI4o9SeNOjN0%3D)
2026-03-28 14:05:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SA60NYT/698947090/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/SA60NYT/42810538?sv=2020-08-04&st=2026-03-28T14%3A05%3A31Z&se=2026-03-28T14%3A30%3A31Z&sr=b&sp=r&sig=E2aZntMhZA%2B%2F8gu6iOIeQUHtNbnCVBf4tuK50ckRu0U%3D)
2026-03-28 14:05:57 [bca.uk] INFO: Found listing with ID: LM05%20FYZ
2026-03-28 14:05:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LM05%2520FYZ%27 HTTP/1.1" 200 None
2026-03-28 14:05:57 [bca.uk] INFO: Scrape type for LM05%20FYZ: 1
2026-03-28 14:05:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cd20e351-5a2e-5326-baf7-36f908a1b729 with identifier: LM05%20FYZ
2026-03-28 14:05:57 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item cd20e351-5a2e-5326-baf7-36f908a1b729
2026-03-28 14:05:57 [bca.uk] INFO: Found listing with ID: EY70%20RUA
2026-03-28 14:05:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27EY70%2520RUA%27 HTTP/1.1" 200 None
2026-03-28 14:05:57 [bca.uk] INFO: Scrape type for EY70%20RUA: 2
2026-03-28 14:05:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 865cb917-4eed-5b99-83d3-357d614834f0 with identifier: EY70%20RUA
2026-03-28 14:05:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 865cb917-4eed-5b99-83d3-357d614834f0 with scrape type 2
2026-03-28 14:05:57 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 865cb917-4eed-5b99-83d3-357d614834f0 with scrape type 2
2026-03-28 14:05:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 865cb917-4eed-5b99-83d3-357d614834f0, identifier: EY70%20RUA
2026-03-28 14:05:57 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/OW69BUU/697928859/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=697928859>
2026-03-28 14:05:57 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LJ24UKC/698717332/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698717332>
2026-03-28 14:05:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 865cb917-4eed-5b99-83d3-357d614834f0 with identifier: EY70%20RUA
2026-03-28 14:05:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 865cb917-4eed-5b99-83d3-357d614834f0 with identifier: EY70%20RUA
2026-03-28 14:05:57 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 865cb917-4eed-5b99-83d3-357d614834f0 with identifier: EY70%20RUA to the API
2026-03-28 14:05:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:05:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:05:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=12&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 222,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=EY70%20RUA-GB',
'category': 'Car',
'color': 'grey',
'currency': 'GBP',
'doors_number': 5,
'engine': '3.0L',
'expiration_date': '2026-03-29T10:00:00Z',
'fuel_type': 'Diesel',
'id': '865cb917-4eed-5b99-83d3-357d614834f0',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'EY70 RUA',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=EY70%20RUA&vehicleType=*',
'listing': 'auction',
'location': 'Nottingham',
'make': 'AUDI',
'model': 'Q7',
'odometer': 33814,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-01-01',
'seller_name': None,
'title': 'AUDI Q7 3.0 45 TDI QUATTRO SPORT TIP StationWagon',
'transmission': 'manual',
'trim': '45 TDI QUATTRO SPORT TIP',
'vin': 'WAUZZZ4M5LD002237',
'year': 2020}
2026-03-28 14:05:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27EY70%2520RUA%27 HTTP/1.1" 200 None
2026-03-28 14:05:57 [bca.uk] INFO: Saving data for EY70%20RUA: {'auction_closing_time': 1774778400.0, 'created_time': 1774101920.415695, 'last_price_update_time': 1774706757.945201}
2026-03-28 14:05:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='EY70%2520RUA') HTTP/1.1" 204 0
2026-03-28 14:05:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D697928874%27 HTTP/1.1" 200 None
2026-03-28 14:05:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=697928874 not downloaded yet
2026-03-28 14:05:57 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:05:57 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:05:57 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:05:57 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:05:57 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:05:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:05:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c768510>
2026-03-28 14:05:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:05:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:05:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:05:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_389368a0-4349-5257-9e72-f8c2c2fc01c4/389368a0-4349-5257-9e72-f8c2c2fc01c4_image_6.jpg HTTP/1.1" 201 0
2026-03-28 14:05:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FSA60NYT%252F698947050%252F600') HTTP/1.1" 204 0
2026-03-28 14:05:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SA60NYT/698947050/600 saved to cache
2026-03-28 14:05:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 389368a0-4349-5257-9e72-f8c2c2fc01c4
2026-03-28 14:05:58 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/HY60RUC/42809800?sv=2020-08-04&st=2026-03-28T14%3A05%3A57Z&se=2026-03-28T14%3A30%3A57Z&sr=b&sp=r&sig=H4xVPX%2BQkg%2Fn%2BFlYv77ijhVV1CRf9V8vR2rcopF3JXw%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=HY60%20RUC-GB>
2026-03-28 14:05:58 [bca.uk] INFO: Found listing with ID: GY64%20VCN
2026-03-28 14:05:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GY64%2520VCN%27 HTTP/1.1" 200 None
2026-03-28 14:05:58 [bca.uk] INFO: Scrape type for GY64%20VCN: 0
2026-03-28 14:05:58 [bca.uk] INFO: Found listing with ID: VK66%20VXB
2026-03-28 14:05:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27VK66%2520VXB%27 HTTP/1.1" 200 None
2026-03-28 14:05:58 [bca.uk] INFO: Scrape type for VK66%20VXB: 2
2026-03-28 14:05:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 50dee0a5-bfc4-5de9-9dc1-e71de85f5c0c with identifier: VK66%20VXB
2026-03-28 14:05:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 50dee0a5-bfc4-5de9-9dc1-e71de85f5c0c with scrape type 2
2026-03-28 14:05:58 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 50dee0a5-bfc4-5de9-9dc1-e71de85f5c0c with scrape type 2
2026-03-28 14:05:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 50dee0a5-bfc4-5de9-9dc1-e71de85f5c0c, identifier: VK66%20VXB
2026-03-28 14:05:58 [bca.uk] INFO: Found listing with ID: ET12%20EPJ
2026-03-28 14:05:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27ET12%2520EPJ%27 HTTP/1.1" 200 None
2026-03-28 14:05:58 [bca.uk] INFO: Scrape type for ET12%20EPJ: 0
2026-03-28 14:05:58 [bca.uk] INFO: Found listing with ID: DY59%20NHM
2026-03-28 14:05:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DY59%2520NHM%27 HTTP/1.1" 200 None
2026-03-28 14:05:58 [bca.uk] INFO: Scrape type for DY59%20NHM: 0
2026-03-28 14:05:58 [bca.uk] INFO: Found listing with ID: DF63%20NXU
2026-03-28 14:05:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DF63%2520NXU%27 HTTP/1.1" 200 None
2026-03-28 14:05:58 [bca.uk] INFO: Scrape type for DF63%20NXU: 2
2026-03-28 14:05:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d930d7e4-be35-5384-a4d7-666e916f39a7 with identifier: DF63%20NXU
2026-03-28 14:05:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d930d7e4-be35-5384-a4d7-666e916f39a7 with scrape type 2
2026-03-28 14:05:58 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d930d7e4-be35-5384-a4d7-666e916f39a7 with scrape type 2
2026-03-28 14:05:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: d930d7e4-be35-5384-a4d7-666e916f39a7, identifier: DF63%20NXU
2026-03-28 14:05:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 50dee0a5-bfc4-5de9-9dc1-e71de85f5c0c with identifier: VK66%20VXB
2026-03-28 14:05:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 50dee0a5-bfc4-5de9-9dc1-e71de85f5c0c with identifier: VK66%20VXB
2026-03-28 14:05:58 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 50dee0a5-bfc4-5de9-9dc1-e71de85f5c0c with identifier: VK66%20VXB to the API
2026-03-28 14:05:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:05:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:05:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=11&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 139,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=VK66%20VXB-GB',
'category': 'Car',
'color': 'silver',
'currency': 'GBP',
'doors_number': 5,
'engine': '2.0L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Diesel',
'id': '50dee0a5-bfc4-5de9-9dc1-e71de85f5c0c',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'VK66 VXB',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=VK66%20VXB&vehicleType=*',
'listing': 'auction',
'location': 'Birmingham - Perry Barr',
'make': 'LAND ROVER',
'model': 'DISCOVERY SPORT',
'odometer': 78305,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-01-01',
'seller_name': None,
'title': 'LAND ROVER DISCOVERY SPORT 2.0 TD4 180 HSE StationWagon',
'transmission': 'automatic',
'trim': 'TD4 180 HSE',
'vin': 'SALCA2AN9GH622553',
'year': 2016}
2026-03-28 14:05:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27VK66%2520VXB%27 HTTP/1.1" 200 None
2026-03-28 14:05:58 [bca.uk] INFO: Saving data for VK66%20VXB: {'auction_closing_time': 1774864800.0, 'created_time': 1774391879.388124, 'last_price_update_time': 1774706758.703026}
2026-03-28 14:05:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='VK66%2520VXB') HTTP/1.1" 204 0
2026-03-28 14:05:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: d930d7e4-be35-5384-a4d7-666e916f39a7 with identifier: DF63%20NXU
2026-03-28 14:05:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: d930d7e4-be35-5384-a4d7-666e916f39a7 with identifier: DF63%20NXU
2026-03-28 14:05:58 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: d930d7e4-be35-5384-a4d7-666e916f39a7 with identifier: DF63%20NXU to the API
2026-03-28 14:05:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:05:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:05:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=12&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 149,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=DF63%20NXU-GB',
'category': 'Car',
'color': 'silver',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.6L',
'expiration_date': '2026-03-29T10:00:00Z',
'fuel_type': 'Petrol',
'id': 'd930d7e4-be35-5384-a4d7-666e916f39a7',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'DF63 NXU',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=DF63%20NXU&vehicleType=*',
'listing': 'auction',
'location': 'Nottingham',
'make': 'KIA',
'model': 'SPORTAGE',
'odometer': 89875,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2014-01-01',
'seller_name': None,
'title': 'KIA SPORTAGE 1.6 GDI 2 StationWagon',
'transmission': 'manual',
'trim': 'GDI 2',
'vin': 'U5YPC814LDL298307',
'year': 2014}
2026-03-28 14:05:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DF63%2520NXU%27 HTTP/1.1" 200 None
2026-03-28 14:05:59 [bca.uk] INFO: Saving data for DF63%20NXU: {'auction_closing_time': 1774778400.0, 'created_time': 1774364803.483246, 'last_price_update_time': 1774706759.065247}
2026-03-28 14:05:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='DF63%2520NXU') HTTP/1.1" 204 0
2026-03-28 14:05:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:05:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a1fecab50>
2026-03-28 14:05:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:05:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:05:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:05:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bbfa1477-6876-5cb3-8bcc-b863e9aae5b2/bbfa1477-6876-5cb3-8bcc-b863e9aae5b2_image_7.jpg HTTP/1.1" 201 0
2026-03-28 14:05:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLD06WNS%252F698920839%252F600') HTTP/1.1" 204 0
2026-03-28 14:05:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LD06WNS/698920839/600 saved to cache
2026-03-28 14:05:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item bbfa1477-6876-5cb3-8bcc-b863e9aae5b2
2026-03-28 14:05:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:05:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c9ea7d0>
2026-03-28 14:05:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:05:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:05:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:05:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0d569b1a-e283-5140-bff5-8b0083b89ad4/0d569b1a-e283-5140-bff5-8b0083b89ad4_image_1.jpg HTTP/1.1" 201 0
2026-03-28 14:05:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FOW69BUU%252F697928846%252F600') HTTP/1.1" 204 0
2026-03-28 14:05:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/OW69BUU/697928846/600 saved to cache
2026-03-28 14:05:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 0d569b1a-e283-5140-bff5-8b0083b89ad4
2026-03-28 14:05:59 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:05:59 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:05:59 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:05:59 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:05:59 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:05:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:05:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a1fe50110>
2026-03-28 14:05:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:05:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:05:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:05:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_389368a0-4349-5257-9e72-f8c2c2fc01c4/389368a0-4349-5257-9e72-f8c2c2fc01c4_image_7.jpg HTTP/1.1" 201 0
2026-03-28 14:05:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FSA60NYT%252F698947090%252F600') HTTP/1.1" 204 0
2026-03-28 14:05:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SA60NYT/698947090/600 saved to cache
2026-03-28 14:05:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 389368a0-4349-5257-9e72-f8c2c2fc01c4
2026-03-28 14:05:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/OW69BUU/697928852/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/OW69BUU/42810360?sv=2020-08-04&st=2026-03-28T14%3A05%3A41Z&se=2026-03-28T14%3A30%3A41Z&sr=b&sp=r&sig=K9lRxvrb31NcTkLXgZADadn3Empdjh1%2BI4o9SeNOjN0%3D)
2026-03-28 14:05:59 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/OW69BUU/697928863/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=697928863>
2026-03-28 14:05:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/OW69BUU/697928854/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/OW69BUU/42810360?sv=2020-08-04&st=2026-03-28T14%3A05%3A41Z&se=2026-03-28T14%3A30%3A41Z&sr=b&sp=r&sig=K9lRxvrb31NcTkLXgZADadn3Empdjh1%2BI4o9SeNOjN0%3D)
2026-03-28 14:05:59 [bca.uk] INFO: Found listing with ID: LY62%20DNF
2026-03-28 14:05:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LY62%2520DNF%27 HTTP/1.1" 200 None
2026-03-28 14:05:59 [bca.uk] INFO: Scrape type for LY62%20DNF: 0
2026-03-28 14:05:59 [bca.uk] INFO: Found listing with ID: LD62%20NNR
2026-03-28 14:05:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LD62%2520NNR%27 HTTP/1.1" 200 None
2026-03-28 14:05:59 [bca.uk] INFO: Scrape type for LD62%20NNR: 0
2026-03-28 14:05:59 [bca.uk] INFO: Found listing with ID: YG10%20VAH
2026-03-28 14:05:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YG10%2520VAH%27 HTTP/1.1" 200 None
2026-03-28 14:05:59 [bca.uk] INFO: Scrape type for YG10%20VAH: 0
2026-03-28 14:05:59 [bca.uk] INFO: Found listing with ID: EY63%20WHH
2026-03-28 14:05:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27EY63%2520WHH%27 HTTP/1.1" 200 None
2026-03-28 14:05:59 [bca.uk] INFO: Scrape type for EY63%20WHH: 2
2026-03-28 14:05:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8749cfab-3d52-5e8f-b014-2ec9d40da991 with identifier: EY63%20WHH
2026-03-28 14:05:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8749cfab-3d52-5e8f-b014-2ec9d40da991 with scrape type 2
2026-03-28 14:05:59 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8749cfab-3d52-5e8f-b014-2ec9d40da991 with scrape type 2
2026-03-28 14:05:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 8749cfab-3d52-5e8f-b014-2ec9d40da991, identifier: EY63%20WHH
2026-03-28 14:05:59 [bca.uk] INFO: Found listing with ID: BL62%20FPF
2026-03-28 14:05:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BL62%2520FPF%27 HTTP/1.1" 200 None
2026-03-28 14:05:59 [bca.uk] INFO: Scrape type for BL62%20FPF: 0
2026-03-28 14:05:59 [bca.uk] INFO: Found listing with ID: YK17%20VSR
2026-03-28 14:05:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YK17%2520VSR%27 HTTP/1.1" 200 None
2026-03-28 14:05:59 [bca.uk] INFO: Scrape type for YK17%20VSR: 0
2026-03-28 14:05:59 [bca.uk] INFO: Found listing with ID: SK13%20JJZ
2026-03-28 14:05:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SK13%2520JJZ%27 HTTP/1.1" 200 None
2026-03-28 14:05:59 [bca.uk] INFO: Scrape type for SK13%20JJZ: 0
2026-03-28 14:05:59 [bca.uk] INFO: Found listing with ID: OE67%20PUF
2026-03-28 14:05:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27OE67%2520PUF%27 HTTP/1.1" 200 None
2026-03-28 14:05:59 [bca.uk] INFO: Scrape type for OE67%20PUF: 0
2026-03-28 14:05:59 [bca.uk] INFO: Found listing with ID: CK66%20VME
2026-03-28 14:05:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27CK66%2520VME%27 HTTP/1.1" 200 None
2026-03-28 14:05:59 [bca.uk] INFO: Scrape type for CK66%20VME: 0
2026-03-28 14:05:59 [bca.uk] INFO: Found listing with ID: LD75%20EHO
2026-03-28 14:05:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LD75%2520EHO%27 HTTP/1.1" 200 None
2026-03-28 14:05:59 [bca.uk] INFO: Scrape type for LD75%20EHO: 0
2026-03-28 14:05:59 [bca.uk] INFO: Found listing with ID: BU74%20UXT
2026-03-28 14:05:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BU74%2520UXT%27 HTTP/1.1" 200 None
2026-03-28 14:05:59 [bca.uk] INFO: Scrape type for BU74%20UXT: 0
2026-03-28 14:05:59 [bca.uk] INFO: Found listing with ID: LD63%20HAU
2026-03-28 14:05:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LD63%2520HAU%27 HTTP/1.1" 200 None
2026-03-28 14:05:59 [bca.uk] INFO: Scrape type for LD63%20HAU: 0
2026-03-28 14:05:59 [bca.uk] INFO: Found listing with ID: AL11%20DAV
2026-03-28 14:05:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27AL11%2520DAV%27 HTTP/1.1" 200 None
2026-03-28 14:05:59 [bca.uk] INFO: Scrape type for AL11%20DAV: 2
2026-03-28 14:05:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7e8b7021-2732-5ce9-ad97-7c2134417cc6 with identifier: AL11%20DAV
2026-03-28 14:05:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7e8b7021-2732-5ce9-ad97-7c2134417cc6 with scrape type 2
2026-03-28 14:05:59 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7e8b7021-2732-5ce9-ad97-7c2134417cc6 with scrape type 2
2026-03-28 14:05:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 7e8b7021-2732-5ce9-ad97-7c2134417cc6, identifier: AL11%20DAV
2026-03-28 14:05:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SA60NYT/698947119/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/SA60NYT/42810538?sv=2020-08-04&st=2026-03-28T14%3A05%3A31Z&se=2026-03-28T14%3A30%3A31Z&sr=b&sp=r&sig=E2aZntMhZA%2B%2F8gu6iOIeQUHtNbnCVBf4tuK50ckRu0U%3D)
2026-03-28 14:05:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LJ24UKC/698717262/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LJ24UKC/42810350?sv=2020-08-04&st=2026-03-28T14%3A05%3A36Z&se=2026-03-28T14%3A30%3A36Z&sr=b&sp=r&sig=cuxyo0kEMI6Rf8WOKAH0rgALMpgPmn%2FBYgPsLsWZGdY%3D)
2026-03-28 14:05:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SA60NYT/698947154/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/SA60NYT/42810538?sv=2020-08-04&st=2026-03-28T14%3A05%3A31Z&se=2026-03-28T14%3A30%3A31Z&sr=b&sp=r&sig=E2aZntMhZA%2B%2F8gu6iOIeQUHtNbnCVBf4tuK50ckRu0U%3D)
2026-03-28 14:05:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 8749cfab-3d52-5e8f-b014-2ec9d40da991 with identifier: EY63%20WHH
2026-03-28 14:05:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 8749cfab-3d52-5e8f-b014-2ec9d40da991 with identifier: EY63%20WHH
2026-03-28 14:05:59 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 8749cfab-3d52-5e8f-b014-2ec9d40da991 with identifier: EY63%20WHH to the API
2026-03-28 14:05:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:05:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:05:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=11&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 187,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=EY63%20WHH-GB',
'category': 'Car',
'color': 'grey',
'currency': 'GBP',
'doors_number': 5,
'engine': '2.0L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol',
'id': '8749cfab-3d52-5e8f-b014-2ec9d40da991',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'EY63 WHH',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=EY63%20WHH&vehicleType=*',
'listing': 'auction',
'location': 'Manchester',
'make': 'SUBARU',
'model': 'LEGACY',
'odometer': 75599,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2013-01-01',
'seller_name': None,
'title': 'SUBARU LEGACY 2.0 ES NAV LINEARTRONIC Estate',
'transmission': 'manual',
'trim': 'ES NAV LINEARTRONIC',
'vin': 'JF1BR5KC2BG025432',
'year': 2013}
2026-03-28 14:05:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27EY63%2520WHH%27 HTTP/1.1" 200 None
2026-03-28 14:06:00 [bca.uk] INFO: Saving data for EY63%20WHH: {'auction_closing_time': 1774864800.0, 'created_time': 1774391879.811833, 'last_price_update_time': 1774706760.002919}
2026-03-28 14:06:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='EY63%2520WHH') HTTP/1.1" 204 0
2026-03-28 14:06:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 7e8b7021-2732-5ce9-ad97-7c2134417cc6 with identifier: AL11%20DAV
2026-03-28 14:06:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 7e8b7021-2732-5ce9-ad97-7c2134417cc6 with identifier: AL11%20DAV
2026-03-28 14:06:00 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 7e8b7021-2732-5ce9-ad97-7c2134417cc6 with identifier: AL11%20DAV to the API
2026-03-28 14:06:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:06:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:06:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=12&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 232,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=AL11%20DAV-GB',
'category': 'Car',
'color': 'blue',
'currency': 'GBP',
'doors_number': 5,
'engine': '3.0L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Diesel',
'id': '7e8b7021-2732-5ce9-ad97-7c2134417cc6',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'AL11 DAV',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=AL11%20DAV&vehicleType=*',
'listing': 'auction',
'location': 'Livingston',
'make': 'LAND ROVER',
'model': 'DEFENDER 110',
'odometer': 49850,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-01-01',
'seller_name': None,
'title': 'LAND ROVER DEFENDER 110 3.0 I6 D250 AWD SE (5ST) StationWagon',
'transmission': 'automatic',
'trim': 'I6 D250 AWD SE (5ST)',
'vin': 'SALEA7AW6P2165802',
'year': 2022}
2026-03-28 14:06:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27AL11%2520DAV%27 HTTP/1.1" 200 None
2026-03-28 14:06:00 [bca.uk] INFO: Saving data for AL11%20DAV: {'auction_closing_time': 1774864800.0, 'created_time': 1774523518.621201, 'last_price_update_time': 1774706760.482317}
2026-03-28 14:06:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='AL11%2520DAV') HTTP/1.1" 204 0
2026-03-28 14:06:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/OW69BUU/697928857/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/OW69BUU/42810360?sv=2020-08-04&st=2026-03-28T14%3A05%3A41Z&se=2026-03-28T14%3A30%3A41Z&sr=b&sp=r&sig=K9lRxvrb31NcTkLXgZADadn3Empdjh1%2BI4o9SeNOjN0%3D)
2026-03-28 14:06:00 [scrapy_zyte_api._params] WARNING: Request <GET https://www.bca.co.uk/api/search?q=&pageSize=100&page=13&sort=MostRecentlyAdded> defines the Zyte API customHttpRequestHeaders parameter, overriding Request.headers. Use Request.headers instead.
2026-03-28 14:06:00 [scrapy_zyte_api._params] WARNING: Request <GET https://www.bca.co.uk/api/search?q=&pageSize=100&page=13&sort=MostRecentlyAdded> defines the Zyte API customHttpRequestHeaders parameter, overriding Request.headers. Use Request.headers instead.
2026-03-28 14:06:00 [bca.uk] INFO: Found listing with ID: MF61%20FVN
2026-03-28 14:06:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MF61%2520FVN%27 HTTP/1.1" 200 None
2026-03-28 14:06:00 [bca.uk] INFO: Scrape type for MF61%20FVN: 0
2026-03-28 14:06:00 [bca.uk] INFO: Found listing with ID: MT09%20FDX
2026-03-28 14:06:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MT09%2520FDX%27 HTTP/1.1" 200 None
2026-03-28 14:06:00 [bca.uk] INFO: Scrape type for MT09%20FDX: 0
2026-03-28 14:06:00 [bca.uk] INFO: Found listing with ID: PK11%20ZFG
2026-03-28 14:06:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27PK11%2520ZFG%27 HTTP/1.1" 200 None
2026-03-28 14:06:00 [bca.uk] INFO: Scrape type for PK11%20ZFG: 0
2026-03-28 14:06:00 [bca.uk] INFO: Found listing with ID: RJ57%20KKY
2026-03-28 14:06:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27RJ57%2520KKY%27 HTTP/1.1" 200 None
2026-03-28 14:06:00 [bca.uk] INFO: Scrape type for RJ57%20KKY: 2
2026-03-28 14:06:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a2f6bae8-213b-593a-8c54-14511b54f913 with identifier: RJ57%20KKY
2026-03-28 14:06:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a2f6bae8-213b-593a-8c54-14511b54f913 with scrape type 2
2026-03-28 14:06:00 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a2f6bae8-213b-593a-8c54-14511b54f913 with scrape type 2
2026-03-28 14:06:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: a2f6bae8-213b-593a-8c54-14511b54f913, identifier: RJ57%20KKY
2026-03-28 14:06:00 [bca.uk] INFO: Found listing with ID: LC13%20XXF
2026-03-28 14:06:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LC13%2520XXF%27 HTTP/1.1" 200 None
2026-03-28 14:06:00 [bca.uk] INFO: Scrape type for LC13%20XXF: 0
2026-03-28 14:06:00 [bca.uk] INFO: Found listing with ID: LR63%20VBU
2026-03-28 14:06:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LR63%2520VBU%27 HTTP/1.1" 200 None
2026-03-28 14:06:00 [bca.uk] INFO: Scrape type for LR63%20VBU: 0
2026-03-28 14:06:00 [bca.uk] INFO: Found listing with ID: L14%20RHU
2026-03-28 14:06:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27L14%2520RHU%27 HTTP/1.1" 200 None
2026-03-28 14:06:00 [bca.uk] INFO: Scrape type for L14%20RHU: 0
2026-03-28 14:06:00 [bca.uk] INFO: Found listing with ID: HK14%20ZDR
2026-03-28 14:06:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27HK14%2520ZDR%27 HTTP/1.1" 200 None
2026-03-28 14:06:00 [bca.uk] INFO: Scrape type for HK14%20ZDR: 0
2026-03-28 14:06:00 [bca.uk] INFO: Found listing with ID: MA68%20OAS
2026-03-28 14:06:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MA68%2520OAS%27 HTTP/1.1" 200 None
2026-03-28 14:06:00 [bca.uk] INFO: Scrape type for MA68%20OAS: 0
2026-03-28 14:06:00 [bca.uk] INFO: Found listing with ID: YN18%20XLF
2026-03-28 14:06:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YN18%2520XLF%27 HTTP/1.1" 200 None
2026-03-28 14:06:00 [bca.uk] INFO: Scrape type for YN18%20XLF: 0
2026-03-28 14:06:00 [bca.uk] INFO: Found listing with ID: OE23%20DFP
2026-03-28 14:06:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27OE23%2520DFP%27 HTTP/1.1" 200 None
2026-03-28 14:06:00 [bca.uk] INFO: Scrape type for OE23%20DFP: 2
2026-03-28 14:06:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c6bfa6d1-92b3-5e41-bcb7-8713e2468c78 with identifier: OE23%20DFP
2026-03-28 14:06:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c6bfa6d1-92b3-5e41-bcb7-8713e2468c78 with scrape type 2
2026-03-28 14:06:00 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c6bfa6d1-92b3-5e41-bcb7-8713e2468c78 with scrape type 2
2026-03-28 14:06:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: c6bfa6d1-92b3-5e41-bcb7-8713e2468c78, identifier: OE23%20DFP
2026-03-28 14:06:00 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 14:06:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/EN10PWV/42809685?sv=2020-08-04&st=2026-03-28T14%3A05%3A53Z&se=2026-03-28T14%3A30%3A53Z&sr=b&sp=r&sig=0bUhTFZOWsPha81YwFXHCk91lxzBfSWRH%2BlFeQKDFV0%3D> (referer: https://www.bca.co.uk/)
2026-03-28 14:06:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/OW69BUU/697928859/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/OW69BUU/42810360?sv=2020-08-04&st=2026-03-28T14%3A05%3A41Z&se=2026-03-28T14%3A30%3A41Z&sr=b&sp=r&sig=K9lRxvrb31NcTkLXgZADadn3Empdjh1%2BI4o9SeNOjN0%3D)
2026-03-28 14:06:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: a2f6bae8-213b-593a-8c54-14511b54f913 with identifier: RJ57%20KKY
2026-03-28 14:06:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: a2f6bae8-213b-593a-8c54-14511b54f913 with identifier: RJ57%20KKY
2026-03-28 14:06:01 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: a2f6bae8-213b-593a-8c54-14511b54f913 with identifier: RJ57%20KKY to the API
2026-03-28 14:06:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:06:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:06:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=11&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 214,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=RJ57%20KKY-GB',
'category': 'Car',
'color': 'black',
'currency': 'GBP',
'doors_number': 4,
'engine': '2.5L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol',
'id': 'a2f6bae8-213b-593a-8c54-14511b54f913',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'RJ57 KKY',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=RJ57%20KKY&vehicleType=*',
'listing': 'auction',
'location': 'Manchester',
'make': 'LEXUS',
'model': 'IS 250',
'odometer': 108693,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2007-01-01',
'seller_name': None,
'title': 'LEXUS IS 250 2.5 SE Saloon',
'transmission': 'automatic',
'trim': 'SE',
'vin': 'JTHBK262105048633',
'year': 2007}
2026-03-28 14:06:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27RJ57%2520KKY%27 HTTP/1.1" 200 None
2026-03-28 14:06:01 [bca.uk] INFO: Saving data for RJ57%20KKY: {'auction_closing_time': 1774864800.0, 'created_time': 1774391876.021488, 'last_price_update_time': 1774706761.26623}
2026-03-28 14:06:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='RJ57%2520KKY') HTTP/1.1" 204 0
2026-03-28 14:06:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: c6bfa6d1-92b3-5e41-bcb7-8713e2468c78 with identifier: OE23%20DFP
2026-03-28 14:06:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: c6bfa6d1-92b3-5e41-bcb7-8713e2468c78 with identifier: OE23%20DFP
2026-03-28 14:06:01 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: c6bfa6d1-92b3-5e41-bcb7-8713e2468c78 with identifier: OE23%20DFP to the API
2026-03-28 14:06:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:06:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:06:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=12&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': None,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=OE23%20DFP-GB',
'category': 'Car',
'color': 'black',
'currency': 'GBP',
'doors_number': 5,
'engine': '0.0L',
'expiration_date': '2026-04-04T07:00:00Z',
'fuel_type': 'Electric',
'id': 'c6bfa6d1-92b3-5e41-bcb7-8713e2468c78',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': False,
'license_plate': 'OE23 DFP',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=OE23%20DFP&vehicleType=*',
'listing': 'directbuy',
'location': 'Bedford',
'make': 'POLESTAR',
'model': '2',
'odometer': 50063,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 14450,
'price_includes_vat': False,
'registration_date': '2023-01-01',
'seller_name': None,
'title': 'POLESTAR 2 170KW 78KWH SM2 LONG RANGE Coupe',
'transmission': 'automatic',
'trim': '170KW 78KWH SM2 LONG RANGE',
'vin': 'YSMVSEGE5PL156952',
'year': 2023}
2026-03-28 14:06:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27OE23%2520DFP%27 HTTP/1.1" 200 None
2026-03-28 14:06:01 [bca.uk] INFO: Saving data for OE23%20DFP: {'auction_closing_time': 1775286000.0, 'created_time': 1773908771.573241, 'last_price_update_time': 1774706761.712917}
2026-03-28 14:06:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='OE23%2520DFP') HTTP/1.1" 204 0
2026-03-28 14:06:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LJ24UKC/698717332/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LJ24UKC/42810350?sv=2020-08-04&st=2026-03-28T14%3A05%3A36Z&se=2026-03-28T14%3A30%3A36Z&sr=b&sp=r&sig=cuxyo0kEMI6Rf8WOKAH0rgALMpgPmn%2FBYgPsLsWZGdY%3D)
2026-03-28 14:06:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LJ24UKC/698717312/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LJ24UKC/42810350?sv=2020-08-04&st=2026-03-28T14%3A05%3A36Z&se=2026-03-28T14%3A30%3A36Z&sr=b&sp=r&sig=cuxyo0kEMI6Rf8WOKAH0rgALMpgPmn%2FBYgPsLsWZGdY%3D)
2026-03-28 14:06:01 [bca.uk] INFO: Found listing with ID: SP08%20HWJ
2026-03-28 14:06:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SP08%2520HWJ%27 HTTP/1.1" 200 None
2026-03-28 14:06:01 [bca.uk] INFO: Scrape type for SP08%20HWJ: 2
2026-03-28 14:06:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1470ebd9-e68f-5228-9bc5-cf82ba263673 with identifier: SP08%20HWJ
2026-03-28 14:06:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1470ebd9-e68f-5228-9bc5-cf82ba263673 with scrape type 2
2026-03-28 14:06:01 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1470ebd9-e68f-5228-9bc5-cf82ba263673 with scrape type 2
2026-03-28 14:06:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 1470ebd9-e68f-5228-9bc5-cf82ba263673, identifier: SP08%20HWJ
2026-03-28 14:06:01 [bca.uk] INFO: Found listing with ID: KE71%20OYG
2026-03-28 14:06:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KE71%2520OYG%27 HTTP/1.1" 200 None
2026-03-28 14:06:01 [bca.uk] INFO: Scrape type for KE71%20OYG: 0
2026-03-28 14:06:01 [bca.uk] INFO: Found listing with ID: GU23%20RCX
2026-03-28 14:06:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GU23%2520RCX%27 HTTP/1.1" 200 None
2026-03-28 14:06:01 [bca.uk] INFO: Scrape type for GU23%20RCX: 0
2026-03-28 14:06:01 [bca.uk] INFO: Found listing with ID: KS67%20YMP
2026-03-28 14:06:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KS67%2520YMP%27 HTTP/1.1" 200 None
2026-03-28 14:06:02 [bca.uk] INFO: Scrape type for KS67%20YMP: 0
2026-03-28 14:06:02 [bca.uk] INFO: Found listing with ID: LL21%20EHM
2026-03-28 14:06:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LL21%2520EHM%27 HTTP/1.1" 200 None
2026-03-28 14:06:02 [bca.uk] INFO: Scrape type for LL21%20EHM: 2
2026-03-28 14:06:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e9cd081f-3f68-50eb-8c7e-9493044b440e with identifier: LL21%20EHM
2026-03-28 14:06:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e9cd081f-3f68-50eb-8c7e-9493044b440e with scrape type 2
2026-03-28 14:06:02 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e9cd081f-3f68-50eb-8c7e-9493044b440e with scrape type 2
2026-03-28 14:06:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: e9cd081f-3f68-50eb-8c7e-9493044b440e, identifier: LL21%20EHM
2026-03-28 14:06:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:06:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c62b710>
2026-03-28 14:06:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:06:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:06:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:06:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0d569b1a-e283-5140-bff5-8b0083b89ad4/0d569b1a-e283-5140-bff5-8b0083b89ad4_image_2.jpg HTTP/1.1" 201 0
2026-03-28 14:06:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FOW69BUU%252F697928852%252F600') HTTP/1.1" 204 0
2026-03-28 14:06:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/OW69BUU/697928852/600 saved to cache
2026-03-28 14:06:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 0d569b1a-e283-5140-bff5-8b0083b89ad4
2026-03-28 14:06:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:06:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a1fe113d0>
2026-03-28 14:06:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:06:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:06:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:06:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0d569b1a-e283-5140-bff5-8b0083b89ad4/0d569b1a-e283-5140-bff5-8b0083b89ad4_image_3.jpg HTTP/1.1" 201 0
2026-03-28 14:06:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FOW69BUU%252F697928854%252F600') HTTP/1.1" 204 0
2026-03-28 14:06:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/OW69BUU/697928854/600 saved to cache
2026-03-28 14:06:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 0d569b1a-e283-5140-bff5-8b0083b89ad4
2026-03-28 14:06:02 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:06:02 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:06:02 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:06:02 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:06:02 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:06:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:06:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a1fe01c50>
2026-03-28 14:06:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:06:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:06:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:06:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_389368a0-4349-5257-9e72-f8c2c2fc01c4/389368a0-4349-5257-9e72-f8c2c2fc01c4_image_8.jpg HTTP/1.1" 201 0
2026-03-28 14:06:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FSA60NYT%252F698947119%252F600') HTTP/1.1" 204 0
2026-03-28 14:06:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SA60NYT/698947119/600 saved to cache
2026-03-28 14:06:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 389368a0-4349-5257-9e72-f8c2c2fc01c4
2026-03-28 14:06:02 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:06:02 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:06:02 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:06:02 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:06:02 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:06:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:06:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2dd1d2d0>
2026-03-28 14:06:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:06:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:06:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:06:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e21ba6d8-ccbd-5912-bd24-f51d3dc89889/e21ba6d8-ccbd-5912-bd24-f51d3dc89889_image_6.jpg HTTP/1.1" 201 0
2026-03-28 14:06:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLJ24UKC%252F698717262%252F600') HTTP/1.1" 204 0
2026-03-28 14:06:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LJ24UKC/698717262/600 saved to cache
2026-03-28 14:06:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item e21ba6d8-ccbd-5912-bd24-f51d3dc89889
2026-03-28 14:06:02 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:06:02 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:06:02 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:06:02 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:06:02 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:06:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:06:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2d8f2d10>
2026-03-28 14:06:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:06:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:06:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:06:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_389368a0-4349-5257-9e72-f8c2c2fc01c4/389368a0-4349-5257-9e72-f8c2c2fc01c4_image_9.jpg HTTP/1.1" 201 0
2026-03-28 14:06:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FSA60NYT%252F698947154%252F600') HTTP/1.1" 204 0
2026-03-28 14:06:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SA60NYT/698947154/600 saved to cache
2026-03-28 14:06:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 389368a0-4349-5257-9e72-f8c2c2fc01c4
2026-03-28 14:06:02 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/OW69BUU/697928872/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=697928872>
2026-03-28 14:06:02 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/OW69BUU/697928869/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=697928869>
2026-03-28 14:06:02 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LJ24UKC/698717232/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698717232>
2026-03-28 14:06:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 1470ebd9-e68f-5228-9bc5-cf82ba263673 with identifier: SP08%20HWJ
2026-03-28 14:06:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 1470ebd9-e68f-5228-9bc5-cf82ba263673 with identifier: SP08%20HWJ
2026-03-28 14:06:02 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 1470ebd9-e68f-5228-9bc5-cf82ba263673 with identifier: SP08%20HWJ to the API
2026-03-28 14:06:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:06:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:06:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=11&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 182,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=SP08%20HWJ-GB',
'category': 'Car',
'color': 'silver',
'currency': 'GBP',
'doors_number': 4,
'engine': '1.8L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol',
'id': '1470ebd9-e68f-5228-9bc5-cf82ba263673',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'SP08 HWJ',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=SP08%20HWJ&vehicleType=*',
'listing': 'auction',
'location': 'Manchester',
'make': 'MERCEDES-BENZ',
'model': 'C180',
'odometer': 79991,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2008-01-01',
'seller_name': None,
'title': 'MERCEDES-BENZ C180 1.8 K ELEGANCE Saloon',
'transmission': 'manual',
'trim': 'K ELEGANCE',
'vin': 'WDD2040462A165785',
'year': 2008}
2026-03-28 14:06:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SP08%2520HWJ%27 HTTP/1.1" 200 None
2026-03-28 14:06:02 [bca.uk] INFO: Saving data for SP08%20HWJ: {'auction_closing_time': 1774864800.0, 'created_time': 1774188555.997181, 'last_price_update_time': 1774706762.708306}
2026-03-28 14:06:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='SP08%2520HWJ') HTTP/1.1" 204 0
2026-03-28 14:06:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: e9cd081f-3f68-50eb-8c7e-9493044b440e with identifier: LL21%20EHM
2026-03-28 14:06:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: e9cd081f-3f68-50eb-8c7e-9493044b440e with identifier: LL21%20EHM
2026-03-28 14:06:02 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: e9cd081f-3f68-50eb-8c7e-9493044b440e with identifier: LL21%20EHM to the API
2026-03-28 14:06:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:06:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:06:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=12&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 29,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=LL21%20EHM-GB',
'category': 'Car',
'color': 'white',
'currency': 'GBP',
'doors_number': 5,
'engine': '3.0L',
'expiration_date': '2026-03-30T07:00:00Z',
'fuel_type': 'Petrol/Electric',
'id': 'e9cd081f-3f68-50eb-8c7e-9493044b440e',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': False,
'license_plate': 'LL21 EHM',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=LL21%20EHM&vehicleType=*',
'listing': 'auction',
'location': 'Birmingham - Perry Barr',
'make': 'BMW',
'model': 'X5',
'odometer': 133913,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-01-01',
'seller_name': None,
'title': 'BMW X5 3.0 XDRIVE 45E M SPORT StationWagon',
'transmission': 'automatic',
'trim': 'XDRIVE 45E M SPORT',
'vin': 'WBATA620209G41334',
'year': 2021}
2026-03-28 14:06:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LL21%2520EHM%27 HTTP/1.1" 200 None
2026-03-28 14:06:03 [bca.uk] INFO: Saving data for LL21%20EHM: {'auction_closing_time': 1774854000.0, 'created_time': 1773826624.3179, 'last_price_update_time': 1774706763.049179}
2026-03-28 14:06:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='LL21%2520EHM') HTTP/1.1" 204 0
2026-03-28 14:06:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LJ24UKC/698717287/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LJ24UKC/42810350?sv=2020-08-04&st=2026-03-28T14%3A05%3A36Z&se=2026-03-28T14%3A30%3A36Z&sr=b&sp=r&sig=cuxyo0kEMI6Rf8WOKAH0rgALMpgPmn%2FBYgPsLsWZGdY%3D)
2026-03-28 14:06:03 [bca.uk] INFO: Found listing with ID: FR62%20KCZ
2026-03-28 14:06:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FR62%2520KCZ%27 HTTP/1.1" 200 None
2026-03-28 14:06:03 [bca.uk] INFO: Scrape type for FR62%20KCZ: 0
2026-03-28 14:06:03 [bca.uk] INFO: Found listing with ID: KM66%20FHL
2026-03-28 14:06:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KM66%2520FHL%27 HTTP/1.1" 200 None
2026-03-28 14:06:03 [bca.uk] INFO: Scrape type for KM66%20FHL: 0
2026-03-28 14:06:03 [bca.uk] INFO: Found listing with ID: KY06%20TYK
2026-03-28 14:06:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KY06%2520TYK%27 HTTP/1.1" 200 None
2026-03-28 14:06:03 [bca.uk] INFO: Scrape type for KY06%20TYK: 0
2026-03-28 14:06:03 [bca.uk] INFO: Found listing with ID: RF68%20KUV
2026-03-28 14:06:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27RF68%2520KUV%27 HTTP/1.1" 200 None
2026-03-28 14:06:03 [bca.uk] INFO: Scrape type for RF68%20KUV: 2
2026-03-28 14:06:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 788094bb-0c08-57ce-a434-74ccb287d368 with identifier: RF68%20KUV
2026-03-28 14:06:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 788094bb-0c08-57ce-a434-74ccb287d368 with scrape type 2
2026-03-28 14:06:03 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 788094bb-0c08-57ce-a434-74ccb287d368 with scrape type 2
2026-03-28 14:06:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 788094bb-0c08-57ce-a434-74ccb287d368, identifier: RF68%20KUV
2026-03-28 14:06:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:06:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2dbc3e50>
2026-03-28 14:06:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:06:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:06:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:06:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0d569b1a-e283-5140-bff5-8b0083b89ad4/0d569b1a-e283-5140-bff5-8b0083b89ad4_image_4.jpg HTTP/1.1" 201 0
2026-03-28 14:06:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FOW69BUU%252F697928857%252F600') HTTP/1.1" 204 0
2026-03-28 14:06:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/OW69BUU/697928857/600 saved to cache
2026-03-28 14:06:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 0d569b1a-e283-5140-bff5-8b0083b89ad4
2026-03-28 14:06:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:06:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c68c050>
2026-03-28 14:06:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:06:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:06:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:06:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1da598bb-916d-5198-a760-5aef625fcf96/1da598bb-916d-5198-a760-5aef625fcf96_expert_report_file_14e907ac-1bf6-43e5-8eab-acfc6ae4aa3f.pdf HTTP/1.1" 201 0
2026-03-28 14:06:03 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item 1da598bb-916d-5198-a760-5aef625fcf96
2026-03-28 14:06:03 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 1da598bb-916d-5198-a760-5aef625fcf96, skipping ID generation
2026-03-28 14:06:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 1da598bb-916d-5198-a760-5aef625fcf96
2026-03-28 14:06:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DEN10PWV-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-28 14:06:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=EN10PWV-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-28 14:06:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:06:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2d89df90>
2026-03-28 14:06:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:06:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:06:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:06:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0d569b1a-e283-5140-bff5-8b0083b89ad4/0d569b1a-e283-5140-bff5-8b0083b89ad4_image_5.jpg HTTP/1.1" 201 0
2026-03-28 14:06:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FOW69BUU%252F697928859%252F600') HTTP/1.1" 204 0
2026-03-28 14:06:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/OW69BUU/697928859/600 saved to cache
2026-03-28 14:06:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 0d569b1a-e283-5140-bff5-8b0083b89ad4
2026-03-28 14:06:03 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/OW69BUU/697928874/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=697928874>
2026-03-28 14:06:03 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LM05FYZ/42809535?sv=2020-08-04&st=2026-03-28T14%3A06%3A02Z&se=2026-03-28T14%3A31%3A02Z&sr=b&sp=r&sig=0XLGDeD93HjjiKgV4xBnfu5dFMIwsNV4XYOCMU8Ir%2BU%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=LM05%20FYZ-GB>
2026-03-28 14:06:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 788094bb-0c08-57ce-a434-74ccb287d368 with identifier: RF68%20KUV
2026-03-28 14:06:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 788094bb-0c08-57ce-a434-74ccb287d368 with identifier: RF68%20KUV
2026-03-28 14:06:03 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 788094bb-0c08-57ce-a434-74ccb287d368 with identifier: RF68%20KUV to the API
2026-03-28 14:06:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:06:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:06:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=12&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 153,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=RF68%20KUV-GB',
'category': 'Car',
'color': 'black',
'currency': 'GBP',
'doors_number': 4,
'engine': '3.0L',
'expiration_date': '2026-03-30T07:00:00Z',
'fuel_type': 'Diesel',
'id': '788094bb-0c08-57ce-a434-74ccb287d368',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'RF68 KUV',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=RF68%20KUV&vehicleType=*',
'listing': 'auction',
'location': 'Nottingham',
'make': 'MERCEDES-BENZ',
'model': 'S350 D L',
'odometer': 98087,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-01-01',
'seller_name': None,
'title': 'MERCEDES-BENZ S350 D L 3.0 AMG LINE EXECUTIVE PREMIUM Saloon',
'transmission': 'manual',
'trim': 'AMG LINE EXECUTIVE PREMIUM',
'vin': 'WDD2221202A458019',
'year': 2018}
2026-03-28 14:06:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27RF68%2520KUV%27 HTTP/1.1" 200 None
2026-03-28 14:06:03 [bca.uk] INFO: Saving data for RF68%20KUV: {'auction_closing_time': 1774854000.0, 'created_time': 1774523445.195294, 'last_price_update_time': 1774706763.801476}
2026-03-28 14:06:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='RF68%2520KUV') HTTP/1.1" 204 0
2026-03-28 14:06:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/OW69BUU/697928863/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/OW69BUU/42810360?sv=2020-08-04&st=2026-03-28T14%3A05%3A41Z&se=2026-03-28T14%3A30%3A41Z&sr=b&sp=r&sig=K9lRxvrb31NcTkLXgZADadn3Empdjh1%2BI4o9SeNOjN0%3D)
2026-03-28 14:06:03 [bca.uk] INFO: Found listing with ID: RV18%20ZFG
2026-03-28 14:06:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27RV18%2520ZFG%27 HTTP/1.1" 200 None
2026-03-28 14:06:03 [bca.uk] INFO: Scrape type for RV18%20ZFG: 2
2026-03-28 14:06:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4757170f-43a0-5ce2-b902-afd5cca8588b with identifier: RV18%20ZFG
2026-03-28 14:06:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4757170f-43a0-5ce2-b902-afd5cca8588b with scrape type 2
2026-03-28 14:06:03 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4757170f-43a0-5ce2-b902-afd5cca8588b with scrape type 2
2026-03-28 14:06:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 4757170f-43a0-5ce2-b902-afd5cca8588b, identifier: RV18%20ZFG
2026-03-28 14:06:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698681962%27 HTTP/1.1" 200 None
2026-03-28 14:06:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698681962 not downloaded yet
2026-03-28 14:06:03 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LD06WNS/698920845/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698920845>
2026-03-28 14:06:03 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LJ24UKC/698717217/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698717217>
2026-03-28 14:06:03 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/OW69BUU/697928840/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=OW69BUU-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-28 14:06:03 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SA60NYT/698947025/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698947025>
2026-03-28 14:06:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 4757170f-43a0-5ce2-b902-afd5cca8588b with identifier: RV18%20ZFG
2026-03-28 14:06:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 4757170f-43a0-5ce2-b902-afd5cca8588b with identifier: RV18%20ZFG
2026-03-28 14:06:04 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 4757170f-43a0-5ce2-b902-afd5cca8588b with identifier: RV18%20ZFG to the API
2026-03-28 14:06:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:06:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:06:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=12&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 168,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=RV18%20ZFG-GB',
'category': 'Car',
'color': 'blue',
'currency': 'GBP',
'doors_number': 5,
'engine': '3.0L',
'expiration_date': '2026-03-30T07:00:00Z',
'fuel_type': 'Diesel',
'id': '4757170f-43a0-5ce2-b902-afd5cca8588b',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'RV18 ZFG',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=RV18%20ZFG&vehicleType=*',
'listing': 'auction',
'location': 'Bedford',
'make': 'AUDI',
'model': 'Q7',
'odometer': 94726,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-01-01',
'seller_name': None,
'title': 'AUDI Q7 3.0 TDI 272 QUATTRO S LINE TIP StationWagon',
'transmission': 'manual',
'trim': 'TDI 272 QUATTRO S LINE TIP',
'vin': 'WAUZZZ4M2JD037377',
'year': 2018}
2026-03-28 14:06:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27RV18%2520ZFG%27 HTTP/1.1" 200 None
2026-03-28 14:06:04 [bca.uk] INFO: Saving data for RV18%20ZFG: {'auction_closing_time': 1774854000.0, 'created_time': 1773933188.374824, 'last_price_update_time': 1774706764.386018}
2026-03-28 14:06:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='RV18%2520ZFG') HTTP/1.1" 204 0
2026-03-28 14:06:04 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:06:04 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:06:04 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:06:04 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:06:04 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:06:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:06:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2dbc2d90>
2026-03-28 14:06:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:06:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:06:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:06:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e21ba6d8-ccbd-5912-bd24-f51d3dc89889/e21ba6d8-ccbd-5912-bd24-f51d3dc89889_image_9.jpg HTTP/1.1" 201 0
2026-03-28 14:06:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLJ24UKC%252F698717332%252F600') HTTP/1.1" 204 0
2026-03-28 14:06:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LJ24UKC/698717332/600 saved to cache
2026-03-28 14:06:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item e21ba6d8-ccbd-5912-bd24-f51d3dc89889
2026-03-28 14:06:04 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:06:04 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:06:04 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:06:04 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:06:04 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:06:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:06:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2dcf4650>
2026-03-28 14:06:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:06:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:06:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:06:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e21ba6d8-ccbd-5912-bd24-f51d3dc89889/e21ba6d8-ccbd-5912-bd24-f51d3dc89889_image_8.jpg HTTP/1.1" 201 0
2026-03-28 14:06:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLJ24UKC%252F698717312%252F600') HTTP/1.1" 204 0
2026-03-28 14:06:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LJ24UKC/698717312/600 saved to cache
2026-03-28 14:06:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item e21ba6d8-ccbd-5912-bd24-f51d3dc89889
2026-03-28 14:06:04 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:06:04 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:06:04 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:06:04 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:06:04 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:06:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:06:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c926dd0>
2026-03-28 14:06:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:06:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:06:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:06:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e21ba6d8-ccbd-5912-bd24-f51d3dc89889/e21ba6d8-ccbd-5912-bd24-f51d3dc89889_image_7.jpg HTTP/1.1" 201 0
2026-03-28 14:06:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLJ24UKC%252F698717287%252F600') HTTP/1.1" 204 0
2026-03-28 14:06:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LJ24UKC/698717287/600 saved to cache
2026-03-28 14:06:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item e21ba6d8-ccbd-5912-bd24-f51d3dc89889
2026-03-28 14:06:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/HY60RUC/42809800?sv=2020-08-04&st=2026-03-28T14%3A05%3A57Z&se=2026-03-28T14%3A30%3A57Z&sr=b&sp=r&sig=H4xVPX%2BQkg%2Fn%2BFlYv77ijhVV1CRf9V8vR2rcopF3JXw%3D> (referer: https://www.bca.co.uk/)
2026-03-28 14:06:04 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LD06WNS/698920825/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698920825>
2026-03-28 14:06:04 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LD06WNS/698920835/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698920835>
2026-03-28 14:06:04 [bca.uk] INFO: Found listing with ID: VO14%20OTM
2026-03-28 14:06:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27VO14%2520OTM%27 HTTP/1.1" 200 None
2026-03-28 14:06:04 [bca.uk] INFO: Scrape type for VO14%20OTM: 0
2026-03-28 14:06:04 [bca.uk] INFO: Found listing with ID: HW19%20NFU
2026-03-28 14:06:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27HW19%2520NFU%27 HTTP/1.1" 200 None
2026-03-28 14:06:04 [bca.uk] INFO: Scrape type for HW19%20NFU: 2
2026-03-28 14:06:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e02d7ea0-9101-5aec-a4f5-a66c0af545ad with identifier: HW19%20NFU
2026-03-28 14:06:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e02d7ea0-9101-5aec-a4f5-a66c0af545ad with scrape type 2
2026-03-28 14:06:04 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e02d7ea0-9101-5aec-a4f5-a66c0af545ad with scrape type 2
2026-03-28 14:06:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: e02d7ea0-9101-5aec-a4f5-a66c0af545ad, identifier: HW19%20NFU
2026-03-28 14:06:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698681979%27 HTTP/1.1" 200 None
2026-03-28 14:06:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698681979 not downloaded yet
2026-03-28 14:06:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: e02d7ea0-9101-5aec-a4f5-a66c0af545ad with identifier: HW19%20NFU
2026-03-28 14:06:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: e02d7ea0-9101-5aec-a4f5-a66c0af545ad with identifier: HW19%20NFU
2026-03-28 14:06:04 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: e02d7ea0-9101-5aec-a4f5-a66c0af545ad with identifier: HW19%20NFU to the API
2026-03-28 14:06:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:06:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:06:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=12&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 176,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=HW19%20NFU-GB',
'category': 'Car',
'color': 'red',
'currency': 'GBP',
'doors_number': 5,
'engine': '2.0L',
'expiration_date': '2026-03-30T07:00:00Z',
'fuel_type': 'Diesel',
'id': 'e02d7ea0-9101-5aec-a4f5-a66c0af545ad',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'HW19 NFU',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=HW19%20NFU&vehicleType=*',
'listing': 'auction',
'location': 'Preston',
'make': 'FORD',
'model': 'EDGE',
'odometer': 132602,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-01-01',
'seller_name': None,
'title': 'FORD EDGE 2.0 EBL 238 4WD ST-LINE StationWagon',
'transmission': 'automatic',
'trim': 'EBL 238 4WD ST-LINE',
'vin': '2FMTK5A31KBB93916',
'year': 2019}
2026-03-28 14:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27HW19%2520NFU%27 HTTP/1.1" 200 None
2026-03-28 14:06:05 [bca.uk] INFO: Saving data for HW19%20NFU: {'auction_closing_time': 1774854000.0, 'created_time': 1773838321.78319, 'last_price_update_time': 1774706765.111088}
2026-03-28 14:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='HW19%2520NFU') HTTP/1.1" 204 0
2026-03-28 14:06:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LJ24UKC/698717232/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LJ24UKC/42810350?sv=2020-08-04&st=2026-03-28T14%3A05%3A36Z&se=2026-03-28T14%3A30%3A36Z&sr=b&sp=r&sig=cuxyo0kEMI6Rf8WOKAH0rgALMpgPmn%2FBYgPsLsWZGdY%3D)
2026-03-28 14:06:05 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LD57FXL/698934051/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698934051>
2026-03-28 14:06:05 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BU67HNA/698729735/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698729735>
2026-03-28 14:06:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/OW69BUU/697928869/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/OW69BUU/42810360?sv=2020-08-04&st=2026-03-28T14%3A05%3A41Z&se=2026-03-28T14%3A30%3A41Z&sr=b&sp=r&sig=K9lRxvrb31NcTkLXgZADadn3Empdjh1%2BI4o9SeNOjN0%3D)
2026-03-28 14:06:05 [bca.uk] INFO: Found listing with ID: PX65%20UKM
2026-03-28 14:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27PX65%2520UKM%27 HTTP/1.1" 200 None
2026-03-28 14:06:05 [bca.uk] INFO: Scrape type for PX65%20UKM: 2
2026-03-28 14:06:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f32abd7a-f00f-5154-8651-761728dd886a with identifier: PX65%20UKM
2026-03-28 14:06:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f32abd7a-f00f-5154-8651-761728dd886a with scrape type 2
2026-03-28 14:06:05 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f32abd7a-f00f-5154-8651-761728dd886a with scrape type 2
2026-03-28 14:06:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: f32abd7a-f00f-5154-8651-761728dd886a, identifier: PX65%20UKM
2026-03-28 14:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698682002%27 HTTP/1.1" 200 None
2026-03-28 14:06:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698682002 not downloaded yet
2026-03-28 14:06:05 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:06:05 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:06:05 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:06:05 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:06:05 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:06:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:06:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c98c190>
2026-03-28 14:06:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:06:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:06:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:06:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0d569b1a-e283-5140-bff5-8b0083b89ad4/0d569b1a-e283-5140-bff5-8b0083b89ad4_image_6.jpg HTTP/1.1" 201 0
2026-03-28 14:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FOW69BUU%252F697928863%252F600') HTTP/1.1" 204 0
2026-03-28 14:06:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/OW69BUU/697928863/600 saved to cache
2026-03-28 14:06:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 0d569b1a-e283-5140-bff5-8b0083b89ad4
2026-03-28 14:06:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SA60NYT/698947025/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/SA60NYT/42810538?sv=2020-08-04&st=2026-03-28T14%3A05%3A31Z&se=2026-03-28T14%3A30%3A31Z&sr=b&sp=r&sig=E2aZntMhZA%2B%2F8gu6iOIeQUHtNbnCVBf4tuK50ckRu0U%3D)
2026-03-28 14:06:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/OW69BUU/697928872/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/OW69BUU/42810360?sv=2020-08-04&st=2026-03-28T14%3A05%3A41Z&se=2026-03-28T14%3A30%3A41Z&sr=b&sp=r&sig=K9lRxvrb31NcTkLXgZADadn3Empdjh1%2BI4o9SeNOjN0%3D)
2026-03-28 14:06:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: f32abd7a-f00f-5154-8651-761728dd886a with identifier: PX65%20UKM
2026-03-28 14:06:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: f32abd7a-f00f-5154-8651-761728dd886a with identifier: PX65%20UKM
2026-03-28 14:06:05 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: f32abd7a-f00f-5154-8651-761728dd886a with identifier: PX65%20UKM to the API
2026-03-28 14:06:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:06:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:06:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=12&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 109,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=PX65%20UKM-GB',
'category': 'Car',
'color': 'white',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.5L',
'expiration_date': '2026-03-30T07:00:00Z',
'fuel_type': 'Petrol',
'id': 'f32abd7a-f00f-5154-8651-761728dd886a',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'PX65 UKM',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=PX65%20UKM&vehicleType=*',
'listing': 'auction',
'location': 'Leeds',
'make': 'MINI',
'model': 'COOPER',
'odometer': 53728,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-01-01',
'seller_name': None,
'title': 'MINI COOPER 1.5 136 Hatchback',
'transmission': 'manual',
'trim': '136',
'vin': 'WMWXS520X02B72642',
'year': 2015}
2026-03-28 14:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27PX65%2520UKM%27 HTTP/1.1" 200 None
2026-03-28 14:06:05 [bca.uk] INFO: Saving data for PX65%20UKM: {'auction_closing_time': 1774854000.0, 'created_time': 1774523252.559584, 'last_price_update_time': 1774706765.913613}
2026-03-28 14:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='PX65%2520UKM') HTTP/1.1" 204 0
2026-03-28 14:06:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/OW69BUU/697928874/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/OW69BUU/42810360?sv=2020-08-04&st=2026-03-28T14%3A05%3A41Z&se=2026-03-28T14%3A30%3A41Z&sr=b&sp=r&sig=K9lRxvrb31NcTkLXgZADadn3Empdjh1%2BI4o9SeNOjN0%3D)
2026-03-28 14:06:05 [bca.uk] INFO: Found listing with ID: KR61%20ECC
2026-03-28 14:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KR61%2520ECC%27 HTTP/1.1" 200 None
2026-03-28 14:06:05 [bca.uk] INFO: Scrape type for KR61%20ECC: 2
2026-03-28 14:06:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d82978e3-1dbd-5e85-a8e0-e19da11b693a with identifier: KR61%20ECC
2026-03-28 14:06:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d82978e3-1dbd-5e85-a8e0-e19da11b693a with scrape type 2
2026-03-28 14:06:05 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d82978e3-1dbd-5e85-a8e0-e19da11b693a with scrape type 2
2026-03-28 14:06:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: d82978e3-1dbd-5e85-a8e0-e19da11b693a, identifier: KR61%20ECC
2026-03-28 14:06:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698682024%27 HTTP/1.1" 200 None
2026-03-28 14:06:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698682024 not downloaded yet
2026-03-28 14:06:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:06:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c9d4550>
2026-03-28 14:06:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:06:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:06:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:06:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c8897eb2-3293-514c-86a5-f8c7210c23b1/c8897eb2-3293-514c-86a5-f8c7210c23b1_expert_report_file_2c306f36-7094-42c8-86e1-428369178800.pdf HTTP/1.1" 201 0
2026-03-28 14:06:06 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item c8897eb2-3293-514c-86a5-f8c7210c23b1
2026-03-28 14:06:06 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: c8897eb2-3293-514c-86a5-f8c7210c23b1, skipping ID generation
2026-03-28 14:06:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item c8897eb2-3293-514c-86a5-f8c7210c23b1
2026-03-28 14:06:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DHY60RUC-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-28 14:06:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=HY60RUC-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-28 14:06:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LJ24UKC/698717217/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LJ24UKC/42810350?sv=2020-08-04&st=2026-03-28T14%3A05%3A36Z&se=2026-03-28T14%3A30%3A36Z&sr=b&sp=r&sig=cuxyo0kEMI6Rf8WOKAH0rgALMpgPmn%2FBYgPsLsWZGdY%3D)
2026-03-28 14:06:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/OW69BUU/697928840/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/OW69BUU/42810360?sv=2020-08-04&st=2026-03-28T14%3A05%3A41Z&se=2026-03-28T14%3A30%3A41Z&sr=b&sp=r&sig=K9lRxvrb31NcTkLXgZADadn3Empdjh1%2BI4o9SeNOjN0%3D)
2026-03-28 14:06:06 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EN10PWV/698681944/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=EN10PWV-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-28 14:06:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: d82978e3-1dbd-5e85-a8e0-e19da11b693a with identifier: KR61%20ECC
2026-03-28 14:06:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: d82978e3-1dbd-5e85-a8e0-e19da11b693a with identifier: KR61%20ECC
2026-03-28 14:06:06 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: d82978e3-1dbd-5e85-a8e0-e19da11b693a with identifier: KR61%20ECC to the API
2026-03-28 14:06:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:06:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:06:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=12&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 156,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=KR61%20ECC-GB',
'category': 'Car',
'color': 'silver',
'currency': 'GBP',
'doors_number': 5,
'engine': '2.0L',
'expiration_date': '2026-03-30T07:00:00Z',
'fuel_type': 'Diesel',
'id': 'd82978e3-1dbd-5e85-a8e0-e19da11b693a',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'KR61 ECC',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=KR61%20ECC&vehicleType=*',
'listing': 'auction',
'location': 'Leeds',
'make': 'AUDI',
'model': 'Q3',
'odometer': 84988,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2012-01-01',
'seller_name': None,
'title': 'AUDI Q3 2.0 TDI 177 QUATTRO SE S-T StationWagon',
'transmission': 'automatic',
'trim': 'TDI 177 QUATTRO SE S-T',
'vin': 'WAUZZZ8U1CR022384',
'year': 2012}
2026-03-28 14:06:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KR61%2520ECC%27 HTTP/1.1" 200 None
2026-03-28 14:06:06 [bca.uk] INFO: Saving data for KR61%20ECC: {'auction_closing_time': 1774854000.0, 'created_time': 1774523270.344478, 'last_price_update_time': 1774706766.502799}
2026-03-28 14:06:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='KR61%2520ECC') HTTP/1.1" 204 0
2026-03-28 14:06:06 [bca.uk] INFO: Found listing with ID: CY13%20EPU
2026-03-28 14:06:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27CY13%2520EPU%27 HTTP/1.1" 200 None
2026-03-28 14:06:06 [bca.uk] INFO: Scrape type for CY13%20EPU: 2
2026-03-28 14:06:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0f49ed0f-8bec-59a1-b02e-d17eae02133b with identifier: CY13%20EPU
2026-03-28 14:06:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0f49ed0f-8bec-59a1-b02e-d17eae02133b with scrape type 2
2026-03-28 14:06:06 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0f49ed0f-8bec-59a1-b02e-d17eae02133b with scrape type 2
2026-03-28 14:06:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 0f49ed0f-8bec-59a1-b02e-d17eae02133b, identifier: CY13%20EPU
2026-03-28 14:06:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698682038%27 HTTP/1.1" 200 None
2026-03-28 14:06:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698682038 not downloaded yet
2026-03-28 14:06:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698682008%27 HTTP/1.1" 200 None
2026-03-28 14:06:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698682008 not downloaded yet
2026-03-28 14:06:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LM05FYZ/42809535?sv=2020-08-04&st=2026-03-28T14%3A06%3A02Z&se=2026-03-28T14%3A31%3A02Z&sr=b&sp=r&sig=0XLGDeD93HjjiKgV4xBnfu5dFMIwsNV4XYOCMU8Ir%2BU%3D> (referer: https://www.bca.co.uk/)
2026-03-28 14:06:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LD06WNS/698920845/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LD06WNS/42809781?sv=2020-08-04&st=2026-03-28T14%3A05%3A31Z&se=2026-03-28T14%3A30%3A31Z&sr=b&sp=r&sig=OTvnKFmvSmD2QJ4F%2F503KbBKEXfjVzDNMqEsXfGzuJ0%3D)
2026-03-28 14:06:06 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EN10PWV/698681962/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698681962>
2026-03-28 14:06:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 0f49ed0f-8bec-59a1-b02e-d17eae02133b with identifier: CY13%20EPU
2026-03-28 14:06:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 0f49ed0f-8bec-59a1-b02e-d17eae02133b with identifier: CY13%20EPU
2026-03-28 14:06:06 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 0f49ed0f-8bec-59a1-b02e-d17eae02133b with identifier: CY13%20EPU to the API
2026-03-28 14:06:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:06:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:06:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=12&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 139,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=CY13%20EPU-GB',
'category': 'Car',
'color': 'black',
'currency': 'GBP',
'doors_number': 2,
'engine': '2.0L',
'expiration_date': '2026-03-30T07:00:00Z',
'fuel_type': 'Diesel',
'id': '0f49ed0f-8bec-59a1-b02e-d17eae02133b',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'CY13 EPU',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=CY13%20EPU&vehicleType=*',
'listing': 'auction',
'location': 'Enfield',
'make': 'AUDI',
'model': 'A5',
'odometer': 91862,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2013-01-01',
'seller_name': None,
'title': 'AUDI A5 2.0 TDI 177 QUATTRO BLACK ED.S-T Coupe',
'transmission': 'automatic',
'trim': 'TDI 177 QUATTRO BLACK ED.S-T',
'vin': 'WAUZZZ8T9DA077690',
'year': 2013}
2026-03-28 14:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27CY13%2520EPU%27 HTTP/1.1" 200 None
2026-03-28 14:06:07 [bca.uk] INFO: Saving data for CY13%20EPU: {'auction_closing_time': 1774854000.0, 'created_time': 1774437407.596584, 'last_price_update_time': 1774706767.090162}
2026-03-28 14:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='CY13%2520EPU') HTTP/1.1" 204 0
2026-03-28 14:06:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:06:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2d9105d0>
2026-03-28 14:06:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:06:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:06:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:06:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e21ba6d8-ccbd-5912-bd24-f51d3dc89889/e21ba6d8-ccbd-5912-bd24-f51d3dc89889_image_5.jpg HTTP/1.1" 201 0
2026-03-28 14:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLJ24UKC%252F698717232%252F600') HTTP/1.1" 204 0
2026-03-28 14:06:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LJ24UKC/698717232/600 saved to cache
2026-03-28 14:06:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item e21ba6d8-ccbd-5912-bd24-f51d3dc89889
2026-03-28 14:06:07 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:06:07 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:06:07 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:06:07 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:06:07 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:06:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:06:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2d96de50>
2026-03-28 14:06:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:06:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:06:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:06:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0d569b1a-e283-5140-bff5-8b0083b89ad4/0d569b1a-e283-5140-bff5-8b0083b89ad4_image_7.jpg HTTP/1.1" 201 0
2026-03-28 14:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FOW69BUU%252F697928869%252F600') HTTP/1.1" 204 0
2026-03-28 14:06:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/OW69BUU/697928869/600 saved to cache
2026-03-28 14:06:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 0d569b1a-e283-5140-bff5-8b0083b89ad4
2026-03-28 14:06:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:06:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c139a50>
2026-03-28 14:06:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:06:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:06:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:06:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_389368a0-4349-5257-9e72-f8c2c2fc01c4/389368a0-4349-5257-9e72-f8c2c2fc01c4_image_5.jpg HTTP/1.1" 201 0
2026-03-28 14:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FSA60NYT%252F698947025%252F600') HTTP/1.1" 204 0
2026-03-28 14:06:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SA60NYT/698947025/600 saved to cache
2026-03-28 14:06:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 389368a0-4349-5257-9e72-f8c2c2fc01c4
2026-03-28 14:06:07 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 389368a0-4349-5257-9e72-f8c2c2fc01c4, skipping ID generation
2026-03-28 14:06:07 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 389368a0-4349-5257-9e72-f8c2c2fc01c4 sending to next pipeline
2026-03-28 14:06:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 389368a0-4349-5257-9e72-f8c2c2fc01c4, identifier: SA60%20NYT
2026-03-28 14:06:07 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:06:07 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:06:07 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:06:07 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:06:07 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:06:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:06:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c996590>
2026-03-28 14:06:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:06:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:06:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:06:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0d569b1a-e283-5140-bff5-8b0083b89ad4/0d569b1a-e283-5140-bff5-8b0083b89ad4_image_8.jpg HTTP/1.1" 201 0
2026-03-28 14:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FOW69BUU%252F697928872%252F600') HTTP/1.1" 204 0
2026-03-28 14:06:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/OW69BUU/697928872/600 saved to cache
2026-03-28 14:06:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 0d569b1a-e283-5140-bff5-8b0083b89ad4
2026-03-28 14:06:07 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:06:07 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:06:07 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:06:07 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:06:07 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:06:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:06:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c138dd0>
2026-03-28 14:06:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:06:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:06:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:06:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0d569b1a-e283-5140-bff5-8b0083b89ad4/0d569b1a-e283-5140-bff5-8b0083b89ad4_image_9.jpg HTTP/1.1" 201 0
2026-03-28 14:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FOW69BUU%252F697928874%252F600') HTTP/1.1" 204 0
2026-03-28 14:06:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/OW69BUU/697928874/600 saved to cache
2026-03-28 14:06:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 0d569b1a-e283-5140-bff5-8b0083b89ad4
2026-03-28 14:06:07 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EN10PWV/698681979/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698681979>
2026-03-28 14:06:07 [bca.uk] INFO: Found listing with ID: NV21%20YRL
2026-03-28 14:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27NV21%2520YRL%27 HTTP/1.1" 200 None
2026-03-28 14:06:07 [bca.uk] INFO: Scrape type for NV21%20YRL: 0
2026-03-28 14:06:07 [bca.uk] INFO: Found listing with ID: EN68%20PKU
2026-03-28 14:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27EN68%2520PKU%27 HTTP/1.1" 200 None
2026-03-28 14:06:07 [bca.uk] INFO: Scrape type for EN68%20PKU: 0
2026-03-28 14:06:07 [bca.uk] INFO: Found listing with ID: YF18%20DCZ
2026-03-28 14:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YF18%2520DCZ%27 HTTP/1.1" 200 None
2026-03-28 14:06:07 [bca.uk] INFO: Scrape type for YF18%20DCZ: 0
2026-03-28 14:06:07 [bca.uk] INFO: Found listing with ID: NS16%20AHS
2026-03-28 14:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27NS16%2520AHS%27 HTTP/1.1" 200 None
2026-03-28 14:06:07 [bca.uk] INFO: Scrape type for NS16%20AHS: 0
2026-03-28 14:06:07 [bca.uk] INFO: Found listing with ID: LT13%20WRU
2026-03-28 14:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LT13%2520WRU%27 HTTP/1.1" 200 None
2026-03-28 14:06:07 [bca.uk] INFO: Scrape type for LT13%20WRU: 0
2026-03-28 14:06:07 [bca.uk] INFO: Found listing with ID: FY65%20BZP
2026-03-28 14:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FY65%2520BZP%27 HTTP/1.1" 200 None
2026-03-28 14:06:07 [bca.uk] INFO: Scrape type for FY65%20BZP: 0
2026-03-28 14:06:07 [bca.uk] INFO: Found listing with ID: FX15%20VFY
2026-03-28 14:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FX15%2520VFY%27 HTTP/1.1" 200 None
2026-03-28 14:06:07 [bca.uk] INFO: Scrape type for FX15%20VFY: 0
2026-03-28 14:06:07 [bca.uk] INFO: Found listing with ID: FM03%20CCZ
2026-03-28 14:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FM03%2520CCZ%27 HTTP/1.1" 200 None
2026-03-28 14:06:07 [bca.uk] INFO: Scrape type for FM03%20CCZ: 0
2026-03-28 14:06:07 [bca.uk] INFO: Found listing with ID: FA17%20TWN
2026-03-28 14:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FA17%2520TWN%27 HTTP/1.1" 200 None
2026-03-28 14:06:07 [bca.uk] INFO: Scrape type for FA17%20TWN: 0
2026-03-28 14:06:07 [bca.uk] INFO: Found listing with ID: WF66%20WCL
2026-03-28 14:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WF66%2520WCL%27 HTTP/1.1" 200 None
2026-03-28 14:06:07 [bca.uk] INFO: Scrape type for WF66%20WCL: 0
2026-03-28 14:06:07 [bca.uk] INFO: Found listing with ID: PJ64%20LVP
2026-03-28 14:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27PJ64%2520LVP%27 HTTP/1.1" 200 None
2026-03-28 14:06:07 [bca.uk] INFO: Scrape type for PJ64%20LVP: 0
2026-03-28 14:06:07 [bca.uk] INFO: Found listing with ID: KP69%20DTN
2026-03-28 14:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KP69%2520DTN%27 HTTP/1.1" 200 None
2026-03-28 14:06:07 [bca.uk] INFO: Scrape type for KP69%20DTN: 0
2026-03-28 14:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698682064%27 HTTP/1.1" 200 None
2026-03-28 14:06:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698682064 not downloaded yet
2026-03-28 14:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698682033%27 HTTP/1.1" 200 None
2026-03-28 14:06:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698682033 not downloaded yet
2026-03-28 14:06:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 389368a0-4349-5257-9e72-f8c2c2fc01c4 with identifier: SA60%20NYT
2026-03-28 14:06:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 389368a0-4349-5257-9e72-f8c2c2fc01c4 with identifier: SA60%20NYT
2026-03-28 14:06:07 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 389368a0-4349-5257-9e72-f8c2c2fc01c4 with identifier: SA60%20NYT to the API
2026-03-28 14:06:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:06:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:06:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SA60NYT/698947025/600>
{'auction_title': '',
'c_o_2_emission_value': 177,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_389368a0-4349-5257-9e72-f8c2c2fc01c4/389368a0-4349-5257-9e72-f8c2c2fc01c4_expert_report_file_a373ca16-f136-4d11-929a-89565f1acd47.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=SA60%20NYT-GB',
'category': 'Car',
'color': 'black',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.6L',
'expiration_date': '2026-03-31T10:00:00Z',
'fuel_type': 'Petrol',
'id': '389368a0-4349-5257-9e72-f8c2c2fc01c4',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'SA60 NYT',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=SA60%20NYT&vehicleType=*',
'listing': 'auction',
'location': 'Paddock Wood',
'make': 'RENAULT',
'model': 'GRAND SCENIC',
'odometer': 109336,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 11,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_389368a0-4349-5257-9e72-f8c2c2fc01c4/389368a0-4349-5257-9e72-f8c2c2fc01c4_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 53669,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SA60NYT/698946973/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_389368a0-4349-5257-9e72-f8c2c2fc01c4/389368a0-4349-5257-9e72-f8c2c2fc01c4_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 52554,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SA60NYT/698946982/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_389368a0-4349-5257-9e72-f8c2c2fc01c4/389368a0-4349-5257-9e72-f8c2c2fc01c4_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 49920,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SA60NYT/698946995/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_389368a0-4349-5257-9e72-f8c2c2fc01c4/389368a0-4349-5257-9e72-f8c2c2fc01c4_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 47676,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SA60NYT/698947003/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_389368a0-4349-5257-9e72-f8c2c2fc01c4/389368a0-4349-5257-9e72-f8c2c2fc01c4_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 46054,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SA60NYT/698947015/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_389368a0-4349-5257-9e72-f8c2c2fc01c4/389368a0-4349-5257-9e72-f8c2c2fc01c4_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 45628,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SA60NYT/698947025/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_389368a0-4349-5257-9e72-f8c2c2fc01c4/389368a0-4349-5257-9e72-f8c2c2fc01c4_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 99637,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SA60NYT/698947050/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_389368a0-4349-5257-9e72-f8c2c2fc01c4/389368a0-4349-5257-9e72-f8c2c2fc01c4_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 71253,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SA60NYT/698947090/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_389368a0-4349-5257-9e72-f8c2c2fc01c4/389368a0-4349-5257-9e72-f8c2c2fc01c4_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 80893,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SA60NYT/698947119/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_389368a0-4349-5257-9e72-f8c2c2fc01c4/389368a0-4349-5257-9e72-f8c2c2fc01c4_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 72426,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SA60NYT/698947154/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2010-01-01',
'seller_name': None,
'title': 'RENAULT GRAND SCENIC 1.6 VVT 110 DYNAMIQUE (7ST) MPV',
'transmission': 'manual',
'trim': 'VVT 110 DYNAMIQUE (7ST)',
'vin': 'VF1JZ0VB641848080',
'year': 2010}
2026-03-28 14:06:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SA60%2520NYT%27 HTTP/1.1" 200 None
2026-03-28 14:06:08 [bca.uk] INFO: Saving data for SA60%20NYT: {'created_time': 1774706768.055712, 'last_price_update_time': 1774706768.055724, 'auction_closing_time': 1774951200.0}
2026-03-28 14:06:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='SA60%2520NYT') HTTP/1.1" 204 0
2026-03-28 14:06:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LD06WNS/698920835/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LD06WNS/42809781?sv=2020-08-04&st=2026-03-28T14%3A05%3A31Z&se=2026-03-28T14%3A30%3A31Z&sr=b&sp=r&sig=OTvnKFmvSmD2QJ4F%2F503KbBKEXfjVzDNMqEsXfGzuJ0%3D)
2026-03-28 14:06:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LD06WNS/698920825/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LD06WNS/42809781?sv=2020-08-04&st=2026-03-28T14%3A05%3A31Z&se=2026-03-28T14%3A30%3A31Z&sr=b&sp=r&sig=OTvnKFmvSmD2QJ4F%2F503KbBKEXfjVzDNMqEsXfGzuJ0%3D)
2026-03-28 14:06:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BU67HNA/698729735/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/BU67HNA/42810584?sv=2020-08-04&st=2026-03-28T14%3A05%3A27Z&se=2026-03-28T14%3A30%3A27Z&sr=b&sp=r&sig=jvqWs0bbwwPNyCuILhTmpoSOvgJ5gvo7FW1OJ3cgP4I%3D)
2026-03-28 14:06:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LD57FXL/698934051/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LD57FXL/42810412?sv=2020-08-04&st=2026-03-28T14%3A05%3A27Z&se=2026-03-28T14%3A30%3A27Z&sr=b&sp=r&sig=SrrbefNVxYUh04mJFXEMP7I6EJU13XfRB%2BYQXtzw2lU%3D)
2026-03-28 14:06:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:06:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c453c90>
2026-03-28 14:06:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:06:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:06:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:06:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e21ba6d8-ccbd-5912-bd24-f51d3dc89889/e21ba6d8-ccbd-5912-bd24-f51d3dc89889_image_4.jpg HTTP/1.1" 201 0
2026-03-28 14:06:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLJ24UKC%252F698717217%252F600') HTTP/1.1" 204 0
2026-03-28 14:06:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LJ24UKC/698717217/600 saved to cache
2026-03-28 14:06:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item e21ba6d8-ccbd-5912-bd24-f51d3dc89889
2026-03-28 14:06:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:06:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2deb2150>
2026-03-28 14:06:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:06:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:06:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:06:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0d569b1a-e283-5140-bff5-8b0083b89ad4/0d569b1a-e283-5140-bff5-8b0083b89ad4_image_0.jpg HTTP/1.1" 201 0
2026-03-28 14:06:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FOW69BUU%252F697928840%252F600') HTTP/1.1" 204 0
2026-03-28 14:06:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/OW69BUU/697928840/600 saved to cache
2026-03-28 14:06:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 0d569b1a-e283-5140-bff5-8b0083b89ad4
2026-03-28 14:06:08 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 0d569b1a-e283-5140-bff5-8b0083b89ad4, skipping ID generation
2026-03-28 14:06:08 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 0d569b1a-e283-5140-bff5-8b0083b89ad4 sending to next pipeline
2026-03-28 14:06:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 0d569b1a-e283-5140-bff5-8b0083b89ad4, identifier: OW69%20BUU
2026-03-28 14:06:08 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BU67HNA/698729718/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698729718>
2026-03-28 14:06:08 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LJ24UKC/698717129/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=LJ24UKC-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-28 14:06:08 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EN10PWV/698682002/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698682002>
2026-03-28 14:06:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698682099%27 HTTP/1.1" 200 None
2026-03-28 14:06:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698682099 not downloaded yet
2026-03-28 14:06:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698682050%27 HTTP/1.1" 200 None
2026-03-28 14:06:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698682050 not downloaded yet
2026-03-28 14:06:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 0d569b1a-e283-5140-bff5-8b0083b89ad4 with identifier: OW69%20BUU
2026-03-28 14:06:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 0d569b1a-e283-5140-bff5-8b0083b89ad4 with identifier: OW69%20BUU
2026-03-28 14:06:08 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 0d569b1a-e283-5140-bff5-8b0083b89ad4 with identifier: OW69%20BUU to the API
2026-03-28 14:06:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:06:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:06:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/OW69BUU/697928840/600>
{'auction_title': '',
'c_o_2_emission_value': 233,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0d569b1a-e283-5140-bff5-8b0083b89ad4/0d569b1a-e283-5140-bff5-8b0083b89ad4_expert_report_file_b1e5d033-2225-47d9-8cde-ab766714444c.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=OW69%20BUU-GB',
'category': 'Car',
'color': 'green',
'currency': 'GBP',
'doors_number': 2,
'engine': '3.0L',
'expiration_date': '2026-04-02T10:00:00Z',
'fuel_type': 'Petrol',
'id': '0d569b1a-e283-5140-bff5-8b0083b89ad4',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'OW69 BUU',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=OW69%20BUU&vehicleType=*',
'listing': 'auction',
'location': 'Thurleigh',
'make': 'JAGUAR',
'model': 'F-TYPE',
'odometer': 13243,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 12,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0d569b1a-e283-5140-bff5-8b0083b89ad4/0d569b1a-e283-5140-bff5-8b0083b89ad4_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 44832,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/OW69BUU/697928840/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0d569b1a-e283-5140-bff5-8b0083b89ad4/0d569b1a-e283-5140-bff5-8b0083b89ad4_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 46955,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/OW69BUU/697928846/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0d569b1a-e283-5140-bff5-8b0083b89ad4/0d569b1a-e283-5140-bff5-8b0083b89ad4_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 43427,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/OW69BUU/697928852/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0d569b1a-e283-5140-bff5-8b0083b89ad4/0d569b1a-e283-5140-bff5-8b0083b89ad4_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 44346,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/OW69BUU/697928854/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0d569b1a-e283-5140-bff5-8b0083b89ad4/0d569b1a-e283-5140-bff5-8b0083b89ad4_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 41491,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/OW69BUU/697928857/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0d569b1a-e283-5140-bff5-8b0083b89ad4/0d569b1a-e283-5140-bff5-8b0083b89ad4_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 40995,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/OW69BUU/697928859/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0d569b1a-e283-5140-bff5-8b0083b89ad4/0d569b1a-e283-5140-bff5-8b0083b89ad4_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 101380,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/OW69BUU/697928863/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0d569b1a-e283-5140-bff5-8b0083b89ad4/0d569b1a-e283-5140-bff5-8b0083b89ad4_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 61678,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/OW69BUU/697928869/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0d569b1a-e283-5140-bff5-8b0083b89ad4/0d569b1a-e283-5140-bff5-8b0083b89ad4_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 86882,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/OW69BUU/697928872/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0d569b1a-e283-5140-bff5-8b0083b89ad4/0d569b1a-e283-5140-bff5-8b0083b89ad4_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 83727,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/OW69BUU/697928874/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-01-01',
'seller_name': None,
'title': 'JAGUAR F-TYPE 3.0 V6 S/C 380 R-DYNAMIC AWD Roadster',
'transmission': 'automatic',
'trim': 'V6 S/C 380 R-DYNAMIC AWD',
'vin': 'SAJDA5AV8LCK69020',
'year': 2020}
2026-03-28 14:06:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27OW69%2520BUU%27 HTTP/1.1" 200 None
2026-03-28 14:06:08 [bca.uk] INFO: Saving data for OW69%20BUU: {'created_time': 1774706768.778013, 'last_price_update_time': 1774706768.778025, 'auction_closing_time': 1775124000.0}
2026-03-28 14:06:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='OW69%2520BUU') HTTP/1.1" 204 0
2026-03-28 14:06:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:06:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c96b7d0>
2026-03-28 14:06:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:06:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:06:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:06:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cd20e351-5a2e-5326-baf7-36f908a1b729/cd20e351-5a2e-5326-baf7-36f908a1b729_expert_report_file_efefb426-c6dc-41a6-9172-926ba67d0941.pdf HTTP/1.1" 201 0
2026-03-28 14:06:08 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item cd20e351-5a2e-5326-baf7-36f908a1b729
2026-03-28 14:06:08 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: cd20e351-5a2e-5326-baf7-36f908a1b729, skipping ID generation
2026-03-28 14:06:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item cd20e351-5a2e-5326-baf7-36f908a1b729
2026-03-28 14:06:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DLM05FYZ-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-28 14:06:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=LM05FYZ-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-28 14:06:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:06:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2dbfc450>
2026-03-28 14:06:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:06:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:06:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:06:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bbfa1477-6876-5cb3-8bcc-b863e9aae5b2/bbfa1477-6876-5cb3-8bcc-b863e9aae5b2_image_8.jpg HTTP/1.1" 201 0
2026-03-28 14:06:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLD06WNS%252F698920845%252F600') HTTP/1.1" 204 0
2026-03-28 14:06:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LD06WNS/698920845/600 saved to cache
2026-03-28 14:06:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item bbfa1477-6876-5cb3-8bcc-b863e9aae5b2
2026-03-28 14:06:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EN10PWV/698681962/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/EN10PWV/42809685?sv=2020-08-04&st=2026-03-28T14%3A05%3A53Z&se=2026-03-28T14%3A30%3A53Z&sr=b&sp=r&sig=0bUhTFZOWsPha81YwFXHCk91lxzBfSWRH%2BlFeQKDFV0%3D)
2026-03-28 14:06:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EN10PWV/698681944/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/EN10PWV/42809685?sv=2020-08-04&st=2026-03-28T14%3A05%3A53Z&se=2026-03-28T14%3A30%3A53Z&sr=b&sp=r&sig=0bUhTFZOWsPha81YwFXHCk91lxzBfSWRH%2BlFeQKDFV0%3D)
2026-03-28 14:06:08 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LD57FXL/698934001/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698934001>
2026-03-28 14:06:08 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BU67HNA/698729695/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698729695>
2026-03-28 14:06:08 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LD06WNS/698920811/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698920811>
2026-03-28 14:06:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698682127%27 HTTP/1.1" 200 None
2026-03-28 14:06:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698682127 not downloaded yet
2026-03-28 14:06:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698682065%27 HTTP/1.1" 200 None
2026-03-28 14:06:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698682065 not downloaded yet
2026-03-28 14:06:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:06:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2d69e850>
2026-03-28 14:06:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:06:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:06:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:06:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bbfa1477-6876-5cb3-8bcc-b863e9aae5b2/bbfa1477-6876-5cb3-8bcc-b863e9aae5b2_image_6.jpg HTTP/1.1" 201 0
2026-03-28 14:06:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLD06WNS%252F698920835%252F600') HTTP/1.1" 204 0
2026-03-28 14:06:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LD06WNS/698920835/600 saved to cache
2026-03-28 14:06:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item bbfa1477-6876-5cb3-8bcc-b863e9aae5b2
2026-03-28 14:06:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:06:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a1fe31350>
2026-03-28 14:06:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:06:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:06:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:06:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bbfa1477-6876-5cb3-8bcc-b863e9aae5b2/bbfa1477-6876-5cb3-8bcc-b863e9aae5b2_image_4.jpg HTTP/1.1" 201 0
2026-03-28 14:06:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLD06WNS%252F698920825%252F600') HTTP/1.1" 204 0
2026-03-28 14:06:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LD06WNS/698920825/600 saved to cache
2026-03-28 14:06:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item bbfa1477-6876-5cb3-8bcc-b863e9aae5b2
2026-03-28 14:06:08 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:06:08 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:06:08 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:06:08 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:06:08 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:06:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:06:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c8b8290>
2026-03-28 14:06:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:06:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:06:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:06:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e5b1ecb7-cfa8-5758-b32f-ed9093a37d21/e5b1ecb7-cfa8-5758-b32f-ed9093a37d21_image_8.jpg HTTP/1.1" 201 0
2026-03-28 14:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FBU67HNA%252F698729735%252F600') HTTP/1.1" 204 0
2026-03-28 14:06:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BU67HNA/698729735/600 saved to cache
2026-03-28 14:06:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item e5b1ecb7-cfa8-5758-b32f-ed9093a37d21
2026-03-28 14:06:09 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:06:09 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:06:09 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:06:09 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:06:09 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:06:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:06:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2d740650>
2026-03-28 14:06:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:06:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:06:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:06:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_64e95b6e-a78f-537e-8c08-58f1a7f0a9cb/64e95b6e-a78f-537e-8c08-58f1a7f0a9cb_image_8.jpg HTTP/1.1" 201 0
2026-03-28 14:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLD57FXL%252F698934051%252F600') HTTP/1.1" 204 0
2026-03-28 14:06:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LD57FXL/698934051/600 saved to cache
2026-03-28 14:06:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 64e95b6e-a78f-537e-8c08-58f1a7f0a9cb
2026-03-28 14:06:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EN10PWV/698681979/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/EN10PWV/42809685?sv=2020-08-04&st=2026-03-28T14%3A05%3A53Z&se=2026-03-28T14%3A30%3A53Z&sr=b&sp=r&sig=0bUhTFZOWsPha81YwFXHCk91lxzBfSWRH%2BlFeQKDFV0%3D)
2026-03-28 14:06:09 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EN10PWV/698682024/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698682024>
2026-03-28 14:06:09 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HY60RUC/698681990/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=HY60RUC-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-28 14:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698910306%27 HTTP/1.1" 200 None
2026-03-28 14:06:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698910306 not downloaded yet
2026-03-28 14:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698682159%27 HTTP/1.1" 200 None
2026-03-28 14:06:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698682159 not downloaded yet
2026-03-28 14:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698682092%27 HTTP/1.1" 200 None
2026-03-28 14:06:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698682092 not downloaded yet
2026-03-28 14:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698910324%27 HTTP/1.1" 200 None
2026-03-28 14:06:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698910324 not downloaded yet
2026-03-28 14:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698682116%27 HTTP/1.1" 200 None
2026-03-28 14:06:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698682116 not downloaded yet
2026-03-28 14:06:09 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HY60RUC/698682008/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698682008>
2026-03-28 14:06:09 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BU67HNA/698729674/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698729674>
2026-03-28 14:06:09 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EN10PWV/698682038/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698682038>
2026-03-28 14:06:09 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LD57FXL/698933964/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698933964>
2026-03-28 14:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698910339%27 HTTP/1.1" 200 None
2026-03-28 14:06:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698910339 not downloaded yet
2026-03-28 14:06:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:06:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2dcd6a90>
2026-03-28 14:06:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:06:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:06:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:06:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1da598bb-916d-5198-a760-5aef625fcf96/1da598bb-916d-5198-a760-5aef625fcf96_image_1.jpg HTTP/1.1" 201 0
2026-03-28 14:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FEN10PWV%252F698681962%252F600') HTTP/1.1" 204 0
2026-03-28 14:06:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EN10PWV/698681962/600 saved to cache
2026-03-28 14:06:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 1da598bb-916d-5198-a760-5aef625fcf96
2026-03-28 14:06:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:06:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c16ec50>
2026-03-28 14:06:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:06:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:06:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:06:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1da598bb-916d-5198-a760-5aef625fcf96/1da598bb-916d-5198-a760-5aef625fcf96_image_0.jpg HTTP/1.1" 201 0
2026-03-28 14:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FEN10PWV%252F698681944%252F600') HTTP/1.1" 204 0
2026-03-28 14:06:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EN10PWV/698681944/600 saved to cache
2026-03-28 14:06:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 1da598bb-916d-5198-a760-5aef625fcf96
2026-03-28 14:06:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EN10PWV/698682002/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/EN10PWV/42809685?sv=2020-08-04&st=2026-03-28T14%3A05%3A53Z&se=2026-03-28T14%3A30%3A53Z&sr=b&sp=r&sig=0bUhTFZOWsPha81YwFXHCk91lxzBfSWRH%2BlFeQKDFV0%3D)
2026-03-28 14:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698682143%27 HTTP/1.1" 200 None
2026-03-28 14:06:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698682143 not downloaded yet
2026-03-28 14:06:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LJ24UKC/698717129/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LJ24UKC/42810350?sv=2020-08-04&st=2026-03-28T14%3A05%3A36Z&se=2026-03-28T14%3A30%3A36Z&sr=b&sp=r&sig=cuxyo0kEMI6Rf8WOKAH0rgALMpgPmn%2FBYgPsLsWZGdY%3D)
2026-03-28 14:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698910360%27 HTTP/1.1" 200 None
2026-03-28 14:06:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698910360 not downloaded yet
2026-03-28 14:06:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BU67HNA/698729718/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/BU67HNA/42810584?sv=2020-08-04&st=2026-03-28T14%3A05%3A27Z&se=2026-03-28T14%3A30%3A27Z&sr=b&sp=r&sig=jvqWs0bbwwPNyCuILhTmpoSOvgJ5gvo7FW1OJ3cgP4I%3D)
2026-03-28 14:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698682174%27 HTTP/1.1" 200 None
2026-03-28 14:06:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698682174 not downloaded yet
2026-03-28 14:06:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LD06WNS/698920811/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LD06WNS/42809781?sv=2020-08-04&st=2026-03-28T14%3A05%3A31Z&se=2026-03-28T14%3A30%3A31Z&sr=b&sp=r&sig=OTvnKFmvSmD2QJ4F%2F503KbBKEXfjVzDNMqEsXfGzuJ0%3D)
2026-03-28 14:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698910381%27 HTTP/1.1" 200 None
2026-03-28 14:06:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698910381 not downloaded yet
2026-03-28 14:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698682194%27 HTTP/1.1" 200 None
2026-03-28 14:06:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698682194 not downloaded yet
2026-03-28 14:06:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:06:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a1fd92810>
2026-03-28 14:06:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:06:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:06:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:06:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1da598bb-916d-5198-a760-5aef625fcf96/1da598bb-916d-5198-a760-5aef625fcf96_image_2.jpg HTTP/1.1" 201 0
2026-03-28 14:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FEN10PWV%252F698681979%252F600') HTTP/1.1" 204 0
2026-03-28 14:06:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EN10PWV/698681979/600 saved to cache
2026-03-28 14:06:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 1da598bb-916d-5198-a760-5aef625fcf96
2026-03-28 14:06:09 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EN10PWV/698682099/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698682099>
2026-03-28 14:06:09 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HY60RUC/698682050/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698682050>
2026-03-28 14:06:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BU67HNA/698729695/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/BU67HNA/42810584?sv=2020-08-04&st=2026-03-28T14%3A05%3A27Z&se=2026-03-28T14%3A30%3A27Z&sr=b&sp=r&sig=jvqWs0bbwwPNyCuILhTmpoSOvgJ5gvo7FW1OJ3cgP4I%3D)
2026-03-28 14:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698910429%27 HTTP/1.1" 200 None
2026-03-28 14:06:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698910429 not downloaded yet
2026-03-28 14:06:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EN10PWV/698682024/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/EN10PWV/42809685?sv=2020-08-04&st=2026-03-28T14%3A05%3A53Z&se=2026-03-28T14%3A30%3A53Z&sr=b&sp=r&sig=0bUhTFZOWsPha81YwFXHCk91lxzBfSWRH%2BlFeQKDFV0%3D)
2026-03-28 14:06:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HY60RUC/698681990/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/HY60RUC/42809800?sv=2020-08-04&st=2026-03-28T14%3A05%3A57Z&se=2026-03-28T14%3A30%3A57Z&sr=b&sp=r&sig=H4xVPX%2BQkg%2Fn%2BFlYv77ijhVV1CRf9V8vR2rcopF3JXw%3D)
2026-03-28 14:06:09 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HY60RUC/698682065/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698682065>
2026-03-28 14:06:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LD57FXL/698934001/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LD57FXL/42810412?sv=2020-08-04&st=2026-03-28T14%3A05%3A27Z&se=2026-03-28T14%3A30%3A27Z&sr=b&sp=r&sig=SrrbefNVxYUh04mJFXEMP7I6EJU13XfRB%2BYQXtzw2lU%3D)
2026-03-28 14:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698910462%27 HTTP/1.1" 200 None
2026-03-28 14:06:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698910462 not downloaded yet
2026-03-28 14:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698910487%27 HTTP/1.1" 200 None
2026-03-28 14:06:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698910487 not downloaded yet
2026-03-28 14:06:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:06:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c93b510>
2026-03-28 14:06:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:06:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:06:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:06:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1da598bb-916d-5198-a760-5aef625fcf96/1da598bb-916d-5198-a760-5aef625fcf96_image_3.jpg HTTP/1.1" 201 0
2026-03-28 14:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FEN10PWV%252F698682002%252F600') HTTP/1.1" 204 0
2026-03-28 14:06:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EN10PWV/698682002/600 saved to cache
2026-03-28 14:06:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 1da598bb-916d-5198-a760-5aef625fcf96
2026-03-28 14:06:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:06:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2d69ef50>
2026-03-28 14:06:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:06:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:06:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:06:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e21ba6d8-ccbd-5912-bd24-f51d3dc89889/e21ba6d8-ccbd-5912-bd24-f51d3dc89889_image_0.jpg HTTP/1.1" 201 0
2026-03-28 14:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLJ24UKC%252F698717129%252F600') HTTP/1.1" 204 0
2026-03-28 14:06:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LJ24UKC/698717129/600 saved to cache
2026-03-28 14:06:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item e21ba6d8-ccbd-5912-bd24-f51d3dc89889
2026-03-28 14:06:09 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: e21ba6d8-ccbd-5912-bd24-f51d3dc89889, skipping ID generation
2026-03-28 14:06:09 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item e21ba6d8-ccbd-5912-bd24-f51d3dc89889 sending to next pipeline
2026-03-28 14:06:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: e21ba6d8-ccbd-5912-bd24-f51d3dc89889, identifier: LJ24%20UKC
2026-03-28 14:06:09 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:06:09 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:06:09 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:06:09 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:06:09 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:06:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:06:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2da1fc90>
2026-03-28 14:06:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:06:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:06:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:06:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e5b1ecb7-cfa8-5758-b32f-ed9093a37d21/e5b1ecb7-cfa8-5758-b32f-ed9093a37d21_image_7.jpg HTTP/1.1" 201 0
2026-03-28 14:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FBU67HNA%252F698729718%252F600') HTTP/1.1" 204 0
2026-03-28 14:06:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BU67HNA/698729718/600 saved to cache
2026-03-28 14:06:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item e5b1ecb7-cfa8-5758-b32f-ed9093a37d21
2026-03-28 14:06:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: e21ba6d8-ccbd-5912-bd24-f51d3dc89889 with identifier: LJ24%20UKC
2026-03-28 14:06:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: e21ba6d8-ccbd-5912-bd24-f51d3dc89889 with identifier: LJ24%20UKC
2026-03-28 14:06:09 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: e21ba6d8-ccbd-5912-bd24-f51d3dc89889 with identifier: LJ24%20UKC to the API
2026-03-28 14:06:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:06:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:06:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LJ24UKC/698717129/600>
{'auction_title': '',
'c_o_2_emission_value': 226,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e21ba6d8-ccbd-5912-bd24-f51d3dc89889/e21ba6d8-ccbd-5912-bd24-f51d3dc89889_expert_report_file_52b6718e-3afc-4ffb-a77c-c75d89aa5b8f.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=LJ24%20UKC-GB',
'category': 'Car',
'color': 'black',
'currency': 'GBP',
'doors_number': 5,
'engine': '3.0L',
'expiration_date': '2026-04-02T10:00:00Z',
'fuel_type': 'Petrol',
'id': 'e21ba6d8-ccbd-5912-bd24-f51d3dc89889',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'LJ24 UKC',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=LJ24%20UKC&vehicleType=*',
'listing': 'auction',
'location': 'Blackbushe',
'make': 'LAND ROVER',
'model': 'RANGE ROVER',
'odometer': 16821,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 11,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e21ba6d8-ccbd-5912-bd24-f51d3dc89889/e21ba6d8-ccbd-5912-bd24-f51d3dc89889_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 51963,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LJ24UKC/698717129/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e21ba6d8-ccbd-5912-bd24-f51d3dc89889/e21ba6d8-ccbd-5912-bd24-f51d3dc89889_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 49047,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LJ24UKC/698717152/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e21ba6d8-ccbd-5912-bd24-f51d3dc89889/e21ba6d8-ccbd-5912-bd24-f51d3dc89889_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 46053,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LJ24UKC/698717176/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e21ba6d8-ccbd-5912-bd24-f51d3dc89889/e21ba6d8-ccbd-5912-bd24-f51d3dc89889_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 48406,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LJ24UKC/698717195/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e21ba6d8-ccbd-5912-bd24-f51d3dc89889/e21ba6d8-ccbd-5912-bd24-f51d3dc89889_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 48306,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LJ24UKC/698717217/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e21ba6d8-ccbd-5912-bd24-f51d3dc89889/e21ba6d8-ccbd-5912-bd24-f51d3dc89889_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 43663,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LJ24UKC/698717232/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e21ba6d8-ccbd-5912-bd24-f51d3dc89889/e21ba6d8-ccbd-5912-bd24-f51d3dc89889_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 93093,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LJ24UKC/698717262/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e21ba6d8-ccbd-5912-bd24-f51d3dc89889/e21ba6d8-ccbd-5912-bd24-f51d3dc89889_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 75991,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LJ24UKC/698717287/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e21ba6d8-ccbd-5912-bd24-f51d3dc89889/e21ba6d8-ccbd-5912-bd24-f51d3dc89889_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 84191,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LJ24UKC/698717312/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e21ba6d8-ccbd-5912-bd24-f51d3dc89889/e21ba6d8-ccbd-5912-bd24-f51d3dc89889_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 70492,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LJ24UKC/698717332/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2024-01-01',
'seller_name': None,
'title': 'LAND ROVER RANGE ROVER 3.0 P400 SE StationWagon',
'transmission': 'automatic',
'trim': 'P400 SE',
'vin': 'SALKA9AU9RA225853',
'year': 2024}
2026-03-28 14:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LJ24%2520UKC%27 HTTP/1.1" 200 None
2026-03-28 14:06:10 [bca.uk] INFO: Saving data for LJ24%20UKC: {'created_time': 1774706770.088825, 'last_price_update_time': 1774706770.088838, 'auction_closing_time': 1775124000.0}
2026-03-28 14:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='LJ24%2520UKC') HTTP/1.1" 204 0
2026-03-28 14:06:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HY60RUC/698682008/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/HY60RUC/42809800?sv=2020-08-04&st=2026-03-28T14%3A05%3A57Z&se=2026-03-28T14%3A30%3A57Z&sr=b&sp=r&sig=H4xVPX%2BQkg%2Fn%2BFlYv77ijhVV1CRf9V8vR2rcopF3JXw%3D)
2026-03-28 14:06:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EN10PWV/698682038/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/EN10PWV/42809685?sv=2020-08-04&st=2026-03-28T14%3A05%3A53Z&se=2026-03-28T14%3A30%3A53Z&sr=b&sp=r&sig=0bUhTFZOWsPha81YwFXHCk91lxzBfSWRH%2BlFeQKDFV0%3D)
2026-03-28 14:06:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BU67HNA/698729674/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/BU67HNA/42810584?sv=2020-08-04&st=2026-03-28T14%3A05%3A27Z&se=2026-03-28T14%3A30%3A27Z&sr=b&sp=r&sig=jvqWs0bbwwPNyCuILhTmpoSOvgJ5gvo7FW1OJ3cgP4I%3D)
2026-03-28 14:06:10 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HY60RUC/698682143/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698682143>
2026-03-28 14:06:10 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LM05FYZ/698910339/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698910339>
2026-03-28 14:06:10 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HY60RUC/698682116/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698682116>
2026-03-28 14:06:10 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HY60RUC/698682174/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698682174>
2026-03-28 14:06:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LD57FXL/698933964/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LD57FXL/42810412?sv=2020-08-04&st=2026-03-28T14%3A05%3A27Z&se=2026-03-28T14%3A30%3A27Z&sr=b&sp=r&sig=SrrbefNVxYUh04mJFXEMP7I6EJU13XfRB%2BYQXtzw2lU%3D)
2026-03-28 14:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698910521%27 HTTP/1.1" 200 None
2026-03-28 14:06:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698910521 not downloaded yet
2026-03-28 14:06:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:06:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c4e2650>
2026-03-28 14:06:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:06:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:06:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:06:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bbfa1477-6876-5cb3-8bcc-b863e9aae5b2/bbfa1477-6876-5cb3-8bcc-b863e9aae5b2_image_1.jpg HTTP/1.1" 201 0
2026-03-28 14:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLD06WNS%252F698920811%252F600') HTTP/1.1" 204 0
2026-03-28 14:06:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LD06WNS/698920811/600 saved to cache
2026-03-28 14:06:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item bbfa1477-6876-5cb3-8bcc-b863e9aae5b2
2026-03-28 14:06:10 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: bbfa1477-6876-5cb3-8bcc-b863e9aae5b2, skipping ID generation
2026-03-28 14:06:10 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item bbfa1477-6876-5cb3-8bcc-b863e9aae5b2 sending to next pipeline
2026-03-28 14:06:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: bbfa1477-6876-5cb3-8bcc-b863e9aae5b2, identifier: LD06%20WNS
2026-03-28 14:06:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: bbfa1477-6876-5cb3-8bcc-b863e9aae5b2 with identifier: LD06%20WNS
2026-03-28 14:06:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: bbfa1477-6876-5cb3-8bcc-b863e9aae5b2 with identifier: LD06%20WNS
2026-03-28 14:06:10 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: bbfa1477-6876-5cb3-8bcc-b863e9aae5b2 with identifier: LD06%20WNS to the API
2026-03-28 14:06:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:06:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:06:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LD06WNS/698920811/600>
{'auction_title': '',
'c_o_2_emission_value': 204,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bbfa1477-6876-5cb3-8bcc-b863e9aae5b2/bbfa1477-6876-5cb3-8bcc-b863e9aae5b2_expert_report_file_1d6e59ed-5669-401d-b2c4-e18cb42c7602.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=LD06%20WNS-GB',
'category': 'Car',
'color': 'silver',
'currency': 'GBP',
'doors_number': 5,
'engine': '2.2L',
'expiration_date': '2026-03-29T10:00:00Z',
'fuel_type': 'Petrol',
'id': 'bbfa1477-6876-5cb3-8bcc-b863e9aae5b2',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'LD06 WNS',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=LD06%20WNS&vehicleType=*',
'listing': 'auction',
'location': 'Blackbushe',
'make': 'VAUXHALL',
'model': 'ZAFIRA',
'odometer': 84900,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 9,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bbfa1477-6876-5cb3-8bcc-b863e9aae5b2/bbfa1477-6876-5cb3-8bcc-b863e9aae5b2_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 175406,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LD06WNS/698920809/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bbfa1477-6876-5cb3-8bcc-b863e9aae5b2/bbfa1477-6876-5cb3-8bcc-b863e9aae5b2_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 170210,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LD06WNS/698920811/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bbfa1477-6876-5cb3-8bcc-b863e9aae5b2/bbfa1477-6876-5cb3-8bcc-b863e9aae5b2_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 160245,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LD06WNS/698920815/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bbfa1477-6876-5cb3-8bcc-b863e9aae5b2/bbfa1477-6876-5cb3-8bcc-b863e9aae5b2_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 153927,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LD06WNS/698920822/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bbfa1477-6876-5cb3-8bcc-b863e9aae5b2/bbfa1477-6876-5cb3-8bcc-b863e9aae5b2_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 162050,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LD06WNS/698920825/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bbfa1477-6876-5cb3-8bcc-b863e9aae5b2/bbfa1477-6876-5cb3-8bcc-b863e9aae5b2_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 141440,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LD06WNS/698920830/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bbfa1477-6876-5cb3-8bcc-b863e9aae5b2/bbfa1477-6876-5cb3-8bcc-b863e9aae5b2_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 155578,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LD06WNS/698920835/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bbfa1477-6876-5cb3-8bcc-b863e9aae5b2/bbfa1477-6876-5cb3-8bcc-b863e9aae5b2_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 156344,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LD06WNS/698920839/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bbfa1477-6876-5cb3-8bcc-b863e9aae5b2/bbfa1477-6876-5cb3-8bcc-b863e9aae5b2_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 141203,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LD06WNS/698920845/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2006-01-01',
'seller_name': None,
'title': 'VAUXHALL ZAFIRA 2.2 CLUB MPV',
'transmission': 'automatic',
'trim': 'CLUB',
'vin': 'W0L0AHM7562144045',
'year': 2006}
2026-03-28 14:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LD06%2520WNS%27 HTTP/1.1" 200 None
2026-03-28 14:06:10 [bca.uk] INFO: Saving data for LD06%20WNS: {'created_time': 1774706770.703295, 'last_price_update_time': 1774706770.703306, 'auction_closing_time': 1774778400.0}
2026-03-28 14:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='LD06%2520WNS') HTTP/1.1" 204 0
2026-03-28 14:06:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HY60RUC/698682065/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/HY60RUC/42809800?sv=2020-08-04&st=2026-03-28T14%3A05%3A57Z&se=2026-03-28T14%3A30%3A57Z&sr=b&sp=r&sig=H4xVPX%2BQkg%2Fn%2BFlYv77ijhVV1CRf9V8vR2rcopF3JXw%3D)
2026-03-28 14:06:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EN10PWV/698682099/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/EN10PWV/42809685?sv=2020-08-04&st=2026-03-28T14%3A05%3A53Z&se=2026-03-28T14%3A30%3A53Z&sr=b&sp=r&sig=0bUhTFZOWsPha81YwFXHCk91lxzBfSWRH%2BlFeQKDFV0%3D)
2026-03-28 14:06:10 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LM05FYZ/698910429/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698910429>
2026-03-28 14:06:10 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HY60RUC/698682194/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698682194>
2026-03-28 14:06:10 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LM05FYZ/698910360/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698910360>
2026-03-28 14:06:10 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LM05FYZ/698910381/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698910381>
2026-03-28 14:06:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HY60RUC/698682050/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/HY60RUC/42809800?sv=2020-08-04&st=2026-03-28T14%3A05%3A57Z&se=2026-03-28T14%3A30%3A57Z&sr=b&sp=r&sig=H4xVPX%2BQkg%2Fn%2BFlYv77ijhVV1CRf9V8vR2rcopF3JXw%3D)
2026-03-28 14:06:10 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:06:10 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:06:10 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:06:10 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:06:10 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:06:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:06:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c823990>
2026-03-28 14:06:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:06:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:06:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:06:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e5b1ecb7-cfa8-5758-b32f-ed9093a37d21/e5b1ecb7-cfa8-5758-b32f-ed9093a37d21_image_6.jpg HTTP/1.1" 201 0
2026-03-28 14:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FBU67HNA%252F698729695%252F600') HTTP/1.1" 204 0
2026-03-28 14:06:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BU67HNA/698729695/600 saved to cache
2026-03-28 14:06:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item e5b1ecb7-cfa8-5758-b32f-ed9093a37d21
2026-03-28 14:06:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:06:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2d979a50>
2026-03-28 14:06:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:06:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:06:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:06:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1da598bb-916d-5198-a760-5aef625fcf96/1da598bb-916d-5198-a760-5aef625fcf96_image_4.jpg HTTP/1.1" 201 0
2026-03-28 14:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FEN10PWV%252F698682024%252F600') HTTP/1.1" 204 0
2026-03-28 14:06:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EN10PWV/698682024/600 saved to cache
2026-03-28 14:06:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 1da598bb-916d-5198-a760-5aef625fcf96
2026-03-28 14:06:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:06:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c187f10>
2026-03-28 14:06:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:06:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:06:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:06:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c8897eb2-3293-514c-86a5-f8c7210c23b1/c8897eb2-3293-514c-86a5-f8c7210c23b1_image_0.jpg HTTP/1.1" 201 0
2026-03-28 14:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FHY60RUC%252F698681990%252F600') HTTP/1.1" 204 0
2026-03-28 14:06:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HY60RUC/698681990/600 saved to cache
2026-03-28 14:06:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item c8897eb2-3293-514c-86a5-f8c7210c23b1
2026-03-28 14:06:10 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:06:10 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:06:10 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:06:10 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:06:10 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:06:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:06:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2d978c10>
2026-03-28 14:06:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:06:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:06:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:06:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_64e95b6e-a78f-537e-8c08-58f1a7f0a9cb/64e95b6e-a78f-537e-8c08-58f1a7f0a9cb_image_6.jpg HTTP/1.1" 201 0
2026-03-28 14:06:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLD57FXL%252F698934001%252F600') HTTP/1.1" 204 0
2026-03-28 14:06:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LD57FXL/698934001/600 saved to cache
2026-03-28 14:06:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 64e95b6e-a78f-537e-8c08-58f1a7f0a9cb
2026-03-28 14:06:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:06:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2dd57c90>
2026-03-28 14:06:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:06:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:06:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:06:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c8897eb2-3293-514c-86a5-f8c7210c23b1/c8897eb2-3293-514c-86a5-f8c7210c23b1_image_1.jpg HTTP/1.1" 201 0
2026-03-28 14:06:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FHY60RUC%252F698682008%252F600') HTTP/1.1" 204 0
2026-03-28 14:06:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HY60RUC/698682008/600 saved to cache
2026-03-28 14:06:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item c8897eb2-3293-514c-86a5-f8c7210c23b1
2026-03-28 14:06:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:06:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2d9781d0>
2026-03-28 14:06:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:06:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:06:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:06:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1da598bb-916d-5198-a760-5aef625fcf96/1da598bb-916d-5198-a760-5aef625fcf96_image_5.jpg HTTP/1.1" 201 0
2026-03-28 14:06:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FEN10PWV%252F698682038%252F600') HTTP/1.1" 204 0
2026-03-28 14:06:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EN10PWV/698682038/600 saved to cache
2026-03-28 14:06:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 1da598bb-916d-5198-a760-5aef625fcf96
2026-03-28 14:06:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:06:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c924ed0>
2026-03-28 14:06:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:06:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:06:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:06:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e5b1ecb7-cfa8-5758-b32f-ed9093a37d21/e5b1ecb7-cfa8-5758-b32f-ed9093a37d21_image_5.jpg HTTP/1.1" 201 0
2026-03-28 14:06:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FBU67HNA%252F698729674%252F600') HTTP/1.1" 204 0
2026-03-28 14:06:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BU67HNA/698729674/600 saved to cache
2026-03-28 14:06:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item e5b1ecb7-cfa8-5758-b32f-ed9093a37d21
2026-03-28 14:06:11 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: e5b1ecb7-cfa8-5758-b32f-ed9093a37d21, skipping ID generation
2026-03-28 14:06:11 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item e5b1ecb7-cfa8-5758-b32f-ed9093a37d21 sending to next pipeline
2026-03-28 14:06:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: e5b1ecb7-cfa8-5758-b32f-ed9093a37d21, identifier: BU67%20HNA
2026-03-28 14:06:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:06:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a30701490>
2026-03-28 14:06:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:06:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:06:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:06:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_64e95b6e-a78f-537e-8c08-58f1a7f0a9cb/64e95b6e-a78f-537e-8c08-58f1a7f0a9cb_image_5.jpg HTTP/1.1" 201 0
2026-03-28 14:06:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLD57FXL%252F698933964%252F600') HTTP/1.1" 204 0
2026-03-28 14:06:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LD57FXL/698933964/600 saved to cache
2026-03-28 14:06:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 64e95b6e-a78f-537e-8c08-58f1a7f0a9cb
2026-03-28 14:06:11 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 64e95b6e-a78f-537e-8c08-58f1a7f0a9cb, skipping ID generation
2026-03-28 14:06:11 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 64e95b6e-a78f-537e-8c08-58f1a7f0a9cb sending to next pipeline
2026-03-28 14:06:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 64e95b6e-a78f-537e-8c08-58f1a7f0a9cb, identifier: LD57%20FXL
2026-03-28 14:06:11 [scrapy.extensions.logstats] INFO: Crawled 164 pages (at 8 pages/min), scraped 312 items (at 72 items/min)
2026-03-28 14:06:11 [scrapy.extensions.memusage] INFO: Peak memory usage is 200MiB
2026-03-28 14:06:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: e5b1ecb7-cfa8-5758-b32f-ed9093a37d21 with identifier: BU67%20HNA
2026-03-28 14:06:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: e5b1ecb7-cfa8-5758-b32f-ed9093a37d21 with identifier: BU67%20HNA
2026-03-28 14:06:11 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: e5b1ecb7-cfa8-5758-b32f-ed9093a37d21 with identifier: BU67%20HNA to the API
2026-03-28 14:06:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:06:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:06:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BU67HNA/698729674/600>
{'auction_title': '',
'c_o_2_emission_value': 137,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e5b1ecb7-cfa8-5758-b32f-ed9093a37d21/e5b1ecb7-cfa8-5758-b32f-ed9093a37d21_expert_report_file_c4eb7c7e-a963-4451-b3f5-dd2c1dc491ea.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=BU67%20HNA-GB',
'category': 'Car',
'color': 'grey',
'currency': 'GBP',
'doors_number': 5,
'engine': '2.0L',
'expiration_date': '2026-03-29T10:00:00Z',
'fuel_type': 'Diesel',
'id': 'e5b1ecb7-cfa8-5758-b32f-ed9093a37d21',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'BU67 HNA',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=BU67%20HNA&vehicleType=*',
'listing': 'auction',
'location': 'Blackbushe',
'make': 'VAUXHALL',
'model': 'ZAFIRA TOURER',
'odometer': 100907,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 11,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e5b1ecb7-cfa8-5758-b32f-ed9093a37d21/e5b1ecb7-cfa8-5758-b32f-ed9093a37d21_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 55823,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BU67HNA/698729591/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e5b1ecb7-cfa8-5758-b32f-ed9093a37d21/e5b1ecb7-cfa8-5758-b32f-ed9093a37d21_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 51842,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BU67HNA/698729606/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e5b1ecb7-cfa8-5758-b32f-ed9093a37d21/e5b1ecb7-cfa8-5758-b32f-ed9093a37d21_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 50145,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BU67HNA/698729626/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e5b1ecb7-cfa8-5758-b32f-ed9093a37d21/e5b1ecb7-cfa8-5758-b32f-ed9093a37d21_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 52330,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BU67HNA/698729644/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e5b1ecb7-cfa8-5758-b32f-ed9093a37d21/e5b1ecb7-cfa8-5758-b32f-ed9093a37d21_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 54227,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BU67HNA/698729656/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e5b1ecb7-cfa8-5758-b32f-ed9093a37d21/e5b1ecb7-cfa8-5758-b32f-ed9093a37d21_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 50033,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BU67HNA/698729674/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e5b1ecb7-cfa8-5758-b32f-ed9093a37d21/e5b1ecb7-cfa8-5758-b32f-ed9093a37d21_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 92085,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BU67HNA/698729695/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e5b1ecb7-cfa8-5758-b32f-ed9093a37d21/e5b1ecb7-cfa8-5758-b32f-ed9093a37d21_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 65225,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BU67HNA/698729718/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e5b1ecb7-cfa8-5758-b32f-ed9093a37d21/e5b1ecb7-cfa8-5758-b32f-ed9093a37d21_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 82988,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BU67HNA/698729735/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e5b1ecb7-cfa8-5758-b32f-ed9093a37d21/e5b1ecb7-cfa8-5758-b32f-ed9093a37d21_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 72822,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BU67HNA/698729755/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-01-01',
'seller_name': None,
'title': 'VAUXHALL ZAFIRA TOURER 2.0 CDTI 170 ELITE MPV',
'transmission': 'manual',
'trim': 'CDTI 170 ELITE',
'vin': 'W0VPE9E77J1070557',
'year': 2017}
2026-03-28 14:06:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BU67%2520HNA%27 HTTP/1.1" 200 None
2026-03-28 14:06:11 [bca.uk] INFO: Saving data for BU67%20HNA: {'created_time': 1774706771.903767, 'last_price_update_time': 1774706771.903779, 'auction_closing_time': 1774778400.0}
2026-03-28 14:06:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='BU67%2520HNA') HTTP/1.1" 204 0
2026-03-28 14:06:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 64e95b6e-a78f-537e-8c08-58f1a7f0a9cb with identifier: LD57%20FXL
2026-03-28 14:06:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 64e95b6e-a78f-537e-8c08-58f1a7f0a9cb with identifier: LD57%20FXL
2026-03-28 14:06:12 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 64e95b6e-a78f-537e-8c08-58f1a7f0a9cb with identifier: LD57%20FXL to the API
2026-03-28 14:06:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:06:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:06:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LD57FXL/698933964/600>
{'auction_title': '',
'c_o_2_emission_value': 165,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_64e95b6e-a78f-537e-8c08-58f1a7f0a9cb/64e95b6e-a78f-537e-8c08-58f1a7f0a9cb_expert_report_file_77fc66f9-d63e-4972-8cf9-03fe5dabcbc8.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=LD57%20FXL-GB',
'category': 'Car',
'color': 'silver',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.4L',
'expiration_date': '2026-03-31T10:00:00Z',
'fuel_type': 'Petrol',
'id': '64e95b6e-a78f-537e-8c08-58f1a7f0a9cb',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'LD57 FXL',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=LD57%20FXL&vehicleType=*',
'listing': 'auction',
'location': 'Paddock Wood',
'make': 'VOLKSWAGEN',
'model': 'POLO',
'odometer': 106214,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 11,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_64e95b6e-a78f-537e-8c08-58f1a7f0a9cb/64e95b6e-a78f-537e-8c08-58f1a7f0a9cb_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 49836,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LD57FXL/698933900/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_64e95b6e-a78f-537e-8c08-58f1a7f0a9cb/64e95b6e-a78f-537e-8c08-58f1a7f0a9cb_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 48371,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LD57FXL/698933908/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_64e95b6e-a78f-537e-8c08-58f1a7f0a9cb/64e95b6e-a78f-537e-8c08-58f1a7f0a9cb_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 47487,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LD57FXL/698933925/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_64e95b6e-a78f-537e-8c08-58f1a7f0a9cb/64e95b6e-a78f-537e-8c08-58f1a7f0a9cb_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 45128,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LD57FXL/698933934/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_64e95b6e-a78f-537e-8c08-58f1a7f0a9cb/64e95b6e-a78f-537e-8c08-58f1a7f0a9cb_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 46718,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LD57FXL/698933945/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_64e95b6e-a78f-537e-8c08-58f1a7f0a9cb/64e95b6e-a78f-537e-8c08-58f1a7f0a9cb_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 45576,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LD57FXL/698933964/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_64e95b6e-a78f-537e-8c08-58f1a7f0a9cb/64e95b6e-a78f-537e-8c08-58f1a7f0a9cb_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 92071,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LD57FXL/698934001/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_64e95b6e-a78f-537e-8c08-58f1a7f0a9cb/64e95b6e-a78f-537e-8c08-58f1a7f0a9cb_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 71481,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LD57FXL/698934025/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_64e95b6e-a78f-537e-8c08-58f1a7f0a9cb/64e95b6e-a78f-537e-8c08-58f1a7f0a9cb_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 76224,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LD57FXL/698934051/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_64e95b6e-a78f-537e-8c08-58f1a7f0a9cb/64e95b6e-a78f-537e-8c08-58f1a7f0a9cb_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 69367,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LD57FXL/698934069/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2007-01-01',
'seller_name': None,
'title': 'VOLKSWAGEN POLO 1.4 S 80 Hatchback',
'transmission': 'automatic',
'trim': 'S 80',
'vin': 'WVWZZZ9NZ8Y048181',
'year': 2007}
2026-03-28 14:06:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LD57%2520FXL%27 HTTP/1.1" 200 None
2026-03-28 14:06:12 [bca.uk] INFO: Saving data for LD57%20FXL: {'created_time': 1774706772.393383, 'last_price_update_time': 1774706772.393398, 'auction_closing_time': 1774951200.0}
2026-03-28 14:06:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='LD57%2520FXL') HTTP/1.1" 204 0
2026-03-28 14:06:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HY60RUC/698682174/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/HY60RUC/42809800?sv=2020-08-04&st=2026-03-28T14%3A05%3A57Z&se=2026-03-28T14%3A30%3A57Z&sr=b&sp=r&sig=H4xVPX%2BQkg%2Fn%2BFlYv77ijhVV1CRf9V8vR2rcopF3JXw%3D)
2026-03-28 14:06:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LM05FYZ/698910339/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LM05FYZ/42809535?sv=2020-08-04&st=2026-03-28T14%3A06%3A02Z&se=2026-03-28T14%3A31%3A02Z&sr=b&sp=r&sig=0XLGDeD93HjjiKgV4xBnfu5dFMIwsNV4XYOCMU8Ir%2BU%3D)
2026-03-28 14:06:12 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LM05FYZ/698910487/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698910487>
2026-03-28 14:06:12 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LM05FYZ/698910324/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698910324>
2026-03-28 14:06:12 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HY60RUC/698682092/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698682092>
2026-03-28 14:06:12 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LM05FYZ/698910462/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698910462>
2026-03-28 14:06:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:06:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2d96cd90>
2026-03-28 14:06:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:06:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:06:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:06:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c8897eb2-3293-514c-86a5-f8c7210c23b1/c8897eb2-3293-514c-86a5-f8c7210c23b1_image_4.jpg HTTP/1.1" 201 0
2026-03-28 14:06:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FHY60RUC%252F698682065%252F600') HTTP/1.1" 204 0
2026-03-28 14:06:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HY60RUC/698682065/600 saved to cache
2026-03-28 14:06:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item c8897eb2-3293-514c-86a5-f8c7210c23b1
2026-03-28 14:06:12 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:06:12 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:06:12 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:06:12 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:06:12 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:06:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:06:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2dcd7a90>
2026-03-28 14:06:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:06:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:06:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:06:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1da598bb-916d-5198-a760-5aef625fcf96/1da598bb-916d-5198-a760-5aef625fcf96_image_7.jpg HTTP/1.1" 201 0
2026-03-28 14:06:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FEN10PWV%252F698682099%252F600') HTTP/1.1" 204 0
2026-03-28 14:06:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EN10PWV/698682099/600 saved to cache
2026-03-28 14:06:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 1da598bb-916d-5198-a760-5aef625fcf96
2026-03-28 14:06:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:06:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2d69f410>
2026-03-28 14:06:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:06:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:06:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:06:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c8897eb2-3293-514c-86a5-f8c7210c23b1/c8897eb2-3293-514c-86a5-f8c7210c23b1_image_3.jpg HTTP/1.1" 201 0
2026-03-28 14:06:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FHY60RUC%252F698682050%252F600') HTTP/1.1" 204 0
2026-03-28 14:06:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HY60RUC/698682050/600 saved to cache
2026-03-28 14:06:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item c8897eb2-3293-514c-86a5-f8c7210c23b1
2026-03-28 14:06:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HY60RUC/698682116/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/HY60RUC/42809800?sv=2020-08-04&st=2026-03-28T14%3A05%3A57Z&se=2026-03-28T14%3A30%3A57Z&sr=b&sp=r&sig=H4xVPX%2BQkg%2Fn%2BFlYv77ijhVV1CRf9V8vR2rcopF3JXw%3D)
2026-03-28 14:06:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HY60RUC/698682143/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/HY60RUC/42809800?sv=2020-08-04&st=2026-03-28T14%3A05%3A57Z&se=2026-03-28T14%3A30%3A57Z&sr=b&sp=r&sig=H4xVPX%2BQkg%2Fn%2BFlYv77ijhVV1CRf9V8vR2rcopF3JXw%3D)
2026-03-28 14:06:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LM05FYZ/698910381/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LM05FYZ/42809535?sv=2020-08-04&st=2026-03-28T14%3A06%3A02Z&se=2026-03-28T14%3A31%3A02Z&sr=b&sp=r&sig=0XLGDeD93HjjiKgV4xBnfu5dFMIwsNV4XYOCMU8Ir%2BU%3D)
2026-03-28 14:06:12 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:06:12 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:06:12 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:06:12 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:06:12 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:06:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:06:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2dcd6cd0>
2026-03-28 14:06:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:06:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:06:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:06:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c8897eb2-3293-514c-86a5-f8c7210c23b1/c8897eb2-3293-514c-86a5-f8c7210c23b1_image_8.jpg HTTP/1.1" 201 0
2026-03-28 14:06:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FHY60RUC%252F698682174%252F600') HTTP/1.1" 204 0
2026-03-28 14:06:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HY60RUC/698682174/600 saved to cache
2026-03-28 14:06:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item c8897eb2-3293-514c-86a5-f8c7210c23b1
2026-03-28 14:06:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:06:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c9dec50>
2026-03-28 14:06:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:06:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:06:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:06:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cd20e351-5a2e-5326-baf7-36f908a1b729/cd20e351-5a2e-5326-baf7-36f908a1b729_image_3.jpg HTTP/1.1" 201 0
2026-03-28 14:06:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLM05FYZ%252F698910339%252F600') HTTP/1.1" 204 0
2026-03-28 14:06:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LM05FYZ/698910339/600 saved to cache
2026-03-28 14:06:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item cd20e351-5a2e-5326-baf7-36f908a1b729
2026-03-28 14:06:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LM05FYZ/698910360/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LM05FYZ/42809535?sv=2020-08-04&st=2026-03-28T14%3A06%3A02Z&se=2026-03-28T14%3A31%3A02Z&sr=b&sp=r&sig=0XLGDeD93HjjiKgV4xBnfu5dFMIwsNV4XYOCMU8Ir%2BU%3D)
2026-03-28 14:06:12 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EN10PWV/698682127/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698682127>
2026-03-28 14:06:12 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LM05FYZ/698910306/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698910306>
2026-03-28 14:06:12 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LM05FYZ/698910521/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698910521>
2026-03-28 14:06:12 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EN10PWV/698682159/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698682159>
2026-03-28 14:06:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LM05FYZ/698910429/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LM05FYZ/42809535?sv=2020-08-04&st=2026-03-28T14%3A06%3A02Z&se=2026-03-28T14%3A31%3A02Z&sr=b&sp=r&sig=0XLGDeD93HjjiKgV4xBnfu5dFMIwsNV4XYOCMU8Ir%2BU%3D)
2026-03-28 14:06:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HY60RUC/698682194/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/HY60RUC/42809800?sv=2020-08-04&st=2026-03-28T14%3A05%3A57Z&se=2026-03-28T14%3A30%3A57Z&sr=b&sp=r&sig=H4xVPX%2BQkg%2Fn%2BFlYv77ijhVV1CRf9V8vR2rcopF3JXw%3D)
2026-03-28 14:06:12 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:06:12 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:06:12 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:06:12 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:06:12 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:06:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:06:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c9b7510>
2026-03-28 14:06:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:06:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:06:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:06:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c8897eb2-3293-514c-86a5-f8c7210c23b1/c8897eb2-3293-514c-86a5-f8c7210c23b1_image_6.jpg HTTP/1.1" 201 0
2026-03-28 14:06:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FHY60RUC%252F698682116%252F600') HTTP/1.1" 204 0
2026-03-28 14:06:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HY60RUC/698682116/600 saved to cache
2026-03-28 14:06:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item c8897eb2-3293-514c-86a5-f8c7210c23b1
2026-03-28 14:06:12 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:06:12 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:06:12 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:06:12 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:06:12 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:06:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:06:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2ca60f90>
2026-03-28 14:06:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:06:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:06:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:06:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c8897eb2-3293-514c-86a5-f8c7210c23b1/c8897eb2-3293-514c-86a5-f8c7210c23b1_image_7.jpg HTTP/1.1" 201 0
2026-03-28 14:06:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FHY60RUC%252F698682143%252F600') HTTP/1.1" 204 0
2026-03-28 14:06:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HY60RUC/698682143/600 saved to cache
2026-03-28 14:06:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item c8897eb2-3293-514c-86a5-f8c7210c23b1
2026-03-28 14:06:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:06:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c855a90>
2026-03-28 14:06:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:06:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:06:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:06:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cd20e351-5a2e-5326-baf7-36f908a1b729/cd20e351-5a2e-5326-baf7-36f908a1b729_image_5.jpg HTTP/1.1" 201 0
2026-03-28 14:06:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLM05FYZ%252F698910381%252F600') HTTP/1.1" 204 0
2026-03-28 14:06:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LM05FYZ/698910381/600 saved to cache
2026-03-28 14:06:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item cd20e351-5a2e-5326-baf7-36f908a1b729
2026-03-28 14:06:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LM05FYZ/698910324/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LM05FYZ/42809535?sv=2020-08-04&st=2026-03-28T14%3A06%3A02Z&se=2026-03-28T14%3A31%3A02Z&sr=b&sp=r&sig=0XLGDeD93HjjiKgV4xBnfu5dFMIwsNV4XYOCMU8Ir%2BU%3D)
2026-03-28 14:06:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HY60RUC/698682092/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/HY60RUC/42809800?sv=2020-08-04&st=2026-03-28T14%3A05%3A57Z&se=2026-03-28T14%3A30%3A57Z&sr=b&sp=r&sig=H4xVPX%2BQkg%2Fn%2BFlYv77ijhVV1CRf9V8vR2rcopF3JXw%3D)
2026-03-28 14:06:12 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HY60RUC/698682033/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698682033>
2026-03-28 14:06:12 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EN10PWV/698682064/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698682064>
2026-03-28 14:06:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LM05FYZ/698910462/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LM05FYZ/42809535?sv=2020-08-04&st=2026-03-28T14%3A06%3A02Z&se=2026-03-28T14%3A31%3A02Z&sr=b&sp=r&sig=0XLGDeD93HjjiKgV4xBnfu5dFMIwsNV4XYOCMU8Ir%2BU%3D)
2026-03-28 14:06:12 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BT66DFX/698129701/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698129701>
2026-03-28 14:06:12 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LM05FYZ/698910291/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=LM05FYZ-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-28 14:06:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LM05FYZ/698910487/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LM05FYZ/42809535?sv=2020-08-04&st=2026-03-28T14%3A06%3A02Z&se=2026-03-28T14%3A31%3A02Z&sr=b&sp=r&sig=0XLGDeD93HjjiKgV4xBnfu5dFMIwsNV4XYOCMU8Ir%2BU%3D)
2026-03-28 14:06:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:06:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2d63d390>
2026-03-28 14:06:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:06:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:06:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:06:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cd20e351-5a2e-5326-baf7-36f908a1b729/cd20e351-5a2e-5326-baf7-36f908a1b729_image_4.jpg HTTP/1.1" 201 0
2026-03-28 14:06:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLM05FYZ%252F698910360%252F600') HTTP/1.1" 204 0
2026-03-28 14:06:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LM05FYZ/698910360/600 saved to cache
2026-03-28 14:06:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item cd20e351-5a2e-5326-baf7-36f908a1b729
2026-03-28 14:06:12 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:06:12 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:06:12 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:06:12 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:06:12 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:06:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:06:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c8b9690>
2026-03-28 14:06:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:06:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:06:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:06:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cd20e351-5a2e-5326-baf7-36f908a1b729/cd20e351-5a2e-5326-baf7-36f908a1b729_image_6.jpg HTTP/1.1" 201 0
2026-03-28 14:06:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLM05FYZ%252F698910429%252F600') HTTP/1.1" 204 0
2026-03-28 14:06:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LM05FYZ/698910429/600 saved to cache
2026-03-28 14:06:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item cd20e351-5a2e-5326-baf7-36f908a1b729
2026-03-28 14:06:12 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:06:12 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:06:12 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:06:12 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:06:12 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:06:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:06:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2dbfc750>
2026-03-28 14:06:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:06:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:06:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:06:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c8897eb2-3293-514c-86a5-f8c7210c23b1/c8897eb2-3293-514c-86a5-f8c7210c23b1_image_9.jpg HTTP/1.1" 201 0
2026-03-28 14:06:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FHY60RUC%252F698682194%252F600') HTTP/1.1" 204 0
2026-03-28 14:06:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HY60RUC/698682194/600 saved to cache
2026-03-28 14:06:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item c8897eb2-3293-514c-86a5-f8c7210c23b1
2026-03-28 14:06:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LM05FYZ/698910306/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LM05FYZ/42809535?sv=2020-08-04&st=2026-03-28T14%3A06%3A02Z&se=2026-03-28T14%3A31%3A02Z&sr=b&sp=r&sig=0XLGDeD93HjjiKgV4xBnfu5dFMIwsNV4XYOCMU8Ir%2BU%3D)
2026-03-28 14:06:12 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YD64WJN/697180820/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=697180820>
2026-03-28 14:06:12 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NK64UTR/698814148/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698814148>
2026-03-28 14:06:12 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AK67LWT/698947171/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698947171>
2026-03-28 14:06:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EN10PWV/698682159/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/EN10PWV/42809685?sv=2020-08-04&st=2026-03-28T14%3A05%3A53Z&se=2026-03-28T14%3A30%3A53Z&sr=b&sp=r&sig=0bUhTFZOWsPha81YwFXHCk91lxzBfSWRH%2BlFeQKDFV0%3D)
2026-03-28 14:06:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EN10PWV/698682127/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/EN10PWV/42809685?sv=2020-08-04&st=2026-03-28T14%3A05%3A53Z&se=2026-03-28T14%3A30%3A53Z&sr=b&sp=r&sig=0bUhTFZOWsPha81YwFXHCk91lxzBfSWRH%2BlFeQKDFV0%3D)
2026-03-28 14:06:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LM05FYZ/698910521/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LM05FYZ/42809535?sv=2020-08-04&st=2026-03-28T14%3A06%3A02Z&se=2026-03-28T14%3A31%3A02Z&sr=b&sp=r&sig=0XLGDeD93HjjiKgV4xBnfu5dFMIwsNV4XYOCMU8Ir%2BU%3D)
2026-03-28 14:06:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:06:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c7987d0>
2026-03-28 14:06:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:06:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:06:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:06:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cd20e351-5a2e-5326-baf7-36f908a1b729/cd20e351-5a2e-5326-baf7-36f908a1b729_image_2.jpg HTTP/1.1" 201 0
2026-03-28 14:06:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLM05FYZ%252F698910324%252F600') HTTP/1.1" 204 0
2026-03-28 14:06:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LM05FYZ/698910324/600 saved to cache
2026-03-28 14:06:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item cd20e351-5a2e-5326-baf7-36f908a1b729
2026-03-28 14:06:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:06:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c16d950>
2026-03-28 14:06:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:06:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:06:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:06:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c8897eb2-3293-514c-86a5-f8c7210c23b1/c8897eb2-3293-514c-86a5-f8c7210c23b1_image_5.jpg HTTP/1.1" 201 0
2026-03-28 14:06:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FHY60RUC%252F698682092%252F600') HTTP/1.1" 204 0
2026-03-28 14:06:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HY60RUC/698682092/600 saved to cache
2026-03-28 14:06:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item c8897eb2-3293-514c-86a5-f8c7210c23b1
2026-03-28 14:06:12 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:06:12 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:06:12 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:06:12 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:06:12 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:06:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:06:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c59a350>
2026-03-28 14:06:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:06:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:06:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:06:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cd20e351-5a2e-5326-baf7-36f908a1b729/cd20e351-5a2e-5326-baf7-36f908a1b729_image_7.jpg HTTP/1.1" 201 0
2026-03-28 14:06:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLM05FYZ%252F698910462%252F600') HTTP/1.1" 204 0
2026-03-28 14:06:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LM05FYZ/698910462/600 saved to cache
2026-03-28 14:06:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item cd20e351-5a2e-5326-baf7-36f908a1b729
2026-03-28 14:06:13 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:06:13 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:06:13 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:06:13 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:06:13 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:06:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:06:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2d63da10>
2026-03-28 14:06:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:06:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:06:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:06:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cd20e351-5a2e-5326-baf7-36f908a1b729/cd20e351-5a2e-5326-baf7-36f908a1b729_image_8.jpg HTTP/1.1" 201 0
2026-03-28 14:06:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLM05FYZ%252F698910487%252F600') HTTP/1.1" 204 0
2026-03-28 14:06:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LM05FYZ/698910487/600 saved to cache
2026-03-28 14:06:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item cd20e351-5a2e-5326-baf7-36f908a1b729
2026-03-28 14:06:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LM05FYZ/698910291/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LM05FYZ/42809535?sv=2020-08-04&st=2026-03-28T14%3A06%3A02Z&se=2026-03-28T14%3A31%3A02Z&sr=b&sp=r&sig=0XLGDeD93HjjiKgV4xBnfu5dFMIwsNV4XYOCMU8Ir%2BU%3D)
2026-03-28 14:06:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HY60RUC/698682033/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/HY60RUC/42809800?sv=2020-08-04&st=2026-03-28T14%3A05%3A57Z&se=2026-03-28T14%3A30%3A57Z&sr=b&sp=r&sig=H4xVPX%2BQkg%2Fn%2BFlYv77ijhVV1CRf9V8vR2rcopF3JXw%3D)
2026-03-28 14:06:13 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YB63ZKP/698284367/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698284367>
2026-03-28 14:06:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BT66DFX/698129701/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/BT66DFX/42810013?sv=2020-08-04&st=2026-03-28T14%3A04%3A00Z&se=2026-03-28T14%3A29%3A00Z&sr=b&sp=r&sig=Yx0iLoKJXBk4DPNXOVJLOrRp66ZUz648vIo6BTtbrJ0%3D)
2026-03-28 14:06:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EN10PWV/698682064/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/EN10PWV/42809685?sv=2020-08-04&st=2026-03-28T14%3A05%3A53Z&se=2026-03-28T14%3A30%3A53Z&sr=b&sp=r&sig=0bUhTFZOWsPha81YwFXHCk91lxzBfSWRH%2BlFeQKDFV0%3D)
2026-03-28 14:06:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:06:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a1fe34050>
2026-03-28 14:06:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:06:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:06:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:06:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cd20e351-5a2e-5326-baf7-36f908a1b729/cd20e351-5a2e-5326-baf7-36f908a1b729_image_1.jpg HTTP/1.1" 201 0
2026-03-28 14:06:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLM05FYZ%252F698910306%252F600') HTTP/1.1" 204 0
2026-03-28 14:06:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LM05FYZ/698910306/600 saved to cache
2026-03-28 14:06:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item cd20e351-5a2e-5326-baf7-36f908a1b729
2026-03-28 14:06:13 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:06:13 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:06:13 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:06:13 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:06:13 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:06:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:06:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2d892f90>
2026-03-28 14:06:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:06:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:06:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:06:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1da598bb-916d-5198-a760-5aef625fcf96/1da598bb-916d-5198-a760-5aef625fcf96_image_9.jpg HTTP/1.1" 201 0
2026-03-28 14:06:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FEN10PWV%252F698682159%252F600') HTTP/1.1" 204 0
2026-03-28 14:06:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EN10PWV/698682159/600 saved to cache
2026-03-28 14:06:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 1da598bb-916d-5198-a760-5aef625fcf96
2026-03-28 14:06:13 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:06:13 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:06:13 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:06:13 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:06:13 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:06:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:06:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c705c50>
2026-03-28 14:06:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:06:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:06:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:06:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1da598bb-916d-5198-a760-5aef625fcf96/1da598bb-916d-5198-a760-5aef625fcf96_image_8.jpg HTTP/1.1" 201 0
2026-03-28 14:06:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FEN10PWV%252F698682127%252F600') HTTP/1.1" 204 0
2026-03-28 14:06:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EN10PWV/698682127/600 saved to cache
2026-03-28 14:06:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 1da598bb-916d-5198-a760-5aef625fcf96
2026-03-28 14:06:13 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:06:13 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:06:13 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:06:13 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:06:13 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:06:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:06:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2dd87fd0>
2026-03-28 14:06:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:06:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:06:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:06:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cd20e351-5a2e-5326-baf7-36f908a1b729/cd20e351-5a2e-5326-baf7-36f908a1b729_image_9.jpg HTTP/1.1" 201 0
2026-03-28 14:06:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLM05FYZ%252F698910521%252F600') HTTP/1.1" 204 0
2026-03-28 14:06:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LM05FYZ/698910521/600 saved to cache
2026-03-28 14:06:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item cd20e351-5a2e-5326-baf7-36f908a1b729
2026-03-28 14:06:13 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HY65KRJ/698920383/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698920383>
2026-03-28 14:06:13 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YD64WJN/697180810/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=697180810>
2026-03-28 14:06:13 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/KY19BNC/42810053?sv=2020-08-04&st=2026-03-28T14%3A06%3A13Z&se=2026-03-28T14%3A31%3A13Z&sr=b&sp=r&sig=ETO0Mg2EeTSEbHBNVPQlrZ1HqsmXyfC8ciLzqOu06H4%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=KY19%20BNC-GB>
2026-03-28 14:06:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NK64UTR/698814148/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/NK64UTR/42807827?sv=2020-08-04&st=2026-03-28T14%3A04%3A00Z&se=2026-03-28T14%3A29%3A00Z&sr=b&sp=r&sig=B2djBTwUnOYzqxtI8e7WJD2j2cACy9SjmoGLE3oN2SE%3D)
2026-03-28 14:06:13 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LD11FZB/698929281/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698929281>
2026-03-28 14:06:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YD64WJN/697180820/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YD64WJN/42809986?sv=2020-08-04&st=2026-03-28T14%3A03%3A59Z&se=2026-03-28T14%3A28%3A59Z&sr=b&sp=r&sig=5rsKGf%2F78vqwWJXVPXpM1R60yxRlhwBt0pb8A02KPMk%3D)
2026-03-28 14:06:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AK67LWT/698947171/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/AK67LWT/42810366?sv=2020-08-04&st=2026-03-28T14%3A04%3A00Z&se=2026-03-28T14%3A29%3A00Z&sr=b&sp=r&sig=dnN3%2FeKHnzQfSMnyGaraMReo6SkHH2Dy4nbY3zUESfI%3D)
2026-03-28 14:06:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:06:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c704290>
2026-03-28 14:06:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:06:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:06:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:06:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cd20e351-5a2e-5326-baf7-36f908a1b729/cd20e351-5a2e-5326-baf7-36f908a1b729_image_0.jpg HTTP/1.1" 201 0
2026-03-28 14:06:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLM05FYZ%252F698910291%252F600') HTTP/1.1" 204 0
2026-03-28 14:06:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LM05FYZ/698910291/600 saved to cache
2026-03-28 14:06:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item cd20e351-5a2e-5326-baf7-36f908a1b729
2026-03-28 14:06:13 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: cd20e351-5a2e-5326-baf7-36f908a1b729, skipping ID generation
2026-03-28 14:06:13 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item cd20e351-5a2e-5326-baf7-36f908a1b729 sending to next pipeline
2026-03-28 14:06:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: cd20e351-5a2e-5326-baf7-36f908a1b729, identifier: LM05%20FYZ
2026-03-28 14:06:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:06:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2d96fc10>
2026-03-28 14:06:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:06:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:06:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:06:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c8897eb2-3293-514c-86a5-f8c7210c23b1/c8897eb2-3293-514c-86a5-f8c7210c23b1_image_2.jpg HTTP/1.1" 201 0
2026-03-28 14:06:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FHY60RUC%252F698682033%252F600') HTTP/1.1" 204 0
2026-03-28 14:06:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HY60RUC/698682033/600 saved to cache
2026-03-28 14:06:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item c8897eb2-3293-514c-86a5-f8c7210c23b1
2026-03-28 14:06:13 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: c8897eb2-3293-514c-86a5-f8c7210c23b1, skipping ID generation
2026-03-28 14:06:13 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item c8897eb2-3293-514c-86a5-f8c7210c23b1 sending to next pipeline
2026-03-28 14:06:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: c8897eb2-3293-514c-86a5-f8c7210c23b1, identifier: HY60%20RUC
2026-03-28 14:06:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:06:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c3b0550>
2026-03-28 14:06:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:06:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:06:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:06:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ca2c3006-0503-55ad-a26d-88f328a541b5/ca2c3006-0503-55ad-a26d-88f328a541b5_image_2.jpg HTTP/1.1" 201 0
2026-03-28 14:06:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FBT66DFX%252F698129701%252F600') HTTP/1.1" 204 0
2026-03-28 14:06:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BT66DFX/698129701/600 saved to cache
2026-03-28 14:06:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item ca2c3006-0503-55ad-a26d-88f328a541b5
2026-03-28 14:06:13 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:06:13 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:06:13 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:06:13 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:06:13 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:06:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:06:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2d63d010>
2026-03-28 14:06:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:06:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:06:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:06:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1da598bb-916d-5198-a760-5aef625fcf96/1da598bb-916d-5198-a760-5aef625fcf96_image_6.jpg HTTP/1.1" 201 0
2026-03-28 14:06:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FEN10PWV%252F698682064%252F600') HTTP/1.1" 204 0
2026-03-28 14:06:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EN10PWV/698682064/600 saved to cache
2026-03-28 14:06:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 1da598bb-916d-5198-a760-5aef625fcf96
2026-03-28 14:06:13 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 1da598bb-916d-5198-a760-5aef625fcf96, skipping ID generation
2026-03-28 14:06:13 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 1da598bb-916d-5198-a760-5aef625fcf96 sending to next pipeline
2026-03-28 14:06:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 1da598bb-916d-5198-a760-5aef625fcf96, identifier: EN10%20PWV
2026-03-28 14:06:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: cd20e351-5a2e-5326-baf7-36f908a1b729 with identifier: LM05%20FYZ
2026-03-28 14:06:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: cd20e351-5a2e-5326-baf7-36f908a1b729 with identifier: LM05%20FYZ
2026-03-28 14:06:13 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: cd20e351-5a2e-5326-baf7-36f908a1b729 with identifier: LM05%20FYZ to the API
2026-03-28 14:06:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:06:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:06:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LM05FYZ/698910291/600>
{'auction_title': '',
'c_o_2_emission_value': 161,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cd20e351-5a2e-5326-baf7-36f908a1b729/cd20e351-5a2e-5326-baf7-36f908a1b729_expert_report_file_efefb426-c6dc-41a6-9172-926ba67d0941.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=LM05%20FYZ-GB',
'category': 'Car',
'color': 'black',
'currency': 'GBP',
'doors_number': 3,
'engine': '1.2L',
'expiration_date': '2026-03-29T10:00:00Z',
'fuel_type': 'Petrol',
'id': 'cd20e351-5a2e-5326-baf7-36f908a1b729',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'LM05 FYZ',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=LM05%20FYZ&vehicleType=*',
'listing': 'auction',
'location': 'Birmingham - Perry Barr',
'make': 'NISSAN',
'model': 'MICRA',
'odometer': 63136,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 11,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cd20e351-5a2e-5326-baf7-36f908a1b729/cd20e351-5a2e-5326-baf7-36f908a1b729_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 45949,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LM05FYZ/698910291/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cd20e351-5a2e-5326-baf7-36f908a1b729/cd20e351-5a2e-5326-baf7-36f908a1b729_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 45438,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LM05FYZ/698910306/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cd20e351-5a2e-5326-baf7-36f908a1b729/cd20e351-5a2e-5326-baf7-36f908a1b729_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 44536,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LM05FYZ/698910324/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cd20e351-5a2e-5326-baf7-36f908a1b729/cd20e351-5a2e-5326-baf7-36f908a1b729_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 44466,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LM05FYZ/698910339/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cd20e351-5a2e-5326-baf7-36f908a1b729/cd20e351-5a2e-5326-baf7-36f908a1b729_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 40473,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LM05FYZ/698910360/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cd20e351-5a2e-5326-baf7-36f908a1b729/cd20e351-5a2e-5326-baf7-36f908a1b729_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 39378,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LM05FYZ/698910381/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cd20e351-5a2e-5326-baf7-36f908a1b729/cd20e351-5a2e-5326-baf7-36f908a1b729_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 82957,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LM05FYZ/698910429/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cd20e351-5a2e-5326-baf7-36f908a1b729/cd20e351-5a2e-5326-baf7-36f908a1b729_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 57671,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LM05FYZ/698910462/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cd20e351-5a2e-5326-baf7-36f908a1b729/cd20e351-5a2e-5326-baf7-36f908a1b729_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 83763,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LM05FYZ/698910487/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cd20e351-5a2e-5326-baf7-36f908a1b729/cd20e351-5a2e-5326-baf7-36f908a1b729_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 77434,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LM05FYZ/698910521/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2005-01-01',
'seller_name': None,
'title': 'NISSAN MICRA 1.2 S Hatchback',
'transmission': 'automatic',
'trim': 'S',
'vin': 'SJNEBAK12U1443438',
'year': 2005}
2026-03-28 14:06:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LM05%2520FYZ%27 HTTP/1.1" 200 None
2026-03-28 14:06:14 [bca.uk] INFO: Saving data for LM05%20FYZ: {'created_time': 1774706774.244826, 'last_price_update_time': 1774706774.244839, 'auction_closing_time': 1774778400.0}
2026-03-28 14:06:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='LM05%2520FYZ') HTTP/1.1" 204 0
2026-03-28 14:06:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: c8897eb2-3293-514c-86a5-f8c7210c23b1 with identifier: HY60%20RUC
2026-03-28 14:06:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: c8897eb2-3293-514c-86a5-f8c7210c23b1 with identifier: HY60%20RUC
2026-03-28 14:06:14 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: c8897eb2-3293-514c-86a5-f8c7210c23b1 with identifier: HY60%20RUC to the API
2026-03-28 14:06:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:06:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:06:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HY60RUC/698682033/600>
{'auction_title': '',
'c_o_2_emission_value': 150,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c8897eb2-3293-514c-86a5-f8c7210c23b1/c8897eb2-3293-514c-86a5-f8c7210c23b1_expert_report_file_2c306f36-7094-42c8-86e1-428369178800.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=HY60%20RUC-GB',
'category': 'Car',
'color': 'red',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.6L',
'expiration_date': '2026-03-29T10:00:00Z',
'fuel_type': 'Diesel',
'id': 'c8897eb2-3293-514c-86a5-f8c7210c23b1',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'HY60 RUC',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=HY60%20RUC&vehicleType=*',
'listing': 'auction',
'location': 'Blackbushe',
'make': 'KIA',
'model': 'CEED',
'odometer': 53874,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 11,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c8897eb2-3293-514c-86a5-f8c7210c23b1/c8897eb2-3293-514c-86a5-f8c7210c23b1_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 56049,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HY60RUC/698681990/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c8897eb2-3293-514c-86a5-f8c7210c23b1/c8897eb2-3293-514c-86a5-f8c7210c23b1_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 52964,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HY60RUC/698682008/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c8897eb2-3293-514c-86a5-f8c7210c23b1/c8897eb2-3293-514c-86a5-f8c7210c23b1_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 52158,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HY60RUC/698682033/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c8897eb2-3293-514c-86a5-f8c7210c23b1/c8897eb2-3293-514c-86a5-f8c7210c23b1_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 54219,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HY60RUC/698682050/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c8897eb2-3293-514c-86a5-f8c7210c23b1/c8897eb2-3293-514c-86a5-f8c7210c23b1_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 54140,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HY60RUC/698682065/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c8897eb2-3293-514c-86a5-f8c7210c23b1/c8897eb2-3293-514c-86a5-f8c7210c23b1_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 50822,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HY60RUC/698682092/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c8897eb2-3293-514c-86a5-f8c7210c23b1/c8897eb2-3293-514c-86a5-f8c7210c23b1_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 75917,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HY60RUC/698682116/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c8897eb2-3293-514c-86a5-f8c7210c23b1/c8897eb2-3293-514c-86a5-f8c7210c23b1_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 72982,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HY60RUC/698682143/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c8897eb2-3293-514c-86a5-f8c7210c23b1/c8897eb2-3293-514c-86a5-f8c7210c23b1_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 93179,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HY60RUC/698682174/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c8897eb2-3293-514c-86a5-f8c7210c23b1/c8897eb2-3293-514c-86a5-f8c7210c23b1_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 85319,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HY60RUC/698682194/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2010-01-01',
'seller_name': None,
'title': 'KIA CEED 1.6 CRDI 115 3 Hatchback',
'transmission': 'automatic',
'trim': 'CRDI 115 3',
'vin': 'U5YHC516MAL235313',
'year': 2010}
2026-03-28 14:06:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27HY60%2520RUC%27 HTTP/1.1" 200 None
2026-03-28 14:06:14 [bca.uk] INFO: Saving data for HY60%20RUC: {'created_time': 1774706774.695474, 'last_price_update_time': 1774706774.695486, 'auction_closing_time': 1774778400.0}
2026-03-28 14:06:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='HY60%2520RUC') HTTP/1.1" 204 0
2026-03-28 14:06:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 1da598bb-916d-5198-a760-5aef625fcf96 with identifier: EN10%20PWV
2026-03-28 14:06:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 1da598bb-916d-5198-a760-5aef625fcf96 with identifier: EN10%20PWV
2026-03-28 14:06:14 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 1da598bb-916d-5198-a760-5aef625fcf96 with identifier: EN10%20PWV to the API
2026-03-28 14:06:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:06:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:06:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EN10PWV/698682064/600>
{'auction_title': '',
'c_o_2_emission_value': 115,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1da598bb-916d-5198-a760-5aef625fcf96/1da598bb-916d-5198-a760-5aef625fcf96_expert_report_file_14e907ac-1bf6-43e5-8eab-acfc6ae4aa3f.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=EN10%20PWV-GB',
'category': 'Car',
'color': 'black',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.6L',
'expiration_date': '2026-03-29T10:00:00Z',
'fuel_type': 'Diesel',
'id': '1da598bb-916d-5198-a760-5aef625fcf96',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'EN10 PWV',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=EN10%20PWV&vehicleType=*',
'listing': 'auction',
'location': 'Blackbushe',
'make': 'FORD',
'model': 'FOCUS',
'odometer': 122566,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 11,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1da598bb-916d-5198-a760-5aef625fcf96/1da598bb-916d-5198-a760-5aef625fcf96_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 55015,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EN10PWV/698681944/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1da598bb-916d-5198-a760-5aef625fcf96/1da598bb-916d-5198-a760-5aef625fcf96_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 53134,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EN10PWV/698681962/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1da598bb-916d-5198-a760-5aef625fcf96/1da598bb-916d-5198-a760-5aef625fcf96_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 52089,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EN10PWV/698681979/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1da598bb-916d-5198-a760-5aef625fcf96/1da598bb-916d-5198-a760-5aef625fcf96_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 53867,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EN10PWV/698682002/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1da598bb-916d-5198-a760-5aef625fcf96/1da598bb-916d-5198-a760-5aef625fcf96_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 51914,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EN10PWV/698682024/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1da598bb-916d-5198-a760-5aef625fcf96/1da598bb-916d-5198-a760-5aef625fcf96_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 50200,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EN10PWV/698682038/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1da598bb-916d-5198-a760-5aef625fcf96/1da598bb-916d-5198-a760-5aef625fcf96_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 80693,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EN10PWV/698682064/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1da598bb-916d-5198-a760-5aef625fcf96/1da598bb-916d-5198-a760-5aef625fcf96_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 64608,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EN10PWV/698682099/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1da598bb-916d-5198-a760-5aef625fcf96/1da598bb-916d-5198-a760-5aef625fcf96_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 94363,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EN10PWV/698682127/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1da598bb-916d-5198-a760-5aef625fcf96/1da598bb-916d-5198-a760-5aef625fcf96_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 73166,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EN10PWV/698682159/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2010-01-01',
'seller_name': None,
'title': 'FORD FOCUS 1.6 TDCI 110 TITANIUM Hatchback',
'transmission': 'manual',
'trim': 'TDCI 110 TITANIUM',
'vin': 'WF0PXXWPDPAM49967',
'year': 2010}
2026-03-28 14:06:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27EN10%2520PWV%27 HTTP/1.1" 200 None
2026-03-28 14:06:15 [bca.uk] INFO: Saving data for EN10%20PWV: {'created_time': 1774706775.069314, 'last_price_update_time': 1774706775.069328, 'auction_closing_time': 1774778400.0}
2026-03-28 14:06:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='EN10%2520PWV') HTTP/1.1" 204 0
2026-03-28 14:06:15 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AK67LWT/698947158/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698947158>
2026-03-28 14:06:15 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NK64UTR/698814113/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698814113>
2026-03-28 14:06:15 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HY65KRJ/698920380/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698920380>
2026-03-28 14:06:15 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PXZ1595/698814087/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=PXZ1595-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-28 14:06:15 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YD64WJN/697180798/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=697180798>
2026-03-28 14:06:15 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YB63ZKP/698284362/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698284362>
2026-03-28 14:06:15 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BT66DFX/698129695/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=BT66DFX-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-28 14:06:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YB63ZKP/698284367/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YB63ZKP/42797877?sv=2020-08-04&st=2026-03-28T14%3A04%3A00Z&se=2026-03-28T14%3A29%3A00Z&sr=b&sp=r&sig=86nclI4iCmgLh3evtZ%2BtpNUit8HkmrBcUBeJLBRYtzg%3D)
2026-03-28 14:06:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:06:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c9c8810>
2026-03-28 14:06:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:06:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:06:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:06:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1a399624-5154-54f6-ad94-51c45341542d/1a399624-5154-54f6-ad94-51c45341542d_image_5.jpg HTTP/1.1" 201 0
2026-03-28 14:06:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FNK64UTR%252F698814148%252F600') HTTP/1.1" 204 0
2026-03-28 14:06:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NK64UTR/698814148/600 saved to cache
2026-03-28 14:06:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 1a399624-5154-54f6-ad94-51c45341542d
2026-03-28 14:06:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:06:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a3008da10>
2026-03-28 14:06:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:06:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:06:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:06:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a6b7695a-3dc3-56dd-a07d-29432fe9fa43/a6b7695a-3dc3-56dd-a07d-29432fe9fa43_image_5.jpg HTTP/1.1" 201 0
2026-03-28 14:06:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FYD64WJN%252F697180820%252F600') HTTP/1.1" 204 0
2026-03-28 14:06:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YD64WJN/697180820/600 saved to cache
2026-03-28 14:06:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item a6b7695a-3dc3-56dd-a07d-29432fe9fa43
2026-03-28 14:06:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:06:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c8b9910>
2026-03-28 14:06:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:06:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:06:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:06:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_96df00f7-d862-5338-b935-5c42d63b82c0/96df00f7-d862-5338-b935-5c42d63b82c0_image_3.jpg HTTP/1.1" 201 0
2026-03-28 14:06:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FAK67LWT%252F698947171%252F600') HTTP/1.1" 204 0
2026-03-28 14:06:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AK67LWT/698947171/600 saved to cache
2026-03-28 14:06:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 96df00f7-d862-5338-b935-5c42d63b82c0
2026-03-28 14:06:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BT66DFX/698129695/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/BT66DFX/42810013?sv=2020-08-04&st=2026-03-28T14%3A04%3A00Z&se=2026-03-28T14%3A29%3A00Z&sr=b&sp=r&sig=Yx0iLoKJXBk4DPNXOVJLOrRp66ZUz648vIo6BTtbrJ0%3D)
2026-03-28 14:06:15 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HY65KRJ/698920375/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698920375>
2026-03-28 14:06:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HY65KRJ/698920383/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/HY65KRJ/42809575?sv=2020-08-04&st=2026-03-28T14%3A03%3A59Z&se=2026-03-28T14%3A28%3A59Z&sr=b&sp=r&sig=qQyrthkWradfVt2c0sIhPBRny5qzj5uOjQmOciVVoMo%3D)
2026-03-28 14:06:15 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LD11FZB/698929254/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698929254>
2026-03-28 14:06:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YD64WJN/697180810/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YD64WJN/42809986?sv=2020-08-04&st=2026-03-28T14%3A03%3A59Z&se=2026-03-28T14%3A28%3A59Z&sr=b&sp=r&sig=5rsKGf%2F78vqwWJXVPXpM1R60yxRlhwBt0pb8A02KPMk%3D)
2026-03-28 14:06:15 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YG70CMV/697550898/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=697550898>
2026-03-28 14:06:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LD11FZB/698929281/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LD11FZB/42809686?sv=2020-08-04&st=2026-03-28T14%3A03%3A58Z&se=2026-03-28T14%3A28%3A58Z&sr=b&sp=r&sig=%2FK4BAlVG%2BClj51VCbQA3WyKfnHgVC%2B3mVHIA2lg6Jqc%3D)
2026-03-28 14:06:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:06:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2eb1d050>
2026-03-28 14:06:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:06:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:06:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:06:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_243a05a7-7cda-5444-ab1c-5fdc014fa410/243a05a7-7cda-5444-ab1c-5fdc014fa410_image_3.jpg HTTP/1.1" 201 0
2026-03-28 14:06:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FYB63ZKP%252F698284367%252F600') HTTP/1.1" 204 0
2026-03-28 14:06:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YB63ZKP/698284367/600 saved to cache
2026-03-28 14:06:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 243a05a7-7cda-5444-ab1c-5fdc014fa410
2026-03-28 14:06:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/KY19BNC/42810053?sv=2020-08-04&st=2026-03-28T14%3A06%3A13Z&se=2026-03-28T14%3A31%3A13Z&sr=b&sp=r&sig=ETO0Mg2EeTSEbHBNVPQlrZ1HqsmXyfC8ciLzqOu06H4%3D> (referer: https://www.bca.co.uk/)
2026-03-28 14:06:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AK67LWT/698947158/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/AK67LWT/42810366?sv=2020-08-04&st=2026-03-28T14%3A04%3A00Z&se=2026-03-28T14%3A29%3A00Z&sr=b&sp=r&sig=dnN3%2FeKHnzQfSMnyGaraMReo6SkHH2Dy4nbY3zUESfI%3D)
2026-03-28 14:06:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NK64UTR/698814113/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/NK64UTR/42807827?sv=2020-08-04&st=2026-03-28T14%3A04%3A00Z&se=2026-03-28T14%3A29%3A00Z&sr=b&sp=r&sig=B2djBTwUnOYzqxtI8e7WJD2j2cACy9SjmoGLE3oN2SE%3D)
2026-03-28 14:06:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:06:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a1fe3eed0>
2026-03-28 14:06:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:06:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:06:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:06:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ca2c3006-0503-55ad-a26d-88f328a541b5/ca2c3006-0503-55ad-a26d-88f328a541b5_image_0.jpg HTTP/1.1" 201 0
2026-03-28 14:06:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FBT66DFX%252F698129695%252F600') HTTP/1.1" 204 0
2026-03-28 14:06:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BT66DFX/698129695/600 saved to cache
2026-03-28 14:06:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item ca2c3006-0503-55ad-a26d-88f328a541b5
2026-03-28 14:06:15 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: ca2c3006-0503-55ad-a26d-88f328a541b5, skipping ID generation
2026-03-28 14:06:15 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item ca2c3006-0503-55ad-a26d-88f328a541b5 sending to next pipeline
2026-03-28 14:06:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: ca2c3006-0503-55ad-a26d-88f328a541b5, identifier: BT66%20DFX
2026-03-28 14:06:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: ca2c3006-0503-55ad-a26d-88f328a541b5 with identifier: BT66%20DFX
2026-03-28 14:06:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: ca2c3006-0503-55ad-a26d-88f328a541b5 with identifier: BT66%20DFX
2026-03-28 14:06:15 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: ca2c3006-0503-55ad-a26d-88f328a541b5 with identifier: BT66%20DFX to the API
2026-03-28 14:06:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:06:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:06:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BT66DFX/698129695/600>
{'auction_title': '',
'c_o_2_emission_value': 99,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ca2c3006-0503-55ad-a26d-88f328a541b5/ca2c3006-0503-55ad-a26d-88f328a541b5_expert_report_file_ee7de95f-3019-4880-bf03-c0ec2e74c8b0.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=BT66%20DFX-GB',
'category': 'Car',
'color': 'grey',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.2L',
'expiration_date': '2026-03-29T10:00:00Z',
'fuel_type': 'Petrol',
'id': 'ca2c3006-0503-55ad-a26d-88f328a541b5',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'BT66 DFX',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=BT66%20DFX&vehicleType=*',
'listing': 'auction',
'location': 'Brighouse',
'make': 'CITROEN',
'model': 'C1',
'odometer': 87492,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 11,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ca2c3006-0503-55ad-a26d-88f328a541b5/ca2c3006-0503-55ad-a26d-88f328a541b5_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 48258,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BT66DFX/698129695/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ca2c3006-0503-55ad-a26d-88f328a541b5/ca2c3006-0503-55ad-a26d-88f328a541b5_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 46806,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BT66DFX/698129699/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ca2c3006-0503-55ad-a26d-88f328a541b5/ca2c3006-0503-55ad-a26d-88f328a541b5_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 42996,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BT66DFX/698129701/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ca2c3006-0503-55ad-a26d-88f328a541b5/ca2c3006-0503-55ad-a26d-88f328a541b5_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 44784,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BT66DFX/698129706/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ca2c3006-0503-55ad-a26d-88f328a541b5/ca2c3006-0503-55ad-a26d-88f328a541b5_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 41759,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BT66DFX/698129708/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ca2c3006-0503-55ad-a26d-88f328a541b5/ca2c3006-0503-55ad-a26d-88f328a541b5_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 44022,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BT66DFX/698129712/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ca2c3006-0503-55ad-a26d-88f328a541b5/ca2c3006-0503-55ad-a26d-88f328a541b5_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 79611,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BT66DFX/698129715/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ca2c3006-0503-55ad-a26d-88f328a541b5/ca2c3006-0503-55ad-a26d-88f328a541b5_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 75640,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BT66DFX/698129720/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ca2c3006-0503-55ad-a26d-88f328a541b5/ca2c3006-0503-55ad-a26d-88f328a541b5_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 87595,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BT66DFX/698129725/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ca2c3006-0503-55ad-a26d-88f328a541b5/ca2c3006-0503-55ad-a26d-88f328a541b5_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 77200,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BT66DFX/698129740/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-01-01',
'seller_name': None,
'title': 'CITROEN C1 1.2 P/T 82 FLAIR Hatchback',
'transmission': 'manual',
'trim': 'P/T 82 FLAIR',
'vin': 'VF7PAHMTCGR790590',
'year': 2016}
2026-03-28 14:06:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BT66%2520DFX%27 HTTP/1.1" 200 None
2026-03-28 14:06:15 [bca.uk] INFO: Saving data for BT66%20DFX: {'created_time': 1774706775.866105, 'last_price_update_time': 1774706775.866116, 'auction_closing_time': 1774778400.0}
2026-03-28 14:06:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='BT66%2520DFX') HTTP/1.1" 204 0
2026-03-28 14:06:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PXZ1595/698814087/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/PXZ1595/42808016?sv=2020-08-04&st=2026-03-28T14%3A04%3A01Z&se=2026-03-28T14%3A29%3A01Z&sr=b&sp=r&sig=xu3OmTnGiQ74jDpi5YWrXOjZvBn7hDxoXdoCW9aef04%3D)
2026-03-28 14:06:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HY65KRJ/698920380/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/HY65KRJ/42809575?sv=2020-08-04&st=2026-03-28T14%3A03%3A59Z&se=2026-03-28T14%3A28%3A59Z&sr=b&sp=r&sig=qQyrthkWradfVt2c0sIhPBRny5qzj5uOjQmOciVVoMo%3D)
2026-03-28 14:06:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YB63ZKP/698284362/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YB63ZKP/42797877?sv=2020-08-04&st=2026-03-28T14%3A04%3A00Z&se=2026-03-28T14%3A29%3A00Z&sr=b&sp=r&sig=86nclI4iCmgLh3evtZ%2BtpNUit8HkmrBcUBeJLBRYtzg%3D)
2026-03-28 14:06:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YD64WJN/697180798/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YD64WJN/42809986?sv=2020-08-04&st=2026-03-28T14%3A03%3A59Z&se=2026-03-28T14%3A28%3A59Z&sr=b&sp=r&sig=5rsKGf%2F78vqwWJXVPXpM1R60yxRlhwBt0pb8A02KPMk%3D)
2026-03-28 14:06:15 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LJ63JYB/42809852?sv=2020-08-04&st=2026-03-28T14%3A06%3A15Z&se=2026-03-28T14%3A31%3A15Z&sr=b&sp=r&sig=3IID5C6KndPfmS4BXAKyAnPFDRKPXiE3OW%2FP%2FAoIOHg%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=LJ63%20JYB-GB>
2026-03-28 14:06:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HY65KRJ/698920375/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/HY65KRJ/42809575?sv=2020-08-04&st=2026-03-28T14%3A03%3A59Z&se=2026-03-28T14%3A28%3A59Z&sr=b&sp=r&sig=qQyrthkWradfVt2c0sIhPBRny5qzj5uOjQmOciVVoMo%3D)
2026-03-28 14:06:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YG70CMV/697550898/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YG70CMV/42809751?sv=2020-08-04&st=2026-03-28T14%3A03%3A58Z&se=2026-03-28T14%3A28%3A58Z&sr=b&sp=r&sig=1ABLz0vVsC9yYBr%2F09SZY1lBMEdGcrDzJ1kVHXJEJlA%3D)
2026-03-28 14:06:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LD11FZB/698929254/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LD11FZB/42809686?sv=2020-08-04&st=2026-03-28T14%3A03%3A58Z&se=2026-03-28T14%3A28%3A58Z&sr=b&sp=r&sig=%2FK4BAlVG%2BClj51VCbQA3WyKfnHgVC%2B3mVHIA2lg6Jqc%3D)
2026-03-28 14:06:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:06:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c9d5b10>
2026-03-28 14:06:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:06:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:06:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:06:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fe123a59-25d0-509d-9046-e45117da9996/fe123a59-25d0-509d-9046-e45117da9996_image_3.jpg HTTP/1.1" 201 0
2026-03-28 14:06:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FHY65KRJ%252F698920383%252F600') HTTP/1.1" 204 0
2026-03-28 14:06:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HY65KRJ/698920383/600 saved to cache
2026-03-28 14:06:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item fe123a59-25d0-509d-9046-e45117da9996
2026-03-28 14:06:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:06:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c9e8b10>
2026-03-28 14:06:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:06:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:06:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:06:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a6b7695a-3dc3-56dd-a07d-29432fe9fa43/a6b7695a-3dc3-56dd-a07d-29432fe9fa43_image_4.jpg HTTP/1.1" 201 0
2026-03-28 14:06:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FYD64WJN%252F697180810%252F600') HTTP/1.1" 204 0
2026-03-28 14:06:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YD64WJN/697180810/600 saved to cache
2026-03-28 14:06:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item a6b7695a-3dc3-56dd-a07d-29432fe9fa43
2026-03-28 14:06:15 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:06:15 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:06:15 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:06:15 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:06:15 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:06:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:06:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2ddb3010>
2026-03-28 14:06:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:06:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:06:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:06:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fadd6eea-e2b0-5574-affe-cdf6b892b445/fadd6eea-e2b0-5574-affe-cdf6b892b445_image_9.jpg HTTP/1.1" 201 0
2026-03-28 14:06:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLD11FZB%252F698929281%252F600') HTTP/1.1" 204 0
2026-03-28 14:06:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LD11FZB/698929281/600 saved to cache
2026-03-28 14:06:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item fadd6eea-e2b0-5574-affe-cdf6b892b445
2026-03-28 14:06:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:06:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2dd81dd0>
2026-03-28 14:06:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:06:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:06:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:06:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e70be94c-e868-51f1-a147-7ef5a60aac74/e70be94c-e868-51f1-a147-7ef5a60aac74_expert_report_file_22cf9b42-9188-4e55-8365-d04b45e54a9f.pdf HTTP/1.1" 201 0
2026-03-28 14:06:16 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item e70be94c-e868-51f1-a147-7ef5a60aac74
2026-03-28 14:06:16 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: e70be94c-e868-51f1-a147-7ef5a60aac74, skipping ID generation
2026-03-28 14:06:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item e70be94c-e868-51f1-a147-7ef5a60aac74
2026-03-28 14:06:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DKY19BNC-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-28 14:06:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=KY19BNC-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-28 14:06:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:06:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2ddb3690>
2026-03-28 14:06:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:06:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:06:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:06:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_96df00f7-d862-5338-b935-5c42d63b82c0/96df00f7-d862-5338-b935-5c42d63b82c0_image_2.jpg HTTP/1.1" 201 0
2026-03-28 14:06:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FAK67LWT%252F698947158%252F600') HTTP/1.1" 204 0
2026-03-28 14:06:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AK67LWT/698947158/600 saved to cache
2026-03-28 14:06:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 96df00f7-d862-5338-b935-5c42d63b82c0
2026-03-28 14:06:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:06:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2ddb2c10>
2026-03-28 14:06:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:06:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:06:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:06:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1a399624-5154-54f6-ad94-51c45341542d/1a399624-5154-54f6-ad94-51c45341542d_image_3.jpg HTTP/1.1" 201 0
2026-03-28 14:06:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FNK64UTR%252F698814113%252F600') HTTP/1.1" 204 0
2026-03-28 14:06:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NK64UTR/698814113/600 saved to cache
2026-03-28 14:06:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 1a399624-5154-54f6-ad94-51c45341542d
2026-03-28 14:06:16 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AK67LWT/698947126/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=AK67LWT-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-28 14:06:16 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LD11FZB/698929226/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698929226>
2026-03-28 14:06:16 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YD64WJN/697180789/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=697180789>
2026-03-28 14:06:16 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YB63ZKP/698284354/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=YB63ZKP-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-28 14:06:16 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YR18ZWP/42810578?sv=2020-08-04&st=2026-03-28T14%3A06%3A15Z&se=2026-03-28T14%3A31%3A15Z&sr=b&sp=r&sig=zCn1XD7WNrAfDR%2B4MyMSkib3CGWTWe4xFlsq2a%2BUqlo%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=YR18%20ZWP-GB>
2026-03-28 14:06:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698717096%27 HTTP/1.1" 200 None
2026-03-28 14:06:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698717096 not downloaded yet
2026-03-28 14:06:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:06:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2de13e50>
2026-03-28 14:06:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:06:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:06:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:06:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8f3e30a4-6b64-5dd1-8e1e-6cce5d49fef3/8f3e30a4-6b64-5dd1-8e1e-6cce5d49fef3_image_0.jpg HTTP/1.1" 201 0
2026-03-28 14:06:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FPXZ1595%252F698814087%252F600') HTTP/1.1" 204 0
2026-03-28 14:06:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PXZ1595/698814087/600 saved to cache
2026-03-28 14:06:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 8f3e30a4-6b64-5dd1-8e1e-6cce5d49fef3
2026-03-28 14:06:16 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 8f3e30a4-6b64-5dd1-8e1e-6cce5d49fef3, skipping ID generation
2026-03-28 14:06:16 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 8f3e30a4-6b64-5dd1-8e1e-6cce5d49fef3 sending to next pipeline
2026-03-28 14:06:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 8f3e30a4-6b64-5dd1-8e1e-6cce5d49fef3, identifier: PXZ%201595
2026-03-28 14:06:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:06:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c9e8110>
2026-03-28 14:06:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:06:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:06:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:06:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fe123a59-25d0-509d-9046-e45117da9996/fe123a59-25d0-509d-9046-e45117da9996_image_2.jpg HTTP/1.1" 201 0
2026-03-28 14:06:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FHY65KRJ%252F698920380%252F600') HTTP/1.1" 204 0
2026-03-28 14:06:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HY65KRJ/698920380/600 saved to cache
2026-03-28 14:06:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item fe123a59-25d0-509d-9046-e45117da9996
2026-03-28 14:06:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:06:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c13f010>
2026-03-28 14:06:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:06:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:06:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:06:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_243a05a7-7cda-5444-ab1c-5fdc014fa410/243a05a7-7cda-5444-ab1c-5fdc014fa410_image_2.jpg HTTP/1.1" 201 0
2026-03-28 14:06:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FYB63ZKP%252F698284362%252F600') HTTP/1.1" 204 0
2026-03-28 14:06:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YB63ZKP/698284362/600 saved to cache
2026-03-28 14:06:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 243a05a7-7cda-5444-ab1c-5fdc014fa410
2026-03-28 14:06:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:06:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c9968d0>
2026-03-28 14:06:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:06:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:06:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:06:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a6b7695a-3dc3-56dd-a07d-29432fe9fa43/a6b7695a-3dc3-56dd-a07d-29432fe9fa43_image_3.jpg HTTP/1.1" 201 0
2026-03-28 14:06:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FYD64WJN%252F697180798%252F600') HTTP/1.1" 204 0
2026-03-28 14:06:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YD64WJN/697180798/600 saved to cache
2026-03-28 14:06:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item a6b7695a-3dc3-56dd-a07d-29432fe9fa43
2026-03-28 14:06:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:06:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2ca1ff10>
2026-03-28 14:06:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:06:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:06:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:06:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fe123a59-25d0-509d-9046-e45117da9996/fe123a59-25d0-509d-9046-e45117da9996_image_1.jpg HTTP/1.1" 201 0
2026-03-28 14:06:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FHY65KRJ%252F698920375%252F600') HTTP/1.1" 204 0
2026-03-28 14:06:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HY65KRJ/698920375/600 saved to cache
2026-03-28 14:06:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item fe123a59-25d0-509d-9046-e45117da9996
2026-03-28 14:06:16 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:06:16 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:06:16 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:06:16 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:06:16 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:06:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:06:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a3073b550>
2026-03-28 14:06:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:06:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:06:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:06:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_505ec447-0f6d-5de4-9190-5ab4c6e276f7/505ec447-0f6d-5de4-9190-5ab4c6e276f7_image_9.jpg HTTP/1.1" 201 0
2026-03-28 14:06:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FYG70CMV%252F697550898%252F600') HTTP/1.1" 204 0
2026-03-28 14:06:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YG70CMV/697550898/600 saved to cache
2026-03-28 14:06:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 505ec447-0f6d-5de4-9190-5ab4c6e276f7
2026-03-28 14:06:16 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:06:16 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:06:16 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:06:16 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:06:16 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:06:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:06:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2ddb3e10>
2026-03-28 14:06:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:06:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:06:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:06:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fadd6eea-e2b0-5574-affe-cdf6b892b445/fadd6eea-e2b0-5574-affe-cdf6b892b445_image_8.jpg HTTP/1.1" 201 0
2026-03-28 14:06:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLD11FZB%252F698929254%252F600') HTTP/1.1" 204 0
2026-03-28 14:06:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LD11FZB/698929254/600 saved to cache
2026-03-28 14:06:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item fadd6eea-e2b0-5574-affe-cdf6b892b445
2026-03-28 14:06:16 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YG70CMV/697550876/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=697550876>
2026-03-28 14:06:16 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HY65KRJ/698920373/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=HY65KRJ-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-28 14:06:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698717119%27 HTTP/1.1" 200 None
2026-03-28 14:06:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698717119 not downloaded yet
2026-03-28 14:06:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 8f3e30a4-6b64-5dd1-8e1e-6cce5d49fef3 with identifier: PXZ%201595
2026-03-28 14:06:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 8f3e30a4-6b64-5dd1-8e1e-6cce5d49fef3 with identifier: PXZ%201595
2026-03-28 14:06:16 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 8f3e30a4-6b64-5dd1-8e1e-6cce5d49fef3 with identifier: PXZ%201595 to the API
2026-03-28 14:06:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:06:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:06:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PXZ1595/698814087/600>
{'auction_title': '',
'c_o_2_emission_value': 209,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8f3e30a4-6b64-5dd1-8e1e-6cce5d49fef3/8f3e30a4-6b64-5dd1-8e1e-6cce5d49fef3_expert_report_file_d6e46f81-0680-46ef-97e7-3f7fdf26697b.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=PXZ%201595-GB',
'category': 'Car',
'color': 'white',
'currency': 'GBP',
'doors_number': 5,
'engine': '3.0L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Diesel',
'id': '8f3e30a4-6b64-5dd1-8e1e-6cce5d49fef3',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'PXZ 1595',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=PXZ%201595&vehicleType=*',
'listing': 'auction',
'location': 'Manchester',
'make': 'MERCEDES-BENZ',
'model': 'GL350',
'odometer': 87201,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 11,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8f3e30a4-6b64-5dd1-8e1e-6cce5d49fef3/8f3e30a4-6b64-5dd1-8e1e-6cce5d49fef3_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 46472,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PXZ1595/698814087/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8f3e30a4-6b64-5dd1-8e1e-6cce5d49fef3/8f3e30a4-6b64-5dd1-8e1e-6cce5d49fef3_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 45087,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PXZ1595/698814105/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8f3e30a4-6b64-5dd1-8e1e-6cce5d49fef3/8f3e30a4-6b64-5dd1-8e1e-6cce5d49fef3_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 43481,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PXZ1595/698814130/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8f3e30a4-6b64-5dd1-8e1e-6cce5d49fef3/8f3e30a4-6b64-5dd1-8e1e-6cce5d49fef3_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 45168,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PXZ1595/698814140/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8f3e30a4-6b64-5dd1-8e1e-6cce5d49fef3/8f3e30a4-6b64-5dd1-8e1e-6cce5d49fef3_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 45134,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PXZ1595/698814161/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8f3e30a4-6b64-5dd1-8e1e-6cce5d49fef3/8f3e30a4-6b64-5dd1-8e1e-6cce5d49fef3_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 42178,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PXZ1595/698814180/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8f3e30a4-6b64-5dd1-8e1e-6cce5d49fef3/8f3e30a4-6b64-5dd1-8e1e-6cce5d49fef3_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 92267,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PXZ1595/698814207/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8f3e30a4-6b64-5dd1-8e1e-6cce5d49fef3/8f3e30a4-6b64-5dd1-8e1e-6cce5d49fef3_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 55230,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PXZ1595/698814225/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8f3e30a4-6b64-5dd1-8e1e-6cce5d49fef3/8f3e30a4-6b64-5dd1-8e1e-6cce5d49fef3_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 75645,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PXZ1595/698814242/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8f3e30a4-6b64-5dd1-8e1e-6cce5d49fef3/8f3e30a4-6b64-5dd1-8e1e-6cce5d49fef3_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 86946,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PXZ1595/698814256/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2014-01-01',
'seller_name': None,
'title': 'MERCEDES-BENZ GL350 3.0 CDI B/T AMG SPORT TIP StationWagon',
'transmission': 'manual',
'trim': 'CDI B/T AMG SPORT TIP',
'vin': 'WDC1668242A333918',
'year': 2014}
2026-03-28 14:06:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27PXZ%25201595%27 HTTP/1.1" 200 None
2026-03-28 14:06:17 [bca.uk] INFO: Saving data for PXZ%201595: {'created_time': 1774706777.085245, 'last_price_update_time': 1774706777.085255, 'auction_closing_time': 1774864800.0}
2026-03-28 14:06:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='PXZ%25201595') HTTP/1.1" 204 0
2026-03-28 14:06:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LJ63JYB/42809852?sv=2020-08-04&st=2026-03-28T14%3A06%3A15Z&se=2026-03-28T14%3A31%3A15Z&sr=b&sp=r&sig=3IID5C6KndPfmS4BXAKyAnPFDRKPXiE3OW%2FP%2FAoIOHg%3D> (referer: https://www.bca.co.uk/)
2026-03-28 14:06:17 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LD11FZB/698929196/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698929196>
2026-03-28 14:06:17 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YD64WJN/697180770/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=YD64WJN-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-28 14:06:17 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/ND19ZXL/42810628?sv=2020-08-04&st=2026-03-28T14%3A06%3A16Z&se=2026-03-28T14%3A31%3A16Z&sr=b&sp=r&sig=5xmogTYqVurr0j8AfDD7yhrKv%2BhU0%2BedAHaG0Z0v2KA%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=ND19%20ZXL-GB>
2026-03-28 14:06:17 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YD64WJN/697180780/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=697180780>
2026-03-28 14:06:17 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NK64UTR/698814057/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=NK64UTR-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-28 14:06:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698717137%27 HTTP/1.1" 200 None
2026-03-28 14:06:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698717137 not downloaded yet
2026-03-28 14:06:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698717157%27 HTTP/1.1" 200 None
2026-03-28 14:06:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698717157 not downloaded yet
2026-03-28 14:06:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698717180%27 HTTP/1.1" 200 None
2026-03-28 14:06:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698717180 not downloaded yet
2026-03-28 14:06:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698717208%27 HTTP/1.1" 200 None
2026-03-28 14:06:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698717208 not downloaded yet
2026-03-28 14:06:17 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LD11FZB/698929162/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698929162>
2026-03-28 14:06:17 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YG70CMV/697550832/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=697550832>
2026-03-28 14:06:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698717239%27 HTTP/1.1" 200 None
2026-03-28 14:06:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698717239 not downloaded yet
2026-03-28 14:06:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698717270%27 HTTP/1.1" 200 None
2026-03-28 14:06:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698717270 not downloaded yet
2026-03-28 14:06:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YB63ZKP/698284354/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YB63ZKP/42797877?sv=2020-08-04&st=2026-03-28T14%3A04%3A00Z&se=2026-03-28T14%3A29%3A00Z&sr=b&sp=r&sig=86nclI4iCmgLh3evtZ%2BtpNUit8HkmrBcUBeJLBRYtzg%3D)
2026-03-28 14:06:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AK67LWT/698947126/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/AK67LWT/42810366?sv=2020-08-04&st=2026-03-28T14%3A04%3A00Z&se=2026-03-28T14%3A29%3A00Z&sr=b&sp=r&sig=dnN3%2FeKHnzQfSMnyGaraMReo6SkHH2Dy4nbY3zUESfI%3D)
2026-03-28 14:06:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LD11FZB/698929226/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LD11FZB/42809686?sv=2020-08-04&st=2026-03-28T14%3A03%3A58Z&se=2026-03-28T14%3A28%3A58Z&sr=b&sp=r&sig=%2FK4BAlVG%2BClj51VCbQA3WyKfnHgVC%2B3mVHIA2lg6Jqc%3D)
2026-03-28 14:06:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698717291%27 HTTP/1.1" 200 None
2026-03-28 14:06:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698717291 not downloaded yet
2026-03-28 14:06:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HY65KRJ/698920373/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/HY65KRJ/42809575?sv=2020-08-04&st=2026-03-28T14%3A03%3A59Z&se=2026-03-28T14%3A28%3A59Z&sr=b&sp=r&sig=qQyrthkWradfVt2c0sIhPBRny5qzj5uOjQmOciVVoMo%3D)
2026-03-28 14:06:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:06:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2d737f10>
2026-03-28 14:06:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:06:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:06:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:06:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4870bb8b-60c3-52a3-9777-e0e27c2bb711/4870bb8b-60c3-52a3-9777-e0e27c2bb711_expert_report_file_629e875a-3639-4579-9a53-f8f2b706dd5c.pdf HTTP/1.1" 201 0
2026-03-28 14:06:17 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item 4870bb8b-60c3-52a3-9777-e0e27c2bb711
2026-03-28 14:06:17 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 4870bb8b-60c3-52a3-9777-e0e27c2bb711, skipping ID generation
2026-03-28 14:06:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 4870bb8b-60c3-52a3-9777-e0e27c2bb711
2026-03-28 14:06:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DLJ63JYB-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-28 14:06:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=LJ63JYB-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-28 14:06:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YD64WJN/697180789/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YD64WJN/42809986?sv=2020-08-04&st=2026-03-28T14%3A03%3A59Z&se=2026-03-28T14%3A28%3A59Z&sr=b&sp=r&sig=5rsKGf%2F78vqwWJXVPXpM1R60yxRlhwBt0pb8A02KPMk%3D)
2026-03-28 14:06:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699002866%27 HTTP/1.1" 200 None
2026-03-28 14:06:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699002866 not downloaded yet
2026-03-28 14:06:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YG70CMV/697550876/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YG70CMV/42809751?sv=2020-08-04&st=2026-03-28T14%3A03%3A58Z&se=2026-03-28T14%3A28%3A58Z&sr=b&sp=r&sig=1ABLz0vVsC9yYBr%2F09SZY1lBMEdGcrDzJ1kVHXJEJlA%3D)
2026-03-28 14:06:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NK64UTR/698814057/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/NK64UTR/42807827?sv=2020-08-04&st=2026-03-28T14%3A04%3A00Z&se=2026-03-28T14%3A29%3A00Z&sr=b&sp=r&sig=B2djBTwUnOYzqxtI8e7WJD2j2cACy9SjmoGLE3oN2SE%3D)
2026-03-28 14:06:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699002878%27 HTTP/1.1" 200 None
2026-03-28 14:06:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699002878 not downloaded yet
2026-03-28 14:06:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YR18ZWP/42810578?sv=2020-08-04&st=2026-03-28T14%3A06%3A15Z&se=2026-03-28T14%3A31%3A15Z&sr=b&sp=r&sig=zCn1XD7WNrAfDR%2B4MyMSkib3CGWTWe4xFlsq2a%2BUqlo%3D> (referer: https://www.bca.co.uk/)
2026-03-28 14:06:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699002889%27 HTTP/1.1" 200 None
2026-03-28 14:06:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699002889 not downloaded yet
2026-03-28 14:06:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YD64WJN/697180770/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YD64WJN/42809986?sv=2020-08-04&st=2026-03-28T14%3A03%3A59Z&se=2026-03-28T14%3A28%3A59Z&sr=b&sp=r&sig=5rsKGf%2F78vqwWJXVPXpM1R60yxRlhwBt0pb8A02KPMk%3D)
2026-03-28 14:06:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699002911%27 HTTP/1.1" 200 None
2026-03-28 14:06:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699002911 not downloaded yet
2026-03-28 14:06:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LD11FZB/698929196/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LD11FZB/42809686?sv=2020-08-04&st=2026-03-28T14%3A03%3A58Z&se=2026-03-28T14%3A28%3A58Z&sr=b&sp=r&sig=%2FK4BAlVG%2BClj51VCbQA3WyKfnHgVC%2B3mVHIA2lg6Jqc%3D)
2026-03-28 14:06:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699002917%27 HTTP/1.1" 200 None
2026-03-28 14:06:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699002917 not downloaded yet
2026-03-28 14:06:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:06:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c3a0dd0>
2026-03-28 14:06:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:06:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:06:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:06:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_243a05a7-7cda-5444-ab1c-5fdc014fa410/243a05a7-7cda-5444-ab1c-5fdc014fa410_image_0.jpg HTTP/1.1" 201 0
2026-03-28 14:06:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FYB63ZKP%252F698284354%252F600') HTTP/1.1" 204 0
2026-03-28 14:06:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YB63ZKP/698284354/600 saved to cache
2026-03-28 14:06:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 243a05a7-7cda-5444-ab1c-5fdc014fa410
2026-03-28 14:06:17 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 243a05a7-7cda-5444-ab1c-5fdc014fa410, skipping ID generation
2026-03-28 14:06:17 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 243a05a7-7cda-5444-ab1c-5fdc014fa410 sending to next pipeline
2026-03-28 14:06:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 243a05a7-7cda-5444-ab1c-5fdc014fa410, identifier: YB63%20ZKP
2026-03-28 14:06:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:06:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2fdc8310>
2026-03-28 14:06:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:06:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:06:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:06:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_96df00f7-d862-5338-b935-5c42d63b82c0/96df00f7-d862-5338-b935-5c42d63b82c0_image_0.jpg HTTP/1.1" 201 0
2026-03-28 14:06:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FAK67LWT%252F698947126%252F600') HTTP/1.1" 204 0
2026-03-28 14:06:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AK67LWT/698947126/600 saved to cache
2026-03-28 14:06:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 96df00f7-d862-5338-b935-5c42d63b82c0
2026-03-28 14:06:17 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 96df00f7-d862-5338-b935-5c42d63b82c0, skipping ID generation
2026-03-28 14:06:17 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 96df00f7-d862-5338-b935-5c42d63b82c0 sending to next pipeline
2026-03-28 14:06:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 96df00f7-d862-5338-b935-5c42d63b82c0, identifier: AK67%20LWT
2026-03-28 14:06:17 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:06:17 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:06:17 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:06:17 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:06:17 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:06:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:06:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2de84290>
2026-03-28 14:06:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:06:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:06:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:06:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fadd6eea-e2b0-5574-affe-cdf6b892b445/fadd6eea-e2b0-5574-affe-cdf6b892b445_image_7.jpg HTTP/1.1" 201 0
2026-03-28 14:06:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLD11FZB%252F698929226%252F600') HTTP/1.1" 204 0
2026-03-28 14:06:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LD11FZB/698929226/600 saved to cache
2026-03-28 14:06:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item fadd6eea-e2b0-5574-affe-cdf6b892b445
2026-03-28 14:06:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YD64WJN/697180780/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YD64WJN/42809986?sv=2020-08-04&st=2026-03-28T14%3A03%3A59Z&se=2026-03-28T14%3A28%3A59Z&sr=b&sp=r&sig=5rsKGf%2F78vqwWJXVPXpM1R60yxRlhwBt0pb8A02KPMk%3D)
2026-03-28 14:06:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 243a05a7-7cda-5444-ab1c-5fdc014fa410 with identifier: YB63%20ZKP
2026-03-28 14:06:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 243a05a7-7cda-5444-ab1c-5fdc014fa410 with identifier: YB63%20ZKP
2026-03-28 14:06:17 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 243a05a7-7cda-5444-ab1c-5fdc014fa410 with identifier: YB63%20ZKP to the API
2026-03-28 14:06:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:06:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:06:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YB63ZKP/698284354/600>
{'auction_title': '',
'c_o_2_emission_value': 100,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_243a05a7-7cda-5444-ab1c-5fdc014fa410/243a05a7-7cda-5444-ab1c-5fdc014fa410_expert_report_file_556d0e6f-c230-4445-b8bb-5f2ca5c92ce2.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=YB63%20ZKP-GB',
'category': 'Car',
'color': 'silver',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.6L',
'expiration_date': '2026-03-29T10:00:00Z',
'fuel_type': 'Diesel',
'id': '243a05a7-7cda-5444-ab1c-5fdc014fa410',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'YB63 ZKP',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=YB63%20ZKP&vehicleType=*',
'listing': 'auction',
'location': 'Brighouse',
'make': 'KIA',
'model': 'CEED',
'odometer': 97483,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 11,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_243a05a7-7cda-5444-ab1c-5fdc014fa410/243a05a7-7cda-5444-ab1c-5fdc014fa410_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 50206,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YB63ZKP/698284354/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_243a05a7-7cda-5444-ab1c-5fdc014fa410/243a05a7-7cda-5444-ab1c-5fdc014fa410_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 48877,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YB63ZKP/698284358/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_243a05a7-7cda-5444-ab1c-5fdc014fa410/243a05a7-7cda-5444-ab1c-5fdc014fa410_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 43098,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YB63ZKP/698284362/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_243a05a7-7cda-5444-ab1c-5fdc014fa410/243a05a7-7cda-5444-ab1c-5fdc014fa410_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 42834,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YB63ZKP/698284367/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_243a05a7-7cda-5444-ab1c-5fdc014fa410/243a05a7-7cda-5444-ab1c-5fdc014fa410_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 42560,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YB63ZKP/698284372/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_243a05a7-7cda-5444-ab1c-5fdc014fa410/243a05a7-7cda-5444-ab1c-5fdc014fa410_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 42020,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YB63ZKP/698284376/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_243a05a7-7cda-5444-ab1c-5fdc014fa410/243a05a7-7cda-5444-ab1c-5fdc014fa410_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 72369,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YB63ZKP/698284382/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_243a05a7-7cda-5444-ab1c-5fdc014fa410/243a05a7-7cda-5444-ab1c-5fdc014fa410_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 79432,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YB63ZKP/698284387/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_243a05a7-7cda-5444-ab1c-5fdc014fa410/243a05a7-7cda-5444-ab1c-5fdc014fa410_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 87643,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YB63ZKP/698284395/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_243a05a7-7cda-5444-ab1c-5fdc014fa410/243a05a7-7cda-5444-ab1c-5fdc014fa410_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 87440,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YB63ZKP/698284400/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2014-01-01',
'seller_name': None,
'title': 'KIA CEED 1.6 CRDI 126 E/D 3 Hatchback',
'transmission': 'manual',
'trim': 'CRDI 126 E/D 3',
'vin': 'U5YHN516LEL119806',
'year': 2014}
2026-03-28 14:06:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YB63%2520ZKP%27 HTTP/1.1" 200 None
2026-03-28 14:06:18 [bca.uk] INFO: Saving data for YB63%20ZKP: {'created_time': 1774706778.097048, 'last_price_update_time': 1774706778.097058, 'auction_closing_time': 1774778400.0}
2026-03-28 14:06:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='YB63%2520ZKP') HTTP/1.1" 204 0
2026-03-28 14:06:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 96df00f7-d862-5338-b935-5c42d63b82c0 with identifier: AK67%20LWT
2026-03-28 14:06:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 96df00f7-d862-5338-b935-5c42d63b82c0 with identifier: AK67%20LWT
2026-03-28 14:06:18 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 96df00f7-d862-5338-b935-5c42d63b82c0 with identifier: AK67%20LWT to the API
2026-03-28 14:06:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:06:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:06:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AK67LWT/698947126/600>
{'auction_title': '',
'c_o_2_emission_value': 99,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_96df00f7-d862-5338-b935-5c42d63b82c0/96df00f7-d862-5338-b935-5c42d63b82c0_expert_report_file_eda58b57-73f8-4dfb-83a5-72990c802962.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=AK67%20LWT-GB',
'category': 'Car',
'color': 'blue',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.5L',
'expiration_date': '2026-03-29T10:00:00Z',
'fuel_type': 'Diesel',
'id': '96df00f7-d862-5338-b935-5c42d63b82c0',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'AK67 LWT',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=AK67%20LWT&vehicleType=*',
'listing': 'auction',
'location': 'Manchester',
'make': 'NISSAN',
'model': 'QASHQAI',
'odometer': 125633,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 11,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_96df00f7-d862-5338-b935-5c42d63b82c0/96df00f7-d862-5338-b935-5c42d63b82c0_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 48007,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AK67LWT/698947126/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_96df00f7-d862-5338-b935-5c42d63b82c0/96df00f7-d862-5338-b935-5c42d63b82c0_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 47291,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AK67LWT/698947142/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_96df00f7-d862-5338-b935-5c42d63b82c0/96df00f7-d862-5338-b935-5c42d63b82c0_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 47240,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AK67LWT/698947158/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_96df00f7-d862-5338-b935-5c42d63b82c0/96df00f7-d862-5338-b935-5c42d63b82c0_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 48713,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AK67LWT/698947171/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_96df00f7-d862-5338-b935-5c42d63b82c0/96df00f7-d862-5338-b935-5c42d63b82c0_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 46511,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AK67LWT/698947180/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_96df00f7-d862-5338-b935-5c42d63b82c0/96df00f7-d862-5338-b935-5c42d63b82c0_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 44382,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AK67LWT/698947195/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_96df00f7-d862-5338-b935-5c42d63b82c0/96df00f7-d862-5338-b935-5c42d63b82c0_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 94561,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AK67LWT/698947215/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_96df00f7-d862-5338-b935-5c42d63b82c0/96df00f7-d862-5338-b935-5c42d63b82c0_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 82544,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AK67LWT/698947231/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_96df00f7-d862-5338-b935-5c42d63b82c0/96df00f7-d862-5338-b935-5c42d63b82c0_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 100403,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AK67LWT/698947249/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_96df00f7-d862-5338-b935-5c42d63b82c0/96df00f7-d862-5338-b935-5c42d63b82c0_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 92641,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AK67LWT/698947264/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-01-01',
'seller_name': None,
'title': 'NISSAN QASHQAI 1.5 DCI 110 N-CONNECTA Hatchback',
'transmission': 'manual',
'trim': 'DCI 110 N-CONNECTA',
'vin': 'SJNFAAJ11U2170861',
'year': 2017}
2026-03-28 14:06:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27AK67%2520LWT%27 HTTP/1.1" 200 None
2026-03-28 14:06:18 [bca.uk] INFO: Saving data for AK67%20LWT: {'created_time': 1774706778.514115, 'last_price_update_time': 1774706778.514126, 'auction_closing_time': 1774778400.0}
2026-03-28 14:06:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='AK67%2520LWT') HTTP/1.1" 204 0
2026-03-28 14:06:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LD11FZB/698929162/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LD11FZB/42809686?sv=2020-08-04&st=2026-03-28T14%3A03%3A58Z&se=2026-03-28T14%3A28%3A58Z&sr=b&sp=r&sig=%2FK4BAlVG%2BClj51VCbQA3WyKfnHgVC%2B3mVHIA2lg6Jqc%3D)
2026-03-28 14:06:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YG70CMV/697550832/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YG70CMV/42809751?sv=2020-08-04&st=2026-03-28T14%3A03%3A58Z&se=2026-03-28T14%3A28%3A58Z&sr=b&sp=r&sig=1ABLz0vVsC9yYBr%2F09SZY1lBMEdGcrDzJ1kVHXJEJlA%3D)
2026-03-28 14:06:18 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KY19BNC/698717119/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698717119>
2026-03-28 14:06:18 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KY19BNC/698717239/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698717239>
2026-03-28 14:06:18 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KY19BNC/698717270/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698717270>
2026-03-28 14:06:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699002941%27 HTTP/1.1" 200 None
2026-03-28 14:06:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699002941 not downloaded yet
2026-03-28 14:06:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:06:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c537850>
2026-03-28 14:06:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:06:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:06:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:06:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fe123a59-25d0-509d-9046-e45117da9996/fe123a59-25d0-509d-9046-e45117da9996_image_0.jpg HTTP/1.1" 201 0
2026-03-28 14:06:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FHY65KRJ%252F698920373%252F600') HTTP/1.1" 204 0
2026-03-28 14:06:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HY65KRJ/698920373/600 saved to cache
2026-03-28 14:06:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item fe123a59-25d0-509d-9046-e45117da9996
2026-03-28 14:06:18 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: fe123a59-25d0-509d-9046-e45117da9996, skipping ID generation
2026-03-28 14:06:18 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item fe123a59-25d0-509d-9046-e45117da9996 sending to next pipeline
2026-03-28 14:06:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: fe123a59-25d0-509d-9046-e45117da9996, identifier: HY65%20KRJ
2026-03-28 14:06:18 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KY19BNC/698717208/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698717208>
2026-03-28 14:06:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: fe123a59-25d0-509d-9046-e45117da9996 with identifier: HY65%20KRJ
2026-03-28 14:06:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: fe123a59-25d0-509d-9046-e45117da9996 with identifier: HY65%20KRJ
2026-03-28 14:06:18 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: fe123a59-25d0-509d-9046-e45117da9996 with identifier: HY65%20KRJ to the API
2026-03-28 14:06:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:06:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:06:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HY65KRJ/698920373/600>
{'auction_title': '',
'c_o_2_emission_value': 93,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fe123a59-25d0-509d-9046-e45117da9996/fe123a59-25d0-509d-9046-e45117da9996_expert_report_file_e3f10af4-dc17-4c41-aae8-7982da737d79.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=HY65%20KRJ-GB',
'category': 'Car',
'color': 'white',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.5L',
'expiration_date': '2026-03-29T10:00:00Z',
'fuel_type': 'Diesel',
'id': 'fe123a59-25d0-509d-9046-e45117da9996',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'HY65 KRJ',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=HY65%20KRJ&vehicleType=*',
'listing': 'auction',
'location': 'Manchester',
'make': 'RENAULT',
'model': 'MEGANE',
'odometer': 97660,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 11,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fe123a59-25d0-509d-9046-e45117da9996/fe123a59-25d0-509d-9046-e45117da9996_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 44859,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HY65KRJ/698920373/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fe123a59-25d0-509d-9046-e45117da9996/fe123a59-25d0-509d-9046-e45117da9996_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 44900,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HY65KRJ/698920375/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fe123a59-25d0-509d-9046-e45117da9996/fe123a59-25d0-509d-9046-e45117da9996_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 42800,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HY65KRJ/698920380/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fe123a59-25d0-509d-9046-e45117da9996/fe123a59-25d0-509d-9046-e45117da9996_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 43254,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HY65KRJ/698920383/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fe123a59-25d0-509d-9046-e45117da9996/fe123a59-25d0-509d-9046-e45117da9996_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 43703,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HY65KRJ/698920388/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fe123a59-25d0-509d-9046-e45117da9996/fe123a59-25d0-509d-9046-e45117da9996_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 43607,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HY65KRJ/698920390/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fe123a59-25d0-509d-9046-e45117da9996/fe123a59-25d0-509d-9046-e45117da9996_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 75630,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HY65KRJ/698920398/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fe123a59-25d0-509d-9046-e45117da9996/fe123a59-25d0-509d-9046-e45117da9996_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 70873,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HY65KRJ/698920406/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fe123a59-25d0-509d-9046-e45117da9996/fe123a59-25d0-509d-9046-e45117da9996_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 80179,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HY65KRJ/698920412/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fe123a59-25d0-509d-9046-e45117da9996/fe123a59-25d0-509d-9046-e45117da9996_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 87836,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HY65KRJ/698920420/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-01-01',
'seller_name': None,
'title': 'RENAULT MEGANE 1.5 DCI 110 LIMITED Hatchback',
'transmission': 'manual',
'trim': 'DCI 110 LIMITED',
'vin': 'VF1BZ890H53720134',
'year': 2015}
2026-03-28 14:06:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27HY65%2520KRJ%27 HTTP/1.1" 200 None
2026-03-28 14:06:19 [bca.uk] INFO: Saving data for HY65%20KRJ: {'created_time': 1774706779.127221, 'last_price_update_time': 1774706779.127231, 'auction_closing_time': 1774778400.0}
2026-03-28 14:06:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='HY65%2520KRJ') HTTP/1.1" 204 0
2026-03-28 14:06:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699002962%27 HTTP/1.1" 200 None
2026-03-28 14:06:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699002962 not downloaded yet
2026-03-28 14:06:19 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LJ63JYB/699002889/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699002889>
2026-03-28 14:06:19 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LJ63JYB/699002866/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699002866>
2026-03-28 14:06:19 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KY19BNC/698717180/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698717180>
2026-03-28 14:06:19 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LJ63JYB/699002878/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699002878>
2026-03-28 14:06:19 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KY19BNC/698717291/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698717291>
2026-03-28 14:06:19 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LJ63JYB/699002846/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=LJ63JYB-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-28 14:06:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:06:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2d8d83d0>
2026-03-28 14:06:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:06:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:06:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:06:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a6b7695a-3dc3-56dd-a07d-29432fe9fa43/a6b7695a-3dc3-56dd-a07d-29432fe9fa43_image_2.jpg HTTP/1.1" 201 0
2026-03-28 14:06:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FYD64WJN%252F697180789%252F600') HTTP/1.1" 204 0
2026-03-28 14:06:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YD64WJN/697180789/600 saved to cache
2026-03-28 14:06:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item a6b7695a-3dc3-56dd-a07d-29432fe9fa43
2026-03-28 14:06:19 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:06:19 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:06:19 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:06:19 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:06:19 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:06:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:06:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2ca12510>
2026-03-28 14:06:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:06:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:06:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:06:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_505ec447-0f6d-5de4-9190-5ab4c6e276f7/505ec447-0f6d-5de4-9190-5ab4c6e276f7_image_8.jpg HTTP/1.1" 201 0
2026-03-28 14:06:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FYG70CMV%252F697550876%252F600') HTTP/1.1" 204 0
2026-03-28 14:06:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YG70CMV/697550876/600 saved to cache
2026-03-28 14:06:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 505ec447-0f6d-5de4-9190-5ab4c6e276f7
2026-03-28 14:06:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:06:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2ca10d90>
2026-03-28 14:06:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:06:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:06:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:06:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1a399624-5154-54f6-ad94-51c45341542d/1a399624-5154-54f6-ad94-51c45341542d_image_0.jpg HTTP/1.1" 201 0
2026-03-28 14:06:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FNK64UTR%252F698814057%252F600') HTTP/1.1" 204 0
2026-03-28 14:06:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NK64UTR/698814057/600 saved to cache
2026-03-28 14:06:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 1a399624-5154-54f6-ad94-51c45341542d
2026-03-28 14:06:19 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 1a399624-5154-54f6-ad94-51c45341542d, skipping ID generation
2026-03-28 14:06:19 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 1a399624-5154-54f6-ad94-51c45341542d sending to next pipeline
2026-03-28 14:06:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 1a399624-5154-54f6-ad94-51c45341542d, identifier: NK64%20UTR
2026-03-28 14:06:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:06:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2d6eca50>
2026-03-28 14:06:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:06:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:06:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:06:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b702a3ab-2b9c-56eb-8885-dba723a802f3/b702a3ab-2b9c-56eb-8885-dba723a802f3_expert_report_file_43fb3546-a5d0-446b-bc16-66c96b493bac.pdf HTTP/1.1" 201 0
2026-03-28 14:06:19 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item b702a3ab-2b9c-56eb-8885-dba723a802f3
2026-03-28 14:06:19 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: b702a3ab-2b9c-56eb-8885-dba723a802f3, skipping ID generation
2026-03-28 14:06:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item b702a3ab-2b9c-56eb-8885-dba723a802f3
2026-03-28 14:06:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DYR18ZWP-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-28 14:06:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=YR18ZWP-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-28 14:06:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:06:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c537410>
2026-03-28 14:06:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:06:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:06:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:06:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a6b7695a-3dc3-56dd-a07d-29432fe9fa43/a6b7695a-3dc3-56dd-a07d-29432fe9fa43_image_0.jpg HTTP/1.1" 201 0
2026-03-28 14:06:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FYD64WJN%252F697180770%252F600') HTTP/1.1" 204 0
2026-03-28 14:06:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YD64WJN/697180770/600 saved to cache
2026-03-28 14:06:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item a6b7695a-3dc3-56dd-a07d-29432fe9fa43
2026-03-28 14:06:19 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:06:19 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:06:19 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:06:19 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:06:19 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:06:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:06:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a1fec8c90>
2026-03-28 14:06:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:06:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:06:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:06:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fadd6eea-e2b0-5574-affe-cdf6b892b445/fadd6eea-e2b0-5574-affe-cdf6b892b445_image_6.jpg HTTP/1.1" 201 0
2026-03-28 14:06:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLD11FZB%252F698929196%252F600') HTTP/1.1" 204 0
2026-03-28 14:06:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LD11FZB/698929196/600 saved to cache
2026-03-28 14:06:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item fadd6eea-e2b0-5574-affe-cdf6b892b445
2026-03-28 14:06:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:06:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2de123d0>
2026-03-28 14:06:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:06:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:06:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:06:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a6b7695a-3dc3-56dd-a07d-29432fe9fa43/a6b7695a-3dc3-56dd-a07d-29432fe9fa43_image_1.jpg HTTP/1.1" 201 0
2026-03-28 14:06:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FYD64WJN%252F697180780%252F600') HTTP/1.1" 204 0
2026-03-28 14:06:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YD64WJN/697180780/600 saved to cache
2026-03-28 14:06:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item a6b7695a-3dc3-56dd-a07d-29432fe9fa43
2026-03-28 14:06:19 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: a6b7695a-3dc3-56dd-a07d-29432fe9fa43, skipping ID generation
2026-03-28 14:06:19 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item a6b7695a-3dc3-56dd-a07d-29432fe9fa43 sending to next pipeline
2026-03-28 14:06:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: a6b7695a-3dc3-56dd-a07d-29432fe9fa43, identifier: YD64%20WJN
2026-03-28 14:06:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:06:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c3d3ed0>
2026-03-28 14:06:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:06:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:06:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:06:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fadd6eea-e2b0-5574-affe-cdf6b892b445/fadd6eea-e2b0-5574-affe-cdf6b892b445_image_5.jpg HTTP/1.1" 201 0
2026-03-28 14:06:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLD11FZB%252F698929162%252F600') HTTP/1.1" 204 0
2026-03-28 14:06:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LD11FZB/698929162/600 saved to cache
2026-03-28 14:06:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item fadd6eea-e2b0-5574-affe-cdf6b892b445
2026-03-28 14:06:19 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:06:19 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:06:19 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:06:19 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:06:19 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:06:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:06:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a3025f650>
2026-03-28 14:06:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:06:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:06:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:06:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_505ec447-0f6d-5de4-9190-5ab4c6e276f7/505ec447-0f6d-5de4-9190-5ab4c6e276f7_image_6.jpg HTTP/1.1" 201 0
2026-03-28 14:06:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FYG70CMV%252F697550832%252F600') HTTP/1.1" 204 0
2026-03-28 14:06:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YG70CMV/697550832/600 saved to cache
2026-03-28 14:06:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 505ec447-0f6d-5de4-9190-5ab4c6e276f7
2026-03-28 14:06:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699002984%27 HTTP/1.1" 200 None
2026-03-28 14:06:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699002984 not downloaded yet
2026-03-28 14:06:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 1a399624-5154-54f6-ad94-51c45341542d with identifier: NK64%20UTR
2026-03-28 14:06:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 1a399624-5154-54f6-ad94-51c45341542d with identifier: NK64%20UTR
2026-03-28 14:06:19 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 1a399624-5154-54f6-ad94-51c45341542d with identifier: NK64%20UTR to the API
2026-03-28 14:06:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:06:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:06:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NK64UTR/698814057/600>
{'auction_title': '',
'c_o_2_emission_value': 159,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1a399624-5154-54f6-ad94-51c45341542d/1a399624-5154-54f6-ad94-51c45341542d_expert_report_file_8a86a61a-288e-46c2-8357-da037834c361.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=NK64%20UTR-GB',
'category': 'Car',
'color': 'blue',
'currency': 'GBP',
'doors_number': 4,
'engine': '2.0L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol',
'id': '1a399624-5154-54f6-ad94-51c45341542d',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'NK64 UTR',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=NK64%20UTR&vehicleType=*',
'listing': 'auction',
'location': 'Manchester',
'make': 'AUDI',
'model': 'S3 SALOON',
'odometer': 63280,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 11,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1a399624-5154-54f6-ad94-51c45341542d/1a399624-5154-54f6-ad94-51c45341542d_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 46507,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NK64UTR/698814057/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1a399624-5154-54f6-ad94-51c45341542d/1a399624-5154-54f6-ad94-51c45341542d_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 47385,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NK64UTR/698814073/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1a399624-5154-54f6-ad94-51c45341542d/1a399624-5154-54f6-ad94-51c45341542d_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 47229,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NK64UTR/698814095/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1a399624-5154-54f6-ad94-51c45341542d/1a399624-5154-54f6-ad94-51c45341542d_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 46958,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NK64UTR/698814113/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1a399624-5154-54f6-ad94-51c45341542d/1a399624-5154-54f6-ad94-51c45341542d_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 43972,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NK64UTR/698814133/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1a399624-5154-54f6-ad94-51c45341542d/1a399624-5154-54f6-ad94-51c45341542d_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 43971,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NK64UTR/698814148/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1a399624-5154-54f6-ad94-51c45341542d/1a399624-5154-54f6-ad94-51c45341542d_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 98593,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NK64UTR/698814175/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1a399624-5154-54f6-ad94-51c45341542d/1a399624-5154-54f6-ad94-51c45341542d_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 92630,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NK64UTR/698814200/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1a399624-5154-54f6-ad94-51c45341542d/1a399624-5154-54f6-ad94-51c45341542d_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 93312,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NK64UTR/698814227/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1a399624-5154-54f6-ad94-51c45341542d/1a399624-5154-54f6-ad94-51c45341542d_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 77213,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NK64UTR/698814245/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2014-01-01',
'seller_name': None,
'title': 'AUDI S3 SALOON 2.0 TFS1 300 QUATTRO S-T Saloon',
'transmission': 'automatic',
'trim': 'TFS1 300 QUATTRO S-T',
'vin': 'WAUZZZ8V9F1036917',
'year': 2014}
2026-03-28 14:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27NK64%2520UTR%27 HTTP/1.1" 200 None
2026-03-28 14:06:20 [bca.uk] INFO: Saving data for NK64%20UTR: {'created_time': 1774706780.201097, 'last_price_update_time': 1774706780.201109, 'auction_closing_time': 1774864800.0}
2026-03-28 14:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='NK64%2520UTR') HTTP/1.1" 204 0
2026-03-28 14:06:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: a6b7695a-3dc3-56dd-a07d-29432fe9fa43 with identifier: YD64%20WJN
2026-03-28 14:06:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: a6b7695a-3dc3-56dd-a07d-29432fe9fa43 with identifier: YD64%20WJN
2026-03-28 14:06:20 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: a6b7695a-3dc3-56dd-a07d-29432fe9fa43 with identifier: YD64%20WJN to the API
2026-03-28 14:06:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:06:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:06:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YD64WJN/697180780/600>
{'auction_title': '',
'c_o_2_emission_value': 142,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a6b7695a-3dc3-56dd-a07d-29432fe9fa43/a6b7695a-3dc3-56dd-a07d-29432fe9fa43_expert_report_file_ccc4390d-9622-4ec3-8a04-ee2ee1227083.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=YD64%20WJN-GB',
'category': 'Car',
'color': 'silver',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.2L',
'expiration_date': '2026-03-29T10:00:00Z',
'fuel_type': 'Petrol',
'id': 'a6b7695a-3dc3-56dd-a07d-29432fe9fa43',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'YD64 WJN',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=YD64%20WJN&vehicleType=*',
'listing': 'auction',
'location': 'Brighouse',
'make': 'HYUNDAI',
'model': 'I10',
'odometer': 55272,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 11,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a6b7695a-3dc3-56dd-a07d-29432fe9fa43/a6b7695a-3dc3-56dd-a07d-29432fe9fa43_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 48021,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YD64WJN/697180770/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a6b7695a-3dc3-56dd-a07d-29432fe9fa43/a6b7695a-3dc3-56dd-a07d-29432fe9fa43_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 46458,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YD64WJN/697180780/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a6b7695a-3dc3-56dd-a07d-29432fe9fa43/a6b7695a-3dc3-56dd-a07d-29432fe9fa43_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 44226,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YD64WJN/697180789/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a6b7695a-3dc3-56dd-a07d-29432fe9fa43/a6b7695a-3dc3-56dd-a07d-29432fe9fa43_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 44299,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YD64WJN/697180798/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a6b7695a-3dc3-56dd-a07d-29432fe9fa43/a6b7695a-3dc3-56dd-a07d-29432fe9fa43_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 44518,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YD64WJN/697180810/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a6b7695a-3dc3-56dd-a07d-29432fe9fa43/a6b7695a-3dc3-56dd-a07d-29432fe9fa43_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 43288,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YD64WJN/697180820/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a6b7695a-3dc3-56dd-a07d-29432fe9fa43/a6b7695a-3dc3-56dd-a07d-29432fe9fa43_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 83749,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YD64WJN/697180844/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a6b7695a-3dc3-56dd-a07d-29432fe9fa43/a6b7695a-3dc3-56dd-a07d-29432fe9fa43_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 56604,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YD64WJN/697180879/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a6b7695a-3dc3-56dd-a07d-29432fe9fa43/a6b7695a-3dc3-56dd-a07d-29432fe9fa43_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 71676,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YD64WJN/697180911/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a6b7695a-3dc3-56dd-a07d-29432fe9fa43/a6b7695a-3dc3-56dd-a07d-29432fe9fa43_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 70932,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YD64WJN/697180946/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2014-01-01',
'seller_name': None,
'title': 'HYUNDAI I10 1.2 SE Hatchback',
'transmission': 'automatic',
'trim': 'SE',
'vin': 'NLHA851CMFZ076775',
'year': 2014}
2026-03-28 14:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YD64%2520WJN%27 HTTP/1.1" 200 None
2026-03-28 14:06:20 [bca.uk] INFO: Saving data for YD64%20WJN: {'created_time': 1774706780.637865, 'last_price_update_time': 1774706780.637877, 'auction_closing_time': 1774778400.0}
2026-03-28 14:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='YD64%2520WJN') HTTP/1.1" 204 0
2026-03-28 14:06:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/ND19ZXL/42810628?sv=2020-08-04&st=2026-03-28T14%3A06%3A16Z&se=2026-03-28T14%3A31%3A16Z&sr=b&sp=r&sig=5xmogTYqVurr0j8AfDD7yhrKv%2BhU0%2BedAHaG0Z0v2KA%3D> (referer: https://www.bca.co.uk/)
2026-03-28 14:06:20 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LJ63JYB/699002911/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699002911>
2026-03-28 14:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698729627%27 HTTP/1.1" 200 None
2026-03-28 14:06:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698729627 not downloaded yet
2026-03-28 14:06:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KY19BNC/698717119/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/KY19BNC/42810053?sv=2020-08-04&st=2026-03-28T14%3A06%3A13Z&se=2026-03-28T14%3A31%3A13Z&sr=b&sp=r&sig=ETO0Mg2EeTSEbHBNVPQlrZ1HqsmXyfC8ciLzqOu06H4%3D)
2026-03-28 14:06:20 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LJ63JYB/699002917/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699002917>
2026-03-28 14:06:20 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KY19BNC/698717157/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698717157>
2026-03-28 14:06:20 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KY19BNC/698717137/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698717137>
2026-03-28 14:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699003016%27 HTTP/1.1" 200 None
2026-03-28 14:06:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699003016 not downloaded yet
2026-03-28 14:06:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KY19BNC/698717270/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/KY19BNC/42810053?sv=2020-08-04&st=2026-03-28T14%3A06%3A13Z&se=2026-03-28T14%3A31%3A13Z&sr=b&sp=r&sig=ETO0Mg2EeTSEbHBNVPQlrZ1HqsmXyfC8ciLzqOu06H4%3D)
2026-03-28 14:06:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KY19BNC/698717239/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/KY19BNC/42810053?sv=2020-08-04&st=2026-03-28T14%3A06%3A13Z&se=2026-03-28T14%3A31%3A13Z&sr=b&sp=r&sig=ETO0Mg2EeTSEbHBNVPQlrZ1HqsmXyfC8ciLzqOu06H4%3D)
2026-03-28 14:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698729645%27 HTTP/1.1" 200 None
2026-03-28 14:06:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698729645 not downloaded yet
2026-03-28 14:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698729669%27 HTTP/1.1" 200 None
2026-03-28 14:06:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698729669 not downloaded yet
2026-03-28 14:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698729690%27 HTTP/1.1" 200 None
2026-03-28 14:06:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698729690 not downloaded yet
2026-03-28 14:06:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LJ63JYB/699002846/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LJ63JYB/42809852?sv=2020-08-04&st=2026-03-28T14%3A06%3A15Z&se=2026-03-28T14%3A31%3A15Z&sr=b&sp=r&sig=3IID5C6KndPfmS4BXAKyAnPFDRKPXiE3OW%2FP%2FAoIOHg%3D)
2026-03-28 14:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698729700%27 HTTP/1.1" 200 None
2026-03-28 14:06:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698729700 not downloaded yet
2026-03-28 14:06:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KY19BNC/698717208/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/KY19BNC/42810053?sv=2020-08-04&st=2026-03-28T14%3A06%3A13Z&se=2026-03-28T14%3A31%3A13Z&sr=b&sp=r&sig=ETO0Mg2EeTSEbHBNVPQlrZ1HqsmXyfC8ciLzqOu06H4%3D)
2026-03-28 14:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698729717%27 HTTP/1.1" 200 None
2026-03-28 14:06:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698729717 not downloaded yet
2026-03-28 14:06:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KY19BNC/698717180/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/KY19BNC/42810053?sv=2020-08-04&st=2026-03-28T14%3A06%3A13Z&se=2026-03-28T14%3A31%3A13Z&sr=b&sp=r&sig=ETO0Mg2EeTSEbHBNVPQlrZ1HqsmXyfC8ciLzqOu06H4%3D)
2026-03-28 14:06:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LJ63JYB/699002878/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LJ63JYB/42809852?sv=2020-08-04&st=2026-03-28T14%3A06%3A15Z&se=2026-03-28T14%3A31%3A15Z&sr=b&sp=r&sig=3IID5C6KndPfmS4BXAKyAnPFDRKPXiE3OW%2FP%2FAoIOHg%3D)
2026-03-28 14:06:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LJ63JYB/699002911/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LJ63JYB/42809852?sv=2020-08-04&st=2026-03-28T14%3A06%3A15Z&se=2026-03-28T14%3A31%3A15Z&sr=b&sp=r&sig=3IID5C6KndPfmS4BXAKyAnPFDRKPXiE3OW%2FP%2FAoIOHg%3D)
2026-03-28 14:06:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:06:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2da1db90>
2026-03-28 14:06:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:06:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:06:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:06:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c9c54905-b471-54fb-b36b-18e3160cc696/c9c54905-b471-54fb-b36b-18e3160cc696_expert_report_file_60d399fe-5d4e-4bce-8e8f-399303337e0a.pdf HTTP/1.1" 201 0
2026-03-28 14:06:20 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item c9c54905-b471-54fb-b36b-18e3160cc696
2026-03-28 14:06:20 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: c9c54905-b471-54fb-b36b-18e3160cc696, skipping ID generation
2026-03-28 14:06:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item c9c54905-b471-54fb-b36b-18e3160cc696
2026-03-28 14:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DND19ZXL-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-28 14:06:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=ND19ZXL-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-28 14:06:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KY19BNC/698717291/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/KY19BNC/42810053?sv=2020-08-04&st=2026-03-28T14%3A06%3A13Z&se=2026-03-28T14%3A31%3A13Z&sr=b&sp=r&sig=ETO0Mg2EeTSEbHBNVPQlrZ1HqsmXyfC8ciLzqOu06H4%3D)
2026-03-28 14:06:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LJ63JYB/699002889/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LJ63JYB/42809852?sv=2020-08-04&st=2026-03-28T14%3A06%3A15Z&se=2026-03-28T14%3A31%3A15Z&sr=b&sp=r&sig=3IID5C6KndPfmS4BXAKyAnPFDRKPXiE3OW%2FP%2FAoIOHg%3D)
2026-03-28 14:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698729734%27 HTTP/1.1" 200 None
2026-03-28 14:06:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698729734 not downloaded yet
2026-03-28 14:06:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LJ63JYB/699002866/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LJ63JYB/42809852?sv=2020-08-04&st=2026-03-28T14%3A06%3A15Z&se=2026-03-28T14%3A31%3A15Z&sr=b&sp=r&sig=3IID5C6KndPfmS4BXAKyAnPFDRKPXiE3OW%2FP%2FAoIOHg%3D)
2026-03-28 14:06:20 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YR18ZWP/698729605/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=YR18ZWP-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-28 14:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698729615%27 HTTP/1.1" 200 None
2026-03-28 14:06:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698729615 not downloaded yet
2026-03-28 14:06:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:06:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c3d5890>
2026-03-28 14:06:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:06:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:06:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:06:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e70be94c-e868-51f1-a147-7ef5a60aac74/e70be94c-e868-51f1-a147-7ef5a60aac74_image_2.jpg HTTP/1.1" 201 0
2026-03-28 14:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FKY19BNC%252F698717119%252F600') HTTP/1.1" 204 0
2026-03-28 14:06:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KY19BNC/698717119/600 saved to cache
2026-03-28 14:06:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item e70be94c-e868-51f1-a147-7ef5a60aac74
2026-03-28 14:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698729750%27 HTTP/1.1" 200 None
2026-03-28 14:06:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698729750 not downloaded yet
2026-03-28 14:06:21 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LJ63JYB/699002984/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699002984>
2026-03-28 14:06:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LJ63JYB/699002917/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LJ63JYB/42809852?sv=2020-08-04&st=2026-03-28T14%3A06%3A15Z&se=2026-03-28T14%3A31%3A15Z&sr=b&sp=r&sig=3IID5C6KndPfmS4BXAKyAnPFDRKPXiE3OW%2FP%2FAoIOHg%3D)
2026-03-28 14:06:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KY19BNC/698717137/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/KY19BNC/42810053?sv=2020-08-04&st=2026-03-28T14%3A06%3A13Z&se=2026-03-28T14%3A31%3A13Z&sr=b&sp=r&sig=ETO0Mg2EeTSEbHBNVPQlrZ1HqsmXyfC8ciLzqOu06H4%3D)
2026-03-28 14:06:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KY19BNC/698717157/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/KY19BNC/42810053?sv=2020-08-04&st=2026-03-28T14%3A06%3A13Z&se=2026-03-28T14%3A31%3A13Z&sr=b&sp=r&sig=ETO0Mg2EeTSEbHBNVPQlrZ1HqsmXyfC8ciLzqOu06H4%3D)
2026-03-28 14:06:21 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LJ63JYB/699003016/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699003016>
2026-03-28 14:06:21 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YR18ZWP/698729627/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698729627>
2026-03-28 14:06:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698729629%27 HTTP/1.1" 200 None
2026-03-28 14:06:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698729629 not downloaded yet
2026-03-28 14:06:21 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:06:21 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:06:21 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:06:21 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:06:21 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:06:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:06:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c68d4d0>
2026-03-28 14:06:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:06:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:06:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:06:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e70be94c-e868-51f1-a147-7ef5a60aac74/e70be94c-e868-51f1-a147-7ef5a60aac74_image_8.jpg HTTP/1.1" 201 0
2026-03-28 14:06:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FKY19BNC%252F698717270%252F600') HTTP/1.1" 204 0
2026-03-28 14:06:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KY19BNC/698717270/600 saved to cache
2026-03-28 14:06:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item e70be94c-e868-51f1-a147-7ef5a60aac74
2026-03-28 14:06:21 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:06:21 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:06:21 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:06:21 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:06:21 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:06:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:06:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a1fd92710>
2026-03-28 14:06:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:06:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:06:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:06:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e70be94c-e868-51f1-a147-7ef5a60aac74/e70be94c-e868-51f1-a147-7ef5a60aac74_image_7.jpg HTTP/1.1" 201 0
2026-03-28 14:06:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FKY19BNC%252F698717239%252F600') HTTP/1.1" 204 0
2026-03-28 14:06:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KY19BNC/698717239/600 saved to cache
2026-03-28 14:06:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item e70be94c-e868-51f1-a147-7ef5a60aac74
2026-03-28 14:06:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:06:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c98ea10>
2026-03-28 14:06:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:06:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:06:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:06:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4870bb8b-60c3-52a3-9777-e0e27c2bb711/4870bb8b-60c3-52a3-9777-e0e27c2bb711_image_0.jpg HTTP/1.1" 201 0
2026-03-28 14:06:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLJ63JYB%252F699002846%252F600') HTTP/1.1" 204 0
2026-03-28 14:06:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LJ63JYB/699002846/600 saved to cache
2026-03-28 14:06:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 4870bb8b-60c3-52a3-9777-e0e27c2bb711
2026-03-28 14:06:21 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:06:21 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:06:21 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:06:21 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:06:21 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:06:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:06:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c98c710>
2026-03-28 14:06:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:06:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:06:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:06:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e70be94c-e868-51f1-a147-7ef5a60aac74/e70be94c-e868-51f1-a147-7ef5a60aac74_image_6.jpg HTTP/1.1" 201 0
2026-03-28 14:06:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FKY19BNC%252F698717208%252F600') HTTP/1.1" 204 0
2026-03-28 14:06:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KY19BNC/698717208/600 saved to cache
2026-03-28 14:06:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item e70be94c-e868-51f1-a147-7ef5a60aac74
2026-03-28 14:06:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698729771%27 HTTP/1.1" 200 None
2026-03-28 14:06:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698729771 not downloaded yet
2026-03-28 14:06:21 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YR18ZWP/698729690/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698729690>
2026-03-28 14:06:21 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YR18ZWP/698729700/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698729700>
2026-03-28 14:06:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698729647%27 HTTP/1.1" 200 None
2026-03-28 14:06:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698729647 not downloaded yet
2026-03-28 14:06:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:06:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a305cc590>
2026-03-28 14:06:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:06:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:06:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:06:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e70be94c-e868-51f1-a147-7ef5a60aac74/e70be94c-e868-51f1-a147-7ef5a60aac74_image_5.jpg HTTP/1.1" 201 0
2026-03-28 14:06:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FKY19BNC%252F698717180%252F600') HTTP/1.1" 204 0
2026-03-28 14:06:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KY19BNC/698717180/600 saved to cache
2026-03-28 14:06:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item e70be94c-e868-51f1-a147-7ef5a60aac74
2026-03-28 14:06:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:06:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2d83be90>
2026-03-28 14:06:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:06:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:06:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:06:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4870bb8b-60c3-52a3-9777-e0e27c2bb711/4870bb8b-60c3-52a3-9777-e0e27c2bb711_image_2.jpg HTTP/1.1" 201 0
2026-03-28 14:06:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLJ63JYB%252F699002878%252F600') HTTP/1.1" 204 0
2026-03-28 14:06:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LJ63JYB/699002878/600 saved to cache
2026-03-28 14:06:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 4870bb8b-60c3-52a3-9777-e0e27c2bb711
2026-03-28 14:06:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:06:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c9dd850>
2026-03-28 14:06:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:06:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:06:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:06:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4870bb8b-60c3-52a3-9777-e0e27c2bb711/4870bb8b-60c3-52a3-9777-e0e27c2bb711_image_4.jpg HTTP/1.1" 201 0
2026-03-28 14:06:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLJ63JYB%252F699002911%252F600') HTTP/1.1" 204 0
2026-03-28 14:06:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LJ63JYB/699002911/600 saved to cache
2026-03-28 14:06:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 4870bb8b-60c3-52a3-9777-e0e27c2bb711
2026-03-28 14:06:21 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:06:21 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:06:21 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:06:21 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:06:21 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:06:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:06:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c68fe10>
2026-03-28 14:06:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:06:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:06:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:06:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e70be94c-e868-51f1-a147-7ef5a60aac74/e70be94c-e868-51f1-a147-7ef5a60aac74_image_9.jpg HTTP/1.1" 201 0
2026-03-28 14:06:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FKY19BNC%252F698717291%252F600') HTTP/1.1" 204 0
2026-03-28 14:06:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KY19BNC/698717291/600 saved to cache
2026-03-28 14:06:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item e70be94c-e868-51f1-a147-7ef5a60aac74
2026-03-28 14:06:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:06:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2dd15510>
2026-03-28 14:06:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:06:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:06:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:06:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4870bb8b-60c3-52a3-9777-e0e27c2bb711/4870bb8b-60c3-52a3-9777-e0e27c2bb711_image_3.jpg HTTP/1.1" 201 0
2026-03-28 14:06:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLJ63JYB%252F699002889%252F600') HTTP/1.1" 204 0
2026-03-28 14:06:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LJ63JYB/699002889/600 saved to cache
2026-03-28 14:06:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 4870bb8b-60c3-52a3-9777-e0e27c2bb711
2026-03-28 14:06:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:06:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a1feeec10>
2026-03-28 14:06:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:06:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:06:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:06:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4870bb8b-60c3-52a3-9777-e0e27c2bb711/4870bb8b-60c3-52a3-9777-e0e27c2bb711_image_1.jpg HTTP/1.1" 201 0
2026-03-28 14:06:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLJ63JYB%252F699002866%252F600') HTTP/1.1" 204 0
2026-03-28 14:06:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LJ63JYB/699002866/600 saved to cache
2026-03-28 14:06:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 4870bb8b-60c3-52a3-9777-e0e27c2bb711
2026-03-28 14:06:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:06:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2de02810>
2026-03-28 14:06:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:06:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:06:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:06:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4870bb8b-60c3-52a3-9777-e0e27c2bb711/4870bb8b-60c3-52a3-9777-e0e27c2bb711_image_5.jpg HTTP/1.1" 201 0
2026-03-28 14:06:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLJ63JYB%252F699002917%252F600') HTTP/1.1" 204 0
2026-03-28 14:06:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LJ63JYB/699002917/600 saved to cache
2026-03-28 14:06:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 4870bb8b-60c3-52a3-9777-e0e27c2bb711
2026-03-28 14:06:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:06:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c93ee10>
2026-03-28 14:06:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:06:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:06:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:06:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e70be94c-e868-51f1-a147-7ef5a60aac74/e70be94c-e868-51f1-a147-7ef5a60aac74_image_3.jpg HTTP/1.1" 201 0
2026-03-28 14:06:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FKY19BNC%252F698717137%252F600') HTTP/1.1" 204 0
2026-03-28 14:06:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KY19BNC/698717137/600 saved to cache
2026-03-28 14:06:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item e70be94c-e868-51f1-a147-7ef5a60aac74
2026-03-28 14:06:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:06:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c8bb750>
2026-03-28 14:06:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:06:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:06:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:06:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e70be94c-e868-51f1-a147-7ef5a60aac74/e70be94c-e868-51f1-a147-7ef5a60aac74_image_4.jpg HTTP/1.1" 201 0
2026-03-28 14:06:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FKY19BNC%252F698717157%252F600') HTTP/1.1" 204 0
2026-03-28 14:06:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KY19BNC/698717157/600 saved to cache
2026-03-28 14:06:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item e70be94c-e868-51f1-a147-7ef5a60aac74
2026-03-28 14:06:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YR18ZWP/698729605/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YR18ZWP/42810578?sv=2020-08-04&st=2026-03-28T14%3A06%3A15Z&se=2026-03-28T14%3A31%3A15Z&sr=b&sp=r&sig=zCn1XD7WNrAfDR%2B4MyMSkib3CGWTWe4xFlsq2a%2BUqlo%3D)
2026-03-28 14:06:21 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YR18ZWP/698729645/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698729645>
2026-03-28 14:06:21 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YR18ZWP/698729669/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698729669>
2026-03-28 14:06:21 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YR18ZWP/698729717/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698729717>
2026-03-28 14:06:21 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LJ63JYB/699002962/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699002962>
2026-03-28 14:06:21 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LJ63JYB/699002941/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699002941>
2026-03-28 14:06:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698729663%27 HTTP/1.1" 200 None
2026-03-28 14:06:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698729663 not downloaded yet
2026-03-28 14:06:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698729684%27 HTTP/1.1" 200 None
2026-03-28 14:06:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698729684 not downloaded yet
2026-03-28 14:06:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698729710%27 HTTP/1.1" 200 None
2026-03-28 14:06:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698729710 not downloaded yet
2026-03-28 14:06:21 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/ND19ZXL/698729597/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=ND19ZXL-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-28 14:06:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698729729%27 HTTP/1.1" 200 None
2026-03-28 14:06:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698729729 not downloaded yet
2026-03-28 14:06:21 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KY19BNC/698717096/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698717096>
2026-03-28 14:06:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YR18ZWP/698729627/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YR18ZWP/42810578?sv=2020-08-04&st=2026-03-28T14%3A06%3A15Z&se=2026-03-28T14%3A31%3A15Z&sr=b&sp=r&sig=zCn1XD7WNrAfDR%2B4MyMSkib3CGWTWe4xFlsq2a%2BUqlo%3D)
2026-03-28 14:06:21 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/ND19ZXL/698729615/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698729615>
2026-03-28 14:06:21 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YR18ZWP/698729734/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698729734>
2026-03-28 14:06:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698729748%27 HTTP/1.1" 200 None
2026-03-28 14:06:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698729748 not downloaded yet
2026-03-28 14:06:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LJ63JYB/699002984/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LJ63JYB/42809852?sv=2020-08-04&st=2026-03-28T14%3A06%3A15Z&se=2026-03-28T14%3A31%3A15Z&sr=b&sp=r&sig=3IID5C6KndPfmS4BXAKyAnPFDRKPXiE3OW%2FP%2FAoIOHg%3D)
2026-03-28 14:06:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:06:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2dbe9b10>
2026-03-28 14:06:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:06:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:06:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:06:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b702a3ab-2b9c-56eb-8885-dba723a802f3/b702a3ab-2b9c-56eb-8885-dba723a802f3_image_0.jpg HTTP/1.1" 201 0
2026-03-28 14:06:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FYR18ZWP%252F698729605%252F600') HTTP/1.1" 204 0
2026-03-28 14:06:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YR18ZWP/698729605/600 saved to cache
2026-03-28 14:06:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item b702a3ab-2b9c-56eb-8885-dba723a802f3
2026-03-28 14:06:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LJ63JYB/699003016/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LJ63JYB/42809852?sv=2020-08-04&st=2026-03-28T14%3A06%3A15Z&se=2026-03-28T14%3A31%3A15Z&sr=b&sp=r&sig=3IID5C6KndPfmS4BXAKyAnPFDRKPXiE3OW%2FP%2FAoIOHg%3D)
2026-03-28 14:06:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698729768%27 HTTP/1.1" 200 None
2026-03-28 14:06:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698729768 not downloaded yet
2026-03-28 14:06:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YR18ZWP/698729700/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YR18ZWP/42810578?sv=2020-08-04&st=2026-03-28T14%3A06%3A15Z&se=2026-03-28T14%3A31%3A15Z&sr=b&sp=r&sig=zCn1XD7WNrAfDR%2B4MyMSkib3CGWTWe4xFlsq2a%2BUqlo%3D)
2026-03-28 14:06:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:06:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c8b0390>
2026-03-28 14:06:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:06:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:06:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:06:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b702a3ab-2b9c-56eb-8885-dba723a802f3/b702a3ab-2b9c-56eb-8885-dba723a802f3_image_1.jpg HTTP/1.1" 201 0
2026-03-28 14:06:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FYR18ZWP%252F698729627%252F600') HTTP/1.1" 204 0
2026-03-28 14:06:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YR18ZWP/698729627/600 saved to cache
2026-03-28 14:06:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item b702a3ab-2b9c-56eb-8885-dba723a802f3
2026-03-28 14:06:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YR18ZWP/698729690/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YR18ZWP/42810578?sv=2020-08-04&st=2026-03-28T14%3A06%3A15Z&se=2026-03-28T14%3A31%3A15Z&sr=b&sp=r&sig=zCn1XD7WNrAfDR%2B4MyMSkib3CGWTWe4xFlsq2a%2BUqlo%3D)
2026-03-28 14:06:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YR18ZWP/698729645/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YR18ZWP/42810578?sv=2020-08-04&st=2026-03-28T14%3A06%3A15Z&se=2026-03-28T14%3A31%3A15Z&sr=b&sp=r&sig=zCn1XD7WNrAfDR%2B4MyMSkib3CGWTWe4xFlsq2a%2BUqlo%3D)
2026-03-28 14:06:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YR18ZWP/698729669/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YR18ZWP/42810578?sv=2020-08-04&st=2026-03-28T14%3A06%3A15Z&se=2026-03-28T14%3A31%3A15Z&sr=b&sp=r&sig=zCn1XD7WNrAfDR%2B4MyMSkib3CGWTWe4xFlsq2a%2BUqlo%3D)
2026-03-28 14:06:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/ND19ZXL/698729597/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/ND19ZXL/42810628?sv=2020-08-04&st=2026-03-28T14%3A06%3A16Z&se=2026-03-28T14%3A31%3A16Z&sr=b&sp=r&sig=5xmogTYqVurr0j8AfDD7yhrKv%2BhU0%2BedAHaG0Z0v2KA%3D)
2026-03-28 14:06:22 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:06:22 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:06:22 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:06:22 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:06:22 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:06:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:06:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c533cd0>
2026-03-28 14:06:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:06:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:06:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:06:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4870bb8b-60c3-52a3-9777-e0e27c2bb711/4870bb8b-60c3-52a3-9777-e0e27c2bb711_image_8.jpg HTTP/1.1" 201 0
2026-03-28 14:06:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLJ63JYB%252F699002984%252F600') HTTP/1.1" 204 0
2026-03-28 14:06:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LJ63JYB/699002984/600 saved to cache
2026-03-28 14:06:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 4870bb8b-60c3-52a3-9777-e0e27c2bb711
2026-03-28 14:06:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LJ63JYB/699002962/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LJ63JYB/42809852?sv=2020-08-04&st=2026-03-28T14%3A06%3A15Z&se=2026-03-28T14%3A31%3A15Z&sr=b&sp=r&sig=3IID5C6KndPfmS4BXAKyAnPFDRKPXiE3OW%2FP%2FAoIOHg%3D)
2026-03-28 14:06:22 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/ND19ZXL/698729647/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698729647>
2026-03-28 14:06:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YR18ZWP/698729717/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YR18ZWP/42810578?sv=2020-08-04&st=2026-03-28T14%3A06%3A15Z&se=2026-03-28T14%3A31%3A15Z&sr=b&sp=r&sig=zCn1XD7WNrAfDR%2B4MyMSkib3CGWTWe4xFlsq2a%2BUqlo%3D)
2026-03-28 14:06:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LJ63JYB/699002941/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LJ63JYB/42809852?sv=2020-08-04&st=2026-03-28T14%3A06%3A15Z&se=2026-03-28T14%3A31%3A15Z&sr=b&sp=r&sig=3IID5C6KndPfmS4BXAKyAnPFDRKPXiE3OW%2FP%2FAoIOHg%3D)
2026-03-28 14:06:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/ND19ZXL/698729615/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/ND19ZXL/42810628?sv=2020-08-04&st=2026-03-28T14%3A06%3A16Z&se=2026-03-28T14%3A31%3A16Z&sr=b&sp=r&sig=5xmogTYqVurr0j8AfDD7yhrKv%2BhU0%2BedAHaG0Z0v2KA%3D)
2026-03-28 14:06:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YR18ZWP/698729734/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YR18ZWP/42810578?sv=2020-08-04&st=2026-03-28T14%3A06%3A15Z&se=2026-03-28T14%3A31%3A15Z&sr=b&sp=r&sig=zCn1XD7WNrAfDR%2B4MyMSkib3CGWTWe4xFlsq2a%2BUqlo%3D)
2026-03-28 14:06:22 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:06:22 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:06:22 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:06:22 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:06:22 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:06:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:06:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a1fed1e90>
2026-03-28 14:06:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:06:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:06:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:06:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4870bb8b-60c3-52a3-9777-e0e27c2bb711/4870bb8b-60c3-52a3-9777-e0e27c2bb711_image_9.jpg HTTP/1.1" 201 0
2026-03-28 14:06:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLJ63JYB%252F699003016%252F600') HTTP/1.1" 204 0
2026-03-28 14:06:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LJ63JYB/699003016/600 saved to cache
2026-03-28 14:06:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 4870bb8b-60c3-52a3-9777-e0e27c2bb711
2026-03-28 14:06:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:06:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2d8f1b10>
2026-03-28 14:06:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:06:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:06:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:06:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b702a3ab-2b9c-56eb-8885-dba723a802f3/b702a3ab-2b9c-56eb-8885-dba723a802f3_image_5.jpg HTTP/1.1" 201 0
2026-03-28 14:06:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FYR18ZWP%252F698729700%252F600') HTTP/1.1" 204 0
2026-03-28 14:06:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YR18ZWP/698729700/600 saved to cache
2026-03-28 14:06:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item b702a3ab-2b9c-56eb-8885-dba723a802f3
2026-03-28 14:06:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:06:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2ca5bed0>
2026-03-28 14:06:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:06:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:06:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:06:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b702a3ab-2b9c-56eb-8885-dba723a802f3/b702a3ab-2b9c-56eb-8885-dba723a802f3_image_4.jpg HTTP/1.1" 201 0
2026-03-28 14:06:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FYR18ZWP%252F698729690%252F600') HTTP/1.1" 204 0
2026-03-28 14:06:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YR18ZWP/698729690/600 saved to cache
2026-03-28 14:06:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item b702a3ab-2b9c-56eb-8885-dba723a802f3
2026-03-28 14:06:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:06:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2d7aa2d0>
2026-03-28 14:06:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:06:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:06:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:06:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b702a3ab-2b9c-56eb-8885-dba723a802f3/b702a3ab-2b9c-56eb-8885-dba723a802f3_image_2.jpg HTTP/1.1" 201 0
2026-03-28 14:06:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FYR18ZWP%252F698729645%252F600') HTTP/1.1" 204 0
2026-03-28 14:06:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YR18ZWP/698729645/600 saved to cache
2026-03-28 14:06:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item b702a3ab-2b9c-56eb-8885-dba723a802f3
2026-03-28 14:06:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:06:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c9b8110>
2026-03-28 14:06:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:06:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:06:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:06:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b702a3ab-2b9c-56eb-8885-dba723a802f3/b702a3ab-2b9c-56eb-8885-dba723a802f3_image_3.jpg HTTP/1.1" 201 0
2026-03-28 14:06:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FYR18ZWP%252F698729669%252F600') HTTP/1.1" 204 0
2026-03-28 14:06:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YR18ZWP/698729669/600 saved to cache
2026-03-28 14:06:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item b702a3ab-2b9c-56eb-8885-dba723a802f3
2026-03-28 14:06:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:06:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2dbc0c10>
2026-03-28 14:06:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:06:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:06:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:06:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c9c54905-b471-54fb-b36b-18e3160cc696/c9c54905-b471-54fb-b36b-18e3160cc696_image_0.jpg HTTP/1.1" 201 0
2026-03-28 14:06:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FND19ZXL%252F698729597%252F600') HTTP/1.1" 204 0
2026-03-28 14:06:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/ND19ZXL/698729597/600 saved to cache
2026-03-28 14:06:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item c9c54905-b471-54fb-b36b-18e3160cc696
2026-03-28 14:06:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KY19BNC/698717096/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/KY19BNC/42810053?sv=2020-08-04&st=2026-03-28T14%3A06%3A13Z&se=2026-03-28T14%3A31%3A13Z&sr=b&sp=r&sig=ETO0Mg2EeTSEbHBNVPQlrZ1HqsmXyfC8ciLzqOu06H4%3D)
2026-03-28 14:06:22 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/ND19ZXL/698729729/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698729729>
2026-03-28 14:06:22 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:06:22 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:06:22 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:06:22 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:06:22 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:06:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:06:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c938d50>
2026-03-28 14:06:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:06:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:06:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:06:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4870bb8b-60c3-52a3-9777-e0e27c2bb711/4870bb8b-60c3-52a3-9777-e0e27c2bb711_image_7.jpg HTTP/1.1" 201 0
2026-03-28 14:06:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLJ63JYB%252F699002962%252F600') HTTP/1.1" 204 0
2026-03-28 14:06:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LJ63JYB/699002962/600 saved to cache
2026-03-28 14:06:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 4870bb8b-60c3-52a3-9777-e0e27c2bb711
2026-03-28 14:06:22 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:06:22 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:06:22 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:06:22 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:06:22 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:06:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:06:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c9fc150>
2026-03-28 14:06:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:06:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:06:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:06:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b702a3ab-2b9c-56eb-8885-dba723a802f3/b702a3ab-2b9c-56eb-8885-dba723a802f3_image_6.jpg HTTP/1.1" 201 0
2026-03-28 14:06:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FYR18ZWP%252F698729717%252F600') HTTP/1.1" 204 0
2026-03-28 14:06:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YR18ZWP/698729717/600 saved to cache
2026-03-28 14:06:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item b702a3ab-2b9c-56eb-8885-dba723a802f3
2026-03-28 14:06:22 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:06:22 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:06:22 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:06:22 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:06:22 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:06:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:06:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c100510>
2026-03-28 14:06:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:06:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:06:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:06:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4870bb8b-60c3-52a3-9777-e0e27c2bb711/4870bb8b-60c3-52a3-9777-e0e27c2bb711_image_6.jpg HTTP/1.1" 201 0
2026-03-28 14:06:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLJ63JYB%252F699002941%252F600') HTTP/1.1" 204 0
2026-03-28 14:06:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LJ63JYB/699002941/600 saved to cache
2026-03-28 14:06:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 4870bb8b-60c3-52a3-9777-e0e27c2bb711
2026-03-28 14:06:22 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 4870bb8b-60c3-52a3-9777-e0e27c2bb711, skipping ID generation
2026-03-28 14:06:22 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 4870bb8b-60c3-52a3-9777-e0e27c2bb711 sending to next pipeline
2026-03-28 14:06:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 4870bb8b-60c3-52a3-9777-e0e27c2bb711, identifier: LJ63%20JYB
2026-03-28 14:06:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:06:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c9d7c50>
2026-03-28 14:06:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:06:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:06:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:06:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c9c54905-b471-54fb-b36b-18e3160cc696/c9c54905-b471-54fb-b36b-18e3160cc696_image_1.jpg HTTP/1.1" 201 0
2026-03-28 14:06:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FND19ZXL%252F698729615%252F600') HTTP/1.1" 204 0
2026-03-28 14:06:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/ND19ZXL/698729615/600 saved to cache
2026-03-28 14:06:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item c9c54905-b471-54fb-b36b-18e3160cc696
2026-03-28 14:06:22 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:06:22 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:06:22 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:06:22 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:06:22 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:06:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:06:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c704a50>
2026-03-28 14:06:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:06:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:06:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:06:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b702a3ab-2b9c-56eb-8885-dba723a802f3/b702a3ab-2b9c-56eb-8885-dba723a802f3_image_7.jpg HTTP/1.1" 201 0
2026-03-28 14:06:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FYR18ZWP%252F698729734%252F600') HTTP/1.1" 204 0
2026-03-28 14:06:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YR18ZWP/698729734/600 saved to cache
2026-03-28 14:06:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item b702a3ab-2b9c-56eb-8885-dba723a802f3
2026-03-28 14:06:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 4870bb8b-60c3-52a3-9777-e0e27c2bb711 with identifier: LJ63%20JYB
2026-03-28 14:06:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 4870bb8b-60c3-52a3-9777-e0e27c2bb711 with identifier: LJ63%20JYB
2026-03-28 14:06:22 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 4870bb8b-60c3-52a3-9777-e0e27c2bb711 with identifier: LJ63%20JYB to the API
2026-03-28 14:06:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:06:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:06:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LJ63JYB/699002941/600>
{'auction_title': '',
'c_o_2_emission_value': 135,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4870bb8b-60c3-52a3-9777-e0e27c2bb711/4870bb8b-60c3-52a3-9777-e0e27c2bb711_expert_report_file_629e875a-3639-4579-9a53-f8f2b706dd5c.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=LJ63%20JYB-GB',
'category': 'Car',
'color': 'white',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.6L',
'expiration_date': '2026-03-29T10:00:00Z',
'fuel_type': 'Petrol',
'id': '4870bb8b-60c3-52a3-9777-e0e27c2bb711',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'LJ63 JYB',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=LJ63%20JYB&vehicleType=*',
'listing': 'auction',
'location': 'Bedford',
'make': 'PEUGEOT',
'model': '2008',
'odometer': 62079,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 13,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4870bb8b-60c3-52a3-9777-e0e27c2bb711/4870bb8b-60c3-52a3-9777-e0e27c2bb711_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 41691,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LJ63JYB/699002846/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4870bb8b-60c3-52a3-9777-e0e27c2bb711/4870bb8b-60c3-52a3-9777-e0e27c2bb711_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 40632,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LJ63JYB/699002866/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4870bb8b-60c3-52a3-9777-e0e27c2bb711/4870bb8b-60c3-52a3-9777-e0e27c2bb711_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 39370,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LJ63JYB/699002878/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4870bb8b-60c3-52a3-9777-e0e27c2bb711/4870bb8b-60c3-52a3-9777-e0e27c2bb711_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 36760,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LJ63JYB/699002889/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4870bb8b-60c3-52a3-9777-e0e27c2bb711/4870bb8b-60c3-52a3-9777-e0e27c2bb711_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 37092,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LJ63JYB/699002911/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4870bb8b-60c3-52a3-9777-e0e27c2bb711/4870bb8b-60c3-52a3-9777-e0e27c2bb711_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 37707,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LJ63JYB/699002917/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4870bb8b-60c3-52a3-9777-e0e27c2bb711/4870bb8b-60c3-52a3-9777-e0e27c2bb711_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 60745,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LJ63JYB/699002941/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4870bb8b-60c3-52a3-9777-e0e27c2bb711/4870bb8b-60c3-52a3-9777-e0e27c2bb711_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 59757,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LJ63JYB/699002962/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4870bb8b-60c3-52a3-9777-e0e27c2bb711/4870bb8b-60c3-52a3-9777-e0e27c2bb711_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 87021,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LJ63JYB/699002984/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4870bb8b-60c3-52a3-9777-e0e27c2bb711/4870bb8b-60c3-52a3-9777-e0e27c2bb711_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 68629,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LJ63JYB/699003016/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2013-01-01',
'seller_name': None,
'title': 'PEUGEOT 2008 1.6 VTI ALLURE MPV',
'transmission': 'manual',
'trim': 'VTI ALLURE',
'vin': 'VF3CU5FS0DY062695',
'year': 2013}
2026-03-28 14:06:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LJ63%2520JYB%27 HTTP/1.1" 200 None
2026-03-28 14:06:23 [bca.uk] INFO: Saving data for LJ63%20JYB: {'created_time': 1774706783.942076, 'last_price_update_time': 1774706783.942089, 'auction_closing_time': 1774778400.0}
2026-03-28 14:06:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='LJ63%2520JYB') HTTP/1.1" 204 0
2026-03-28 14:06:23 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/ND19ZXL/698729684/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698729684>
2026-03-28 14:06:23 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/ND19ZXL/698729663/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698729663>
2026-03-28 14:06:23 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/ND19ZXL/698729748/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698729748>
2026-03-28 14:06:23 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/ND19ZXL/698729710/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698729710>
2026-03-28 14:06:23 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YR18ZWP/698729771/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698729771>
2026-03-28 14:06:23 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/ND19ZXL/698729768/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698729768>
2026-03-28 14:06:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/ND19ZXL/698729647/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/ND19ZXL/42810628?sv=2020-08-04&st=2026-03-28T14%3A06%3A16Z&se=2026-03-28T14%3A31%3A16Z&sr=b&sp=r&sig=5xmogTYqVurr0j8AfDD7yhrKv%2BhU0%2BedAHaG0Z0v2KA%3D)
2026-03-28 14:06:23 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/ND19ZXL/698729629/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698729629>
2026-03-28 14:06:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:06:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c680b10>
2026-03-28 14:06:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:06:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:06:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:06:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e70be94c-e868-51f1-a147-7ef5a60aac74/e70be94c-e868-51f1-a147-7ef5a60aac74_image_1.jpg HTTP/1.1" 201 0
2026-03-28 14:06:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FKY19BNC%252F698717096%252F600') HTTP/1.1" 204 0
2026-03-28 14:06:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KY19BNC/698717096/600 saved to cache
2026-03-28 14:06:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item e70be94c-e868-51f1-a147-7ef5a60aac74
2026-03-28 14:06:24 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LD11FZB/698929129/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698929129>
2026-03-28 14:06:24 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YR18ZWP/698729750/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698729750>
2026-03-28 14:06:24 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YB57FZC/42780945?sv=2020-08-04&st=2026-03-28T14%3A06%3A24Z&se=2026-03-28T14%3A31%3A24Z&sr=b&sp=r&sig=kASeFsaHouQL63iaTeQp41zLaxTJgFeMsVL%2BJCZ14I4%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=YB57%20FZC-GB>
2026-03-28 14:06:24 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/RV60TZO/42810285?sv=2020-08-04&st=2026-03-28T14%3A06%3A24Z&se=2026-03-28T14%3A31%3A24Z&sr=b&sp=r&sig=0wfV7eTXgj18RoXJ9dVJaCh0eej2XdKr%2F9zBrTgYLZs%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=RV60%20TZO-GB>
2026-03-28 14:06:24 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KY19BNC/698717088/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=KY19BNC-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-28 14:06:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:06:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a1ff52350>
2026-03-28 14:06:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:06:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:06:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:06:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c9c54905-b471-54fb-b36b-18e3160cc696/c9c54905-b471-54fb-b36b-18e3160cc696_image_3.jpg HTTP/1.1" 201 0
2026-03-28 14:06:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FND19ZXL%252F698729647%252F600') HTTP/1.1" 204 0
2026-03-28 14:06:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/ND19ZXL/698729647/600 saved to cache
2026-03-28 14:06:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item c9c54905-b471-54fb-b36b-18e3160cc696
2026-03-28 14:06:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/ND19ZXL/698729729/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/ND19ZXL/42810628?sv=2020-08-04&st=2026-03-28T14%3A06%3A16Z&se=2026-03-28T14%3A31%3A16Z&sr=b&sp=r&sig=5xmogTYqVurr0j8AfDD7yhrKv%2BhU0%2BedAHaG0Z0v2KA%3D)
2026-03-28 14:06:24 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/GK66WPY/42809827?sv=2020-08-04&st=2026-03-28T14%3A06%3A24Z&se=2026-03-28T14%3A31%3A24Z&sr=b&sp=r&sig=o38p1n2nvobOwynrpVnEPlBMUIA211EoJMva9vtfiY0%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=GK66%20WPY-GB>
2026-03-28 14:06:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/ND19ZXL/698729748/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/ND19ZXL/42810628?sv=2020-08-04&st=2026-03-28T14%3A06%3A16Z&se=2026-03-28T14%3A31%3A16Z&sr=b&sp=r&sig=5xmogTYqVurr0j8AfDD7yhrKv%2BhU0%2BedAHaG0Z0v2KA%3D)
2026-03-28 14:06:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/ND19ZXL/698729710/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/ND19ZXL/42810628?sv=2020-08-04&st=2026-03-28T14%3A06%3A16Z&se=2026-03-28T14%3A31%3A16Z&sr=b&sp=r&sig=5xmogTYqVurr0j8AfDD7yhrKv%2BhU0%2BedAHaG0Z0v2KA%3D)
2026-03-28 14:06:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/ND19ZXL/698729663/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/ND19ZXL/42810628?sv=2020-08-04&st=2026-03-28T14%3A06%3A16Z&se=2026-03-28T14%3A31%3A16Z&sr=b&sp=r&sig=5xmogTYqVurr0j8AfDD7yhrKv%2BhU0%2BedAHaG0Z0v2KA%3D)
2026-03-28 14:06:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/ND19ZXL/698729684/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/ND19ZXL/42810628?sv=2020-08-04&st=2026-03-28T14%3A06%3A16Z&se=2026-03-28T14%3A31%3A16Z&sr=b&sp=r&sig=5xmogTYqVurr0j8AfDD7yhrKv%2BhU0%2BedAHaG0Z0v2KA%3D)
2026-03-28 14:06:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/ND19ZXL/698729768/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/ND19ZXL/42810628?sv=2020-08-04&st=2026-03-28T14%3A06%3A16Z&se=2026-03-28T14%3A31%3A16Z&sr=b&sp=r&sig=5xmogTYqVurr0j8AfDD7yhrKv%2BhU0%2BedAHaG0Z0v2KA%3D)
2026-03-28 14:06:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LD11FZB/698929129/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LD11FZB/42809686?sv=2020-08-04&st=2026-03-28T14%3A03%3A58Z&se=2026-03-28T14%3A28%3A58Z&sr=b&sp=r&sig=%2FK4BAlVG%2BClj51VCbQA3WyKfnHgVC%2B3mVHIA2lg6Jqc%3D)
2026-03-28 14:06:24 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/GL11XOW/42810476?sv=2020-08-04&st=2026-03-28T14%3A06%3A24Z&se=2026-03-28T14%3A31%3A24Z&sr=b&sp=r&sig=Z2KlPx5wKthhayrUXNoIRMZ89bgZHolJc7BL3Q6T4LE%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=GL11%20XOW-GB>
2026-03-28 14:06:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/ND19ZXL/698729629/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/ND19ZXL/42810628?sv=2020-08-04&st=2026-03-28T14%3A06%3A16Z&se=2026-03-28T14%3A31%3A16Z&sr=b&sp=r&sig=5xmogTYqVurr0j8AfDD7yhrKv%2BhU0%2BedAHaG0Z0v2KA%3D)
2026-03-28 14:06:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KY19BNC/698717088/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/KY19BNC/42810053?sv=2020-08-04&st=2026-03-28T14%3A06%3A13Z&se=2026-03-28T14%3A31%3A13Z&sr=b&sp=r&sig=ETO0Mg2EeTSEbHBNVPQlrZ1HqsmXyfC8ciLzqOu06H4%3D)
2026-03-28 14:06:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YR18ZWP/698729750/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YR18ZWP/42810578?sv=2020-08-04&st=2026-03-28T14%3A06%3A15Z&se=2026-03-28T14%3A31%3A15Z&sr=b&sp=r&sig=zCn1XD7WNrAfDR%2B4MyMSkib3CGWTWe4xFlsq2a%2BUqlo%3D)
2026-03-28 14:06:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YR18ZWP/698729771/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YR18ZWP/42810578?sv=2020-08-04&st=2026-03-28T14%3A06%3A15Z&se=2026-03-28T14%3A31%3A15Z&sr=b&sp=r&sig=zCn1XD7WNrAfDR%2B4MyMSkib3CGWTWe4xFlsq2a%2BUqlo%3D)
2026-03-28 14:06:24 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:06:24 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:06:24 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:06:24 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:06:24 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:06:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:06:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a1fe35b10>
2026-03-28 14:06:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:06:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:06:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:06:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c9c54905-b471-54fb-b36b-18e3160cc696/c9c54905-b471-54fb-b36b-18e3160cc696_image_7.jpg HTTP/1.1" 201 0
2026-03-28 14:06:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FND19ZXL%252F698729729%252F600') HTTP/1.1" 204 0
2026-03-28 14:06:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/ND19ZXL/698729729/600 saved to cache
2026-03-28 14:06:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item c9c54905-b471-54fb-b36b-18e3160cc696
2026-03-28 14:06:24 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/AJ17HXL/42798748?sv=2020-08-04&st=2026-03-28T14%3A06%3A24Z&se=2026-03-28T14%3A31%3A24Z&sr=b&sp=r&sig=s%2FenQJFKWZab81RCtX8FxHWN1BS3QTqj1oqoO1gcyoI%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=AJ17%20HXL-GB>
2026-03-28 14:06:24 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MV57UOY/698798330/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698798330>
2026-03-28 14:06:24 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LD11FZB/698929094/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698929094>
2026-03-28 14:06:24 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/BN10FFD/42810471?sv=2020-08-04&st=2026-03-28T14%3A06%3A24Z&se=2026-03-28T14%3A31%3A24Z&sr=b&sp=r&sig=YRKnec8Y1hjSrUO4yfYPgpbhzRG9GcT5SYUolkFsGgY%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=BN10%20FFD-GB>
2026-03-28 14:06:24 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LD11FZB/698929069/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=LD11FZB-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-28 14:06:24 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:06:24 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:06:24 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:06:24 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:06:24 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:06:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:06:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2ca73290>
2026-03-28 14:06:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:06:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:06:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:06:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c9c54905-b471-54fb-b36b-18e3160cc696/c9c54905-b471-54fb-b36b-18e3160cc696_image_8.jpg HTTP/1.1" 201 0
2026-03-28 14:06:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FND19ZXL%252F698729748%252F600') HTTP/1.1" 204 0
2026-03-28 14:06:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/ND19ZXL/698729748/600 saved to cache
2026-03-28 14:06:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item c9c54905-b471-54fb-b36b-18e3160cc696
2026-03-28 14:06:24 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:06:24 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:06:24 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:06:24 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:06:24 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:06:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:06:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c9b7050>
2026-03-28 14:06:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:06:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:06:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:06:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c9c54905-b471-54fb-b36b-18e3160cc696/c9c54905-b471-54fb-b36b-18e3160cc696_image_6.jpg HTTP/1.1" 201 0
2026-03-28 14:06:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FND19ZXL%252F698729710%252F600') HTTP/1.1" 204 0
2026-03-28 14:06:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/ND19ZXL/698729710/600 saved to cache
2026-03-28 14:06:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item c9c54905-b471-54fb-b36b-18e3160cc696
2026-03-28 14:06:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:06:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c8a1bd0>
2026-03-28 14:06:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:06:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:06:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:06:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c9c54905-b471-54fb-b36b-18e3160cc696/c9c54905-b471-54fb-b36b-18e3160cc696_image_4.jpg HTTP/1.1" 201 0
2026-03-28 14:06:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FND19ZXL%252F698729663%252F600') HTTP/1.1" 204 0
2026-03-28 14:06:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/ND19ZXL/698729663/600 saved to cache
2026-03-28 14:06:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item c9c54905-b471-54fb-b36b-18e3160cc696
2026-03-28 14:06:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:06:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c102f90>
2026-03-28 14:06:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:06:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:06:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:06:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c9c54905-b471-54fb-b36b-18e3160cc696/c9c54905-b471-54fb-b36b-18e3160cc696_image_5.jpg HTTP/1.1" 201 0
2026-03-28 14:06:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FND19ZXL%252F698729684%252F600') HTTP/1.1" 204 0
2026-03-28 14:06:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/ND19ZXL/698729684/600 saved to cache
2026-03-28 14:06:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item c9c54905-b471-54fb-b36b-18e3160cc696
2026-03-28 14:06:24 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:06:24 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:06:24 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:06:24 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:06:24 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:06:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:06:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2dd35610>
2026-03-28 14:06:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:06:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:06:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:06:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c9c54905-b471-54fb-b36b-18e3160cc696/c9c54905-b471-54fb-b36b-18e3160cc696_image_9.jpg HTTP/1.1" 201 0
2026-03-28 14:06:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FND19ZXL%252F698729768%252F600') HTTP/1.1" 204 0
2026-03-28 14:06:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/ND19ZXL/698729768/600 saved to cache
2026-03-28 14:06:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item c9c54905-b471-54fb-b36b-18e3160cc696
2026-03-28 14:06:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YB57FZC/42780945?sv=2020-08-04&st=2026-03-28T14%3A06%3A24Z&se=2026-03-28T14%3A31%3A24Z&sr=b&sp=r&sig=kASeFsaHouQL63iaTeQp41zLaxTJgFeMsVL%2BJCZ14I4%3D> (referer: https://www.bca.co.uk/)
2026-03-28 14:06:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/GK66WPY/42809827?sv=2020-08-04&st=2026-03-28T14%3A06%3A24Z&se=2026-03-28T14%3A31%3A24Z&sr=b&sp=r&sig=o38p1n2nvobOwynrpVnEPlBMUIA211EoJMva9vtfiY0%3D> (referer: https://www.bca.co.uk/)
2026-03-28 14:06:24 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YG70CMV/697550745/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=697550745>
2026-03-28 14:06:24 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MV57UOY/698798308/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698798308>
2026-03-28 14:06:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:06:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2dcd5c90>
2026-03-28 14:06:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:06:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:06:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:06:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fadd6eea-e2b0-5574-affe-cdf6b892b445/fadd6eea-e2b0-5574-affe-cdf6b892b445_image_3.jpg HTTP/1.1" 201 0
2026-03-28 14:06:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLD11FZB%252F698929129%252F600') HTTP/1.1" 204 0
2026-03-28 14:06:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LD11FZB/698929129/600 saved to cache
2026-03-28 14:06:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item fadd6eea-e2b0-5574-affe-cdf6b892b445
2026-03-28 14:06:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:06:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2dcc9110>
2026-03-28 14:06:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:06:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:06:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:06:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c9c54905-b471-54fb-b36b-18e3160cc696/c9c54905-b471-54fb-b36b-18e3160cc696_image_2.jpg HTTP/1.1" 201 0
2026-03-28 14:06:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FND19ZXL%252F698729629%252F600') HTTP/1.1" 204 0
2026-03-28 14:06:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/ND19ZXL/698729629/600 saved to cache
2026-03-28 14:06:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item c9c54905-b471-54fb-b36b-18e3160cc696
2026-03-28 14:06:24 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: c9c54905-b471-54fb-b36b-18e3160cc696, skipping ID generation
2026-03-28 14:06:24 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item c9c54905-b471-54fb-b36b-18e3160cc696 sending to next pipeline
2026-03-28 14:06:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: c9c54905-b471-54fb-b36b-18e3160cc696, identifier: ND19%20ZXL
2026-03-28 14:06:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:06:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2eb12110>
2026-03-28 14:06:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:06:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:06:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:06:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e70be94c-e868-51f1-a147-7ef5a60aac74/e70be94c-e868-51f1-a147-7ef5a60aac74_image_0.jpg HTTP/1.1" 201 0
2026-03-28 14:06:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FKY19BNC%252F698717088%252F600') HTTP/1.1" 204 0
2026-03-28 14:06:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KY19BNC/698717088/600 saved to cache
2026-03-28 14:06:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item e70be94c-e868-51f1-a147-7ef5a60aac74
2026-03-28 14:06:24 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: e70be94c-e868-51f1-a147-7ef5a60aac74, skipping ID generation
2026-03-28 14:06:24 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item e70be94c-e868-51f1-a147-7ef5a60aac74 sending to next pipeline
2026-03-28 14:06:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: e70be94c-e868-51f1-a147-7ef5a60aac74, identifier: KY19%20BNC
2026-03-28 14:06:24 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:06:24 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:06:24 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:06:24 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:06:24 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:06:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:06:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a1ff53e10>
2026-03-28 14:06:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:06:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:06:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:06:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b702a3ab-2b9c-56eb-8885-dba723a802f3/b702a3ab-2b9c-56eb-8885-dba723a802f3_image_8.jpg HTTP/1.1" 201 0
2026-03-28 14:06:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FYR18ZWP%252F698729750%252F600') HTTP/1.1" 204 0
2026-03-28 14:06:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YR18ZWP/698729750/600 saved to cache
2026-03-28 14:06:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item b702a3ab-2b9c-56eb-8885-dba723a802f3
2026-03-28 14:06:24 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:06:24 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:06:24 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:06:24 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:06:24 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:06:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:06:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c100b50>
2026-03-28 14:06:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:06:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:06:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:06:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b702a3ab-2b9c-56eb-8885-dba723a802f3/b702a3ab-2b9c-56eb-8885-dba723a802f3_image_9.jpg HTTP/1.1" 201 0
2026-03-28 14:06:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FYR18ZWP%252F698729771%252F600') HTTP/1.1" 204 0
2026-03-28 14:06:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YR18ZWP/698729771/600 saved to cache
2026-03-28 14:06:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item b702a3ab-2b9c-56eb-8885-dba723a802f3
2026-03-28 14:06:25 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: b702a3ab-2b9c-56eb-8885-dba723a802f3, skipping ID generation
2026-03-28 14:06:25 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item b702a3ab-2b9c-56eb-8885-dba723a802f3 sending to next pipeline
2026-03-28 14:06:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: b702a3ab-2b9c-56eb-8885-dba723a802f3, identifier: YR18%20ZWP
2026-03-28 14:06:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/RV60TZO/42810285?sv=2020-08-04&st=2026-03-28T14%3A06%3A24Z&se=2026-03-28T14%3A31%3A24Z&sr=b&sp=r&sig=0wfV7eTXgj18RoXJ9dVJaCh0eej2XdKr%2F9zBrTgYLZs%3D> (referer: https://www.bca.co.uk/)
2026-03-28 14:06:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: c9c54905-b471-54fb-b36b-18e3160cc696 with identifier: ND19%20ZXL
2026-03-28 14:06:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: c9c54905-b471-54fb-b36b-18e3160cc696 with identifier: ND19%20ZXL
2026-03-28 14:06:25 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: c9c54905-b471-54fb-b36b-18e3160cc696 with identifier: ND19%20ZXL to the API
2026-03-28 14:06:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:06:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:06:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/ND19ZXL/698729629/600>
{'auction_title': '',
'c_o_2_emission_value': 140,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c9c54905-b471-54fb-b36b-18e3160cc696/c9c54905-b471-54fb-b36b-18e3160cc696_expert_report_file_60d399fe-5d4e-4bce-8e8f-399303337e0a.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=ND19%20ZXL-GB',
'category': 'Car',
'color': 'grey',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.0L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol',
'id': 'c9c54905-b471-54fb-b36b-18e3160cc696',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'ND19 ZXL',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=ND19%20ZXL&vehicleType=*',
'listing': 'auction',
'location': 'Blackbushe',
'make': 'FORD',
'model': 'ECOSPORT',
'odometer': 71639,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 11,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c9c54905-b471-54fb-b36b-18e3160cc696/c9c54905-b471-54fb-b36b-18e3160cc696_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 57025,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/ND19ZXL/698729597/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c9c54905-b471-54fb-b36b-18e3160cc696/c9c54905-b471-54fb-b36b-18e3160cc696_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 54760,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/ND19ZXL/698729615/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c9c54905-b471-54fb-b36b-18e3160cc696/c9c54905-b471-54fb-b36b-18e3160cc696_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 53189,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/ND19ZXL/698729629/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c9c54905-b471-54fb-b36b-18e3160cc696/c9c54905-b471-54fb-b36b-18e3160cc696_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 53772,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/ND19ZXL/698729647/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c9c54905-b471-54fb-b36b-18e3160cc696/c9c54905-b471-54fb-b36b-18e3160cc696_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 56974,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/ND19ZXL/698729663/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c9c54905-b471-54fb-b36b-18e3160cc696/c9c54905-b471-54fb-b36b-18e3160cc696_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 55514,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/ND19ZXL/698729684/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c9c54905-b471-54fb-b36b-18e3160cc696/c9c54905-b471-54fb-b36b-18e3160cc696_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 87169,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/ND19ZXL/698729710/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c9c54905-b471-54fb-b36b-18e3160cc696/c9c54905-b471-54fb-b36b-18e3160cc696_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 63997,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/ND19ZXL/698729729/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c9c54905-b471-54fb-b36b-18e3160cc696/c9c54905-b471-54fb-b36b-18e3160cc696_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 83213,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/ND19ZXL/698729748/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c9c54905-b471-54fb-b36b-18e3160cc696/c9c54905-b471-54fb-b36b-18e3160cc696_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 76336,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/ND19ZXL/698729768/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-01-01',
'seller_name': None,
'title': 'FORD ECOSPORT 1.0 E/B 125 TITANIUM StationWagon',
'transmission': 'automatic',
'trim': 'E/B 125 TITANIUM',
'vin': 'WF01XXERK1KD09345',
'year': 2019}
2026-03-28 14:06:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27ND19%2520ZXL%27 HTTP/1.1" 200 None
2026-03-28 14:06:25 [bca.uk] INFO: Saving data for ND19%20ZXL: {'created_time': 1774706785.542658, 'last_price_update_time': 1774706785.54267, 'auction_closing_time': 1774864800.0}
2026-03-28 14:06:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='ND19%2520ZXL') HTTP/1.1" 204 0
2026-03-28 14:06:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: e70be94c-e868-51f1-a147-7ef5a60aac74 with identifier: KY19%20BNC
2026-03-28 14:06:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: e70be94c-e868-51f1-a147-7ef5a60aac74 with identifier: KY19%20BNC
2026-03-28 14:06:25 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: e70be94c-e868-51f1-a147-7ef5a60aac74 with identifier: KY19%20BNC to the API
2026-03-28 14:06:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:06:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:06:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KY19BNC/698717088/600>
{'auction_title': '',
'c_o_2_emission_value': 113,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e70be94c-e868-51f1-a147-7ef5a60aac74/e70be94c-e868-51f1-a147-7ef5a60aac74_expert_report_file_22cf9b42-9188-4e55-8365-d04b45e54a9f.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=KY19%20BNC-GB',
'category': 'Car',
'color': 'blue',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.0L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol',
'id': 'e70be94c-e868-51f1-a147-7ef5a60aac74',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'KY19 BNC',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=KY19%20BNC&vehicleType=*',
'listing': 'auction',
'location': 'Blackbushe',
'make': 'FORD',
'model': 'FIESTA ACTIVE',
'odometer': 56419,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 11,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e70be94c-e868-51f1-a147-7ef5a60aac74/e70be94c-e868-51f1-a147-7ef5a60aac74_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 56232,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KY19BNC/698717088/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e70be94c-e868-51f1-a147-7ef5a60aac74/e70be94c-e868-51f1-a147-7ef5a60aac74_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 51641,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KY19BNC/698717096/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e70be94c-e868-51f1-a147-7ef5a60aac74/e70be94c-e868-51f1-a147-7ef5a60aac74_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 52798,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KY19BNC/698717119/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e70be94c-e868-51f1-a147-7ef5a60aac74/e70be94c-e868-51f1-a147-7ef5a60aac74_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 54571,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KY19BNC/698717137/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e70be94c-e868-51f1-a147-7ef5a60aac74/e70be94c-e868-51f1-a147-7ef5a60aac74_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 56003,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KY19BNC/698717157/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e70be94c-e868-51f1-a147-7ef5a60aac74/e70be94c-e868-51f1-a147-7ef5a60aac74_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 51698,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KY19BNC/698717180/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e70be94c-e868-51f1-a147-7ef5a60aac74/e70be94c-e868-51f1-a147-7ef5a60aac74_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 62315,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KY19BNC/698717208/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e70be94c-e868-51f1-a147-7ef5a60aac74/e70be94c-e868-51f1-a147-7ef5a60aac74_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 74451,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KY19BNC/698717239/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e70be94c-e868-51f1-a147-7ef5a60aac74/e70be94c-e868-51f1-a147-7ef5a60aac74_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 90012,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KY19BNC/698717270/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e70be94c-e868-51f1-a147-7ef5a60aac74/e70be94c-e868-51f1-a147-7ef5a60aac74_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 64588,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KY19BNC/698717291/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-01-01',
'seller_name': None,
'title': 'FORD FIESTA ACTIVE 1.0 E/B 125 X Hatchback',
'transmission': 'manual',
'trim': 'E/B 125 X',
'vin': 'WF0JXXGAHJKD25784',
'year': 2019}
2026-03-28 14:06:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KY19%2520BNC%27 HTTP/1.1" 200 None
2026-03-28 14:06:26 [bca.uk] INFO: Saving data for KY19%20BNC: {'created_time': 1774706786.005334, 'last_price_update_time': 1774706786.005348, 'auction_closing_time': 1774864800.0}
2026-03-28 14:06:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='KY19%2520BNC') HTTP/1.1" 204 0
2026-03-28 14:06:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: b702a3ab-2b9c-56eb-8885-dba723a802f3 with identifier: YR18%20ZWP
2026-03-28 14:06:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: b702a3ab-2b9c-56eb-8885-dba723a802f3 with identifier: YR18%20ZWP
2026-03-28 14:06:26 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: b702a3ab-2b9c-56eb-8885-dba723a802f3 with identifier: YR18%20ZWP to the API
2026-03-28 14:06:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:06:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:06:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YR18ZWP/698729771/600>
{'auction_title': '',
'c_o_2_emission_value': 134,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b702a3ab-2b9c-56eb-8885-dba723a802f3/b702a3ab-2b9c-56eb-8885-dba723a802f3_expert_report_file_43fb3546-a5d0-446b-bc16-66c96b493bac.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=YR18%20ZWP-GB',
'category': 'Car',
'color': 'black',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.0L',
'expiration_date': '2026-03-29T10:00:00Z',
'fuel_type': 'Petrol',
'id': 'b702a3ab-2b9c-56eb-8885-dba723a802f3',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'YR18 ZWP',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=YR18%20ZWP&vehicleType=*',
'listing': 'auction',
'location': 'Blackbushe',
'make': 'FORD',
'model': 'ECOSPORT',
'odometer': 28406,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 11,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b702a3ab-2b9c-56eb-8885-dba723a802f3/b702a3ab-2b9c-56eb-8885-dba723a802f3_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 56735,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YR18ZWP/698729605/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b702a3ab-2b9c-56eb-8885-dba723a802f3/b702a3ab-2b9c-56eb-8885-dba723a802f3_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 54459,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YR18ZWP/698729627/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b702a3ab-2b9c-56eb-8885-dba723a802f3/b702a3ab-2b9c-56eb-8885-dba723a802f3_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 52462,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YR18ZWP/698729645/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b702a3ab-2b9c-56eb-8885-dba723a802f3/b702a3ab-2b9c-56eb-8885-dba723a802f3_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 53371,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YR18ZWP/698729669/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b702a3ab-2b9c-56eb-8885-dba723a802f3/b702a3ab-2b9c-56eb-8885-dba723a802f3_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 55929,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YR18ZWP/698729690/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b702a3ab-2b9c-56eb-8885-dba723a802f3/b702a3ab-2b9c-56eb-8885-dba723a802f3_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 52798,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YR18ZWP/698729700/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b702a3ab-2b9c-56eb-8885-dba723a802f3/b702a3ab-2b9c-56eb-8885-dba723a802f3_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 80364,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YR18ZWP/698729717/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b702a3ab-2b9c-56eb-8885-dba723a802f3/b702a3ab-2b9c-56eb-8885-dba723a802f3_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 76014,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YR18ZWP/698729734/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b702a3ab-2b9c-56eb-8885-dba723a802f3/b702a3ab-2b9c-56eb-8885-dba723a802f3_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 84530,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YR18ZWP/698729750/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b702a3ab-2b9c-56eb-8885-dba723a802f3/b702a3ab-2b9c-56eb-8885-dba723a802f3_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 66462,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YR18ZWP/698729771/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-01-01',
'seller_name': None,
'title': 'FORD ECOSPORT 1.0 E/B 125 TITANIUM StationWagon',
'transmission': 'automatic',
'trim': 'E/B 125 TITANIUM',
'vin': 'WF01XXERK1JS53612',
'year': 2018}
2026-03-28 14:06:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YR18%2520ZWP%27 HTTP/1.1" 200 None
2026-03-28 14:06:26 [bca.uk] INFO: Saving data for YR18%20ZWP: {'created_time': 1774706786.507242, 'last_price_update_time': 1774706786.507254, 'auction_closing_time': 1774778400.0}
2026-03-28 14:06:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='YR18%2520ZWP') HTTP/1.1" 204 0
2026-03-28 14:06:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/GL11XOW/42810476?sv=2020-08-04&st=2026-03-28T14%3A06%3A24Z&se=2026-03-28T14%3A31%3A24Z&sr=b&sp=r&sig=Z2KlPx5wKthhayrUXNoIRMZ89bgZHolJc7BL3Q6T4LE%3D> (referer: https://www.bca.co.uk/)
2026-03-28 14:06:26 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/AV13PZZ/42810506?sv=2020-08-04&st=2026-03-28T14%3A06%3A24Z&se=2026-03-28T14%3A31%3A24Z&sr=b&sp=r&sig=nZ0bGWVTxK13EuaxhdSPPyqqrzizvd8XT5v5hUK7Ua4%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=AV13%20PZZ-GB>
2026-03-28 14:06:26 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/KJ70LJU/42807917?sv=2020-08-04&st=2026-03-28T14%3A06%3A24Z&se=2026-03-28T14%3A31%3A24Z&sr=b&sp=r&sig=T2vuiJBTz4jV3GmdM5bnFNfH4xGipPA46fpyn3Y01Pc%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=KJ70%20LJU-GB>
2026-03-28 14:06:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LD11FZB/698929094/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LD11FZB/42809686?sv=2020-08-04&st=2026-03-28T14%3A03%3A58Z&se=2026-03-28T14%3A28%3A58Z&sr=b&sp=r&sig=%2FK4BAlVG%2BClj51VCbQA3WyKfnHgVC%2B3mVHIA2lg6Jqc%3D)
2026-03-28 14:06:26 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MV57UOY/698798259/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698798259>
2026-03-28 14:06:26 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/GJ70LXZ/42808336?sv=2020-08-04&st=2026-03-28T14%3A06%3A24Z&se=2026-03-28T14%3A31%3A24Z&sr=b&sp=r&sig=b57i0PzDZVUlozUA4vRBxPguh6MBQAEl464L60jtAsQ%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=GJ70%20LXZ-GB>
2026-03-28 14:06:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MV57UOY/698798330/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/MV57UOY/42807073?sv=2020-08-04&st=2026-03-28T14%3A03%3A53Z&se=2026-03-28T14%3A28%3A53Z&sr=b&sp=r&sig=4yruJ8ij2lkpzOh%2Bl0IV9Mz1vdyrZkWNPL1z%2B2woEio%3D)
2026-03-28 14:06:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:06:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c683b50>
2026-03-28 14:06:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:06:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:06:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:06:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b9b1844a-f6e4-586f-88aa-fc22f6ebd424/b9b1844a-f6e4-586f-88aa-fc22f6ebd424_expert_report_file_1555b607-c1a2-4b35-8c75-21bba344d1a6.pdf HTTP/1.1" 201 0
2026-03-28 14:06:26 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item b9b1844a-f6e4-586f-88aa-fc22f6ebd424
2026-03-28 14:06:26 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: b9b1844a-f6e4-586f-88aa-fc22f6ebd424, skipping ID generation
2026-03-28 14:06:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item b9b1844a-f6e4-586f-88aa-fc22f6ebd424
2026-03-28 14:06:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DYB57FZC-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-28 14:06:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=YB57FZC-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-28 14:06:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:06:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2dcf4ad0>
2026-03-28 14:06:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:06:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:06:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:06:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3e1a668c-07f1-5b40-8f70-ce6f3b64756d/3e1a668c-07f1-5b40-8f70-ce6f3b64756d_expert_report_file_9fbcde14-d1df-4aa9-82cb-657e048e42bc.pdf HTTP/1.1" 201 0
2026-03-28 14:06:26 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item 3e1a668c-07f1-5b40-8f70-ce6f3b64756d
2026-03-28 14:06:26 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 3e1a668c-07f1-5b40-8f70-ce6f3b64756d, skipping ID generation
2026-03-28 14:06:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 3e1a668c-07f1-5b40-8f70-ce6f3b64756d
2026-03-28 14:06:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DGK66WPY-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-28 14:06:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=GK66WPY-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-28 14:06:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D697429828%27 HTTP/1.1" 200 None
2026-03-28 14:06:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=697429828 not downloaded yet
2026-03-28 14:06:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698996494%27 HTTP/1.1" 200 None
2026-03-28 14:06:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698996494 not downloaded yet
2026-03-28 14:06:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:06:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c76b390>
2026-03-28 14:06:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:06:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:06:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:06:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_be5cf8be-a032-55c5-880a-33e1f5f6185e/be5cf8be-a032-55c5-880a-33e1f5f6185e_expert_report_file_242a587c-e04c-4d1b-b85a-b34cd0913cda.pdf HTTP/1.1" 201 0
2026-03-28 14:06:26 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item be5cf8be-a032-55c5-880a-33e1f5f6185e
2026-03-28 14:06:26 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: be5cf8be-a032-55c5-880a-33e1f5f6185e, skipping ID generation
2026-03-28 14:06:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item be5cf8be-a032-55c5-880a-33e1f5f6185e
2026-03-28 14:06:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DRV60TZO-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-28 14:06:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=RV60TZO-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-28 14:06:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LD11FZB/698929069/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LD11FZB/42809686?sv=2020-08-04&st=2026-03-28T14%3A03%3A58Z&se=2026-03-28T14%3A28%3A58Z&sr=b&sp=r&sig=%2FK4BAlVG%2BClj51VCbQA3WyKfnHgVC%2B3mVHIA2lg6Jqc%3D)
2026-03-28 14:06:26 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MV57UOY/698798192/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698798192>
2026-03-28 14:06:26 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/BC65FJV/42805191?sv=2020-08-04&st=2026-03-28T14%3A06%3A26Z&se=2026-03-28T14%3A31%3A26Z&sr=b&sp=r&sig=VD7AqlkCpzlQHKxBAL0n0wRt3IwFKoVa%2FExqjVTdHHA%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=BC65%20FJV-GB>
2026-03-28 14:06:26 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YH12ZWB/42807832?sv=2020-08-04&st=2026-03-28T14%3A06%3A26Z&se=2026-03-28T14%3A31%3A26Z&sr=b&sp=r&sig=IdAZy5bTiPvaFPsGYQH5tM1qjYLVI7KwntzQxTYK%2F38%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=YH12%20ZWB-GB>
2026-03-28 14:06:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YG70CMV/697550745/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YG70CMV/42809751?sv=2020-08-04&st=2026-03-28T14%3A03%3A58Z&se=2026-03-28T14%3A28%3A58Z&sr=b&sp=r&sig=1ABLz0vVsC9yYBr%2F09SZY1lBMEdGcrDzJ1kVHXJEJlA%3D)
2026-03-28 14:06:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D697429833%27 HTTP/1.1" 200 None
2026-03-28 14:06:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=697429833 not downloaded yet
2026-03-28 14:06:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698996502%27 HTTP/1.1" 200 None
2026-03-28 14:06:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698996502 not downloaded yet
2026-03-28 14:06:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698707933%27 HTTP/1.1" 200 None
2026-03-28 14:06:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698707933 not downloaded yet
2026-03-28 14:06:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MV57UOY/698798308/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/MV57UOY/42807073?sv=2020-08-04&st=2026-03-28T14%3A03%3A53Z&se=2026-03-28T14%3A28%3A53Z&sr=b&sp=r&sig=4yruJ8ij2lkpzOh%2Bl0IV9Mz1vdyrZkWNPL1z%2B2woEio%3D)
2026-03-28 14:06:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:06:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2d99ff10>
2026-03-28 14:06:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:06:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:06:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:06:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_011230be-e1a4-58b5-92df-e152edda7f73/011230be-e1a4-58b5-92df-e152edda7f73_expert_report_file_8dbe7601-ed5a-4d19-b2f9-880346f2abf6.pdf HTTP/1.1" 201 0
2026-03-28 14:06:26 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item 011230be-e1a4-58b5-92df-e152edda7f73
2026-03-28 14:06:26 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 011230be-e1a4-58b5-92df-e152edda7f73, skipping ID generation
2026-03-28 14:06:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 011230be-e1a4-58b5-92df-e152edda7f73
2026-03-28 14:06:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DGL11XOW-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-28 14:06:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=GL11XOW-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-28 14:06:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:06:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c9fa790>
2026-03-28 14:06:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:06:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:06:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:06:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fadd6eea-e2b0-5574-affe-cdf6b892b445/fadd6eea-e2b0-5574-affe-cdf6b892b445_image_1.jpg HTTP/1.1" 201 0
2026-03-28 14:06:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLD11FZB%252F698929094%252F600') HTTP/1.1" 204 0
2026-03-28 14:06:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LD11FZB/698929094/600 saved to cache
2026-03-28 14:06:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item fadd6eea-e2b0-5574-affe-cdf6b892b445
2026-03-28 14:06:26 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:06:26 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:06:26 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:06:26 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:06:26 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:06:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:06:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2d7a9d10>
2026-03-28 14:06:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:06:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:06:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:06:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b344c6b3-761f-572b-9e4c-84678fe27e52/b344c6b3-761f-572b-9e4c-84678fe27e52_image_8.jpg HTTP/1.1" 201 0
2026-03-28 14:06:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FMV57UOY%252F698798330%252F600') HTTP/1.1" 204 0
2026-03-28 14:06:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MV57UOY/698798330/600 saved to cache
2026-03-28 14:06:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item b344c6b3-761f-572b-9e4c-84678fe27e52
2026-03-28 14:06:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/AJ17HXL/42798748?sv=2020-08-04&st=2026-03-28T14%3A06%3A24Z&se=2026-03-28T14%3A31%3A24Z&sr=b&sp=r&sig=s%2FenQJFKWZab81RCtX8FxHWN1BS3QTqj1oqoO1gcyoI%3D> (referer: https://www.bca.co.uk/)
2026-03-28 14:06:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D697429839%27 HTTP/1.1" 200 None
2026-03-28 14:06:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=697429839 not downloaded yet
2026-03-28 14:06:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698996514%27 HTTP/1.1" 200 None
2026-03-28 14:06:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698996514 not downloaded yet
2026-03-28 14:06:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698707962%27 HTTP/1.1" 200 None
2026-03-28 14:06:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698707962 not downloaded yet
2026-03-28 14:06:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/BN10FFD/42810471?sv=2020-08-04&st=2026-03-28T14%3A06%3A24Z&se=2026-03-28T14%3A31%3A24Z&sr=b&sp=r&sig=YRKnec8Y1hjSrUO4yfYPgpbhzRG9GcT5SYUolkFsGgY%3D> (referer: https://www.bca.co.uk/)
2026-03-28 14:06:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698717172%27 HTTP/1.1" 200 None
2026-03-28 14:06:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698717172 not downloaded yet
2026-03-28 14:06:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D697429844%27 HTTP/1.1" 200 None
2026-03-28 14:06:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=697429844 not downloaded yet
2026-03-28 14:06:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698996520%27 HTTP/1.1" 200 None
2026-03-28 14:06:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698996520 not downloaded yet
2026-03-28 14:06:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698707998%27 HTTP/1.1" 200 None
2026-03-28 14:06:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698707998 not downloaded yet
2026-03-28 14:06:27 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YO66ENU/42809748?sv=2020-08-04&st=2026-03-28T14%3A06%3A26Z&se=2026-03-28T14%3A31%3A26Z&sr=b&sp=r&sig=7%2BETLPIcX2eu%2By5D0%2BtTEmXYS%2FFAqP%2B5SquQ2dIEkPA%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=YO66%20ENU-GB>
2026-03-28 14:06:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698717191%27 HTTP/1.1" 200 None
2026-03-28 14:06:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698717191 not downloaded yet
2026-03-28 14:06:27 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/M70ODE/42810084?sv=2020-08-04&st=2026-03-28T14%3A06%3A26Z&se=2026-03-28T14%3A31%3A26Z&sr=b&sp=r&sig=NvAgSAtcVVNpw59OnQY5IgDyurxqMu%2F2N0bZVQgkz%2BA%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=M70%20ODE-GB>
2026-03-28 14:06:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MV57UOY/698798259/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/MV57UOY/42807073?sv=2020-08-04&st=2026-03-28T14%3A03%3A53Z&se=2026-03-28T14%3A28%3A53Z&sr=b&sp=r&sig=4yruJ8ij2lkpzOh%2Bl0IV9Mz1vdyrZkWNPL1z%2B2woEio%3D)
2026-03-28 14:06:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D697429849%27 HTTP/1.1" 200 None
2026-03-28 14:06:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=697429849 not downloaded yet
2026-03-28 14:06:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698996529%27 HTTP/1.1" 200 None
2026-03-28 14:06:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698996529 not downloaded yet
2026-03-28 14:06:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698708036%27 HTTP/1.1" 200 None
2026-03-28 14:06:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698708036 not downloaded yet
2026-03-28 14:06:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:06:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2d7f8b50>
2026-03-28 14:06:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:06:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:06:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:06:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fadd6eea-e2b0-5574-affe-cdf6b892b445/fadd6eea-e2b0-5574-affe-cdf6b892b445_image_0.jpg HTTP/1.1" 201 0
2026-03-28 14:06:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLD11FZB%252F698929069%252F600') HTTP/1.1" 204 0
2026-03-28 14:06:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LD11FZB/698929069/600 saved to cache
2026-03-28 14:06:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item fadd6eea-e2b0-5574-affe-cdf6b892b445
2026-03-28 14:06:27 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: fadd6eea-e2b0-5574-affe-cdf6b892b445, skipping ID generation
2026-03-28 14:06:27 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item fadd6eea-e2b0-5574-affe-cdf6b892b445 sending to next pipeline
2026-03-28 14:06:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: fadd6eea-e2b0-5574-affe-cdf6b892b445, identifier: LD11%20FZB
2026-03-28 14:06:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:06:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a1fe3c2d0>
2026-03-28 14:06:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:06:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:06:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:06:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_505ec447-0f6d-5de4-9190-5ab4c6e276f7/505ec447-0f6d-5de4-9190-5ab4c6e276f7_image_1.jpg HTTP/1.1" 201 0
2026-03-28 14:06:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FYG70CMV%252F697550745%252F600') HTTP/1.1" 204 0
2026-03-28 14:06:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YG70CMV/697550745/600 saved to cache
2026-03-28 14:06:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 505ec447-0f6d-5de4-9190-5ab4c6e276f7
2026-03-28 14:06:27 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 505ec447-0f6d-5de4-9190-5ab4c6e276f7, skipping ID generation
2026-03-28 14:06:27 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 505ec447-0f6d-5de4-9190-5ab4c6e276f7 sending to next pipeline
2026-03-28 14:06:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 505ec447-0f6d-5de4-9190-5ab4c6e276f7, identifier: YG70%20CMV
2026-03-28 14:06:27 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:06:27 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:06:27 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:06:27 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:06:27 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:06:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:06:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c86cb90>
2026-03-28 14:06:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:06:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:06:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:06:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b344c6b3-761f-572b-9e4c-84678fe27e52/b344c6b3-761f-572b-9e4c-84678fe27e52_image_7.jpg HTTP/1.1" 201 0
2026-03-28 14:06:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FMV57UOY%252F698798308%252F600') HTTP/1.1" 204 0
2026-03-28 14:06:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MV57UOY/698798308/600 saved to cache
2026-03-28 14:06:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item b344c6b3-761f-572b-9e4c-84678fe27e52
2026-03-28 14:06:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/KJ70LJU/42807917?sv=2020-08-04&st=2026-03-28T14%3A06%3A24Z&se=2026-03-28T14%3A31%3A24Z&sr=b&sp=r&sig=T2vuiJBTz4jV3GmdM5bnFNfH4xGipPA46fpyn3Y01Pc%3D> (referer: https://www.bca.co.uk/)
2026-03-28 14:06:27 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KM11UUD/698915386/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698915386>
2026-03-28 14:06:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698717219%27 HTTP/1.1" 200 None
2026-03-28 14:06:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698717219 not downloaded yet
2026-03-28 14:06:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: fadd6eea-e2b0-5574-affe-cdf6b892b445 with identifier: LD11%20FZB
2026-03-28 14:06:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: fadd6eea-e2b0-5574-affe-cdf6b892b445 with identifier: LD11%20FZB
2026-03-28 14:06:27 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: fadd6eea-e2b0-5574-affe-cdf6b892b445 with identifier: LD11%20FZB to the API
2026-03-28 14:06:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:06:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:06:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LD11FZB/698929069/600>
{'auction_title': '',
'c_o_2_emission_value': 139,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fadd6eea-e2b0-5574-affe-cdf6b892b445/fadd6eea-e2b0-5574-affe-cdf6b892b445_expert_report_file_db0f0701-344c-4398-a0f9-7927ecbd182a.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=LD11%20FZB-GB',
'category': 'Car',
'color': 'silver',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.4L',
'expiration_date': '2026-03-29T10:00:00Z',
'fuel_type': 'Petrol',
'id': 'fadd6eea-e2b0-5574-affe-cdf6b892b445',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'LD11 FZB',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=LD11%20FZB&vehicleType=*',
'listing': 'auction',
'location': 'Manchester',
'make': 'KIA',
'model': 'RIO',
'odometer': 91452,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 11,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fadd6eea-e2b0-5574-affe-cdf6b892b445/fadd6eea-e2b0-5574-affe-cdf6b892b445_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 44984,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LD11FZB/698929069/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fadd6eea-e2b0-5574-affe-cdf6b892b445/fadd6eea-e2b0-5574-affe-cdf6b892b445_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 44423,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LD11FZB/698929094/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fadd6eea-e2b0-5574-affe-cdf6b892b445/fadd6eea-e2b0-5574-affe-cdf6b892b445_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 43560,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LD11FZB/698929108/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fadd6eea-e2b0-5574-affe-cdf6b892b445/fadd6eea-e2b0-5574-affe-cdf6b892b445_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 44239,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LD11FZB/698929129/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fadd6eea-e2b0-5574-affe-cdf6b892b445/fadd6eea-e2b0-5574-affe-cdf6b892b445_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 44982,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LD11FZB/698929149/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fadd6eea-e2b0-5574-affe-cdf6b892b445/fadd6eea-e2b0-5574-affe-cdf6b892b445_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 43180,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LD11FZB/698929162/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fadd6eea-e2b0-5574-affe-cdf6b892b445/fadd6eea-e2b0-5574-affe-cdf6b892b445_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 77935,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LD11FZB/698929196/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fadd6eea-e2b0-5574-affe-cdf6b892b445/fadd6eea-e2b0-5574-affe-cdf6b892b445_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 75091,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LD11FZB/698929226/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fadd6eea-e2b0-5574-affe-cdf6b892b445/fadd6eea-e2b0-5574-affe-cdf6b892b445_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 81696,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LD11FZB/698929254/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fadd6eea-e2b0-5574-affe-cdf6b892b445/fadd6eea-e2b0-5574-affe-cdf6b892b445_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 67986,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LD11FZB/698929281/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2011-01-01',
'seller_name': None,
'title': 'KIA RIO 1.4 1 Hatchback',
'transmission': 'manual',
'trim': '1',
'vin': 'KNADG511LB6807002',
'year': 2011}
2026-03-28 14:06:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LD11%2520FZB%27 HTTP/1.1" 200 None
2026-03-28 14:06:27 [bca.uk] INFO: Saving data for LD11%20FZB: {'created_time': 1774706787.869071, 'last_price_update_time': 1774706787.869082, 'auction_closing_time': 1774778400.0}
2026-03-28 14:06:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='LD11%2520FZB') HTTP/1.1" 204 0
2026-03-28 14:06:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 505ec447-0f6d-5de4-9190-5ab4c6e276f7 with identifier: YG70%20CMV
2026-03-28 14:06:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 505ec447-0f6d-5de4-9190-5ab4c6e276f7 with identifier: YG70%20CMV
2026-03-28 14:06:27 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 505ec447-0f6d-5de4-9190-5ab4c6e276f7 with identifier: YG70%20CMV to the API
2026-03-28 14:06:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:06:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:06:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YG70CMV/697550745/600>
{'auction_title': '',
'c_o_2_emission_value': 152,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_505ec447-0f6d-5de4-9190-5ab4c6e276f7/505ec447-0f6d-5de4-9190-5ab4c6e276f7_expert_report_file_8a3ecf23-4626-4ef3-926a-baf583f3b389.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=YG70%20CMV-GB',
'category': 'Car',
'color': 'black',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.2L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol',
'id': '505ec447-0f6d-5de4-9190-5ab4c6e276f7',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'YG70 CMV',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=YG70%20CMV&vehicleType=*',
'listing': 'auction',
'location': 'Brighouse',
'make': 'PEUGEOT',
'model': '3008',
'odometer': 87364,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 11,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_505ec447-0f6d-5de4-9190-5ab4c6e276f7/505ec447-0f6d-5de4-9190-5ab4c6e276f7_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 51670,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YG70CMV/697550736/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_505ec447-0f6d-5de4-9190-5ab4c6e276f7/505ec447-0f6d-5de4-9190-5ab4c6e276f7_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 50619,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YG70CMV/697550745/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_505ec447-0f6d-5de4-9190-5ab4c6e276f7/505ec447-0f6d-5de4-9190-5ab4c6e276f7_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 44475,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YG70CMV/697550760/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_505ec447-0f6d-5de4-9190-5ab4c6e276f7/505ec447-0f6d-5de4-9190-5ab4c6e276f7_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 43030,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YG70CMV/697550773/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_505ec447-0f6d-5de4-9190-5ab4c6e276f7/505ec447-0f6d-5de4-9190-5ab4c6e276f7_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 43065,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YG70CMV/697550796/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_505ec447-0f6d-5de4-9190-5ab4c6e276f7/505ec447-0f6d-5de4-9190-5ab4c6e276f7_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 43781,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YG70CMV/697550812/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_505ec447-0f6d-5de4-9190-5ab4c6e276f7/505ec447-0f6d-5de4-9190-5ab4c6e276f7_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 64117,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YG70CMV/697550832/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_505ec447-0f6d-5de4-9190-5ab4c6e276f7/505ec447-0f6d-5de4-9190-5ab4c6e276f7_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 76651,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YG70CMV/697550856/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_505ec447-0f6d-5de4-9190-5ab4c6e276f7/505ec447-0f6d-5de4-9190-5ab4c6e276f7_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 86657,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YG70CMV/697550876/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_505ec447-0f6d-5de4-9190-5ab4c6e276f7/505ec447-0f6d-5de4-9190-5ab4c6e276f7_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 77493,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YG70CMV/697550898/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-01-01',
'seller_name': None,
'title': 'PEUGEOT 3008 1.2 P/T 130 ALLURE EAT8 Hatchback',
'transmission': 'automatic',
'trim': 'P/T 130 ALLURE EAT8',
'vin': 'VF3MRHNSULS043646',
'year': 2020}
2026-03-28 14:06:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YG70%2520CMV%27 HTTP/1.1" 200 None
2026-03-28 14:06:28 [bca.uk] INFO: Saving data for YG70%20CMV: {'created_time': 1774706788.283893, 'last_price_update_time': 1774706788.283906, 'auction_closing_time': 1774864800.0}
2026-03-28 14:06:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='YG70%2520CMV') HTTP/1.1" 204 0
2026-03-28 14:06:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/GJ70LXZ/42808336?sv=2020-08-04&st=2026-03-28T14%3A06%3A24Z&se=2026-03-28T14%3A31%3A24Z&sr=b&sp=r&sig=b57i0PzDZVUlozUA4vRBxPguh6MBQAEl464L60jtAsQ%3D> (referer: https://www.bca.co.uk/)
2026-03-28 14:06:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D697429856%27 HTTP/1.1" 200 None
2026-03-28 14:06:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=697429856 not downloaded yet
2026-03-28 14:06:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698996546%27 HTTP/1.1" 200 None
2026-03-28 14:06:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698996546 not downloaded yet
2026-03-28 14:06:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698708062%27 HTTP/1.1" 200 None
2026-03-28 14:06:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698708062 not downloaded yet
2026-03-28 14:06:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:06:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c4518d0>
2026-03-28 14:06:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:06:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:06:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:06:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2a541890-0343-5ec1-9e09-787ef67af079/2a541890-0343-5ec1-9e09-787ef67af079_expert_report_file_24470f81-d5e5-4510-8ff7-496e957ce0cd.pdf HTTP/1.1" 201 0
2026-03-28 14:06:28 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item 2a541890-0343-5ec1-9e09-787ef67af079
2026-03-28 14:06:28 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 2a541890-0343-5ec1-9e09-787ef67af079, skipping ID generation
2026-03-28 14:06:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 2a541890-0343-5ec1-9e09-787ef67af079
2026-03-28 14:06:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DAJ17HXL-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-28 14:06:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=AJ17HXL-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-28 14:06:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MV57UOY/698798192/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/MV57UOY/42807073?sv=2020-08-04&st=2026-03-28T14%3A03%3A53Z&se=2026-03-28T14%3A28%3A53Z&sr=b&sp=r&sig=4yruJ8ij2lkpzOh%2Bl0IV9Mz1vdyrZkWNPL1z%2B2woEio%3D)
2026-03-28 14:06:28 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RV60TZO/698707911/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=RV60TZO-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-28 14:06:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698717235%27 HTTP/1.1" 200 None
2026-03-28 14:06:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698717235 not downloaded yet
2026-03-28 14:06:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/AV13PZZ/42810506?sv=2020-08-04&st=2026-03-28T14%3A06%3A24Z&se=2026-03-28T14%3A31%3A24Z&sr=b&sp=r&sig=nZ0bGWVTxK13EuaxhdSPPyqqrzizvd8XT5v5hUK7Ua4%3D> (referer: https://www.bca.co.uk/)
2026-03-28 14:06:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D697429863%27 HTTP/1.1" 200 None
2026-03-28 14:06:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=697429863 not downloaded yet
2026-03-28 14:06:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698996564%27 HTTP/1.1" 200 None
2026-03-28 14:06:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698996564 not downloaded yet
2026-03-28 14:06:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698708089%27 HTTP/1.1" 200 None
2026-03-28 14:06:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698708089 not downloaded yet
2026-03-28 14:06:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698328429%27 HTTP/1.1" 200 None
2026-03-28 14:06:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698328429 not downloaded yet
2026-03-28 14:06:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/BC65FJV/42805191?sv=2020-08-04&st=2026-03-28T14%3A06%3A26Z&se=2026-03-28T14%3A31%3A26Z&sr=b&sp=r&sig=VD7AqlkCpzlQHKxBAL0n0wRt3IwFKoVa%2FExqjVTdHHA%3D> (referer: https://www.bca.co.uk/)
2026-03-28 14:06:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698717256%27 HTTP/1.1" 200 None
2026-03-28 14:06:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698717256 not downloaded yet
2026-03-28 14:06:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:06:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2d7aae50>
2026-03-28 14:06:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:06:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:06:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:06:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_aa05e46e-6535-54ec-9d2a-990536e25c18/aa05e46e-6535-54ec-9d2a-990536e25c18_expert_report_file_b1350618-f45b-495c-9310-6622c4ce6668.pdf HTTP/1.1" 201 0
2026-03-28 14:06:28 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item aa05e46e-6535-54ec-9d2a-990536e25c18
2026-03-28 14:06:28 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: aa05e46e-6535-54ec-9d2a-990536e25c18, skipping ID generation
2026-03-28 14:06:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item aa05e46e-6535-54ec-9d2a-990536e25c18
2026-03-28 14:06:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DBN10FFD-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-28 14:06:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=BN10FFD-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-28 14:06:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:06:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2dd80810>
2026-03-28 14:06:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:06:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:06:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:06:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b344c6b3-761f-572b-9e4c-84678fe27e52/b344c6b3-761f-572b-9e4c-84678fe27e52_image_5.jpg HTTP/1.1" 201 0
2026-03-28 14:06:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FMV57UOY%252F698798259%252F600') HTTP/1.1" 204 0
2026-03-28 14:06:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MV57UOY/698798259/600 saved to cache
2026-03-28 14:06:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item b344c6b3-761f-572b-9e4c-84678fe27e52
2026-03-28 14:06:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:06:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c534110>
2026-03-28 14:06:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:06:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:06:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:06:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_df9a9a0d-7908-5df5-80db-63767b9fcbae/df9a9a0d-7908-5df5-80db-63767b9fcbae_expert_report_file_5e298352-5673-4968-b535-20c36db2e4c8.pdf HTTP/1.1" 201 0
2026-03-28 14:06:28 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item df9a9a0d-7908-5df5-80db-63767b9fcbae
2026-03-28 14:06:28 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: df9a9a0d-7908-5df5-80db-63767b9fcbae, skipping ID generation
2026-03-28 14:06:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item df9a9a0d-7908-5df5-80db-63767b9fcbae
2026-03-28 14:06:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DKJ70LJU-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-28 14:06:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=KJ70LJU-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-28 14:06:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:06:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2dd370d0>
2026-03-28 14:06:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:06:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:06:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:06:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_680c4e9b-15ae-54e0-a824-8a7fce3528fb/680c4e9b-15ae-54e0-a824-8a7fce3528fb_expert_report_file_53062d49-9ac0-4e77-8b2d-b0dc7356f747.pdf HTTP/1.1" 201 0
2026-03-28 14:06:28 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item 680c4e9b-15ae-54e0-a824-8a7fce3528fb
2026-03-28 14:06:28 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 680c4e9b-15ae-54e0-a824-8a7fce3528fb, skipping ID generation
2026-03-28 14:06:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 680c4e9b-15ae-54e0-a824-8a7fce3528fb
2026-03-28 14:06:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DGJ70LXZ-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-28 14:06:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=GJ70LXZ-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-28 14:06:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YH12ZWB/42807832?sv=2020-08-04&st=2026-03-28T14%3A06%3A26Z&se=2026-03-28T14%3A31%3A26Z&sr=b&sp=r&sig=IdAZy5bTiPvaFPsGYQH5tM1qjYLVI7KwntzQxTYK%2F38%3D> (referer: https://www.bca.co.uk/)
2026-03-28 14:06:28 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YB57FZC/697429828/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=697429828>
2026-03-28 14:06:28 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GL11XOW/698717151/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=GL11XOW-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-28 14:06:28 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GK66WPY/698996494/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698996494>
2026-03-28 14:06:28 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RV60TZO/698707933/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698707933>
2026-03-28 14:06:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D697429875%27 HTTP/1.1" 200 None
2026-03-28 14:06:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=697429875 not downloaded yet
2026-03-28 14:06:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698996579%27 HTTP/1.1" 200 None
2026-03-28 14:06:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698996579 not downloaded yet
2026-03-28 14:06:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698708121%27 HTTP/1.1" 200 None
2026-03-28 14:06:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698708121 not downloaded yet
2026-03-28 14:06:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698328430%27 HTTP/1.1" 200 None
2026-03-28 14:06:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698328430 not downloaded yet
2026-03-28 14:06:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698717277%27 HTTP/1.1" 200 None
2026-03-28 14:06:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698717277 not downloaded yet
2026-03-28 14:06:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698729607%27 HTTP/1.1" 200 None
2026-03-28 14:06:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698729607 not downloaded yet
2026-03-28 14:06:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698795032%27 HTTP/1.1" 200 None
2026-03-28 14:06:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698795032 not downloaded yet
2026-03-28 14:06:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698814387%27 HTTP/1.1" 200 None
2026-03-28 14:06:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698814387 not downloaded yet
2026-03-28 14:06:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/M70ODE/42810084?sv=2020-08-04&st=2026-03-28T14%3A06%3A26Z&se=2026-03-28T14%3A31%3A26Z&sr=b&sp=r&sig=NvAgSAtcVVNpw59OnQY5IgDyurxqMu%2F2N0bZVQgkz%2BA%3D> (referer: https://www.bca.co.uk/)
2026-03-28 14:06:29 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RV60TZO/698707998/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698707998>
2026-03-28 14:06:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D697429882%27 HTTP/1.1" 200 None
2026-03-28 14:06:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=697429882 not downloaded yet
2026-03-28 14:06:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698996596%27 HTTP/1.1" 200 None
2026-03-28 14:06:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698996596 not downloaded yet
2026-03-28 14:06:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698708188%27 HTTP/1.1" 200 None
2026-03-28 14:06:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698708188 not downloaded yet
2026-03-28 14:06:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698328434%27 HTTP/1.1" 200 None
2026-03-28 14:06:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698328434 not downloaded yet
2026-03-28 14:06:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:06:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2d6e5150>
2026-03-28 14:06:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:06:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:06:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:06:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b344c6b3-761f-572b-9e4c-84678fe27e52/b344c6b3-761f-572b-9e4c-84678fe27e52_image_1.jpg HTTP/1.1" 201 0
2026-03-28 14:06:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FMV57UOY%252F698798192%252F600') HTTP/1.1" 204 0
2026-03-28 14:06:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MV57UOY/698798192/600 saved to cache
2026-03-28 14:06:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item b344c6b3-761f-572b-9e4c-84678fe27e52
2026-03-28 14:06:29 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: b344c6b3-761f-572b-9e4c-84678fe27e52, skipping ID generation
2026-03-28 14:06:29 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item b344c6b3-761f-572b-9e4c-84678fe27e52 sending to next pipeline
2026-03-28 14:06:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: b344c6b3-761f-572b-9e4c-84678fe27e52, identifier: MV57%20UOY
2026-03-28 14:06:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:06:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2dcd6e90>
2026-03-28 14:06:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:06:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:06:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:06:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a2561847-ff84-5663-b0c4-a7e1fe0e31f4/a2561847-ff84-5663-b0c4-a7e1fe0e31f4_expert_report_file_872e2fa8-e256-45a7-8d4b-bdbea7f55b5e.pdf HTTP/1.1" 201 0
2026-03-28 14:06:29 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item a2561847-ff84-5663-b0c4-a7e1fe0e31f4
2026-03-28 14:06:29 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: a2561847-ff84-5663-b0c4-a7e1fe0e31f4, skipping ID generation
2026-03-28 14:06:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item a2561847-ff84-5663-b0c4-a7e1fe0e31f4
2026-03-28 14:06:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DAV13PZZ-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-28 14:06:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=AV13PZZ-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-28 14:06:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:06:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c707450>
2026-03-28 14:06:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:06:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:06:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:06:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_515d9b9e-7ed9-596c-8fe3-830ee20f7887/515d9b9e-7ed9-596c-8fe3-830ee20f7887_expert_report_file_2ffda8e0-0252-4bff-92cc-1e9a03687d70.pdf HTTP/1.1" 201 0
2026-03-28 14:06:29 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item 515d9b9e-7ed9-596c-8fe3-830ee20f7887
2026-03-28 14:06:29 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 515d9b9e-7ed9-596c-8fe3-830ee20f7887, skipping ID generation
2026-03-28 14:06:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 515d9b9e-7ed9-596c-8fe3-830ee20f7887
2026-03-28 14:06:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DBC65FJV-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-28 14:06:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=BC65FJV-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-28 14:06:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RV60TZO/698707911/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/RV60TZO/42810285?sv=2020-08-04&st=2026-03-28T14%3A06%3A24Z&se=2026-03-28T14%3A31%3A24Z&sr=b&sp=r&sig=0wfV7eTXgj18RoXJ9dVJaCh0eej2XdKr%2F9zBrTgYLZs%3D)
2026-03-28 14:06:29 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RV60TZO/698708036/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698708036>
2026-03-28 14:06:29 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GK66WPY/698996529/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698996529>
2026-03-28 14:06:29 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GL11XOW/698717219/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698717219>
2026-03-28 14:06:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698717301%27 HTTP/1.1" 200 None
2026-03-28 14:06:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698717301 not downloaded yet
2026-03-28 14:06:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698729622%27 HTTP/1.1" 200 None
2026-03-28 14:06:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698729622 not downloaded yet
2026-03-28 14:06:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698795039%27 HTTP/1.1" 200 None
2026-03-28 14:06:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698795039 not downloaded yet
2026-03-28 14:06:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698814406%27 HTTP/1.1" 200 None
2026-03-28 14:06:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698814406 not downloaded yet
2026-03-28 14:06:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: b344c6b3-761f-572b-9e4c-84678fe27e52 with identifier: MV57%20UOY
2026-03-28 14:06:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: b344c6b3-761f-572b-9e4c-84678fe27e52 with identifier: MV57%20UOY
2026-03-28 14:06:29 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: b344c6b3-761f-572b-9e4c-84678fe27e52 with identifier: MV57%20UOY to the API
2026-03-28 14:06:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:06:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:06:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MV57UOY/698798192/600>
{'auction_title': '',
'c_o_2_emission_value': 129,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b344c6b3-761f-572b-9e4c-84678fe27e52/b344c6b3-761f-572b-9e4c-84678fe27e52_expert_report_file_01c36beb-92f0-430c-a878-974237118823.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=MV57%20UOY-GB',
'category': 'Car',
'color': 'black',
'currency': 'GBP',
'doors_number': 3,
'engine': '1.6L',
'expiration_date': '2026-03-29T10:00:00Z',
'fuel_type': 'Petrol',
'id': 'b344c6b3-761f-572b-9e4c-84678fe27e52',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'MV57 UOY',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=MV57%20UOY&vehicleType=*',
'listing': 'auction',
'location': 'Manchester',
'make': 'MINI',
'model': 'COOPER',
'odometer': 83778,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 11,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b344c6b3-761f-572b-9e4c-84678fe27e52/b344c6b3-761f-572b-9e4c-84678fe27e52_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 45486,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MV57UOY/698798182/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b344c6b3-761f-572b-9e4c-84678fe27e52/b344c6b3-761f-572b-9e4c-84678fe27e52_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 44810,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MV57UOY/698798192/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b344c6b3-761f-572b-9e4c-84678fe27e52/b344c6b3-761f-572b-9e4c-84678fe27e52_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 44080,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MV57UOY/698798204/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b344c6b3-761f-572b-9e4c-84678fe27e52/b344c6b3-761f-572b-9e4c-84678fe27e52_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 44555,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MV57UOY/698798217/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b344c6b3-761f-572b-9e4c-84678fe27e52/b344c6b3-761f-572b-9e4c-84678fe27e52_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 41643,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MV57UOY/698798243/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b344c6b3-761f-572b-9e4c-84678fe27e52/b344c6b3-761f-572b-9e4c-84678fe27e52_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 40243,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MV57UOY/698798259/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b344c6b3-761f-572b-9e4c-84678fe27e52/b344c6b3-761f-572b-9e4c-84678fe27e52_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 103598,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MV57UOY/698798285/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b344c6b3-761f-572b-9e4c-84678fe27e52/b344c6b3-761f-572b-9e4c-84678fe27e52_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 70483,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MV57UOY/698798308/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b344c6b3-761f-572b-9e4c-84678fe27e52/b344c6b3-761f-572b-9e4c-84678fe27e52_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 85377,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MV57UOY/698798330/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b344c6b3-761f-572b-9e4c-84678fe27e52/b344c6b3-761f-572b-9e4c-84678fe27e52_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 88329,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MV57UOY/698798344/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2007-01-01',
'seller_name': None,
'title': 'MINI COOPER 1.6 Hatchback',
'transmission': 'manual',
'trim': '',
'vin': 'WMWMF32080TT14537',
'year': 2007}
2026-03-28 14:06:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MV57%2520UOY%27 HTTP/1.1" 200 None
2026-03-28 14:06:30 [bca.uk] INFO: Saving data for MV57%20UOY: {'created_time': 1774706790.034139, 'last_price_update_time': 1774706790.03415, 'auction_closing_time': 1774778400.0}
2026-03-28 14:06:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='MV57%2520UOY') HTTP/1.1" 204 0
2026-03-28 14:06:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YO66ENU/42809748?sv=2020-08-04&st=2026-03-28T14%3A06%3A26Z&se=2026-03-28T14%3A31%3A26Z&sr=b&sp=r&sig=7%2BETLPIcX2eu%2By5D0%2BtTEmXYS%2FFAqP%2B5SquQ2dIEkPA%3D> (referer: https://www.bca.co.uk/)
2026-03-28 14:06:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KM11UUD/698915386/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/KM11UUD/42809630?sv=2020-08-04&st=2026-03-28T14%3A03%3A52Z&se=2026-03-28T14%3A28%3A52Z&sr=b&sp=r&sig=S16ojkv9p8NH2wa7caJZQVn%2BDGo%2BREXS30Hz2ckWR%2FA%3D)
2026-03-28 14:06:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698708232%27 HTTP/1.1" 200 None
2026-03-28 14:06:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698708232 not downloaded yet
2026-03-28 14:06:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698328435%27 HTTP/1.1" 200 None
2026-03-28 14:06:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698328435 not downloaded yet
2026-03-28 14:06:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698729612%27 HTTP/1.1" 200 None
2026-03-28 14:06:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698729612 not downloaded yet
2026-03-28 14:06:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698633975%27 HTTP/1.1" 200 None
2026-03-28 14:06:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698633975 not downloaded yet
2026-03-28 14:06:30 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GL11XOW/698717235/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698717235>
2026-03-28 14:06:30 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AJ17HXL/698328427/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=AJ17HXL-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-28 14:06:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698717326%27 HTTP/1.1" 200 None
2026-03-28 14:06:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698717326 not downloaded yet
2026-03-28 14:06:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698729643%27 HTTP/1.1" 200 None
2026-03-28 14:06:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698729643 not downloaded yet
2026-03-28 14:06:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698795050%27 HTTP/1.1" 200 None
2026-03-28 14:06:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698795050 not downloaded yet
2026-03-28 14:06:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698814418%27 HTTP/1.1" 200 None
2026-03-28 14:06:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698814418 not downloaded yet
2026-03-28 14:06:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:06:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2ca73650>
2026-03-28 14:06:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:06:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:06:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:06:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bca1d29f-c38f-5f42-aceb-2939b9e67c99/bca1d29f-c38f-5f42-aceb-2939b9e67c99_expert_report_file_49cdc4e4-f364-4155-9c78-60f54269a98c.pdf HTTP/1.1" 201 0
2026-03-28 14:06:30 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item bca1d29f-c38f-5f42-aceb-2939b9e67c99
2026-03-28 14:06:30 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: bca1d29f-c38f-5f42-aceb-2939b9e67c99, skipping ID generation
2026-03-28 14:06:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item bca1d29f-c38f-5f42-aceb-2939b9e67c99
2026-03-28 14:06:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DYH12ZWB-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-28 14:06:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=YH12ZWB-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-28 14:06:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:06:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c1391d0>
2026-03-28 14:06:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:06:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:06:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:06:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6671a6d0-673a-5170-b57c-2fa413a2722d/6671a6d0-673a-5170-b57c-2fa413a2722d_expert_report_file_579eb67e-f083-454b-8a32-a9776a13b288.pdf HTTP/1.1" 201 0
2026-03-28 14:06:30 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item 6671a6d0-673a-5170-b57c-2fa413a2722d
2026-03-28 14:06:30 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 6671a6d0-673a-5170-b57c-2fa413a2722d, skipping ID generation
2026-03-28 14:06:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 6671a6d0-673a-5170-b57c-2fa413a2722d
2026-03-28 14:06:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DM70ODE-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-28 14:06:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=M70ODE-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-28 14:06:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GL11XOW/698717151/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/GL11XOW/42810476?sv=2020-08-04&st=2026-03-28T14%3A06%3A24Z&se=2026-03-28T14%3A31%3A24Z&sr=b&sp=r&sig=Z2KlPx5wKthhayrUXNoIRMZ89bgZHolJc7BL3Q6T4LE%3D)
2026-03-28 14:06:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GK66WPY/698996494/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/GK66WPY/42809827?sv=2020-08-04&st=2026-03-28T14%3A06%3A24Z&se=2026-03-28T14%3A31%3A24Z&sr=b&sp=r&sig=o38p1n2nvobOwynrpVnEPlBMUIA211EoJMva9vtfiY0%3D)
2026-03-28 14:06:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698328437%27 HTTP/1.1" 200 None
2026-03-28 14:06:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698328437 not downloaded yet
2026-03-28 14:06:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698729628%27 HTTP/1.1" 200 None
2026-03-28 14:06:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698729628 not downloaded yet
2026-03-28 14:06:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698633980%27 HTTP/1.1" 200 None
2026-03-28 14:06:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698633980 not downloaded yet
2026-03-28 14:06:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YB57FZC/697429828/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YB57FZC/42780945?sv=2020-08-04&st=2026-03-28T14%3A06%3A24Z&se=2026-03-28T14%3A31%3A24Z&sr=b&sp=r&sig=kASeFsaHouQL63iaTeQp41zLaxTJgFeMsVL%2BJCZ14I4%3D)
2026-03-28 14:06:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RV60TZO/698707933/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/RV60TZO/42810285?sv=2020-08-04&st=2026-03-28T14%3A06%3A24Z&se=2026-03-28T14%3A31%3A24Z&sr=b&sp=r&sig=0wfV7eTXgj18RoXJ9dVJaCh0eej2XdKr%2F9zBrTgYLZs%3D)
2026-03-28 14:06:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698717345%27 HTTP/1.1" 200 None
2026-03-28 14:06:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698717345 not downloaded yet
2026-03-28 14:06:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698729664%27 HTTP/1.1" 200 None
2026-03-28 14:06:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698729664 not downloaded yet
2026-03-28 14:06:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698795056%27 HTTP/1.1" 200 None
2026-03-28 14:06:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698795056 not downloaded yet
2026-03-28 14:06:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698814440%27 HTTP/1.1" 200 None
2026-03-28 14:06:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698814440 not downloaded yet
2026-03-28 14:06:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698787057%27 HTTP/1.1" 200 None
2026-03-28 14:06:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698787057 not downloaded yet
2026-03-28 14:06:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698941314%27 HTTP/1.1" 200 None
2026-03-28 14:06:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698941314 not downloaded yet
2026-03-28 14:06:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:06:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a1fe8fd90>
2026-03-28 14:06:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:06:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:06:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:06:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_be5cf8be-a032-55c5-880a-33e1f5f6185e/be5cf8be-a032-55c5-880a-33e1f5f6185e_image_0.jpg HTTP/1.1" 201 0
2026-03-28 14:06:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FRV60TZO%252F698707911%252F600') HTTP/1.1" 204 0
2026-03-28 14:06:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RV60TZO/698707911/600 saved to cache
2026-03-28 14:06:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item be5cf8be-a032-55c5-880a-33e1f5f6185e
2026-03-28 14:06:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698328438%27 HTTP/1.1" 200 None
2026-03-28 14:06:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698328438 not downloaded yet
2026-03-28 14:06:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698729646%27 HTTP/1.1" 200 None
2026-03-28 14:06:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698729646 not downloaded yet
2026-03-28 14:06:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698633989%27 HTTP/1.1" 200 None
2026-03-28 14:06:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698633989 not downloaded yet
2026-03-28 14:06:30 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AJ17HXL/698328430/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698328430>
2026-03-28 14:06:30 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AJ17HXL/698328429/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698328429>
2026-03-28 14:06:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GL11XOW/698717219/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/GL11XOW/42810476?sv=2020-08-04&st=2026-03-28T14%3A06%3A24Z&se=2026-03-28T14%3A31%3A24Z&sr=b&sp=r&sig=Z2KlPx5wKthhayrUXNoIRMZ89bgZHolJc7BL3Q6T4LE%3D)
2026-03-28 14:06:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RV60TZO/698707998/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/RV60TZO/42810285?sv=2020-08-04&st=2026-03-28T14%3A06%3A24Z&se=2026-03-28T14%3A31%3A24Z&sr=b&sp=r&sig=0wfV7eTXgj18RoXJ9dVJaCh0eej2XdKr%2F9zBrTgYLZs%3D)
2026-03-28 14:06:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698729680%27 HTTP/1.1" 200 None
2026-03-28 14:06:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698729680 not downloaded yet
2026-03-28 14:06:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698795066%27 HTTP/1.1" 200 None
2026-03-28 14:06:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698795066 not downloaded yet
2026-03-28 14:06:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698814451%27 HTTP/1.1" 200 None
2026-03-28 14:06:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698814451 not downloaded yet
2026-03-28 14:06:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698787080%27 HTTP/1.1" 200 None
2026-03-28 14:06:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698787080 not downloaded yet
2026-03-28 14:06:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698941322%27 HTTP/1.1" 200 None
2026-03-28 14:06:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698941322 not downloaded yet
2026-03-28 14:06:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:06:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c58a510>
2026-03-28 14:06:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:06:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:06:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:06:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8d0c9ac8-161b-5c76-8a79-0338cb8a1867/8d0c9ac8-161b-5c76-8a79-0338cb8a1867_expert_report_file_7b034426-1e17-4f42-967f-51dd4c33ed63.pdf HTTP/1.1" 201 0
2026-03-28 14:06:30 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item 8d0c9ac8-161b-5c76-8a79-0338cb8a1867
2026-03-28 14:06:30 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 8d0c9ac8-161b-5c76-8a79-0338cb8a1867, skipping ID generation
2026-03-28 14:06:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 8d0c9ac8-161b-5c76-8a79-0338cb8a1867
2026-03-28 14:06:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DYO66ENU-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-28 14:06:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=YO66ENU-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-28 14:06:30 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:06:30 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:06:30 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:06:30 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:06:30 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:06:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:06:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c923ed0>
2026-03-28 14:06:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:06:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:06:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:06:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7ba82627-3d66-5970-bb5d-b19d751b9eb4/7ba82627-3d66-5970-bb5d-b19d751b9eb4_image_8.jpg HTTP/1.1" 201 0
2026-03-28 14:06:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FKM11UUD%252F698915386%252F600') HTTP/1.1" 204 0
2026-03-28 14:06:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KM11UUD/698915386/600 saved to cache
2026-03-28 14:06:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 7ba82627-3d66-5970-bb5d-b19d751b9eb4
2026-03-28 14:06:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AJ17HXL/698328427/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/AJ17HXL/42798748?sv=2020-08-04&st=2026-03-28T14%3A06%3A24Z&se=2026-03-28T14%3A31%3A24Z&sr=b&sp=r&sig=s%2FenQJFKWZab81RCtX8FxHWN1BS3QTqj1oqoO1gcyoI%3D)
2026-03-28 14:06:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GK66WPY/698996529/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/GK66WPY/42809827?sv=2020-08-04&st=2026-03-28T14%3A06%3A24Z&se=2026-03-28T14%3A31%3A24Z&sr=b&sp=r&sig=o38p1n2nvobOwynrpVnEPlBMUIA211EoJMva9vtfiY0%3D)
2026-03-28 14:06:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RV60TZO/698708036/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/RV60TZO/42810285?sv=2020-08-04&st=2026-03-28T14%3A06%3A24Z&se=2026-03-28T14%3A31%3A24Z&sr=b&sp=r&sig=0wfV7eTXgj18RoXJ9dVJaCh0eej2XdKr%2F9zBrTgYLZs%3D)
2026-03-28 14:06:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698328440%27 HTTP/1.1" 200 None
2026-03-28 14:06:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698328440 not downloaded yet
2026-03-28 14:06:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698729666%27 HTTP/1.1" 200 None
2026-03-28 14:06:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698729666 not downloaded yet
2026-03-28 14:06:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698634000%27 HTTP/1.1" 200 None
2026-03-28 14:06:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698634000 not downloaded yet
2026-03-28 14:06:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:06:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c40f110>
2026-03-28 14:06:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:06:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:06:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:06:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_011230be-e1a4-58b5-92df-e152edda7f73/011230be-e1a4-58b5-92df-e152edda7f73_image_0.jpg HTTP/1.1" 201 0
2026-03-28 14:06:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FGL11XOW%252F698717151%252F600') HTTP/1.1" 204 0
2026-03-28 14:06:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GL11XOW/698717151/600 saved to cache
2026-03-28 14:06:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 011230be-e1a4-58b5-92df-e152edda7f73
2026-03-28 14:06:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:06:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c3fcb50>
2026-03-28 14:06:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:06:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:06:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:06:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3e1a668c-07f1-5b40-8f70-ce6f3b64756d/3e1a668c-07f1-5b40-8f70-ce6f3b64756d_image_1.jpg HTTP/1.1" 201 0
2026-03-28 14:06:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FGK66WPY%252F698996494%252F600') HTTP/1.1" 204 0
2026-03-28 14:06:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GK66WPY/698996494/600 saved to cache
2026-03-28 14:06:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 3e1a668c-07f1-5b40-8f70-ce6f3b64756d
2026-03-28 14:06:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:06:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c59e750>
2026-03-28 14:06:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:06:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:06:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:06:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b9b1844a-f6e4-586f-88aa-fc22f6ebd424/b9b1844a-f6e4-586f-88aa-fc22f6ebd424_image_1.jpg HTTP/1.1" 201 0
2026-03-28 14:06:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FYB57FZC%252F697429828%252F600') HTTP/1.1" 204 0
2026-03-28 14:06:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YB57FZC/697429828/600 saved to cache
2026-03-28 14:06:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item b9b1844a-f6e4-586f-88aa-fc22f6ebd424
2026-03-28 14:06:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:06:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c3fc050>
2026-03-28 14:06:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:06:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:06:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:06:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_be5cf8be-a032-55c5-880a-33e1f5f6185e/be5cf8be-a032-55c5-880a-33e1f5f6185e_image_1.jpg HTTP/1.1" 201 0
2026-03-28 14:06:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FRV60TZO%252F698707933%252F600') HTTP/1.1" 204 0
2026-03-28 14:06:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RV60TZO/698707933/600 saved to cache
2026-03-28 14:06:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item be5cf8be-a032-55c5-880a-33e1f5f6185e
2026-03-28 14:06:30 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GJ70LXZ/698814387/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698814387>
2026-03-28 14:06:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698729703%27 HTTP/1.1" 200 None
2026-03-28 14:06:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698729703 not downloaded yet
2026-03-28 14:06:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698795082%27 HTTP/1.1" 200 None
2026-03-28 14:06:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698795082 not downloaded yet
2026-03-28 14:06:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698814478%27 HTTP/1.1" 200 None
2026-03-28 14:06:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698814478 not downloaded yet
2026-03-28 14:06:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698787097%27 HTTP/1.1" 200 None
2026-03-28 14:06:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698787097 not downloaded yet
2026-03-28 14:06:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698941340%27 HTTP/1.1" 200 None
2026-03-28 14:06:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698941340 not downloaded yet
2026-03-28 14:06:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D696055918%27 HTTP/1.1" 200 None
2026-03-28 14:06:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=696055918 not downloaded yet
2026-03-28 14:06:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GL11XOW/698717235/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/GL11XOW/42810476?sv=2020-08-04&st=2026-03-28T14%3A06%3A24Z&se=2026-03-28T14%3A31%3A24Z&sr=b&sp=r&sig=Z2KlPx5wKthhayrUXNoIRMZ89bgZHolJc7BL3Q6T4LE%3D)
2026-03-28 14:06:31 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GJ70LXZ/698814406/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698814406>
2026-03-28 14:06:31 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KJ70LJU/698795039/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698795039>
2026-03-28 14:06:31 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/M70ODE/698941305/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=M70ODE-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-28 14:06:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698328441%27 HTTP/1.1" 200 None
2026-03-28 14:06:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698328441 not downloaded yet
2026-03-28 14:06:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698729678%27 HTTP/1.1" 200 None
2026-03-28 14:06:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698729678 not downloaded yet
2026-03-28 14:06:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698634008%27 HTTP/1.1" 200 None
2026-03-28 14:06:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698634008 not downloaded yet
2026-03-28 14:06:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:06:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2ddfb210>
2026-03-28 14:06:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:06:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:06:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:06:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_011230be-e1a4-58b5-92df-e152edda7f73/011230be-e1a4-58b5-92df-e152edda7f73_image_3.jpg HTTP/1.1" 201 0
2026-03-28 14:06:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FGL11XOW%252F698717219%252F600') HTTP/1.1" 204 0
2026-03-28 14:06:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GL11XOW/698717219/600 saved to cache
2026-03-28 14:06:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 011230be-e1a4-58b5-92df-e152edda7f73
2026-03-28 14:06:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:06:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c9a0ad0>
2026-03-28 14:06:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:06:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:06:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:06:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_be5cf8be-a032-55c5-880a-33e1f5f6185e/be5cf8be-a032-55c5-880a-33e1f5f6185e_image_3.jpg HTTP/1.1" 201 0
2026-03-28 14:06:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FRV60TZO%252F698707998%252F600') HTTP/1.1" 204 0
2026-03-28 14:06:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RV60TZO/698707998/600 saved to cache
2026-03-28 14:06:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item be5cf8be-a032-55c5-880a-33e1f5f6185e
2026-03-28 14:06:31 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KJ70LJU/698795050/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698795050>
2026-03-28 14:06:31 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YH12ZWB/698787040/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=YH12ZWB-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-28 14:06:31 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GJ70LXZ/698814418/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698814418>
2026-03-28 14:06:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698729720%27 HTTP/1.1" 200 None
2026-03-28 14:06:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698729720 not downloaded yet
2026-03-28 14:06:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698795089%27 HTTP/1.1" 200 None
2026-03-28 14:06:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698795089 not downloaded yet
2026-03-28 14:06:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698814503%27 HTTP/1.1" 200 None
2026-03-28 14:06:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698814503 not downloaded yet
2026-03-28 14:06:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698787113%27 HTTP/1.1" 200 None
2026-03-28 14:06:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698787113 not downloaded yet
2026-03-28 14:06:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698941358%27 HTTP/1.1" 200 None
2026-03-28 14:06:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698941358 not downloaded yet
2026-03-28 14:06:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D696055921%27 HTTP/1.1" 200 None
2026-03-28 14:06:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=696055921 not downloaded yet
2026-03-28 14:06:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698328443%27 HTTP/1.1" 200 None
2026-03-28 14:06:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698328443 not downloaded yet
2026-03-28 14:06:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698729701%27 HTTP/1.1" 200 None
2026-03-28 14:06:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698729701 not downloaded yet
2026-03-28 14:06:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698634023%27 HTTP/1.1" 200 None
2026-03-28 14:06:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698634023 not downloaded yet
2026-03-28 14:06:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AJ17HXL/698328429/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/AJ17HXL/42798748?sv=2020-08-04&st=2026-03-28T14%3A06%3A24Z&se=2026-03-28T14%3A31%3A24Z&sr=b&sp=r&sig=s%2FenQJFKWZab81RCtX8FxHWN1BS3QTqj1oqoO1gcyoI%3D)
2026-03-28 14:06:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AJ17HXL/698328430/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/AJ17HXL/42798748?sv=2020-08-04&st=2026-03-28T14%3A06%3A24Z&se=2026-03-28T14%3A31%3A24Z&sr=b&sp=r&sig=s%2FenQJFKWZab81RCtX8FxHWN1BS3QTqj1oqoO1gcyoI%3D)
2026-03-28 14:06:31 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BC65FJV/698633989/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698633989>
2026-03-28 14:06:31 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/M70ODE/698941314/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698941314>
2026-03-28 14:06:31 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YH12ZWB/698787057/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698787057>
2026-03-28 14:06:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698729736%27 HTTP/1.1" 200 None
2026-03-28 14:06:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698729736 not downloaded yet
2026-03-28 14:06:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698795108%27 HTTP/1.1" 200 None
2026-03-28 14:06:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698795108 not downloaded yet
2026-03-28 14:06:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698814526%27 HTTP/1.1" 200 None
2026-03-28 14:06:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698814526 not downloaded yet
2026-03-28 14:06:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698787125%27 HTTP/1.1" 200 None
2026-03-28 14:06:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698787125 not downloaded yet
2026-03-28 14:06:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698941374%27 HTTP/1.1" 200 None
2026-03-28 14:06:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698941374 not downloaded yet
2026-03-28 14:06:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D696055929%27 HTTP/1.1" 200 None
2026-03-28 14:06:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=696055929 not downloaded yet
2026-03-28 14:06:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:06:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c6dd590>
2026-03-28 14:06:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:06:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:06:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:06:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2a541890-0343-5ec1-9e09-787ef67af079/2a541890-0343-5ec1-9e09-787ef67af079_image_0.jpg HTTP/1.1" 201 0
2026-03-28 14:06:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FAJ17HXL%252F698328427%252F600') HTTP/1.1" 204 0
2026-03-28 14:06:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AJ17HXL/698328427/600 saved to cache
2026-03-28 14:06:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 2a541890-0343-5ec1-9e09-787ef67af079
2026-03-28 14:06:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:06:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c4c8490>
2026-03-28 14:06:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:06:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:06:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:06:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3e1a668c-07f1-5b40-8f70-ce6f3b64756d/3e1a668c-07f1-5b40-8f70-ce6f3b64756d_image_5.jpg HTTP/1.1" 201 0
2026-03-28 14:06:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FGK66WPY%252F698996529%252F600') HTTP/1.1" 204 0
2026-03-28 14:06:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GK66WPY/698996529/600 saved to cache
2026-03-28 14:06:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 3e1a668c-07f1-5b40-8f70-ce6f3b64756d
2026-03-28 14:06:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:06:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c4ca350>
2026-03-28 14:06:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:06:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:06:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:06:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_be5cf8be-a032-55c5-880a-33e1f5f6185e/be5cf8be-a032-55c5-880a-33e1f5f6185e_image_4.jpg HTTP/1.1" 201 0
2026-03-28 14:06:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FRV60TZO%252F698708036%252F600') HTTP/1.1" 204 0
2026-03-28 14:06:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RV60TZO/698708036/600 saved to cache
2026-03-28 14:06:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item be5cf8be-a032-55c5-880a-33e1f5f6185e
2026-03-28 14:06:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:06:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2d7b44d0>
2026-03-28 14:06:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:06:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:06:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:06:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_011230be-e1a4-58b5-92df-e152edda7f73/011230be-e1a4-58b5-92df-e152edda7f73_image_4.jpg HTTP/1.1" 201 0
2026-03-28 14:06:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FGL11XOW%252F698717235%252F600') HTTP/1.1" 204 0
2026-03-28 14:06:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GL11XOW/698717235/600 saved to cache
2026-03-28 14:06:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 011230be-e1a4-58b5-92df-e152edda7f73
2026-03-28 14:06:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/M70ODE/698941305/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/M70ODE/42810084?sv=2020-08-04&st=2026-03-28T14%3A06%3A26Z&se=2026-03-28T14%3A31%3A26Z&sr=b&sp=r&sig=NvAgSAtcVVNpw59OnQY5IgDyurxqMu%2F2N0bZVQgkz%2BA%3D)
2026-03-28 14:06:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698729719%27 HTTP/1.1" 200 None
2026-03-28 14:06:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698729719 not downloaded yet
2026-03-28 14:06:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698634038%27 HTTP/1.1" 200 None
2026-03-28 14:06:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698634038 not downloaded yet
2026-03-28 14:06:31 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AV13PZZ/698729646/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698729646>
2026-03-28 14:06:31 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AJ17HXL/698328438/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698328438>
2026-03-28 14:06:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698729752%27 HTTP/1.1" 200 None
2026-03-28 14:06:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698729752 not downloaded yet
2026-03-28 14:06:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698795119%27 HTTP/1.1" 200 None
2026-03-28 14:06:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698795119 not downloaded yet
2026-03-28 14:06:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698814543%27 HTTP/1.1" 200 None
2026-03-28 14:06:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698814543 not downloaded yet
2026-03-28 14:06:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698787151%27 HTTP/1.1" 200 None
2026-03-28 14:06:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698787151 not downloaded yet
2026-03-28 14:06:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698941400%27 HTTP/1.1" 200 None
2026-03-28 14:06:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698941400 not downloaded yet
2026-03-28 14:06:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D696055938%27 HTTP/1.1" 200 None
2026-03-28 14:06:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=696055938 not downloaded yet
2026-03-28 14:06:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698729741%27 HTTP/1.1" 200 None
2026-03-28 14:06:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698729741 not downloaded yet
2026-03-28 14:06:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698634050%27 HTTP/1.1" 200 None
2026-03-28 14:06:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698634050 not downloaded yet
2026-03-28 14:06:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:06:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2d8e4cd0>
2026-03-28 14:06:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:06:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:06:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:06:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2a541890-0343-5ec1-9e09-787ef67af079/2a541890-0343-5ec1-9e09-787ef67af079_image_1.jpg HTTP/1.1" 201 0
2026-03-28 14:06:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FAJ17HXL%252F698328429%252F600') HTTP/1.1" 204 0
2026-03-28 14:06:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AJ17HXL/698328429/600 saved to cache
2026-03-28 14:06:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 2a541890-0343-5ec1-9e09-787ef67af079
2026-03-28 14:06:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:06:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c9b7410>
2026-03-28 14:06:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:06:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:06:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:06:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2a541890-0343-5ec1-9e09-787ef67af079/2a541890-0343-5ec1-9e09-787ef67af079_image_2.jpg HTTP/1.1" 201 0
2026-03-28 14:06:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FAJ17HXL%252F698328430%252F600') HTTP/1.1" 204 0
2026-03-28 14:06:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AJ17HXL/698328430/600 saved to cache
2026-03-28 14:06:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 2a541890-0343-5ec1-9e09-787ef67af079
2026-03-28 14:06:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GJ70LXZ/698814406/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/GJ70LXZ/42808336?sv=2020-08-04&st=2026-03-28T14%3A06%3A24Z&se=2026-03-28T14%3A31%3A24Z&sr=b&sp=r&sig=b57i0PzDZVUlozUA4vRBxPguh6MBQAEl464L60jtAsQ%3D)
2026-03-28 14:06:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KJ70LJU/698795039/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/KJ70LJU/42807917?sv=2020-08-04&st=2026-03-28T14%3A06%3A24Z&se=2026-03-28T14%3A31%3A24Z&sr=b&sp=r&sig=T2vuiJBTz4jV3GmdM5bnFNfH4xGipPA46fpyn3Y01Pc%3D)
2026-03-28 14:06:31 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BC65FJV/698634000/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698634000>
2026-03-28 14:06:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YH12ZWB/698787040/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YH12ZWB/42807832?sv=2020-08-04&st=2026-03-28T14%3A06%3A26Z&se=2026-03-28T14%3A31%3A26Z&sr=b&sp=r&sig=IdAZy5bTiPvaFPsGYQH5tM1qjYLVI7KwntzQxTYK%2F38%3D)
2026-03-28 14:06:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GJ70LXZ/698814387/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/GJ70LXZ/42808336?sv=2020-08-04&st=2026-03-28T14%3A06%3A24Z&se=2026-03-28T14%3A31%3A24Z&sr=b&sp=r&sig=b57i0PzDZVUlozUA4vRBxPguh6MBQAEl464L60jtAsQ%3D)
2026-03-28 14:06:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GJ70LXZ/698814418/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/GJ70LXZ/42808336?sv=2020-08-04&st=2026-03-28T14%3A06%3A24Z&se=2026-03-28T14%3A31%3A24Z&sr=b&sp=r&sig=b57i0PzDZVUlozUA4vRBxPguh6MBQAEl464L60jtAsQ%3D)
2026-03-28 14:06:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698787190%27 HTTP/1.1" 200 None
2026-03-28 14:06:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698787190 not downloaded yet
2026-03-28 14:06:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698941434%27 HTTP/1.1" 200 None
2026-03-28 14:06:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698941434 not downloaded yet
2026-03-28 14:06:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D696055944%27 HTTP/1.1" 200 None
2026-03-28 14:06:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=696055944 not downloaded yet
2026-03-28 14:06:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698729758%27 HTTP/1.1" 200 None
2026-03-28 14:06:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698729758 not downloaded yet
2026-03-28 14:06:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698634070%27 HTTP/1.1" 200 None
2026-03-28 14:06:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698634070 not downloaded yet
2026-03-28 14:06:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698787214%27 HTTP/1.1" 200 None
2026-03-28 14:06:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698787214 not downloaded yet
2026-03-28 14:06:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698941455%27 HTTP/1.1" 200 None
2026-03-28 14:06:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698941455 not downloaded yet
2026-03-28 14:06:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D696055953%27 HTTP/1.1" 200 None
2026-03-28 14:06:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=696055953 not downloaded yet
2026-03-28 14:06:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:06:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c927e50>
2026-03-28 14:06:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:06:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:06:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:06:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6671a6d0-673a-5170-b57c-2fa413a2722d/6671a6d0-673a-5170-b57c-2fa413a2722d_image_0.jpg HTTP/1.1" 201 0
2026-03-28 14:06:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FM70ODE%252F698941305%252F600') HTTP/1.1" 204 0
2026-03-28 14:06:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/M70ODE/698941305/600 saved to cache
2026-03-28 14:06:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 6671a6d0-673a-5170-b57c-2fa413a2722d
2026-03-28 14:06:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YH12ZWB/698787057/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YH12ZWB/42807832?sv=2020-08-04&st=2026-03-28T14%3A06%3A26Z&se=2026-03-28T14%3A31%3A26Z&sr=b&sp=r&sig=IdAZy5bTiPvaFPsGYQH5tM1qjYLVI7KwntzQxTYK%2F38%3D)
2026-03-28 14:06:32 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BC65FJV/698634023/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698634023>
2026-03-28 14:06:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/M70ODE/698941314/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/M70ODE/42810084?sv=2020-08-04&st=2026-03-28T14%3A06%3A26Z&se=2026-03-28T14%3A31%3A26Z&sr=b&sp=r&sig=NvAgSAtcVVNpw59OnQY5IgDyurxqMu%2F2N0bZVQgkz%2BA%3D)
2026-03-28 14:06:32 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/M70ODE/698941358/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698941358>
2026-03-28 14:06:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KJ70LJU/698795050/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/KJ70LJU/42807917?sv=2020-08-04&st=2026-03-28T14%3A06%3A24Z&se=2026-03-28T14%3A31%3A24Z&sr=b&sp=r&sig=T2vuiJBTz4jV3GmdM5bnFNfH4xGipPA46fpyn3Y01Pc%3D)
2026-03-28 14:06:32 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YO66ENU/696055921/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=696055921>
2026-03-28 14:06:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BC65FJV/698633989/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/BC65FJV/42805191?sv=2020-08-04&st=2026-03-28T14%3A06%3A26Z&se=2026-03-28T14%3A31%3A26Z&sr=b&sp=r&sig=VD7AqlkCpzlQHKxBAL0n0wRt3IwFKoVa%2FExqjVTdHHA%3D)
2026-03-28 14:06:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698787232%27 HTTP/1.1" 200 None
2026-03-28 14:06:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698787232 not downloaded yet
2026-03-28 14:06:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698941481%27 HTTP/1.1" 200 None
2026-03-28 14:06:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698941481 not downloaded yet
2026-03-28 14:06:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D696055963%27 HTTP/1.1" 200 None
2026-03-28 14:06:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=696055963 not downloaded yet
2026-03-28 14:06:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AJ17HXL/698328438/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/AJ17HXL/42798748?sv=2020-08-04&st=2026-03-28T14%3A06%3A24Z&se=2026-03-28T14%3A31%3A24Z&sr=b&sp=r&sig=s%2FenQJFKWZab81RCtX8FxHWN1BS3QTqj1oqoO1gcyoI%3D)
2026-03-28 14:06:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:06:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2dd07f10>
2026-03-28 14:06:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:06:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:06:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:06:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_680c4e9b-15ae-54e0-a824-8a7fce3528fb/680c4e9b-15ae-54e0-a824-8a7fce3528fb_image_2.jpg HTTP/1.1" 201 0
2026-03-28 14:06:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FGJ70LXZ%252F698814406%252F600') HTTP/1.1" 204 0
2026-03-28 14:06:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GJ70LXZ/698814406/600 saved to cache
2026-03-28 14:06:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 680c4e9b-15ae-54e0-a824-8a7fce3528fb
2026-03-28 14:06:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:06:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c42b890>
2026-03-28 14:06:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:06:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:06:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:06:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_df9a9a0d-7908-5df5-80db-63767b9fcbae/df9a9a0d-7908-5df5-80db-63767b9fcbae_image_2.jpg HTTP/1.1" 201 0
2026-03-28 14:06:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FKJ70LJU%252F698795039%252F600') HTTP/1.1" 204 0
2026-03-28 14:06:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KJ70LJU/698795039/600 saved to cache
2026-03-28 14:06:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item df9a9a0d-7908-5df5-80db-63767b9fcbae
2026-03-28 14:06:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:06:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c98f450>
2026-03-28 14:06:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:06:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:06:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:06:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bca1d29f-c38f-5f42-aceb-2939b9e67c99/bca1d29f-c38f-5f42-aceb-2939b9e67c99_image_0.jpg HTTP/1.1" 201 0
2026-03-28 14:06:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FYH12ZWB%252F698787040%252F600') HTTP/1.1" 204 0
2026-03-28 14:06:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YH12ZWB/698787040/600 saved to cache
2026-03-28 14:06:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item bca1d29f-c38f-5f42-aceb-2939b9e67c99
2026-03-28 14:06:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:06:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c40e850>
2026-03-28 14:06:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:06:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:06:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:06:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_680c4e9b-15ae-54e0-a824-8a7fce3528fb/680c4e9b-15ae-54e0-a824-8a7fce3528fb_image_1.jpg HTTP/1.1" 201 0
2026-03-28 14:06:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FGJ70LXZ%252F698814387%252F600') HTTP/1.1" 204 0
2026-03-28 14:06:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GJ70LXZ/698814387/600 saved to cache
2026-03-28 14:06:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 680c4e9b-15ae-54e0-a824-8a7fce3528fb
2026-03-28 14:06:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:06:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c98c4d0>
2026-03-28 14:06:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:06:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:06:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:06:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_680c4e9b-15ae-54e0-a824-8a7fce3528fb/680c4e9b-15ae-54e0-a824-8a7fce3528fb_image_3.jpg HTTP/1.1" 201 0
2026-03-28 14:06:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FGJ70LXZ%252F698814418%252F600') HTTP/1.1" 204 0
2026-03-28 14:06:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GJ70LXZ/698814418/600 saved to cache
2026-03-28 14:06:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 680c4e9b-15ae-54e0-a824-8a7fce3528fb
2026-03-28 14:06:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D696055970%27 HTTP/1.1" 200 None
2026-03-28 14:06:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=696055970 not downloaded yet
2026-03-28 14:06:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AV13PZZ/698729646/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/AV13PZZ/42810506?sv=2020-08-04&st=2026-03-28T14%3A06%3A24Z&se=2026-03-28T14%3A31%3A24Z&sr=b&sp=r&sig=nZ0bGWVTxK13EuaxhdSPPyqqrzizvd8XT5v5hUK7Ua4%3D)
2026-03-28 14:06:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D696055980%27 HTTP/1.1" 200 None
2026-03-28 14:06:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=696055980 not downloaded yet
2026-03-28 14:06:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:06:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c81af90>
2026-03-28 14:06:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:06:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:06:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:06:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bca1d29f-c38f-5f42-aceb-2939b9e67c99/bca1d29f-c38f-5f42-aceb-2939b9e67c99_image_1.jpg HTTP/1.1" 201 0
2026-03-28 14:06:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FYH12ZWB%252F698787057%252F600') HTTP/1.1" 204 0
2026-03-28 14:06:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YH12ZWB/698787057/600 saved to cache
2026-03-28 14:06:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item bca1d29f-c38f-5f42-aceb-2939b9e67c99
2026-03-28 14:06:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:06:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c819310>
2026-03-28 14:06:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:06:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:06:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:06:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6671a6d0-673a-5170-b57c-2fa413a2722d/6671a6d0-673a-5170-b57c-2fa413a2722d_image_1.jpg HTTP/1.1" 201 0
2026-03-28 14:06:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FM70ODE%252F698941314%252F600') HTTP/1.1" 204 0
2026-03-28 14:06:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/M70ODE/698941314/600 saved to cache
2026-03-28 14:06:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 6671a6d0-673a-5170-b57c-2fa413a2722d
2026-03-28 14:06:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:06:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c9e9f90>
2026-03-28 14:06:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:06:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:06:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:06:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_df9a9a0d-7908-5df5-80db-63767b9fcbae/df9a9a0d-7908-5df5-80db-63767b9fcbae_image_3.jpg HTTP/1.1" 201 0
2026-03-28 14:06:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FKJ70LJU%252F698795050%252F600') HTTP/1.1" 204 0
2026-03-28 14:06:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KJ70LJU/698795050/600 saved to cache
2026-03-28 14:06:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item df9a9a0d-7908-5df5-80db-63767b9fcbae
2026-03-28 14:06:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:06:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a1fe315d0>
2026-03-28 14:06:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:06:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:06:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:06:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_515d9b9e-7ed9-596c-8fe3-830ee20f7887/515d9b9e-7ed9-596c-8fe3-830ee20f7887_image_3.jpg HTTP/1.1" 201 0
2026-03-28 14:06:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FBC65FJV%252F698633989%252F600') HTTP/1.1" 204 0
2026-03-28 14:06:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BC65FJV/698633989/600 saved to cache
2026-03-28 14:06:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 515d9b9e-7ed9-596c-8fe3-830ee20f7887
2026-03-28 14:06:32 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:06:32 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:06:32 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:06:32 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:06:32 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:06:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:06:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c8db210>
2026-03-28 14:06:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:06:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:06:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:06:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2a541890-0343-5ec1-9e09-787ef67af079/2a541890-0343-5ec1-9e09-787ef67af079_image_6.jpg HTTP/1.1" 201 0
2026-03-28 14:06:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FAJ17HXL%252F698328438%252F600') HTTP/1.1" 204 0
2026-03-28 14:06:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AJ17HXL/698328438/600 saved to cache
2026-03-28 14:06:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 2a541890-0343-5ec1-9e09-787ef67af079
2026-03-28 14:06:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BC65FJV/698634000/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/BC65FJV/42805191?sv=2020-08-04&st=2026-03-28T14%3A06%3A26Z&se=2026-03-28T14%3A31%3A26Z&sr=b&sp=r&sig=VD7AqlkCpzlQHKxBAL0n0wRt3IwFKoVa%2FExqjVTdHHA%3D)
2026-03-28 14:06:32 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YO66ENU/696055938/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=696055938>
2026-03-28 14:06:32 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BC65FJV/698634070/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698634070>
2026-03-28 14:06:32 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KJ70LJU/698795119/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698795119>
2026-03-28 14:06:32 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/M70ODE/698941400/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698941400>
2026-03-28 14:06:32 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GJ70LXZ/698814543/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698814543>
2026-03-28 14:06:32 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YH12ZWB/698787151/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698787151>
2026-03-28 14:06:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:06:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c819bd0>
2026-03-28 14:06:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:06:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:06:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:06:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a2561847-ff84-5663-b0c4-a7e1fe0e31f4/a2561847-ff84-5663-b0c4-a7e1fe0e31f4_image_3.jpg HTTP/1.1" 201 0
2026-03-28 14:06:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FAV13PZZ%252F698729646%252F600') HTTP/1.1" 204 0
2026-03-28 14:06:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AV13PZZ/698729646/600 saved to cache
2026-03-28 14:06:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item a2561847-ff84-5663-b0c4-a7e1fe0e31f4
2026-03-28 14:06:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YO66ENU/696055921/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YO66ENU/42809748?sv=2020-08-04&st=2026-03-28T14%3A06%3A26Z&se=2026-03-28T14%3A31%3A26Z&sr=b&sp=r&sig=7%2BETLPIcX2eu%2By5D0%2BtTEmXYS%2FFAqP%2B5SquQ2dIEkPA%3D)
2026-03-28 14:06:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:06:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c12d490>
2026-03-28 14:06:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:06:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:06:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:06:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_515d9b9e-7ed9-596c-8fe3-830ee20f7887/515d9b9e-7ed9-596c-8fe3-830ee20f7887_image_4.jpg HTTP/1.1" 201 0
2026-03-28 14:06:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FBC65FJV%252F698634000%252F600') HTTP/1.1" 204 0
2026-03-28 14:06:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BC65FJV/698634000/600 saved to cache
2026-03-28 14:06:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 515d9b9e-7ed9-596c-8fe3-830ee20f7887
2026-03-28 14:06:33 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AV13PZZ/698729758/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698729758>
2026-03-28 14:06:33 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YO66ENU/696055970/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=696055970>
2026-03-28 14:06:33 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/M70ODE/698941455/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698941455>
2026-03-28 14:06:33 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YH12ZWB/698787214/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698787214>
2026-03-28 14:06:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/M70ODE/698941358/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/M70ODE/42810084?sv=2020-08-04&st=2026-03-28T14%3A06%3A26Z&se=2026-03-28T14%3A31%3A26Z&sr=b&sp=r&sig=NvAgSAtcVVNpw59OnQY5IgDyurxqMu%2F2N0bZVQgkz%2BA%3D)
2026-03-28 14:06:33 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YO66ENU/696055953/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=696055953>
2026-03-28 14:06:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BC65FJV/698634023/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/BC65FJV/42805191?sv=2020-08-04&st=2026-03-28T14%3A06%3A26Z&se=2026-03-28T14%3A31%3A26Z&sr=b&sp=r&sig=VD7AqlkCpzlQHKxBAL0n0wRt3IwFKoVa%2FExqjVTdHHA%3D)
2026-03-28 14:06:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YH12ZWB/698787151/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YH12ZWB/42807832?sv=2020-08-04&st=2026-03-28T14%3A06%3A26Z&se=2026-03-28T14%3A31%3A26Z&sr=b&sp=r&sig=IdAZy5bTiPvaFPsGYQH5tM1qjYLVI7KwntzQxTYK%2F38%3D)
2026-03-28 14:06:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:06:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c12d890>
2026-03-28 14:06:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:06:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:06:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:06:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8d0c9ac8-161b-5c76-8a79-0338cb8a1867/8d0c9ac8-161b-5c76-8a79-0338cb8a1867_image_2.jpg HTTP/1.1" 201 0
2026-03-28 14:06:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FYO66ENU%252F696055921%252F600') HTTP/1.1" 204 0
2026-03-28 14:06:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YO66ENU/696055921/600 saved to cache
2026-03-28 14:06:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 8d0c9ac8-161b-5c76-8a79-0338cb8a1867
2026-03-28 14:06:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YO66ENU/696055938/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YO66ENU/42809748?sv=2020-08-04&st=2026-03-28T14%3A06%3A26Z&se=2026-03-28T14%3A31%3A26Z&sr=b&sp=r&sig=7%2BETLPIcX2eu%2By5D0%2BtTEmXYS%2FFAqP%2B5SquQ2dIEkPA%3D)
2026-03-28 14:06:33 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YO66ENU/696055980/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=696055980>
2026-03-28 14:06:33 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YO66ENU/696055963/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=696055963>
2026-03-28 14:06:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YO66ENU/696055953/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YO66ENU/42809748?sv=2020-08-04&st=2026-03-28T14%3A06%3A26Z&se=2026-03-28T14%3A31%3A26Z&sr=b&sp=r&sig=7%2BETLPIcX2eu%2By5D0%2BtTEmXYS%2FFAqP%2B5SquQ2dIEkPA%3D)
2026-03-28 14:06:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/M70ODE/698941400/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/M70ODE/42810084?sv=2020-08-04&st=2026-03-28T14%3A06%3A26Z&se=2026-03-28T14%3A31%3A26Z&sr=b&sp=r&sig=NvAgSAtcVVNpw59OnQY5IgDyurxqMu%2F2N0bZVQgkz%2BA%3D)
2026-03-28 14:06:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:06:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c133410>
2026-03-28 14:06:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:06:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:06:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:06:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6671a6d0-673a-5170-b57c-2fa413a2722d/6671a6d0-673a-5170-b57c-2fa413a2722d_image_4.jpg HTTP/1.1" 201 0
2026-03-28 14:06:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FM70ODE%252F698941358%252F600') HTTP/1.1" 204 0
2026-03-28 14:06:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/M70ODE/698941358/600 saved to cache
2026-03-28 14:06:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 6671a6d0-673a-5170-b57c-2fa413a2722d
2026-03-28 14:06:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GJ70LXZ/698814543/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/GJ70LXZ/42808336?sv=2020-08-04&st=2026-03-28T14%3A06%3A24Z&se=2026-03-28T14%3A31%3A24Z&sr=b&sp=r&sig=b57i0PzDZVUlozUA4vRBxPguh6MBQAEl464L60jtAsQ%3D)
2026-03-28 14:06:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YH12ZWB/698787214/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YH12ZWB/42807832?sv=2020-08-04&st=2026-03-28T14%3A06%3A26Z&se=2026-03-28T14%3A31%3A26Z&sr=b&sp=r&sig=IdAZy5bTiPvaFPsGYQH5tM1qjYLVI7KwntzQxTYK%2F38%3D)
2026-03-28 14:06:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YO66ENU/696055970/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YO66ENU/42809748?sv=2020-08-04&st=2026-03-28T14%3A06%3A26Z&se=2026-03-28T14%3A31%3A26Z&sr=b&sp=r&sig=7%2BETLPIcX2eu%2By5D0%2BtTEmXYS%2FFAqP%2B5SquQ2dIEkPA%3D)
2026-03-28 14:06:33 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:06:33 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:06:33 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:06:33 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:06:33 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:06:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:06:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a1fe8fed0>
2026-03-28 14:06:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:06:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:06:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:06:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_515d9b9e-7ed9-596c-8fe3-830ee20f7887/515d9b9e-7ed9-596c-8fe3-830ee20f7887_image_6.jpg HTTP/1.1" 201 0
2026-03-28 14:06:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FBC65FJV%252F698634023%252F600') HTTP/1.1" 204 0
2026-03-28 14:06:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BC65FJV/698634023/600 saved to cache
2026-03-28 14:06:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 515d9b9e-7ed9-596c-8fe3-830ee20f7887
2026-03-28 14:06:33 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:06:33 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:06:33 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:06:33 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:06:33 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:06:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:06:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2d6ec190>
2026-03-28 14:06:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:06:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:06:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:06:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bca1d29f-c38f-5f42-aceb-2939b9e67c99/bca1d29f-c38f-5f42-aceb-2939b9e67c99_image_6.jpg HTTP/1.1" 201 0
2026-03-28 14:06:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FYH12ZWB%252F698787151%252F600') HTTP/1.1" 204 0
2026-03-28 14:06:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YH12ZWB/698787151/600 saved to cache
2026-03-28 14:06:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item bca1d29f-c38f-5f42-aceb-2939b9e67c99
2026-03-28 14:06:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BC65FJV/698634070/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/BC65FJV/42805191?sv=2020-08-04&st=2026-03-28T14%3A06%3A26Z&se=2026-03-28T14%3A31%3A26Z&sr=b&sp=r&sig=VD7AqlkCpzlQHKxBAL0n0wRt3IwFKoVa%2FExqjVTdHHA%3D)
2026-03-28 14:06:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/M70ODE/698941455/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/M70ODE/42810084?sv=2020-08-04&st=2026-03-28T14%3A06%3A26Z&se=2026-03-28T14%3A31%3A26Z&sr=b&sp=r&sig=NvAgSAtcVVNpw59OnQY5IgDyurxqMu%2F2N0bZVQgkz%2BA%3D)
2026-03-28 14:06:33 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/M70ODE/698941481/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698941481>
2026-03-28 14:06:33 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YH12ZWB/698787232/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698787232>
2026-03-28 14:06:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KJ70LJU/698795119/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/KJ70LJU/42807917?sv=2020-08-04&st=2026-03-28T14%3A06%3A24Z&se=2026-03-28T14%3A31%3A24Z&sr=b&sp=r&sig=T2vuiJBTz4jV3GmdM5bnFNfH4xGipPA46fpyn3Y01Pc%3D)
2026-03-28 14:06:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AV13PZZ/698729758/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/AV13PZZ/42810506?sv=2020-08-04&st=2026-03-28T14%3A06%3A24Z&se=2026-03-28T14%3A31%3A24Z&sr=b&sp=r&sig=nZ0bGWVTxK13EuaxhdSPPyqqrzizvd8XT5v5hUK7Ua4%3D)
2026-03-28 14:06:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:06:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2da1dad0>
2026-03-28 14:06:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:06:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:06:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:06:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8d0c9ac8-161b-5c76-8a79-0338cb8a1867/8d0c9ac8-161b-5c76-8a79-0338cb8a1867_image_4.jpg HTTP/1.1" 201 0
2026-03-28 14:06:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FYO66ENU%252F696055938%252F600') HTTP/1.1" 204 0
2026-03-28 14:06:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YO66ENU/696055938/600 saved to cache
2026-03-28 14:06:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 8d0c9ac8-161b-5c76-8a79-0338cb8a1867
2026-03-28 14:06:33 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:06:33 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:06:33 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:06:33 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:06:33 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:06:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:06:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2d89d8d0>
2026-03-28 14:06:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:06:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:06:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:06:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8d0c9ac8-161b-5c76-8a79-0338cb8a1867/8d0c9ac8-161b-5c76-8a79-0338cb8a1867_image_6.jpg HTTP/1.1" 201 0
2026-03-28 14:06:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FYO66ENU%252F696055953%252F600') HTTP/1.1" 204 0
2026-03-28 14:06:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YO66ENU/696055953/600 saved to cache
2026-03-28 14:06:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 8d0c9ac8-161b-5c76-8a79-0338cb8a1867
2026-03-28 14:06:33 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:06:33 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:06:33 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:06:33 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:06:33 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:06:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:06:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2dd96d50>
2026-03-28 14:06:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:06:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:06:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:06:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6671a6d0-673a-5170-b57c-2fa413a2722d/6671a6d0-673a-5170-b57c-2fa413a2722d_image_6.jpg HTTP/1.1" 201 0
2026-03-28 14:06:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FM70ODE%252F698941400%252F600') HTTP/1.1" 204 0
2026-03-28 14:06:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/M70ODE/698941400/600 saved to cache
2026-03-28 14:06:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 6671a6d0-673a-5170-b57c-2fa413a2722d
2026-03-28 14:06:33 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YO66ENU/696055944/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=696055944>
2026-03-28 14:06:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YO66ENU/696055963/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YO66ENU/42809748?sv=2020-08-04&st=2026-03-28T14%3A06%3A26Z&se=2026-03-28T14%3A31%3A26Z&sr=b&sp=r&sig=7%2BETLPIcX2eu%2By5D0%2BtTEmXYS%2FFAqP%2B5SquQ2dIEkPA%3D)
2026-03-28 14:06:33 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:06:33 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:06:33 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:06:33 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:06:33 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:06:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:06:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2ddaa410>
2026-03-28 14:06:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:06:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:06:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:06:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_680c4e9b-15ae-54e0-a824-8a7fce3528fb/680c4e9b-15ae-54e0-a824-8a7fce3528fb_image_9.jpg HTTP/1.1" 201 0
2026-03-28 14:06:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FGJ70LXZ%252F698814543%252F600') HTTP/1.1" 204 0
2026-03-28 14:06:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GJ70LXZ/698814543/600 saved to cache
2026-03-28 14:06:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 680c4e9b-15ae-54e0-a824-8a7fce3528fb
2026-03-28 14:06:33 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:06:33 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:06:33 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:06:33 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:06:33 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:06:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:06:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c9bb590>
2026-03-28 14:06:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:06:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:06:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:06:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bca1d29f-c38f-5f42-aceb-2939b9e67c99/bca1d29f-c38f-5f42-aceb-2939b9e67c99_image_8.jpg HTTP/1.1" 201 0
2026-03-28 14:06:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FYH12ZWB%252F698787214%252F600') HTTP/1.1" 204 0
2026-03-28 14:06:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YH12ZWB/698787214/600 saved to cache
2026-03-28 14:06:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item bca1d29f-c38f-5f42-aceb-2939b9e67c99
2026-03-28 14:06:33 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:06:33 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:06:33 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:06:33 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:06:33 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:06:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:06:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2dccba90>
2026-03-28 14:06:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:06:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:06:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:06:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8d0c9ac8-161b-5c76-8a79-0338cb8a1867/8d0c9ac8-161b-5c76-8a79-0338cb8a1867_image_8.jpg HTTP/1.1" 201 0
2026-03-28 14:06:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FYO66ENU%252F696055970%252F600') HTTP/1.1" 204 0
2026-03-28 14:06:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YO66ENU/696055970/600 saved to cache
2026-03-28 14:06:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 8d0c9ac8-161b-5c76-8a79-0338cb8a1867
2026-03-28 14:06:33 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:06:33 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:06:33 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:06:33 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:06:33 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:06:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:06:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2de02690>
2026-03-28 14:06:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:06:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:06:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:06:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_515d9b9e-7ed9-596c-8fe3-830ee20f7887/515d9b9e-7ed9-596c-8fe3-830ee20f7887_image_9.jpg HTTP/1.1" 201 0
2026-03-28 14:06:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FBC65FJV%252F698634070%252F600') HTTP/1.1" 204 0
2026-03-28 14:06:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BC65FJV/698634070/600 saved to cache
2026-03-28 14:06:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 515d9b9e-7ed9-596c-8fe3-830ee20f7887
2026-03-28 14:06:33 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:06:33 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:06:33 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:06:33 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:06:33 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:06:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:06:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c8da850>
2026-03-28 14:06:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:06:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:06:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:06:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6671a6d0-673a-5170-b57c-2fa413a2722d/6671a6d0-673a-5170-b57c-2fa413a2722d_image_8.jpg HTTP/1.1" 201 0
2026-03-28 14:06:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FM70ODE%252F698941455%252F600') HTTP/1.1" 204 0
2026-03-28 14:06:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/M70ODE/698941455/600 saved to cache
2026-03-28 14:06:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 6671a6d0-673a-5170-b57c-2fa413a2722d
2026-03-28 14:06:33 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:06:33 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:06:33 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:06:33 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:06:33 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:06:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:06:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c997350>
2026-03-28 14:06:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:06:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:06:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:06:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_df9a9a0d-7908-5df5-80db-63767b9fcbae/df9a9a0d-7908-5df5-80db-63767b9fcbae_image_9.jpg HTTP/1.1" 201 0
2026-03-28 14:06:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FKJ70LJU%252F698795119%252F600') HTTP/1.1" 204 0
2026-03-28 14:06:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KJ70LJU/698795119/600 saved to cache
2026-03-28 14:06:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item df9a9a0d-7908-5df5-80db-63767b9fcbae
2026-03-28 14:06:33 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:06:33 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:06:33 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:06:33 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:06:33 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:06:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:06:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c9b91d0>
2026-03-28 14:06:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:06:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:06:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:06:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a2561847-ff84-5663-b0c4-a7e1fe0e31f4/a2561847-ff84-5663-b0c4-a7e1fe0e31f4_image_9.jpg HTTP/1.1" 201 0
2026-03-28 14:06:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FAV13PZZ%252F698729758%252F600') HTTP/1.1" 204 0
2026-03-28 14:06:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AV13PZZ/698729758/600 saved to cache
2026-03-28 14:06:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item a2561847-ff84-5663-b0c4-a7e1fe0e31f4
2026-03-28 14:06:33 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AV13PZZ/698729741/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698729741>
2026-03-28 14:06:33 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/M70ODE/698941434/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698941434>
2026-03-28 14:06:33 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BC65FJV/698634050/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698634050>
2026-03-28 14:06:33 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BN10FFD/698729752/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698729752>
2026-03-28 14:06:33 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YH12ZWB/698787190/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698787190>
2026-03-28 14:06:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YO66ENU/696055980/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YO66ENU/42809748?sv=2020-08-04&st=2026-03-28T14%3A06%3A26Z&se=2026-03-28T14%3A31%3A26Z&sr=b&sp=r&sig=7%2BETLPIcX2eu%2By5D0%2BtTEmXYS%2FFAqP%2B5SquQ2dIEkPA%3D)
2026-03-28 14:06:33 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:06:33 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:06:33 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:06:33 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:06:33 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:06:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:06:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c9b5fd0>
2026-03-28 14:06:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:06:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:06:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:06:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8d0c9ac8-161b-5c76-8a79-0338cb8a1867/8d0c9ac8-161b-5c76-8a79-0338cb8a1867_image_7.jpg HTTP/1.1" 201 0
2026-03-28 14:06:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FYO66ENU%252F696055963%252F600') HTTP/1.1" 204 0
2026-03-28 14:06:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YO66ENU/696055963/600 saved to cache
2026-03-28 14:06:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 8d0c9ac8-161b-5c76-8a79-0338cb8a1867
2026-03-28 14:06:33 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BC65FJV/698634038/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698634038>
2026-03-28 14:06:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YH12ZWB/698787232/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YH12ZWB/42807832?sv=2020-08-04&st=2026-03-28T14%3A06%3A26Z&se=2026-03-28T14%3A31%3A26Z&sr=b&sp=r&sig=IdAZy5bTiPvaFPsGYQH5tM1qjYLVI7KwntzQxTYK%2F38%3D)
2026-03-28 14:06:33 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AV13PZZ/698729719/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698729719>
2026-03-28 14:06:33 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YO66ENU/696055929/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=696055929>
2026-03-28 14:06:33 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YH12ZWB/698787125/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698787125>
2026-03-28 14:06:33 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/M70ODE/698941374/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698941374>
2026-03-28 14:06:33 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:06:33 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:06:33 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:06:33 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:06:33 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:06:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:06:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2d7d8fd0>
2026-03-28 14:06:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:06:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:06:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:06:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8d0c9ac8-161b-5c76-8a79-0338cb8a1867/8d0c9ac8-161b-5c76-8a79-0338cb8a1867_image_9.jpg HTTP/1.1" 201 0
2026-03-28 14:06:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FYO66ENU%252F696055980%252F600') HTTP/1.1" 204 0
2026-03-28 14:06:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YO66ENU/696055980/600 saved to cache
2026-03-28 14:06:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 8d0c9ac8-161b-5c76-8a79-0338cb8a1867
2026-03-28 14:06:34 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GJ70LXZ/698814526/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698814526>
2026-03-28 14:06:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YO66ENU/696055944/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YO66ENU/42809748?sv=2020-08-04&st=2026-03-28T14%3A06%3A26Z&se=2026-03-28T14%3A31%3A26Z&sr=b&sp=r&sig=7%2BETLPIcX2eu%2By5D0%2BtTEmXYS%2FFAqP%2B5SquQ2dIEkPA%3D)
2026-03-28 14:06:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YH12ZWB/698787190/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YH12ZWB/42807832?sv=2020-08-04&st=2026-03-28T14%3A06%3A26Z&se=2026-03-28T14%3A31%3A26Z&sr=b&sp=r&sig=IdAZy5bTiPvaFPsGYQH5tM1qjYLVI7KwntzQxTYK%2F38%3D)
2026-03-28 14:06:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BC65FJV/698634050/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/BC65FJV/42805191?sv=2020-08-04&st=2026-03-28T14%3A06%3A26Z&se=2026-03-28T14%3A31%3A26Z&sr=b&sp=r&sig=VD7AqlkCpzlQHKxBAL0n0wRt3IwFKoVa%2FExqjVTdHHA%3D)
2026-03-28 14:06:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AV13PZZ/698729741/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/AV13PZZ/42810506?sv=2020-08-04&st=2026-03-28T14%3A06%3A24Z&se=2026-03-28T14%3A31%3A24Z&sr=b&sp=r&sig=nZ0bGWVTxK13EuaxhdSPPyqqrzizvd8XT5v5hUK7Ua4%3D)
2026-03-28 14:06:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/M70ODE/698941434/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/M70ODE/42810084?sv=2020-08-04&st=2026-03-28T14%3A06%3A26Z&se=2026-03-28T14%3A31%3A26Z&sr=b&sp=r&sig=NvAgSAtcVVNpw59OnQY5IgDyurxqMu%2F2N0bZVQgkz%2BA%3D)
2026-03-28 14:06:34 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:06:34 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:06:34 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:06:34 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:06:34 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:06:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:06:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c14bad0>
2026-03-28 14:06:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:06:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:06:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:06:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bca1d29f-c38f-5f42-aceb-2939b9e67c99/bca1d29f-c38f-5f42-aceb-2939b9e67c99_image_9.jpg HTTP/1.1" 201 0
2026-03-28 14:06:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FYH12ZWB%252F698787232%252F600') HTTP/1.1" 204 0
2026-03-28 14:06:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YH12ZWB/698787232/600 saved to cache
2026-03-28 14:06:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item bca1d29f-c38f-5f42-aceb-2939b9e67c99
2026-03-28 14:06:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/M70ODE/698941481/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/M70ODE/42810084?sv=2020-08-04&st=2026-03-28T14%3A06%3A26Z&se=2026-03-28T14%3A31%3A26Z&sr=b&sp=r&sig=NvAgSAtcVVNpw59OnQY5IgDyurxqMu%2F2N0bZVQgkz%2BA%3D)
2026-03-28 14:06:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BN10FFD/698729752/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/BN10FFD/42810471?sv=2020-08-04&st=2026-03-28T14%3A06%3A24Z&se=2026-03-28T14%3A31%3A24Z&sr=b&sp=r&sig=YRKnec8Y1hjSrUO4yfYPgpbhzRG9GcT5SYUolkFsGgY%3D)
2026-03-28 14:06:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YO66ENU/696055929/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YO66ENU/42809748?sv=2020-08-04&st=2026-03-28T14%3A06%3A26Z&se=2026-03-28T14%3A31%3A26Z&sr=b&sp=r&sig=7%2BETLPIcX2eu%2By5D0%2BtTEmXYS%2FFAqP%2B5SquQ2dIEkPA%3D)
2026-03-28 14:06:34 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BN10FFD/698729736/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698729736>
2026-03-28 14:06:34 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KJ70LJU/698795108/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698795108>
2026-03-28 14:06:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GJ70LXZ/698814526/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/GJ70LXZ/42808336?sv=2020-08-04&st=2026-03-28T14%3A06%3A24Z&se=2026-03-28T14%3A31%3A24Z&sr=b&sp=r&sig=b57i0PzDZVUlozUA4vRBxPguh6MBQAEl464L60jtAsQ%3D)
2026-03-28 14:06:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:06:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2dbbbad0>
2026-03-28 14:06:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:06:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:06:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:06:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8d0c9ac8-161b-5c76-8a79-0338cb8a1867/8d0c9ac8-161b-5c76-8a79-0338cb8a1867_image_5.jpg HTTP/1.1" 201 0
2026-03-28 14:06:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FYO66ENU%252F696055944%252F600') HTTP/1.1" 204 0
2026-03-28 14:06:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YO66ENU/696055944/600 saved to cache
2026-03-28 14:06:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 8d0c9ac8-161b-5c76-8a79-0338cb8a1867
2026-03-28 14:06:34 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:06:34 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:06:34 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:06:34 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:06:34 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:06:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:06:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2d742950>
2026-03-28 14:06:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:06:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:06:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:06:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bca1d29f-c38f-5f42-aceb-2939b9e67c99/bca1d29f-c38f-5f42-aceb-2939b9e67c99_image_7.jpg HTTP/1.1" 201 0
2026-03-28 14:06:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FYH12ZWB%252F698787190%252F600') HTTP/1.1" 204 0
2026-03-28 14:06:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YH12ZWB/698787190/600 saved to cache
2026-03-28 14:06:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item bca1d29f-c38f-5f42-aceb-2939b9e67c99
2026-03-28 14:06:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/M70ODE/698941374/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/M70ODE/42810084?sv=2020-08-04&st=2026-03-28T14%3A06%3A26Z&se=2026-03-28T14%3A31%3A26Z&sr=b&sp=r&sig=NvAgSAtcVVNpw59OnQY5IgDyurxqMu%2F2N0bZVQgkz%2BA%3D)
2026-03-28 14:06:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YH12ZWB/698787125/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YH12ZWB/42807832?sv=2020-08-04&st=2026-03-28T14%3A06%3A26Z&se=2026-03-28T14%3A31%3A26Z&sr=b&sp=r&sig=IdAZy5bTiPvaFPsGYQH5tM1qjYLVI7KwntzQxTYK%2F38%3D)
2026-03-28 14:06:34 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AJ17HXL/698328443/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698328443>
2026-03-28 14:06:34 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AV13PZZ/698729701/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698729701>
2026-03-28 14:06:34 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YH12ZWB/698787113/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698787113>
2026-03-28 14:06:34 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GJ70LXZ/698814503/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698814503>
2026-03-28 14:06:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AV13PZZ/698729719/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/AV13PZZ/42810506?sv=2020-08-04&st=2026-03-28T14%3A06%3A24Z&se=2026-03-28T14%3A31%3A24Z&sr=b&sp=r&sig=nZ0bGWVTxK13EuaxhdSPPyqqrzizvd8XT5v5hUK7Ua4%3D)
2026-03-28 14:06:34 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:06:34 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:06:34 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:06:34 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:06:34 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:06:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:06:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c93a450>
2026-03-28 14:06:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:06:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:06:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:06:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_515d9b9e-7ed9-596c-8fe3-830ee20f7887/515d9b9e-7ed9-596c-8fe3-830ee20f7887_image_8.jpg HTTP/1.1" 201 0
2026-03-28 14:06:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FBC65FJV%252F698634050%252F600') HTTP/1.1" 204 0
2026-03-28 14:06:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BC65FJV/698634050/600 saved to cache
2026-03-28 14:06:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 515d9b9e-7ed9-596c-8fe3-830ee20f7887
2026-03-28 14:06:34 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:06:34 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:06:34 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:06:34 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:06:34 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:06:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:06:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a1fdb4490>
2026-03-28 14:06:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:06:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:06:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:06:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a2561847-ff84-5663-b0c4-a7e1fe0e31f4/a2561847-ff84-5663-b0c4-a7e1fe0e31f4_image_8.jpg HTTP/1.1" 201 0
2026-03-28 14:06:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FAV13PZZ%252F698729741%252F600') HTTP/1.1" 204 0
2026-03-28 14:06:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AV13PZZ/698729741/600 saved to cache
2026-03-28 14:06:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item a2561847-ff84-5663-b0c4-a7e1fe0e31f4
2026-03-28 14:06:34 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:06:34 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:06:34 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:06:34 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:06:34 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:06:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:06:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c994890>
2026-03-28 14:06:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:06:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:06:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:06:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6671a6d0-673a-5170-b57c-2fa413a2722d/6671a6d0-673a-5170-b57c-2fa413a2722d_image_7.jpg HTTP/1.1" 201 0
2026-03-28 14:06:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FM70ODE%252F698941434%252F600') HTTP/1.1" 204 0
2026-03-28 14:06:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/M70ODE/698941434/600 saved to cache
2026-03-28 14:06:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 6671a6d0-673a-5170-b57c-2fa413a2722d
2026-03-28 14:06:34 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:06:34 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:06:34 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:06:34 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:06:34 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:06:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:06:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c93bb10>
2026-03-28 14:06:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:06:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:06:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:06:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6671a6d0-673a-5170-b57c-2fa413a2722d/6671a6d0-673a-5170-b57c-2fa413a2722d_image_9.jpg HTTP/1.1" 201 0
2026-03-28 14:06:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FM70ODE%252F698941481%252F600') HTTP/1.1" 204 0
2026-03-28 14:06:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/M70ODE/698941481/600 saved to cache
2026-03-28 14:06:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 6671a6d0-673a-5170-b57c-2fa413a2722d
2026-03-28 14:06:34 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:06:34 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:06:34 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:06:34 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:06:34 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:06:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:06:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a1fe331d0>
2026-03-28 14:06:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:06:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:06:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:06:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_aa05e46e-6535-54ec-9d2a-990536e25c18/aa05e46e-6535-54ec-9d2a-990536e25c18_image_9.jpg HTTP/1.1" 201 0
2026-03-28 14:06:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FBN10FFD%252F698729752%252F600') HTTP/1.1" 204 0
2026-03-28 14:06:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BN10FFD/698729752/600 saved to cache
2026-03-28 14:06:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item aa05e46e-6535-54ec-9d2a-990536e25c18
2026-03-28 14:06:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:06:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c702290>
2026-03-28 14:06:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:06:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:06:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:06:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8d0c9ac8-161b-5c76-8a79-0338cb8a1867/8d0c9ac8-161b-5c76-8a79-0338cb8a1867_image_3.jpg HTTP/1.1" 201 0
2026-03-28 14:06:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FYO66ENU%252F696055929%252F600') HTTP/1.1" 204 0
2026-03-28 14:06:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YO66ENU/696055929/600 saved to cache
2026-03-28 14:06:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 8d0c9ac8-161b-5c76-8a79-0338cb8a1867
2026-03-28 14:06:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BC65FJV/698634038/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/BC65FJV/42805191?sv=2020-08-04&st=2026-03-28T14%3A06%3A26Z&se=2026-03-28T14%3A31%3A26Z&sr=b&sp=r&sig=VD7AqlkCpzlQHKxBAL0n0wRt3IwFKoVa%2FExqjVTdHHA%3D)
2026-03-28 14:06:34 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:06:34 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:06:34 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:06:34 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:06:34 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:06:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:06:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2d886d90>
2026-03-28 14:06:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:06:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:06:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:06:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_680c4e9b-15ae-54e0-a824-8a7fce3528fb/680c4e9b-15ae-54e0-a824-8a7fce3528fb_image_8.jpg HTTP/1.1" 201 0
2026-03-28 14:06:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FGJ70LXZ%252F698814526%252F600') HTTP/1.1" 204 0
2026-03-28 14:06:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GJ70LXZ/698814526/600 saved to cache
2026-03-28 14:06:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 680c4e9b-15ae-54e0-a824-8a7fce3528fb
2026-03-28 14:06:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:06:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2ddb1c10>
2026-03-28 14:06:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:06:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:06:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:06:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6671a6d0-673a-5170-b57c-2fa413a2722d/6671a6d0-673a-5170-b57c-2fa413a2722d_image_5.jpg HTTP/1.1" 201 0
2026-03-28 14:06:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FM70ODE%252F698941374%252F600') HTTP/1.1" 204 0
2026-03-28 14:06:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/M70ODE/698941374/600 saved to cache
2026-03-28 14:06:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 6671a6d0-673a-5170-b57c-2fa413a2722d
2026-03-28 14:06:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:06:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2dcd6650>
2026-03-28 14:06:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:06:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:06:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:06:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bca1d29f-c38f-5f42-aceb-2939b9e67c99/bca1d29f-c38f-5f42-aceb-2939b9e67c99_image_5.jpg HTTP/1.1" 201 0
2026-03-28 14:06:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FYH12ZWB%252F698787125%252F600') HTTP/1.1" 204 0
2026-03-28 14:06:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YH12ZWB/698787125/600 saved to cache
2026-03-28 14:06:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item bca1d29f-c38f-5f42-aceb-2939b9e67c99
2026-03-28 14:06:34 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:06:34 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:06:34 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:06:34 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:06:34 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:06:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:06:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a1fe7b050>
2026-03-28 14:06:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:06:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:06:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:06:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a2561847-ff84-5663-b0c4-a7e1fe0e31f4/a2561847-ff84-5663-b0c4-a7e1fe0e31f4_image_7.jpg HTTP/1.1" 201 0
2026-03-28 14:06:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FAV13PZZ%252F698729719%252F600') HTTP/1.1" 204 0
2026-03-28 14:06:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AV13PZZ/698729719/600 saved to cache
2026-03-28 14:06:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item a2561847-ff84-5663-b0c4-a7e1fe0e31f4
2026-03-28 14:06:34 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BC65FJV/698634008/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698634008>
2026-03-28 14:06:34 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KJ70LJU/698795089/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698795089>
2026-03-28 14:06:34 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BN10FFD/698729720/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698729720>
2026-03-28 14:06:34 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AJ17HXL/698328441/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698328441>
2026-03-28 14:06:34 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AV13PZZ/698729678/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698729678>
2026-03-28 14:06:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KJ70LJU/698795108/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/KJ70LJU/42807917?sv=2020-08-04&st=2026-03-28T14%3A06%3A24Z&se=2026-03-28T14%3A31%3A24Z&sr=b&sp=r&sig=T2vuiJBTz4jV3GmdM5bnFNfH4xGipPA46fpyn3Y01Pc%3D)
2026-03-28 14:06:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BN10FFD/698729736/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/BN10FFD/42810471?sv=2020-08-04&st=2026-03-28T14%3A06%3A24Z&se=2026-03-28T14%3A31%3A24Z&sr=b&sp=r&sig=YRKnec8Y1hjSrUO4yfYPgpbhzRG9GcT5SYUolkFsGgY%3D)
2026-03-28 14:06:34 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:06:34 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:06:34 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:06:34 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:06:34 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:06:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:06:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2de85a90>
2026-03-28 14:06:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:06:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:06:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:06:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_515d9b9e-7ed9-596c-8fe3-830ee20f7887/515d9b9e-7ed9-596c-8fe3-830ee20f7887_image_7.jpg HTTP/1.1" 201 0
2026-03-28 14:06:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FBC65FJV%252F698634038%252F600') HTTP/1.1" 204 0
2026-03-28 14:06:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BC65FJV/698634038/600 saved to cache
2026-03-28 14:06:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 515d9b9e-7ed9-596c-8fe3-830ee20f7887
2026-03-28 14:06:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GJ70LXZ/698814503/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/GJ70LXZ/42808336?sv=2020-08-04&st=2026-03-28T14%3A06%3A24Z&se=2026-03-28T14%3A31%3A24Z&sr=b&sp=r&sig=b57i0PzDZVUlozUA4vRBxPguh6MBQAEl464L60jtAsQ%3D)
2026-03-28 14:06:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AJ17HXL/698328443/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/AJ17HXL/42798748?sv=2020-08-04&st=2026-03-28T14%3A06%3A24Z&se=2026-03-28T14%3A31%3A24Z&sr=b&sp=r&sig=s%2FenQJFKWZab81RCtX8FxHWN1BS3QTqj1oqoO1gcyoI%3D)
2026-03-28 14:06:34 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YO66ENU/696055918/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=696055918>
2026-03-28 14:06:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YH12ZWB/698787113/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YH12ZWB/42807832?sv=2020-08-04&st=2026-03-28T14%3A06%3A26Z&se=2026-03-28T14%3A31%3A26Z&sr=b&sp=r&sig=IdAZy5bTiPvaFPsGYQH5tM1qjYLVI7KwntzQxTYK%2F38%3D)
2026-03-28 14:06:34 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/M70ODE/698941340/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698941340>
2026-03-28 14:06:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AV13PZZ/698729701/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/AV13PZZ/42810506?sv=2020-08-04&st=2026-03-28T14%3A06%3A24Z&se=2026-03-28T14%3A31%3A24Z&sr=b&sp=r&sig=nZ0bGWVTxK13EuaxhdSPPyqqrzizvd8XT5v5hUK7Ua4%3D)
2026-03-28 14:06:34 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YH12ZWB/698787097/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698787097>
2026-03-28 14:06:34 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:06:34 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:06:34 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:06:34 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:06:34 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:06:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:06:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c775450>
2026-03-28 14:06:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:06:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:06:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:06:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_df9a9a0d-7908-5df5-80db-63767b9fcbae/df9a9a0d-7908-5df5-80db-63767b9fcbae_image_8.jpg HTTP/1.1" 201 0
2026-03-28 14:06:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FKJ70LJU%252F698795108%252F600') HTTP/1.1" 204 0
2026-03-28 14:06:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KJ70LJU/698795108/600 saved to cache
2026-03-28 14:06:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item df9a9a0d-7908-5df5-80db-63767b9fcbae
2026-03-28 14:06:34 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GJ70LXZ/698814478/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698814478>
2026-03-28 14:06:34 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:06:34 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:06:34 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:06:34 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:06:34 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:06:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:06:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2d9136d0>
2026-03-28 14:06:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:06:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:06:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:06:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_aa05e46e-6535-54ec-9d2a-990536e25c18/aa05e46e-6535-54ec-9d2a-990536e25c18_image_8.jpg HTTP/1.1" 201 0
2026-03-28 14:06:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FBN10FFD%252F698729736%252F600') HTTP/1.1" 204 0
2026-03-28 14:06:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BN10FFD/698729736/600 saved to cache
2026-03-28 14:06:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item aa05e46e-6535-54ec-9d2a-990536e25c18
2026-03-28 14:06:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AV13PZZ/698729678/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/AV13PZZ/42810506?sv=2020-08-04&st=2026-03-28T14%3A06%3A24Z&se=2026-03-28T14%3A31%3A24Z&sr=b&sp=r&sig=nZ0bGWVTxK13EuaxhdSPPyqqrzizvd8XT5v5hUK7Ua4%3D)
2026-03-28 14:06:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AJ17HXL/698328441/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/AJ17HXL/42798748?sv=2020-08-04&st=2026-03-28T14%3A06%3A24Z&se=2026-03-28T14%3A31%3A24Z&sr=b&sp=r&sig=s%2FenQJFKWZab81RCtX8FxHWN1BS3QTqj1oqoO1gcyoI%3D)
2026-03-28 14:06:34 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KJ70LJU/698795082/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698795082>
2026-03-28 14:06:34 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BN10FFD/698729703/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698729703>
2026-03-28 14:06:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KJ70LJU/698795089/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/KJ70LJU/42807917?sv=2020-08-04&st=2026-03-28T14%3A06%3A24Z&se=2026-03-28T14%3A31%3A24Z&sr=b&sp=r&sig=T2vuiJBTz4jV3GmdM5bnFNfH4xGipPA46fpyn3Y01Pc%3D)
2026-03-28 14:06:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BN10FFD/698729720/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/BN10FFD/42810471?sv=2020-08-04&st=2026-03-28T14%3A06%3A24Z&se=2026-03-28T14%3A31%3A24Z&sr=b&sp=r&sig=YRKnec8Y1hjSrUO4yfYPgpbhzRG9GcT5SYUolkFsGgY%3D)
2026-03-28 14:06:34 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:06:34 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:06:34 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:06:34 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:06:34 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:06:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:06:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2ffa9810>
2026-03-28 14:06:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:06:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:06:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:06:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_680c4e9b-15ae-54e0-a824-8a7fce3528fb/680c4e9b-15ae-54e0-a824-8a7fce3528fb_image_7.jpg HTTP/1.1" 201 0
2026-03-28 14:06:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FGJ70LXZ%252F698814503%252F600') HTTP/1.1" 204 0
2026-03-28 14:06:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GJ70LXZ/698814503/600 saved to cache
2026-03-28 14:06:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 680c4e9b-15ae-54e0-a824-8a7fce3528fb
2026-03-28 14:06:34 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:06:34 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:06:34 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:06:34 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:06:34 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:06:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:06:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2d913e10>
2026-03-28 14:06:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:06:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:06:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:06:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2a541890-0343-5ec1-9e09-787ef67af079/2a541890-0343-5ec1-9e09-787ef67af079_image_9.jpg HTTP/1.1" 201 0
2026-03-28 14:06:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FAJ17HXL%252F698328443%252F600') HTTP/1.1" 204 0
2026-03-28 14:06:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AJ17HXL/698328443/600 saved to cache
2026-03-28 14:06:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 2a541890-0343-5ec1-9e09-787ef67af079
2026-03-28 14:06:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:06:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2dd550d0>
2026-03-28 14:06:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:06:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:06:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:06:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bca1d29f-c38f-5f42-aceb-2939b9e67c99/bca1d29f-c38f-5f42-aceb-2939b9e67c99_image_4.jpg HTTP/1.1" 201 0
2026-03-28 14:06:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FYH12ZWB%252F698787113%252F600') HTTP/1.1" 204 0
2026-03-28 14:06:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YH12ZWB/698787113/600 saved to cache
2026-03-28 14:06:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item bca1d29f-c38f-5f42-aceb-2939b9e67c99
2026-03-28 14:06:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BC65FJV/698634008/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/BC65FJV/42805191?sv=2020-08-04&st=2026-03-28T14%3A06%3A26Z&se=2026-03-28T14%3A31%3A26Z&sr=b&sp=r&sig=VD7AqlkCpzlQHKxBAL0n0wRt3IwFKoVa%2FExqjVTdHHA%3D)
2026-03-28 14:06:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YO66ENU/696055918/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YO66ENU/42809748?sv=2020-08-04&st=2026-03-28T14%3A06%3A26Z&se=2026-03-28T14%3A31%3A26Z&sr=b&sp=r&sig=7%2BETLPIcX2eu%2By5D0%2BtTEmXYS%2FFAqP%2B5SquQ2dIEkPA%3D)
2026-03-28 14:06:34 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AJ17HXL/698328440/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698328440>
2026-03-28 14:06:34 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AV13PZZ/698729666/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698729666>
2026-03-28 14:06:34 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:06:34 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:06:34 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:06:34 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:06:34 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:06:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:06:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2deabb90>
2026-03-28 14:06:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:06:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:06:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:06:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a2561847-ff84-5663-b0c4-a7e1fe0e31f4/a2561847-ff84-5663-b0c4-a7e1fe0e31f4_image_6.jpg HTTP/1.1" 201 0
2026-03-28 14:06:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FAV13PZZ%252F698729701%252F600') HTTP/1.1" 204 0
2026-03-28 14:06:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AV13PZZ/698729701/600 saved to cache
2026-03-28 14:06:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item a2561847-ff84-5663-b0c4-a7e1fe0e31f4
2026-03-28 14:06:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:06:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2d8f2ed0>
2026-03-28 14:06:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:06:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:06:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:06:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a2561847-ff84-5663-b0c4-a7e1fe0e31f4/a2561847-ff84-5663-b0c4-a7e1fe0e31f4_image_5.jpg HTTP/1.1" 201 0
2026-03-28 14:06:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FAV13PZZ%252F698729678%252F600') HTTP/1.1" 204 0
2026-03-28 14:06:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AV13PZZ/698729678/600 saved to cache
2026-03-28 14:06:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item a2561847-ff84-5663-b0c4-a7e1fe0e31f4
2026-03-28 14:06:35 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:06:35 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:06:35 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:06:35 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:06:35 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:06:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:06:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2d837710>
2026-03-28 14:06:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:06:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:06:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:06:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2a541890-0343-5ec1-9e09-787ef67af079/2a541890-0343-5ec1-9e09-787ef67af079_image_8.jpg HTTP/1.1" 201 0
2026-03-28 14:06:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FAJ17HXL%252F698328441%252F600') HTTP/1.1" 204 0
2026-03-28 14:06:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AJ17HXL/698328441/600 saved to cache
2026-03-28 14:06:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 2a541890-0343-5ec1-9e09-787ef67af079
2026-03-28 14:06:35 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:06:35 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:06:35 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:06:35 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:06:35 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:06:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:06:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2ddb29d0>
2026-03-28 14:06:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:06:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:06:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:06:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_df9a9a0d-7908-5df5-80db-63767b9fcbae/df9a9a0d-7908-5df5-80db-63767b9fcbae_image_7.jpg HTTP/1.1" 201 0
2026-03-28 14:06:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FKJ70LJU%252F698795089%252F600') HTTP/1.1" 204 0
2026-03-28 14:06:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KJ70LJU/698795089/600 saved to cache
2026-03-28 14:06:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item df9a9a0d-7908-5df5-80db-63767b9fcbae
2026-03-28 14:06:35 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:06:35 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:06:35 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:06:35 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:06:35 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:06:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:06:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c9b8b90>
2026-03-28 14:06:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:06:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:06:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:06:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_aa05e46e-6535-54ec-9d2a-990536e25c18/aa05e46e-6535-54ec-9d2a-990536e25c18_image_7.jpg HTTP/1.1" 201 0
2026-03-28 14:06:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FBN10FFD%252F698729720%252F600') HTTP/1.1" 204 0
2026-03-28 14:06:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BN10FFD/698729720/600 saved to cache
2026-03-28 14:06:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item aa05e46e-6535-54ec-9d2a-990536e25c18
2026-03-28 14:06:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YH12ZWB/698787097/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YH12ZWB/42807832?sv=2020-08-04&st=2026-03-28T14%3A06%3A26Z&se=2026-03-28T14%3A31%3A26Z&sr=b&sp=r&sig=IdAZy5bTiPvaFPsGYQH5tM1qjYLVI7KwntzQxTYK%2F38%3D)
2026-03-28 14:06:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/M70ODE/698941340/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/M70ODE/42810084?sv=2020-08-04&st=2026-03-28T14%3A06%3A26Z&se=2026-03-28T14%3A31%3A26Z&sr=b&sp=r&sig=NvAgSAtcVVNpw59OnQY5IgDyurxqMu%2F2N0bZVQgkz%2BA%3D)
2026-03-28 14:06:35 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YO66ENU/696055910/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=YO66ENU-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-28 14:06:35 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/M70ODE/698941322/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698941322>
2026-03-28 14:06:35 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YH12ZWB/698787080/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698787080>
2026-03-28 14:06:35 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GJ70LXZ/698814451/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698814451>
2026-03-28 14:06:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GJ70LXZ/698814478/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/GJ70LXZ/42808336?sv=2020-08-04&st=2026-03-28T14%3A06%3A24Z&se=2026-03-28T14%3A31%3A24Z&sr=b&sp=r&sig=b57i0PzDZVUlozUA4vRBxPguh6MBQAEl464L60jtAsQ%3D)
2026-03-28 14:06:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BN10FFD/698729703/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/BN10FFD/42810471?sv=2020-08-04&st=2026-03-28T14%3A06%3A24Z&se=2026-03-28T14%3A31%3A24Z&sr=b&sp=r&sig=YRKnec8Y1hjSrUO4yfYPgpbhzRG9GcT5SYUolkFsGgY%3D)
2026-03-28 14:06:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:06:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2fdf9a50>
2026-03-28 14:06:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:06:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:06:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:06:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_515d9b9e-7ed9-596c-8fe3-830ee20f7887/515d9b9e-7ed9-596c-8fe3-830ee20f7887_image_5.jpg HTTP/1.1" 201 0
2026-03-28 14:06:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FBC65FJV%252F698634008%252F600') HTTP/1.1" 204 0
2026-03-28 14:06:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BC65FJV/698634008/600 saved to cache
2026-03-28 14:06:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 515d9b9e-7ed9-596c-8fe3-830ee20f7887
2026-03-28 14:06:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:06:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a301f83d0>
2026-03-28 14:06:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:06:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:06:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:06:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8d0c9ac8-161b-5c76-8a79-0338cb8a1867/8d0c9ac8-161b-5c76-8a79-0338cb8a1867_image_1.jpg HTTP/1.1" 201 0
2026-03-28 14:06:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FYO66ENU%252F696055918%252F600') HTTP/1.1" 204 0
2026-03-28 14:06:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YO66ENU/696055918/600 saved to cache
2026-03-28 14:06:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 8d0c9ac8-161b-5c76-8a79-0338cb8a1867
2026-03-28 14:06:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:06:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2d987fd0>
2026-03-28 14:06:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:06:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:06:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:06:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bca1d29f-c38f-5f42-aceb-2939b9e67c99/bca1d29f-c38f-5f42-aceb-2939b9e67c99_image_3.jpg HTTP/1.1" 201 0
2026-03-28 14:06:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FYH12ZWB%252F698787097%252F600') HTTP/1.1" 204 0
2026-03-28 14:06:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YH12ZWB/698787097/600 saved to cache
2026-03-28 14:06:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item bca1d29f-c38f-5f42-aceb-2939b9e67c99
2026-03-28 14:06:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:06:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c9c8f90>
2026-03-28 14:06:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:06:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:06:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:06:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6671a6d0-673a-5170-b57c-2fa413a2722d/6671a6d0-673a-5170-b57c-2fa413a2722d_image_3.jpg HTTP/1.1" 201 0
2026-03-28 14:06:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FM70ODE%252F698941340%252F600') HTTP/1.1" 204 0
2026-03-28 14:06:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/M70ODE/698941340/600 saved to cache
2026-03-28 14:06:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 6671a6d0-673a-5170-b57c-2fa413a2722d
2026-03-28 14:06:36 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:06:36 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:06:36 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:06:36 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:06:36 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:06:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:06:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c4523d0>
2026-03-28 14:06:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:06:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:06:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:06:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_680c4e9b-15ae-54e0-a824-8a7fce3528fb/680c4e9b-15ae-54e0-a824-8a7fce3528fb_image_6.jpg HTTP/1.1" 201 0
2026-03-28 14:06:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FGJ70LXZ%252F698814478%252F600') HTTP/1.1" 204 0
2026-03-28 14:06:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GJ70LXZ/698814478/600 saved to cache
2026-03-28 14:06:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 680c4e9b-15ae-54e0-a824-8a7fce3528fb
2026-03-28 14:06:36 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:06:36 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:06:36 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:06:36 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:06:36 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:06:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:06:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c776710>
2026-03-28 14:06:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:06:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:06:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:06:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_aa05e46e-6535-54ec-9d2a-990536e25c18/aa05e46e-6535-54ec-9d2a-990536e25c18_image_6.jpg HTTP/1.1" 201 0
2026-03-28 14:06:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FBN10FFD%252F698729703%252F600') HTTP/1.1" 204 0
2026-03-28 14:06:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BN10FFD/698729703/600 saved to cache
2026-03-28 14:06:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item aa05e46e-6535-54ec-9d2a-990536e25c18
2026-03-28 14:06:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AV13PZZ/698729666/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/AV13PZZ/42810506?sv=2020-08-04&st=2026-03-28T14%3A06%3A24Z&se=2026-03-28T14%3A31%3A24Z&sr=b&sp=r&sig=nZ0bGWVTxK13EuaxhdSPPyqqrzizvd8XT5v5hUK7Ua4%3D)
2026-03-28 14:06:36 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KJ70LJU/698795056/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698795056>
2026-03-28 14:06:36 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BN10FFD/698729680/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698729680>
2026-03-28 14:06:36 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KJ70LJU/698795066/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698795066>
2026-03-28 14:06:36 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GJ70LXZ/698814440/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698814440>
2026-03-28 14:06:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GJ70LXZ/698814451/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/GJ70LXZ/42808336?sv=2020-08-04&st=2026-03-28T14%3A06%3A24Z&se=2026-03-28T14%3A31%3A24Z&sr=b&sp=r&sig=b57i0PzDZVUlozUA4vRBxPguh6MBQAEl464L60jtAsQ%3D)
2026-03-28 14:06:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KJ70LJU/698795082/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/KJ70LJU/42807917?sv=2020-08-04&st=2026-03-28T14%3A06%3A24Z&se=2026-03-28T14%3A31%3A24Z&sr=b&sp=r&sig=T2vuiJBTz4jV3GmdM5bnFNfH4xGipPA46fpyn3Y01Pc%3D)
2026-03-28 14:06:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AJ17HXL/698328440/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/AJ17HXL/42798748?sv=2020-08-04&st=2026-03-28T14%3A06%3A24Z&se=2026-03-28T14%3A31%3A24Z&sr=b&sp=r&sig=s%2FenQJFKWZab81RCtX8FxHWN1BS3QTqj1oqoO1gcyoI%3D)
2026-03-28 14:06:36 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GL11XOW/698717345/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698717345>
2026-03-28 14:06:36 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BC65FJV/698633980/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698633980>
2026-03-28 14:06:36 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BN10FFD/698729664/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698729664>
2026-03-28 14:06:36 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AV13PZZ/698729628/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698729628>
2026-03-28 14:06:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/M70ODE/698941322/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/M70ODE/42810084?sv=2020-08-04&st=2026-03-28T14%3A06%3A26Z&se=2026-03-28T14%3A31%3A26Z&sr=b&sp=r&sig=NvAgSAtcVVNpw59OnQY5IgDyurxqMu%2F2N0bZVQgkz%2BA%3D)
2026-03-28 14:06:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YH12ZWB/698787080/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YH12ZWB/42807832?sv=2020-08-04&st=2026-03-28T14%3A06%3A26Z&se=2026-03-28T14%3A31%3A26Z&sr=b&sp=r&sig=IdAZy5bTiPvaFPsGYQH5tM1qjYLVI7KwntzQxTYK%2F38%3D)
2026-03-28 14:06:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:06:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c93b410>
2026-03-28 14:06:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:06:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:06:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:06:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a2561847-ff84-5663-b0c4-a7e1fe0e31f4/a2561847-ff84-5663-b0c4-a7e1fe0e31f4_image_4.jpg HTTP/1.1" 201 0
2026-03-28 14:06:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FAV13PZZ%252F698729666%252F600') HTTP/1.1" 204 0
2026-03-28 14:06:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AV13PZZ/698729666/600 saved to cache
2026-03-28 14:06:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item a2561847-ff84-5663-b0c4-a7e1fe0e31f4
2026-03-28 14:06:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YO66ENU/696055910/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YO66ENU/42809748?sv=2020-08-04&st=2026-03-28T14%3A06%3A26Z&se=2026-03-28T14%3A31%3A26Z&sr=b&sp=r&sig=7%2BETLPIcX2eu%2By5D0%2BtTEmXYS%2FFAqP%2B5SquQ2dIEkPA%3D)
2026-03-28 14:06:36 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AJ17HXL/698328437/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698328437>
2026-03-28 14:06:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:06:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a1fe8e9d0>
2026-03-28 14:06:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:06:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:06:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:06:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_680c4e9b-15ae-54e0-a824-8a7fce3528fb/680c4e9b-15ae-54e0-a824-8a7fce3528fb_image_5.jpg HTTP/1.1" 201 0
2026-03-28 14:06:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FGJ70LXZ%252F698814451%252F600') HTTP/1.1" 204 0
2026-03-28 14:06:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GJ70LXZ/698814451/600 saved to cache
2026-03-28 14:06:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 680c4e9b-15ae-54e0-a824-8a7fce3528fb
2026-03-28 14:06:36 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:06:36 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:06:36 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:06:36 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:06:36 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:06:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:06:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2d7433d0>
2026-03-28 14:06:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:06:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:06:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:06:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_df9a9a0d-7908-5df5-80db-63767b9fcbae/df9a9a0d-7908-5df5-80db-63767b9fcbae_image_6.jpg HTTP/1.1" 201 0
2026-03-28 14:06:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FKJ70LJU%252F698795082%252F600') HTTP/1.1" 204 0
2026-03-28 14:06:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KJ70LJU/698795082/600 saved to cache
2026-03-28 14:06:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item df9a9a0d-7908-5df5-80db-63767b9fcbae
2026-03-28 14:06:36 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:06:36 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:06:36 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:06:36 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:06:36 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:06:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:06:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2dcc9110>
2026-03-28 14:06:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:06:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:06:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:06:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2a541890-0343-5ec1-9e09-787ef67af079/2a541890-0343-5ec1-9e09-787ef67af079_image_7.jpg HTTP/1.1" 201 0
2026-03-28 14:06:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FAJ17HXL%252F698328440%252F600') HTTP/1.1" 204 0
2026-03-28 14:06:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AJ17HXL/698328440/600 saved to cache
2026-03-28 14:06:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 2a541890-0343-5ec1-9e09-787ef67af079
2026-03-28 14:06:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GJ70LXZ/698814440/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/GJ70LXZ/42808336?sv=2020-08-04&st=2026-03-28T14%3A06%3A24Z&se=2026-03-28T14%3A31%3A24Z&sr=b&sp=r&sig=b57i0PzDZVUlozUA4vRBxPguh6MBQAEl464L60jtAsQ%3D)
2026-03-28 14:06:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KJ70LJU/698795066/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/KJ70LJU/42807917?sv=2020-08-04&st=2026-03-28T14%3A06%3A24Z&se=2026-03-28T14%3A31%3A24Z&sr=b&sp=r&sig=T2vuiJBTz4jV3GmdM5bnFNfH4xGipPA46fpyn3Y01Pc%3D)
2026-03-28 14:06:36 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BN10FFD/698729643/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698729643>
2026-03-28 14:06:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KJ70LJU/698795056/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/KJ70LJU/42807917?sv=2020-08-04&st=2026-03-28T14%3A06%3A24Z&se=2026-03-28T14%3A31%3A24Z&sr=b&sp=r&sig=T2vuiJBTz4jV3GmdM5bnFNfH4xGipPA46fpyn3Y01Pc%3D)
2026-03-28 14:06:36 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GL11XOW/698717326/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698717326>
2026-03-28 14:06:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BN10FFD/698729680/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/BN10FFD/42810471?sv=2020-08-04&st=2026-03-28T14%3A06%3A24Z&se=2026-03-28T14%3A31%3A24Z&sr=b&sp=r&sig=YRKnec8Y1hjSrUO4yfYPgpbhzRG9GcT5SYUolkFsGgY%3D)
2026-03-28 14:06:36 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BC65FJV/698633975/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698633975>
2026-03-28 14:06:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GL11XOW/698717345/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/GL11XOW/42810476?sv=2020-08-04&st=2026-03-28T14%3A06%3A24Z&se=2026-03-28T14%3A31%3A24Z&sr=b&sp=r&sig=Z2KlPx5wKthhayrUXNoIRMZ89bgZHolJc7BL3Q6T4LE%3D)
2026-03-28 14:06:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:06:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c776210>
2026-03-28 14:06:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:06:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:06:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:06:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6671a6d0-673a-5170-b57c-2fa413a2722d/6671a6d0-673a-5170-b57c-2fa413a2722d_image_2.jpg HTTP/1.1" 201 0
2026-03-28 14:06:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FM70ODE%252F698941322%252F600') HTTP/1.1" 204 0
2026-03-28 14:06:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/M70ODE/698941322/600 saved to cache
2026-03-28 14:06:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 6671a6d0-673a-5170-b57c-2fa413a2722d
2026-03-28 14:06:36 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 6671a6d0-673a-5170-b57c-2fa413a2722d, skipping ID generation
2026-03-28 14:06:36 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 6671a6d0-673a-5170-b57c-2fa413a2722d sending to next pipeline
2026-03-28 14:06:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 6671a6d0-673a-5170-b57c-2fa413a2722d, identifier: M70%20ODE
2026-03-28 14:06:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:06:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c452c50>
2026-03-28 14:06:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:06:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:06:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:06:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bca1d29f-c38f-5f42-aceb-2939b9e67c99/bca1d29f-c38f-5f42-aceb-2939b9e67c99_image_2.jpg HTTP/1.1" 201 0
2026-03-28 14:06:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FYH12ZWB%252F698787080%252F600') HTTP/1.1" 204 0
2026-03-28 14:06:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YH12ZWB/698787080/600 saved to cache
2026-03-28 14:06:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item bca1d29f-c38f-5f42-aceb-2939b9e67c99
2026-03-28 14:06:36 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: bca1d29f-c38f-5f42-aceb-2939b9e67c99, skipping ID generation
2026-03-28 14:06:36 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item bca1d29f-c38f-5f42-aceb-2939b9e67c99 sending to next pipeline
2026-03-28 14:06:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: bca1d29f-c38f-5f42-aceb-2939b9e67c99, identifier: YH12%20ZWB
2026-03-28 14:06:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:06:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a1fe8e490>
2026-03-28 14:06:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:06:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:06:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:06:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8d0c9ac8-161b-5c76-8a79-0338cb8a1867/8d0c9ac8-161b-5c76-8a79-0338cb8a1867_image_0.jpg HTTP/1.1" 201 0
2026-03-28 14:06:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FYO66ENU%252F696055910%252F600') HTTP/1.1" 204 0
2026-03-28 14:06:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YO66ENU/696055910/600 saved to cache
2026-03-28 14:06:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 8d0c9ac8-161b-5c76-8a79-0338cb8a1867
2026-03-28 14:06:36 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 8d0c9ac8-161b-5c76-8a79-0338cb8a1867, skipping ID generation
2026-03-28 14:06:36 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 8d0c9ac8-161b-5c76-8a79-0338cb8a1867 sending to next pipeline
2026-03-28 14:06:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 8d0c9ac8-161b-5c76-8a79-0338cb8a1867, identifier: YO66%20ENU
2026-03-28 14:06:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 6671a6d0-673a-5170-b57c-2fa413a2722d with identifier: M70%20ODE
2026-03-28 14:06:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 6671a6d0-673a-5170-b57c-2fa413a2722d with identifier: M70%20ODE
2026-03-28 14:06:36 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 6671a6d0-673a-5170-b57c-2fa413a2722d with identifier: M70%20ODE to the API
2026-03-28 14:06:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:06:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:06:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/M70ODE/698941322/600>
{'auction_title': '',
'c_o_2_emission_value': 117,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6671a6d0-673a-5170-b57c-2fa413a2722d/6671a6d0-673a-5170-b57c-2fa413a2722d_expert_report_file_579eb67e-f083-454b-8a32-a9776a13b288.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=M70%20ODE-GB',
'category': 'Car',
'color': 'black',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.2L',
'expiration_date': '2026-03-29T10:00:00Z',
'fuel_type': 'Petrol',
'id': '6671a6d0-673a-5170-b57c-2fa413a2722d',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'M70 ODE',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=M70%20ODE&vehicleType=*',
'listing': 'auction',
'location': 'Manchester',
'make': 'PEUGEOT',
'model': '3008',
'odometer': 65272,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 11,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6671a6d0-673a-5170-b57c-2fa413a2722d/6671a6d0-673a-5170-b57c-2fa413a2722d_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 47461,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/M70ODE/698941305/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6671a6d0-673a-5170-b57c-2fa413a2722d/6671a6d0-673a-5170-b57c-2fa413a2722d_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 46903,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/M70ODE/698941314/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6671a6d0-673a-5170-b57c-2fa413a2722d/6671a6d0-673a-5170-b57c-2fa413a2722d_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 45823,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/M70ODE/698941322/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6671a6d0-673a-5170-b57c-2fa413a2722d/6671a6d0-673a-5170-b57c-2fa413a2722d_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 47006,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/M70ODE/698941340/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6671a6d0-673a-5170-b57c-2fa413a2722d/6671a6d0-673a-5170-b57c-2fa413a2722d_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 43862,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/M70ODE/698941358/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6671a6d0-673a-5170-b57c-2fa413a2722d/6671a6d0-673a-5170-b57c-2fa413a2722d_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 40932,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/M70ODE/698941374/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6671a6d0-673a-5170-b57c-2fa413a2722d/6671a6d0-673a-5170-b57c-2fa413a2722d_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 100322,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/M70ODE/698941400/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6671a6d0-673a-5170-b57c-2fa413a2722d/6671a6d0-673a-5170-b57c-2fa413a2722d_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 89361,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/M70ODE/698941434/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6671a6d0-673a-5170-b57c-2fa413a2722d/6671a6d0-673a-5170-b57c-2fa413a2722d_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 97194,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/M70ODE/698941455/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6671a6d0-673a-5170-b57c-2fa413a2722d/6671a6d0-673a-5170-b57c-2fa413a2722d_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 84812,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/M70ODE/698941481/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-01-01',
'seller_name': None,
'title': 'PEUGEOT 3008 1.2 P/T 130 ALLURE Hatchback',
'transmission': 'manual',
'trim': 'P/T 130 ALLURE',
'vin': 'VF3MRHNYHJS047206',
'year': 2018}
2026-03-28 14:06:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27M70%2520ODE%27 HTTP/1.1" 200 None
2026-03-28 14:06:37 [bca.uk] INFO: Saving data for M70%20ODE: {'created_time': 1774706797.336907, 'last_price_update_time': 1774706797.336923, 'auction_closing_time': 1774778400.0}
2026-03-28 14:06:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='M70%2520ODE') HTTP/1.1" 204 0
2026-03-28 14:06:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: bca1d29f-c38f-5f42-aceb-2939b9e67c99 with identifier: YH12%20ZWB
2026-03-28 14:06:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: bca1d29f-c38f-5f42-aceb-2939b9e67c99 with identifier: YH12%20ZWB
2026-03-28 14:06:37 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: bca1d29f-c38f-5f42-aceb-2939b9e67c99 with identifier: YH12%20ZWB to the API
2026-03-28 14:06:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:06:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:06:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YH12ZWB/698787080/600>
{'auction_title': '',
'c_o_2_emission_value': 132,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bca1d29f-c38f-5f42-aceb-2939b9e67c99/bca1d29f-c38f-5f42-aceb-2939b9e67c99_expert_report_file_49cdc4e4-f364-4155-9c78-60f54269a98c.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=YH12%20ZWB-GB',
'category': 'Car',
'color': 'white',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.6L',
'expiration_date': '2026-03-29T10:00:00Z',
'fuel_type': 'Petrol',
'id': 'bca1d29f-c38f-5f42-aceb-2939b9e67c99',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'YH12 ZWB',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=YH12%20ZWB&vehicleType=*',
'listing': 'auction',
'location': 'Brighouse',
'make': 'BMW',
'model': '116I',
'odometer': 82742,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 11,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bca1d29f-c38f-5f42-aceb-2939b9e67c99/bca1d29f-c38f-5f42-aceb-2939b9e67c99_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 46713,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YH12ZWB/698787040/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bca1d29f-c38f-5f42-aceb-2939b9e67c99/bca1d29f-c38f-5f42-aceb-2939b9e67c99_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 44905,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YH12ZWB/698787057/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bca1d29f-c38f-5f42-aceb-2939b9e67c99/bca1d29f-c38f-5f42-aceb-2939b9e67c99_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 44553,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YH12ZWB/698787080/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bca1d29f-c38f-5f42-aceb-2939b9e67c99/bca1d29f-c38f-5f42-aceb-2939b9e67c99_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 44266,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YH12ZWB/698787097/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bca1d29f-c38f-5f42-aceb-2939b9e67c99/bca1d29f-c38f-5f42-aceb-2939b9e67c99_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 43919,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YH12ZWB/698787113/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bca1d29f-c38f-5f42-aceb-2939b9e67c99/bca1d29f-c38f-5f42-aceb-2939b9e67c99_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 43014,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YH12ZWB/698787125/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bca1d29f-c38f-5f42-aceb-2939b9e67c99/bca1d29f-c38f-5f42-aceb-2939b9e67c99_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 68928,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YH12ZWB/698787151/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bca1d29f-c38f-5f42-aceb-2939b9e67c99/bca1d29f-c38f-5f42-aceb-2939b9e67c99_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 60756,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YH12ZWB/698787190/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bca1d29f-c38f-5f42-aceb-2939b9e67c99/bca1d29f-c38f-5f42-aceb-2939b9e67c99_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 77830,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YH12ZWB/698787214/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bca1d29f-c38f-5f42-aceb-2939b9e67c99/bca1d29f-c38f-5f42-aceb-2939b9e67c99_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 81141,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YH12ZWB/698787232/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2012-01-01',
'seller_name': None,
'title': 'BMW 116I 1.6 SPORT Hatchback',
'transmission': 'manual',
'trim': 'SPORT',
'vin': 'WBA1A12020E689947',
'year': 2012}
2026-03-28 14:06:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YH12%2520ZWB%27 HTTP/1.1" 200 None
2026-03-28 14:06:37 [bca.uk] INFO: Saving data for YH12%20ZWB: {'created_time': 1774706797.801021, 'last_price_update_time': 1774706797.801032, 'auction_closing_time': 1774778400.0}
2026-03-28 14:06:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='YH12%2520ZWB') HTTP/1.1" 204 0
2026-03-28 14:06:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 8d0c9ac8-161b-5c76-8a79-0338cb8a1867 with identifier: YO66%20ENU
2026-03-28 14:06:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 8d0c9ac8-161b-5c76-8a79-0338cb8a1867 with identifier: YO66%20ENU
2026-03-28 14:06:37 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 8d0c9ac8-161b-5c76-8a79-0338cb8a1867 with identifier: YO66%20ENU to the API
2026-03-28 14:06:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:06:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:06:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YO66ENU/696055910/600>
{'auction_title': '',
'c_o_2_emission_value': 144,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8d0c9ac8-161b-5c76-8a79-0338cb8a1867/8d0c9ac8-161b-5c76-8a79-0338cb8a1867_expert_report_file_7b034426-1e17-4f42-967f-51dd4c33ed63.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=YO66%20ENU-GB',
'category': 'Car',
'color': 'black',
'currency': 'GBP',
'doors_number': 5,
'engine': '3.0L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Diesel',
'id': '8d0c9ac8-161b-5c76-8a79-0338cb8a1867',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'YO66 ENU',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=YO66%20ENU&vehicleType=*',
'listing': 'auction',
'location': 'Brighouse',
'make': 'AUDI',
'model': 'A6 AVANT',
'odometer': 93731,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 12,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8d0c9ac8-161b-5c76-8a79-0338cb8a1867/8d0c9ac8-161b-5c76-8a79-0338cb8a1867_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 51321,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YO66ENU/696055910/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8d0c9ac8-161b-5c76-8a79-0338cb8a1867/8d0c9ac8-161b-5c76-8a79-0338cb8a1867_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 49622,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YO66ENU/696055918/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8d0c9ac8-161b-5c76-8a79-0338cb8a1867/8d0c9ac8-161b-5c76-8a79-0338cb8a1867_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 45114,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YO66ENU/696055921/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8d0c9ac8-161b-5c76-8a79-0338cb8a1867/8d0c9ac8-161b-5c76-8a79-0338cb8a1867_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 45901,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YO66ENU/696055929/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8d0c9ac8-161b-5c76-8a79-0338cb8a1867/8d0c9ac8-161b-5c76-8a79-0338cb8a1867_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 42783,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YO66ENU/696055938/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8d0c9ac8-161b-5c76-8a79-0338cb8a1867/8d0c9ac8-161b-5c76-8a79-0338cb8a1867_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 44006,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YO66ENU/696055944/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8d0c9ac8-161b-5c76-8a79-0338cb8a1867/8d0c9ac8-161b-5c76-8a79-0338cb8a1867_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 96875,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YO66ENU/696055953/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8d0c9ac8-161b-5c76-8a79-0338cb8a1867/8d0c9ac8-161b-5c76-8a79-0338cb8a1867_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 87648,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YO66ENU/696055963/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8d0c9ac8-161b-5c76-8a79-0338cb8a1867/8d0c9ac8-161b-5c76-8a79-0338cb8a1867_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 90719,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YO66ENU/696055970/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8d0c9ac8-161b-5c76-8a79-0338cb8a1867/8d0c9ac8-161b-5c76-8a79-0338cb8a1867_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 88279,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YO66ENU/696055980/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-01-01',
'seller_name': None,
'title': 'AUDI A6 AVANT 3.0 TDI 272 QUATTRO BLACK ED.S-T Estate',
'transmission': 'automatic',
'trim': 'TDI 272 QUATTRO BLACK ED.S-T',
'vin': 'WAUZZZ4G4HN060710',
'year': 2017}
2026-03-28 14:06:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YO66%2520ENU%27 HTTP/1.1" 200 None
2026-03-28 14:06:38 [bca.uk] INFO: Saving data for YO66%20ENU: {'created_time': 1774706798.229591, 'last_price_update_time': 1774706798.229602, 'auction_closing_time': 1774864800.0}
2026-03-28 14:06:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='YO66%2520ENU') HTTP/1.1" 204 0
2026-03-28 14:06:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BC65FJV/698633980/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/BC65FJV/42805191?sv=2020-08-04&st=2026-03-28T14%3A06%3A26Z&se=2026-03-28T14%3A31%3A26Z&sr=b&sp=r&sig=VD7AqlkCpzlQHKxBAL0n0wRt3IwFKoVa%2FExqjVTdHHA%3D)
2026-03-28 14:06:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AJ17HXL/698328437/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/AJ17HXL/42798748?sv=2020-08-04&st=2026-03-28T14%3A06%3A24Z&se=2026-03-28T14%3A31%3A24Z&sr=b&sp=r&sig=s%2FenQJFKWZab81RCtX8FxHWN1BS3QTqj1oqoO1gcyoI%3D)
2026-03-28 14:06:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AV13PZZ/698729628/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/AV13PZZ/42810506?sv=2020-08-04&st=2026-03-28T14%3A06%3A24Z&se=2026-03-28T14%3A31%3A24Z&sr=b&sp=r&sig=nZ0bGWVTxK13EuaxhdSPPyqqrzizvd8XT5v5hUK7Ua4%3D)
2026-03-28 14:06:38 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AJ17HXL/698328435/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698328435>
2026-03-28 14:06:38 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AV13PZZ/698729612/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698729612>
2026-03-28 14:06:38 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RV60TZO/698708232/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698708232>
2026-03-28 14:06:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BN10FFD/698729664/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/BN10FFD/42810471?sv=2020-08-04&st=2026-03-28T14%3A06%3A24Z&se=2026-03-28T14%3A31%3A24Z&sr=b&sp=r&sig=YRKnec8Y1hjSrUO4yfYPgpbhzRG9GcT5SYUolkFsGgY%3D)
2026-03-28 14:06:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BC65FJV/698633975/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/BC65FJV/42805191?sv=2020-08-04&st=2026-03-28T14%3A06%3A26Z&se=2026-03-28T14%3A31%3A26Z&sr=b&sp=r&sig=VD7AqlkCpzlQHKxBAL0n0wRt3IwFKoVa%2FExqjVTdHHA%3D)
2026-03-28 14:06:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:06:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2d7dab90>
2026-03-28 14:06:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:06:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:06:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:06:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_680c4e9b-15ae-54e0-a824-8a7fce3528fb/680c4e9b-15ae-54e0-a824-8a7fce3528fb_image_4.jpg HTTP/1.1" 201 0
2026-03-28 14:06:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FGJ70LXZ%252F698814440%252F600') HTTP/1.1" 204 0
2026-03-28 14:06:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GJ70LXZ/698814440/600 saved to cache
2026-03-28 14:06:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 680c4e9b-15ae-54e0-a824-8a7fce3528fb
2026-03-28 14:06:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:06:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2d912e90>
2026-03-28 14:06:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:06:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:06:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:06:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_df9a9a0d-7908-5df5-80db-63767b9fcbae/df9a9a0d-7908-5df5-80db-63767b9fcbae_image_5.jpg HTTP/1.1" 201 0
2026-03-28 14:06:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FKJ70LJU%252F698795066%252F600') HTTP/1.1" 204 0
2026-03-28 14:06:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KJ70LJU/698795066/600 saved to cache
2026-03-28 14:06:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item df9a9a0d-7908-5df5-80db-63767b9fcbae
2026-03-28 14:06:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:06:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c9cb450>
2026-03-28 14:06:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:06:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:06:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:06:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_df9a9a0d-7908-5df5-80db-63767b9fcbae/df9a9a0d-7908-5df5-80db-63767b9fcbae_image_4.jpg HTTP/1.1" 201 0
2026-03-28 14:06:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FKJ70LJU%252F698795056%252F600') HTTP/1.1" 204 0
2026-03-28 14:06:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KJ70LJU/698795056/600 saved to cache
2026-03-28 14:06:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item df9a9a0d-7908-5df5-80db-63767b9fcbae
2026-03-28 14:06:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:06:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2d743650>
2026-03-28 14:06:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:06:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:06:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:06:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_aa05e46e-6535-54ec-9d2a-990536e25c18/aa05e46e-6535-54ec-9d2a-990536e25c18_image_5.jpg HTTP/1.1" 201 0
2026-03-28 14:06:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FBN10FFD%252F698729680%252F600') HTTP/1.1" 204 0
2026-03-28 14:06:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BN10FFD/698729680/600 saved to cache
2026-03-28 14:06:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item aa05e46e-6535-54ec-9d2a-990536e25c18
2026-03-28 14:06:38 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:06:38 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:06:38 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:06:38 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:06:38 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:06:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:06:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a1fe8dd90>
2026-03-28 14:06:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:06:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:06:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:06:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_011230be-e1a4-58b5-92df-e152edda7f73/011230be-e1a4-58b5-92df-e152edda7f73_image_9.jpg HTTP/1.1" 201 0
2026-03-28 14:06:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FGL11XOW%252F698717345%252F600') HTTP/1.1" 204 0
2026-03-28 14:06:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GL11XOW/698717345/600 saved to cache
2026-03-28 14:06:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 011230be-e1a4-58b5-92df-e152edda7f73
2026-03-28 14:06:38 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BN10FFD/698729622/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698729622>
2026-03-28 14:06:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BN10FFD/698729643/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/BN10FFD/42810471?sv=2020-08-04&st=2026-03-28T14%3A06%3A24Z&se=2026-03-28T14%3A31%3A24Z&sr=b&sp=r&sig=YRKnec8Y1hjSrUO4yfYPgpbhzRG9GcT5SYUolkFsGgY%3D)
2026-03-28 14:06:38 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AV13PZZ/698729594/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=AV13PZZ-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-28 14:06:38 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GL11XOW/698717301/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698717301>
2026-03-28 14:06:38 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AJ17HXL/698328434/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698328434>
2026-03-28 14:06:38 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BC65FJV/698633972/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=BC65FJV-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-28 14:06:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GL11XOW/698717326/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/GL11XOW/42810476?sv=2020-08-04&st=2026-03-28T14%3A06%3A24Z&se=2026-03-28T14%3A31%3A24Z&sr=b&sp=r&sig=Z2KlPx5wKthhayrUXNoIRMZ89bgZHolJc7BL3Q6T4LE%3D)
2026-03-28 14:06:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:06:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c184dd0>
2026-03-28 14:06:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:06:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:06:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:06:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_515d9b9e-7ed9-596c-8fe3-830ee20f7887/515d9b9e-7ed9-596c-8fe3-830ee20f7887_image_2.jpg HTTP/1.1" 201 0
2026-03-28 14:06:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FBC65FJV%252F698633980%252F600') HTTP/1.1" 204 0
2026-03-28 14:06:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BC65FJV/698633980/600 saved to cache
2026-03-28 14:06:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 515d9b9e-7ed9-596c-8fe3-830ee20f7887
2026-03-28 14:06:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:06:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c93ad90>
2026-03-28 14:06:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:06:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:06:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:06:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2a541890-0343-5ec1-9e09-787ef67af079/2a541890-0343-5ec1-9e09-787ef67af079_image_5.jpg HTTP/1.1" 201 0
2026-03-28 14:06:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FAJ17HXL%252F698328437%252F600') HTTP/1.1" 204 0
2026-03-28 14:06:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AJ17HXL/698328437/600 saved to cache
2026-03-28 14:06:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 2a541890-0343-5ec1-9e09-787ef67af079
2026-03-28 14:06:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:06:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a1feeca90>
2026-03-28 14:06:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:06:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:06:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:06:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a2561847-ff84-5663-b0c4-a7e1fe0e31f4/a2561847-ff84-5663-b0c4-a7e1fe0e31f4_image_2.jpg HTTP/1.1" 201 0
2026-03-28 14:06:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FAV13PZZ%252F698729628%252F600') HTTP/1.1" 204 0
2026-03-28 14:06:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AV13PZZ/698729628/600 saved to cache
2026-03-28 14:06:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item a2561847-ff84-5663-b0c4-a7e1fe0e31f4
2026-03-28 14:06:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:06:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c42b490>
2026-03-28 14:06:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:06:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:06:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:06:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_aa05e46e-6535-54ec-9d2a-990536e25c18/aa05e46e-6535-54ec-9d2a-990536e25c18_image_4.jpg HTTP/1.1" 201 0
2026-03-28 14:06:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FBN10FFD%252F698729664%252F600') HTTP/1.1" 204 0
2026-03-28 14:06:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BN10FFD/698729664/600 saved to cache
2026-03-28 14:06:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item aa05e46e-6535-54ec-9d2a-990536e25c18
2026-03-28 14:06:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:06:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2dd85910>
2026-03-28 14:06:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:06:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:06:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:06:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_515d9b9e-7ed9-596c-8fe3-830ee20f7887/515d9b9e-7ed9-596c-8fe3-830ee20f7887_image_1.jpg HTTP/1.1" 201 0
2026-03-28 14:06:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FBC65FJV%252F698633975%252F600') HTTP/1.1" 204 0
2026-03-28 14:06:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BC65FJV/698633975/600 saved to cache
2026-03-28 14:06:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 515d9b9e-7ed9-596c-8fe3-830ee20f7887
2026-03-28 14:06:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RV60TZO/698708232/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/RV60TZO/42810285?sv=2020-08-04&st=2026-03-28T14%3A06%3A24Z&se=2026-03-28T14%3A31%3A24Z&sr=b&sp=r&sig=0wfV7eTXgj18RoXJ9dVJaCh0eej2XdKr%2F9zBrTgYLZs%3D)
2026-03-28 14:06:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:06:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2de3f350>
2026-03-28 14:06:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:06:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:06:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:06:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_aa05e46e-6535-54ec-9d2a-990536e25c18/aa05e46e-6535-54ec-9d2a-990536e25c18_image_3.jpg HTTP/1.1" 201 0
2026-03-28 14:06:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FBN10FFD%252F698729643%252F600') HTTP/1.1" 204 0
2026-03-28 14:06:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BN10FFD/698729643/600 saved to cache
2026-03-28 14:06:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item aa05e46e-6535-54ec-9d2a-990536e25c18
2026-03-28 14:06:38 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:06:38 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:06:38 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:06:38 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:06:38 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:06:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:06:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c3a8510>
2026-03-28 14:06:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:06:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:06:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:06:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_011230be-e1a4-58b5-92df-e152edda7f73/011230be-e1a4-58b5-92df-e152edda7f73_image_8.jpg HTTP/1.1" 201 0
2026-03-28 14:06:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FGL11XOW%252F698717326%252F600') HTTP/1.1" 204 0
2026-03-28 14:06:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GL11XOW/698717326/600 saved to cache
2026-03-28 14:06:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 011230be-e1a4-58b5-92df-e152edda7f73
2026-03-28 14:06:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AJ17HXL/698328435/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/AJ17HXL/42798748?sv=2020-08-04&st=2026-03-28T14%3A06%3A24Z&se=2026-03-28T14%3A31%3A24Z&sr=b&sp=r&sig=s%2FenQJFKWZab81RCtX8FxHWN1BS3QTqj1oqoO1gcyoI%3D)
2026-03-28 14:06:38 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RV60TZO/698708188/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698708188>
2026-03-28 14:06:38 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YB57FZC/697429882/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=697429882>
2026-03-28 14:06:38 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GK66WPY/698996596/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698996596>
2026-03-28 14:06:38 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KJ70LJU/698795032/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698795032>
2026-03-28 14:06:38 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BN10FFD/698729607/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698729607>
2026-03-28 14:06:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BC65FJV/698633972/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/BC65FJV/42805191?sv=2020-08-04&st=2026-03-28T14%3A06%3A26Z&se=2026-03-28T14%3A31%3A26Z&sr=b&sp=r&sig=VD7AqlkCpzlQHKxBAL0n0wRt3IwFKoVa%2FExqjVTdHHA%3D)
2026-03-28 14:06:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AV13PZZ/698729612/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/AV13PZZ/42810506?sv=2020-08-04&st=2026-03-28T14%3A06%3A24Z&se=2026-03-28T14%3A31%3A24Z&sr=b&sp=r&sig=nZ0bGWVTxK13EuaxhdSPPyqqrzizvd8XT5v5hUK7Ua4%3D)
2026-03-28 14:06:38 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:06:38 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:06:38 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:06:38 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:06:38 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:06:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:06:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c81a4d0>
2026-03-28 14:06:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:06:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:06:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:06:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_be5cf8be-a032-55c5-880a-33e1f5f6185e/be5cf8be-a032-55c5-880a-33e1f5f6185e_image_9.jpg HTTP/1.1" 201 0
2026-03-28 14:06:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FRV60TZO%252F698708232%252F600') HTTP/1.1" 204 0
2026-03-28 14:06:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RV60TZO/698708232/600 saved to cache
2026-03-28 14:06:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item be5cf8be-a032-55c5-880a-33e1f5f6185e
2026-03-28 14:06:38 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GK66WPY/698996579/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698996579>
2026-03-28 14:06:38 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RV60TZO/698708121/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698708121>
2026-03-28 14:06:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AV13PZZ/698729594/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/AV13PZZ/42810506?sv=2020-08-04&st=2026-03-28T14%3A06%3A24Z&se=2026-03-28T14%3A31%3A24Z&sr=b&sp=r&sig=nZ0bGWVTxK13EuaxhdSPPyqqrzizvd8XT5v5hUK7Ua4%3D)
2026-03-28 14:06:38 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GL11XOW/698717277/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698717277>
2026-03-28 14:06:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AJ17HXL/698328434/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/AJ17HXL/42798748?sv=2020-08-04&st=2026-03-28T14%3A06%3A24Z&se=2026-03-28T14%3A31%3A24Z&sr=b&sp=r&sig=s%2FenQJFKWZab81RCtX8FxHWN1BS3QTqj1oqoO1gcyoI%3D)
2026-03-28 14:06:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GL11XOW/698717301/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/GL11XOW/42810476?sv=2020-08-04&st=2026-03-28T14%3A06%3A24Z&se=2026-03-28T14%3A31%3A24Z&sr=b&sp=r&sig=Z2KlPx5wKthhayrUXNoIRMZ89bgZHolJc7BL3Q6T4LE%3D)
2026-03-28 14:06:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:06:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c3ab290>
2026-03-28 14:06:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:06:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:06:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:06:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2a541890-0343-5ec1-9e09-787ef67af079/2a541890-0343-5ec1-9e09-787ef67af079_image_4.jpg HTTP/1.1" 201 0
2026-03-28 14:06:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FAJ17HXL%252F698328435%252F600') HTTP/1.1" 204 0
2026-03-28 14:06:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AJ17HXL/698328435/600 saved to cache
2026-03-28 14:06:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 2a541890-0343-5ec1-9e09-787ef67af079
2026-03-28 14:06:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KJ70LJU/698795032/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/KJ70LJU/42807917?sv=2020-08-04&st=2026-03-28T14%3A06%3A24Z&se=2026-03-28T14%3A31%3A24Z&sr=b&sp=r&sig=T2vuiJBTz4jV3GmdM5bnFNfH4xGipPA46fpyn3Y01Pc%3D)
2026-03-28 14:06:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RV60TZO/698708188/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/RV60TZO/42810285?sv=2020-08-04&st=2026-03-28T14%3A06%3A24Z&se=2026-03-28T14%3A31%3A24Z&sr=b&sp=r&sig=0wfV7eTXgj18RoXJ9dVJaCh0eej2XdKr%2F9zBrTgYLZs%3D)
2026-03-28 14:06:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BN10FFD/698729622/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/BN10FFD/42810471?sv=2020-08-04&st=2026-03-28T14%3A06%3A24Z&se=2026-03-28T14%3A31%3A24Z&sr=b&sp=r&sig=YRKnec8Y1hjSrUO4yfYPgpbhzRG9GcT5SYUolkFsGgY%3D)
2026-03-28 14:06:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:06:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2ca10390>
2026-03-28 14:06:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:06:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:06:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:06:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_515d9b9e-7ed9-596c-8fe3-830ee20f7887/515d9b9e-7ed9-596c-8fe3-830ee20f7887_image_0.jpg HTTP/1.1" 201 0
2026-03-28 14:06:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FBC65FJV%252F698633972%252F600') HTTP/1.1" 204 0
2026-03-28 14:06:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BC65FJV/698633972/600 saved to cache
2026-03-28 14:06:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 515d9b9e-7ed9-596c-8fe3-830ee20f7887
2026-03-28 14:06:38 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 515d9b9e-7ed9-596c-8fe3-830ee20f7887, skipping ID generation
2026-03-28 14:06:38 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 515d9b9e-7ed9-596c-8fe3-830ee20f7887 sending to next pipeline
2026-03-28 14:06:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 515d9b9e-7ed9-596c-8fe3-830ee20f7887, identifier: BC65%20FJV
2026-03-28 14:06:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:06:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2de3cd10>
2026-03-28 14:06:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:06:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:06:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:06:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a2561847-ff84-5663-b0c4-a7e1fe0e31f4/a2561847-ff84-5663-b0c4-a7e1fe0e31f4_image_1.jpg HTTP/1.1" 201 0
2026-03-28 14:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FAV13PZZ%252F698729612%252F600') HTTP/1.1" 204 0
2026-03-28 14:06:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AV13PZZ/698729612/600 saved to cache
2026-03-28 14:06:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item a2561847-ff84-5663-b0c4-a7e1fe0e31f4
2026-03-28 14:06:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 515d9b9e-7ed9-596c-8fe3-830ee20f7887 with identifier: BC65%20FJV
2026-03-28 14:06:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 515d9b9e-7ed9-596c-8fe3-830ee20f7887 with identifier: BC65%20FJV
2026-03-28 14:06:39 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 515d9b9e-7ed9-596c-8fe3-830ee20f7887 with identifier: BC65%20FJV to the API
2026-03-28 14:06:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:06:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:06:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BC65FJV/698633972/600>
{'auction_title': '',
'c_o_2_emission_value': 99,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_515d9b9e-7ed9-596c-8fe3-830ee20f7887/515d9b9e-7ed9-596c-8fe3-830ee20f7887_expert_report_file_2ffda8e0-0252-4bff-92cc-1e9a03687d70.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=BC65%20FJV-GB',
'category': 'Car',
'color': 'red',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.2L',
'expiration_date': '2026-03-29T10:00:00Z',
'fuel_type': 'Petrol',
'id': '515d9b9e-7ed9-596c-8fe3-830ee20f7887',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'BC65 FJV',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=BC65%20FJV&vehicleType=*',
'listing': 'auction',
'location': 'Brighouse',
'make': 'PEUGEOT',
'model': '108',
'odometer': 51277,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 11,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_515d9b9e-7ed9-596c-8fe3-830ee20f7887/515d9b9e-7ed9-596c-8fe3-830ee20f7887_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 52218,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BC65FJV/698633972/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_515d9b9e-7ed9-596c-8fe3-830ee20f7887/515d9b9e-7ed9-596c-8fe3-830ee20f7887_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 50943,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BC65FJV/698633975/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_515d9b9e-7ed9-596c-8fe3-830ee20f7887/515d9b9e-7ed9-596c-8fe3-830ee20f7887_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 44921,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BC65FJV/698633980/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_515d9b9e-7ed9-596c-8fe3-830ee20f7887/515d9b9e-7ed9-596c-8fe3-830ee20f7887_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 46260,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BC65FJV/698633989/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_515d9b9e-7ed9-596c-8fe3-830ee20f7887/515d9b9e-7ed9-596c-8fe3-830ee20f7887_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 44816,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BC65FJV/698634000/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_515d9b9e-7ed9-596c-8fe3-830ee20f7887/515d9b9e-7ed9-596c-8fe3-830ee20f7887_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 45512,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BC65FJV/698634008/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_515d9b9e-7ed9-596c-8fe3-830ee20f7887/515d9b9e-7ed9-596c-8fe3-830ee20f7887_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 93954,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BC65FJV/698634023/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_515d9b9e-7ed9-596c-8fe3-830ee20f7887/515d9b9e-7ed9-596c-8fe3-830ee20f7887_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 65957,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BC65FJV/698634038/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_515d9b9e-7ed9-596c-8fe3-830ee20f7887/515d9b9e-7ed9-596c-8fe3-830ee20f7887_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 85640,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BC65FJV/698634050/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_515d9b9e-7ed9-596c-8fe3-830ee20f7887/515d9b9e-7ed9-596c-8fe3-830ee20f7887_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 77292,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BC65FJV/698634070/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-01-01',
'seller_name': None,
'title': 'PEUGEOT 108 1.2 P/T ALLURE Hatchback',
'transmission': 'manual',
'trim': 'P/T ALLURE',
'vin': 'VF3PAHMTCFR282095',
'year': 2016}
2026-03-28 14:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BC65%2520FJV%27 HTTP/1.1" 200 None
2026-03-28 14:06:39 [bca.uk] INFO: Saving data for BC65%20FJV: {'created_time': 1774706799.579674, 'last_price_update_time': 1774706799.579686, 'auction_closing_time': 1774778400.0}
2026-03-28 14:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='BC65%2520FJV') HTTP/1.1" 204 0
2026-03-28 14:06:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GK66WPY/698996596/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/GK66WPY/42809827?sv=2020-08-04&st=2026-03-28T14%3A06%3A24Z&se=2026-03-28T14%3A31%3A24Z&sr=b&sp=r&sig=o38p1n2nvobOwynrpVnEPlBMUIA211EoJMva9vtfiY0%3D)
2026-03-28 14:06:39 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GJ70LXZ/698814371/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=GJ70LXZ-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-28 14:06:39 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YB57FZC/697429875/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=697429875>
2026-03-28 14:06:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BN10FFD/698729607/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/BN10FFD/42810471?sv=2020-08-04&st=2026-03-28T14%3A06%3A24Z&se=2026-03-28T14%3A31%3A24Z&sr=b&sp=r&sig=YRKnec8Y1hjSrUO4yfYPgpbhzRG9GcT5SYUolkFsGgY%3D)
2026-03-28 14:06:39 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KJ70LJU/698794981/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=KJ70LJU-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-28 14:06:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RV60TZO/698708121/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/RV60TZO/42810285?sv=2020-08-04&st=2026-03-28T14%3A06%3A24Z&se=2026-03-28T14%3A31%3A24Z&sr=b&sp=r&sig=0wfV7eTXgj18RoXJ9dVJaCh0eej2XdKr%2F9zBrTgYLZs%3D)
2026-03-28 14:06:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YB57FZC/697429882/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YB57FZC/42780945?sv=2020-08-04&st=2026-03-28T14%3A06%3A24Z&se=2026-03-28T14%3A31%3A24Z&sr=b&sp=r&sig=kASeFsaHouQL63iaTeQp41zLaxTJgFeMsVL%2BJCZ14I4%3D)
2026-03-28 14:06:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GK66WPY/698996579/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/GK66WPY/42809827?sv=2020-08-04&st=2026-03-28T14%3A06%3A24Z&se=2026-03-28T14%3A31%3A24Z&sr=b&sp=r&sig=o38p1n2nvobOwynrpVnEPlBMUIA211EoJMva9vtfiY0%3D)
2026-03-28 14:06:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:06:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c12f950>
2026-03-28 14:06:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:06:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:06:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:06:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a2561847-ff84-5663-b0c4-a7e1fe0e31f4/a2561847-ff84-5663-b0c4-a7e1fe0e31f4_image_0.jpg HTTP/1.1" 201 0
2026-03-28 14:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FAV13PZZ%252F698729594%252F600') HTTP/1.1" 204 0
2026-03-28 14:06:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AV13PZZ/698729594/600 saved to cache
2026-03-28 14:06:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item a2561847-ff84-5663-b0c4-a7e1fe0e31f4
2026-03-28 14:06:39 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: a2561847-ff84-5663-b0c4-a7e1fe0e31f4, skipping ID generation
2026-03-28 14:06:39 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item a2561847-ff84-5663-b0c4-a7e1fe0e31f4 sending to next pipeline
2026-03-28 14:06:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: a2561847-ff84-5663-b0c4-a7e1fe0e31f4, identifier: AV13%20PZZ
2026-03-28 14:06:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:06:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2ffb2f50>
2026-03-28 14:06:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:06:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:06:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:06:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2a541890-0343-5ec1-9e09-787ef67af079/2a541890-0343-5ec1-9e09-787ef67af079_image_3.jpg HTTP/1.1" 201 0
2026-03-28 14:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FAJ17HXL%252F698328434%252F600') HTTP/1.1" 204 0
2026-03-28 14:06:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AJ17HXL/698328434/600 saved to cache
2026-03-28 14:06:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 2a541890-0343-5ec1-9e09-787ef67af079
2026-03-28 14:06:39 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 2a541890-0343-5ec1-9e09-787ef67af079, skipping ID generation
2026-03-28 14:06:39 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 2a541890-0343-5ec1-9e09-787ef67af079 sending to next pipeline
2026-03-28 14:06:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 2a541890-0343-5ec1-9e09-787ef67af079, identifier: AJ17%20HXL
2026-03-28 14:06:39 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:06:39 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:06:39 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:06:39 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:06:39 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:06:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:06:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a1fe381d0>
2026-03-28 14:06:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:06:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:06:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:06:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_011230be-e1a4-58b5-92df-e152edda7f73/011230be-e1a4-58b5-92df-e152edda7f73_image_7.jpg HTTP/1.1" 201 0
2026-03-28 14:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FGL11XOW%252F698717301%252F600') HTTP/1.1" 204 0
2026-03-28 14:06:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GL11XOW/698717301/600 saved to cache
2026-03-28 14:06:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 011230be-e1a4-58b5-92df-e152edda7f73
2026-03-28 14:06:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:06:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2d8d4b50>
2026-03-28 14:06:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:06:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:06:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:06:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_df9a9a0d-7908-5df5-80db-63767b9fcbae/df9a9a0d-7908-5df5-80db-63767b9fcbae_image_1.jpg HTTP/1.1" 201 0
2026-03-28 14:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FKJ70LJU%252F698795032%252F600') HTTP/1.1" 204 0
2026-03-28 14:06:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KJ70LJU/698795032/600 saved to cache
2026-03-28 14:06:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item df9a9a0d-7908-5df5-80db-63767b9fcbae
2026-03-28 14:06:39 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:06:39 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:06:39 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:06:39 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:06:39 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:06:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:06:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a1fe398d0>
2026-03-28 14:06:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:06:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:06:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:06:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_be5cf8be-a032-55c5-880a-33e1f5f6185e/be5cf8be-a032-55c5-880a-33e1f5f6185e_image_8.jpg HTTP/1.1" 201 0
2026-03-28 14:06:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FRV60TZO%252F698708188%252F600') HTTP/1.1" 204 0
2026-03-28 14:06:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RV60TZO/698708188/600 saved to cache
2026-03-28 14:06:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item be5cf8be-a032-55c5-880a-33e1f5f6185e
2026-03-28 14:06:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:06:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2dbbab50>
2026-03-28 14:06:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:06:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:06:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:06:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_aa05e46e-6535-54ec-9d2a-990536e25c18/aa05e46e-6535-54ec-9d2a-990536e25c18_image_2.jpg HTTP/1.1" 201 0
2026-03-28 14:06:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FBN10FFD%252F698729622%252F600') HTTP/1.1" 204 0
2026-03-28 14:06:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BN10FFD/698729622/600 saved to cache
2026-03-28 14:06:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item aa05e46e-6535-54ec-9d2a-990536e25c18
2026-03-28 14:06:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: a2561847-ff84-5663-b0c4-a7e1fe0e31f4 with identifier: AV13%20PZZ
2026-03-28 14:06:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: a2561847-ff84-5663-b0c4-a7e1fe0e31f4 with identifier: AV13%20PZZ
2026-03-28 14:06:40 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: a2561847-ff84-5663-b0c4-a7e1fe0e31f4 with identifier: AV13%20PZZ to the API
2026-03-28 14:06:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:06:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:06:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AV13PZZ/698729594/600>
{'auction_title': '',
'c_o_2_emission_value': 105,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a2561847-ff84-5663-b0c4-a7e1fe0e31f4/a2561847-ff84-5663-b0c4-a7e1fe0e31f4_expert_report_file_872e2fa8-e256-45a7-8d4b-bdbea7f55b5e.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=AV13%20PZZ-GB',
'category': 'Car',
'color': 'grey',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.6L',
'expiration_date': '2026-03-29T10:00:00Z',
'fuel_type': 'Diesel',
'id': 'a2561847-ff84-5663-b0c4-a7e1fe0e31f4',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'AV13 PZZ',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=AV13%20PZZ&vehicleType=*',
'listing': 'auction',
'location': 'Blackbushe',
'make': 'PEUGEOT',
'model': '2008',
'odometer': 142959,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 11,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a2561847-ff84-5663-b0c4-a7e1fe0e31f4/a2561847-ff84-5663-b0c4-a7e1fe0e31f4_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 55256,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AV13PZZ/698729594/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a2561847-ff84-5663-b0c4-a7e1fe0e31f4/a2561847-ff84-5663-b0c4-a7e1fe0e31f4_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 53659,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AV13PZZ/698729612/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a2561847-ff84-5663-b0c4-a7e1fe0e31f4/a2561847-ff84-5663-b0c4-a7e1fe0e31f4_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 51798,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AV13PZZ/698729628/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a2561847-ff84-5663-b0c4-a7e1fe0e31f4/a2561847-ff84-5663-b0c4-a7e1fe0e31f4_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 52761,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AV13PZZ/698729646/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a2561847-ff84-5663-b0c4-a7e1fe0e31f4/a2561847-ff84-5663-b0c4-a7e1fe0e31f4_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 54953,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AV13PZZ/698729666/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a2561847-ff84-5663-b0c4-a7e1fe0e31f4/a2561847-ff84-5663-b0c4-a7e1fe0e31f4_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 53442,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AV13PZZ/698729678/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a2561847-ff84-5663-b0c4-a7e1fe0e31f4/a2561847-ff84-5663-b0c4-a7e1fe0e31f4_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 87048,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AV13PZZ/698729701/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a2561847-ff84-5663-b0c4-a7e1fe0e31f4/a2561847-ff84-5663-b0c4-a7e1fe0e31f4_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 76322,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AV13PZZ/698729719/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a2561847-ff84-5663-b0c4-a7e1fe0e31f4/a2561847-ff84-5663-b0c4-a7e1fe0e31f4_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 86694,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AV13PZZ/698729741/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a2561847-ff84-5663-b0c4-a7e1fe0e31f4/a2561847-ff84-5663-b0c4-a7e1fe0e31f4_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 92761,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AV13PZZ/698729758/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2013-01-01',
'seller_name': None,
'title': 'PEUGEOT 2008 1.6 E-HDI 115 FELINE MPV',
'transmission': 'manual',
'trim': 'E-HDI 115 FELINE',
'vin': 'VF3CU9HD8DY027202',
'year': 2013}
2026-03-28 14:06:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27AV13%2520PZZ%27 HTTP/1.1" 200 None
2026-03-28 14:06:40 [bca.uk] INFO: Saving data for AV13%20PZZ: {'created_time': 1774706800.461777, 'last_price_update_time': 1774706800.46179, 'auction_closing_time': 1774778400.0}
2026-03-28 14:06:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='AV13%2520PZZ') HTTP/1.1" 204 0
2026-03-28 14:06:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 2a541890-0343-5ec1-9e09-787ef67af079 with identifier: AJ17%20HXL
2026-03-28 14:06:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 2a541890-0343-5ec1-9e09-787ef67af079 with identifier: AJ17%20HXL
2026-03-28 14:06:40 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 2a541890-0343-5ec1-9e09-787ef67af079 with identifier: AJ17%20HXL to the API
2026-03-28 14:06:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:06:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:06:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AJ17HXL/698328434/600>
{'auction_title': '',
'c_o_2_emission_value': 111,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2a541890-0343-5ec1-9e09-787ef67af079/2a541890-0343-5ec1-9e09-787ef67af079_expert_report_file_24470f81-d5e5-4510-8ff7-496e957ce0cd.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=AJ17%20HXL-GB',
'category': 'Car',
'color': 'grey',
'currency': 'GBP',
'doors_number': 4,
'engine': '2.0L',
'expiration_date': '2026-03-29T10:00:00Z',
'fuel_type': 'Diesel',
'id': '2a541890-0343-5ec1-9e09-787ef67af079',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'AJ17 HXL',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=AJ17%20HXL&vehicleType=*',
'listing': 'auction',
'location': 'Bedford',
'make': 'AUDI',
'model': 'A4',
'odometer': 121130,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 11,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2a541890-0343-5ec1-9e09-787ef67af079/2a541890-0343-5ec1-9e09-787ef67af079_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 51523,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AJ17HXL/698328427/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2a541890-0343-5ec1-9e09-787ef67af079/2a541890-0343-5ec1-9e09-787ef67af079_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 51198,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AJ17HXL/698328429/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2a541890-0343-5ec1-9e09-787ef67af079/2a541890-0343-5ec1-9e09-787ef67af079_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 47646,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AJ17HXL/698328430/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2a541890-0343-5ec1-9e09-787ef67af079/2a541890-0343-5ec1-9e09-787ef67af079_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 46546,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AJ17HXL/698328434/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2a541890-0343-5ec1-9e09-787ef67af079/2a541890-0343-5ec1-9e09-787ef67af079_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 45599,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AJ17HXL/698328435/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2a541890-0343-5ec1-9e09-787ef67af079/2a541890-0343-5ec1-9e09-787ef67af079_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 45765,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AJ17HXL/698328437/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2a541890-0343-5ec1-9e09-787ef67af079/2a541890-0343-5ec1-9e09-787ef67af079_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 83875,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AJ17HXL/698328438/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2a541890-0343-5ec1-9e09-787ef67af079/2a541890-0343-5ec1-9e09-787ef67af079_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 79173,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AJ17HXL/698328440/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2a541890-0343-5ec1-9e09-787ef67af079/2a541890-0343-5ec1-9e09-787ef67af079_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 88387,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AJ17HXL/698328441/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2a541890-0343-5ec1-9e09-787ef67af079/2a541890-0343-5ec1-9e09-787ef67af079_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 67075,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AJ17HXL/698328443/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-01-01',
'seller_name': None,
'title': 'AUDI A4 2.0 TDI 190 S LINE S-T Saloon',
'transmission': 'automatic',
'trim': 'TDI 190 S LINE S-T',
'vin': 'WAUZZZF42HA171296',
'year': 2017}
2026-03-28 14:06:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27AJ17%2520HXL%27 HTTP/1.1" 200 None
2026-03-28 14:06:40 [bca.uk] INFO: Saving data for AJ17%20HXL: {'created_time': 1774706800.928404, 'last_price_update_time': 1774706800.928417, 'auction_closing_time': 1774778400.0}
2026-03-28 14:06:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='AJ17%2520HXL') HTTP/1.1" 204 0
2026-03-28 14:06:40 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RV60TZO/698708089/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698708089>
2026-03-28 14:06:40 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GL11XOW/698717256/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698717256>
2026-03-28 14:06:40 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GK66WPY/698996564/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698996564>
2026-03-28 14:06:40 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BN10FFD/698729590/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=BN10FFD-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-28 14:06:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KJ70LJU/698794981/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/KJ70LJU/42807917?sv=2020-08-04&st=2026-03-28T14%3A06%3A24Z&se=2026-03-28T14%3A31%3A24Z&sr=b&sp=r&sig=T2vuiJBTz4jV3GmdM5bnFNfH4xGipPA46fpyn3Y01Pc%3D)
2026-03-28 14:06:40 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YB57FZC/697429863/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=697429863>
2026-03-28 14:06:40 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RV60TZO/698708062/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698708062>
2026-03-28 14:06:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GL11XOW/698717277/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/GL11XOW/42810476?sv=2020-08-04&st=2026-03-28T14%3A06%3A24Z&se=2026-03-28T14%3A31%3A24Z&sr=b&sp=r&sig=Z2KlPx5wKthhayrUXNoIRMZ89bgZHolJc7BL3Q6T4LE%3D)
2026-03-28 14:06:40 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:06:40 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:06:40 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:06:40 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:06:40 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:06:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:06:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2d9d0410>
2026-03-28 14:06:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:06:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:06:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:06:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3e1a668c-07f1-5b40-8f70-ce6f3b64756d/3e1a668c-07f1-5b40-8f70-ce6f3b64756d_image_9.jpg HTTP/1.1" 201 0
2026-03-28 14:06:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FGK66WPY%252F698996596%252F600') HTTP/1.1" 204 0
2026-03-28 14:06:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GK66WPY/698996596/600 saved to cache
2026-03-28 14:06:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 3e1a668c-07f1-5b40-8f70-ce6f3b64756d
2026-03-28 14:06:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:06:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2dda9e90>
2026-03-28 14:06:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:06:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:06:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:06:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_aa05e46e-6535-54ec-9d2a-990536e25c18/aa05e46e-6535-54ec-9d2a-990536e25c18_image_1.jpg HTTP/1.1" 201 0
2026-03-28 14:06:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FBN10FFD%252F698729607%252F600') HTTP/1.1" 204 0
2026-03-28 14:06:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BN10FFD/698729607/600 saved to cache
2026-03-28 14:06:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item aa05e46e-6535-54ec-9d2a-990536e25c18
2026-03-28 14:06:41 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:06:41 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:06:41 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:06:41 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:06:41 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:06:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:06:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2d8e55d0>
2026-03-28 14:06:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:06:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:06:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:06:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_be5cf8be-a032-55c5-880a-33e1f5f6185e/be5cf8be-a032-55c5-880a-33e1f5f6185e_image_7.jpg HTTP/1.1" 201 0
2026-03-28 14:06:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FRV60TZO%252F698708121%252F600') HTTP/1.1" 204 0
2026-03-28 14:06:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RV60TZO/698708121/600 saved to cache
2026-03-28 14:06:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item be5cf8be-a032-55c5-880a-33e1f5f6185e
2026-03-28 14:06:41 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:06:41 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:06:41 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:06:41 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:06:41 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:06:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:06:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2ddb0fd0>
2026-03-28 14:06:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:06:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:06:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:06:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b9b1844a-f6e4-586f-88aa-fc22f6ebd424/b9b1844a-f6e4-586f-88aa-fc22f6ebd424_image_9.jpg HTTP/1.1" 201 0
2026-03-28 14:06:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FYB57FZC%252F697429882%252F600') HTTP/1.1" 204 0
2026-03-28 14:06:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YB57FZC/697429882/600 saved to cache
2026-03-28 14:06:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item b9b1844a-f6e4-586f-88aa-fc22f6ebd424
2026-03-28 14:06:41 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:06:41 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:06:41 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:06:41 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:06:41 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:06:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:06:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a1feecbd0>
2026-03-28 14:06:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:06:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:06:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:06:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3e1a668c-07f1-5b40-8f70-ce6f3b64756d/3e1a668c-07f1-5b40-8f70-ce6f3b64756d_image_8.jpg HTTP/1.1" 201 0
2026-03-28 14:06:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FGK66WPY%252F698996579%252F600') HTTP/1.1" 204 0
2026-03-28 14:06:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GK66WPY/698996579/600 saved to cache
2026-03-28 14:06:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 3e1a668c-07f1-5b40-8f70-ce6f3b64756d
2026-03-28 14:06:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:06:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c598610>
2026-03-28 14:06:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:06:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:06:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:06:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_df9a9a0d-7908-5df5-80db-63767b9fcbae/df9a9a0d-7908-5df5-80db-63767b9fcbae_image_0.jpg HTTP/1.1" 201 0
2026-03-28 14:06:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FKJ70LJU%252F698794981%252F600') HTTP/1.1" 204 0
2026-03-28 14:06:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KJ70LJU/698794981/600 saved to cache
2026-03-28 14:06:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item df9a9a0d-7908-5df5-80db-63767b9fcbae
2026-03-28 14:06:41 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: df9a9a0d-7908-5df5-80db-63767b9fcbae, skipping ID generation
2026-03-28 14:06:41 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item df9a9a0d-7908-5df5-80db-63767b9fcbae sending to next pipeline
2026-03-28 14:06:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: df9a9a0d-7908-5df5-80db-63767b9fcbae, identifier: KJ70%20LJU
2026-03-28 14:06:41 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:06:41 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:06:41 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:06:41 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:06:41 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:06:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:06:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c9f5250>
2026-03-28 14:06:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:06:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:06:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:06:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_011230be-e1a4-58b5-92df-e152edda7f73/011230be-e1a4-58b5-92df-e152edda7f73_image_6.jpg HTTP/1.1" 201 0
2026-03-28 14:06:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FGL11XOW%252F698717277%252F600') HTTP/1.1" 204 0
2026-03-28 14:06:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GL11XOW/698717277/600 saved to cache
2026-03-28 14:06:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 011230be-e1a4-58b5-92df-e152edda7f73
2026-03-28 14:06:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: df9a9a0d-7908-5df5-80db-63767b9fcbae with identifier: KJ70%20LJU
2026-03-28 14:06:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: df9a9a0d-7908-5df5-80db-63767b9fcbae with identifier: KJ70%20LJU
2026-03-28 14:06:41 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: df9a9a0d-7908-5df5-80db-63767b9fcbae with identifier: KJ70%20LJU to the API
2026-03-28 14:06:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:06:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:06:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KJ70LJU/698794981/600>
{'auction_title': '',
'c_o_2_emission_value': 135,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_df9a9a0d-7908-5df5-80db-63767b9fcbae/df9a9a0d-7908-5df5-80db-63767b9fcbae_expert_report_file_5e298352-5673-4968-b535-20c36db2e4c8.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=KJ70%20LJU-GB',
'category': 'Car',
'color': 'grey',
'currency': 'GBP',
'doors_number': 4,
'engine': '1.5L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol',
'id': 'df9a9a0d-7908-5df5-80db-63767b9fcbae',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'KJ70 LJU',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=KJ70%20LJU&vehicleType=*',
'listing': 'auction',
'location': 'Bedford',
'make': 'AUDI',
'model': 'A3 SALOON',
'odometer': 49912,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 11,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_df9a9a0d-7908-5df5-80db-63767b9fcbae/df9a9a0d-7908-5df5-80db-63767b9fcbae_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 51952,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KJ70LJU/698794981/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_df9a9a0d-7908-5df5-80db-63767b9fcbae/df9a9a0d-7908-5df5-80db-63767b9fcbae_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 52519,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KJ70LJU/698795032/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_df9a9a0d-7908-5df5-80db-63767b9fcbae/df9a9a0d-7908-5df5-80db-63767b9fcbae_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 47174,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KJ70LJU/698795039/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_df9a9a0d-7908-5df5-80db-63767b9fcbae/df9a9a0d-7908-5df5-80db-63767b9fcbae_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 46868,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KJ70LJU/698795050/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_df9a9a0d-7908-5df5-80db-63767b9fcbae/df9a9a0d-7908-5df5-80db-63767b9fcbae_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 46100,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KJ70LJU/698795056/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_df9a9a0d-7908-5df5-80db-63767b9fcbae/df9a9a0d-7908-5df5-80db-63767b9fcbae_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 47060,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KJ70LJU/698795066/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_df9a9a0d-7908-5df5-80db-63767b9fcbae/df9a9a0d-7908-5df5-80db-63767b9fcbae_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 67441,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KJ70LJU/698795082/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_df9a9a0d-7908-5df5-80db-63767b9fcbae/df9a9a0d-7908-5df5-80db-63767b9fcbae_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 73998,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KJ70LJU/698795089/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_df9a9a0d-7908-5df5-80db-63767b9fcbae/df9a9a0d-7908-5df5-80db-63767b9fcbae_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 87550,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KJ70LJU/698795108/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_df9a9a0d-7908-5df5-80db-63767b9fcbae/df9a9a0d-7908-5df5-80db-63767b9fcbae_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 83447,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KJ70LJU/698795119/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-01-01',
'seller_name': None,
'title': 'AUDI A3 SALOON 1.5 35 TFSI S LINE S-T Saloon',
'transmission': 'automatic',
'trim': '35 TFSI S LINE S-T',
'vin': 'WAUZZZGY8MA015761',
'year': 2020}
2026-03-28 14:06:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KJ70%2520LJU%27 HTTP/1.1" 200 None
2026-03-28 14:06:41 [bca.uk] INFO: Saving data for KJ70%20LJU: {'created_time': 1774706801.850881, 'last_price_update_time': 1774706801.850894, 'auction_closing_time': 1774864800.0}
2026-03-28 14:06:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='KJ70%2520LJU') HTTP/1.1" 204 0
2026-03-28 14:06:41 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YB57FZC/697429856/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=697429856>
2026-03-28 14:06:41 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GL11XOW/698717191/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698717191>
2026-03-28 14:06:41 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GK66WPY/698996546/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698996546>
2026-03-28 14:06:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RV60TZO/698708062/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/RV60TZO/42810285?sv=2020-08-04&st=2026-03-28T14%3A06%3A24Z&se=2026-03-28T14%3A31%3A24Z&sr=b&sp=r&sig=0wfV7eTXgj18RoXJ9dVJaCh0eej2XdKr%2F9zBrTgYLZs%3D)
2026-03-28 14:06:41 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GK66WPY/698996520/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698996520>
2026-03-28 14:06:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GJ70LXZ/698814371/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/GJ70LXZ/42808336?sv=2020-08-04&st=2026-03-28T14%3A06%3A24Z&se=2026-03-28T14%3A31%3A24Z&sr=b&sp=r&sig=b57i0PzDZVUlozUA4vRBxPguh6MBQAEl464L60jtAsQ%3D)
2026-03-28 14:06:41 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YB57FZC/697429849/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=697429849>
2026-03-28 14:06:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YB57FZC/697429875/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YB57FZC/42780945?sv=2020-08-04&st=2026-03-28T14%3A06%3A24Z&se=2026-03-28T14%3A31%3A24Z&sr=b&sp=r&sig=kASeFsaHouQL63iaTeQp41zLaxTJgFeMsVL%2BJCZ14I4%3D)
2026-03-28 14:06:41 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GL11XOW/698717172/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698717172>
2026-03-28 14:06:41 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YB57FZC/697429844/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=697429844>
2026-03-28 14:06:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BN10FFD/698729590/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/BN10FFD/42810471?sv=2020-08-04&st=2026-03-28T14%3A06%3A24Z&se=2026-03-28T14%3A31%3A24Z&sr=b&sp=r&sig=YRKnec8Y1hjSrUO4yfYPgpbhzRG9GcT5SYUolkFsGgY%3D)
2026-03-28 14:06:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GK66WPY/698996564/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/GK66WPY/42809827?sv=2020-08-04&st=2026-03-28T14%3A06%3A24Z&se=2026-03-28T14%3A31%3A24Z&sr=b&sp=r&sig=o38p1n2nvobOwynrpVnEPlBMUIA211EoJMva9vtfiY0%3D)
2026-03-28 14:06:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GL11XOW/698717256/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/GL11XOW/42810476?sv=2020-08-04&st=2026-03-28T14%3A06%3A24Z&se=2026-03-28T14%3A31%3A24Z&sr=b&sp=r&sig=Z2KlPx5wKthhayrUXNoIRMZ89bgZHolJc7BL3Q6T4LE%3D)
2026-03-28 14:06:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YB57FZC/697429863/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YB57FZC/42780945?sv=2020-08-04&st=2026-03-28T14%3A06%3A24Z&se=2026-03-28T14%3A31%3A24Z&sr=b&sp=r&sig=kASeFsaHouQL63iaTeQp41zLaxTJgFeMsVL%2BJCZ14I4%3D)
2026-03-28 14:06:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YB57FZC/697429849/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YB57FZC/42780945?sv=2020-08-04&st=2026-03-28T14%3A06%3A24Z&se=2026-03-28T14%3A31%3A24Z&sr=b&sp=r&sig=kASeFsaHouQL63iaTeQp41zLaxTJgFeMsVL%2BJCZ14I4%3D)
2026-03-28 14:06:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RV60TZO/698708089/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/RV60TZO/42810285?sv=2020-08-04&st=2026-03-28T14%3A06%3A24Z&se=2026-03-28T14%3A31%3A24Z&sr=b&sp=r&sig=0wfV7eTXgj18RoXJ9dVJaCh0eej2XdKr%2F9zBrTgYLZs%3D)
2026-03-28 14:06:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:06:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2dd555d0>
2026-03-28 14:06:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:06:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:06:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:06:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_be5cf8be-a032-55c5-880a-33e1f5f6185e/be5cf8be-a032-55c5-880a-33e1f5f6185e_image_5.jpg HTTP/1.1" 201 0
2026-03-28 14:06:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FRV60TZO%252F698708062%252F600') HTTP/1.1" 204 0
2026-03-28 14:06:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RV60TZO/698708062/600 saved to cache
2026-03-28 14:06:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item be5cf8be-a032-55c5-880a-33e1f5f6185e
2026-03-28 14:06:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:06:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c13c250>
2026-03-28 14:06:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:06:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:06:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:06:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_680c4e9b-15ae-54e0-a824-8a7fce3528fb/680c4e9b-15ae-54e0-a824-8a7fce3528fb_image_0.jpg HTTP/1.1" 201 0
2026-03-28 14:06:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FGJ70LXZ%252F698814371%252F600') HTTP/1.1" 204 0
2026-03-28 14:06:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GJ70LXZ/698814371/600 saved to cache
2026-03-28 14:06:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 680c4e9b-15ae-54e0-a824-8a7fce3528fb
2026-03-28 14:06:42 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 680c4e9b-15ae-54e0-a824-8a7fce3528fb, skipping ID generation
2026-03-28 14:06:42 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 680c4e9b-15ae-54e0-a824-8a7fce3528fb sending to next pipeline
2026-03-28 14:06:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 680c4e9b-15ae-54e0-a824-8a7fce3528fb, identifier: GJ70%20LXZ
2026-03-28 14:06:42 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:06:42 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:06:42 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:06:42 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:06:42 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:06:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:06:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a1feee310>
2026-03-28 14:06:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:06:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:06:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:06:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b9b1844a-f6e4-586f-88aa-fc22f6ebd424/b9b1844a-f6e4-586f-88aa-fc22f6ebd424_image_8.jpg HTTP/1.1" 201 0
2026-03-28 14:06:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FYB57FZC%252F697429875%252F600') HTTP/1.1" 204 0
2026-03-28 14:06:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YB57FZC/697429875/600 saved to cache
2026-03-28 14:06:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item b9b1844a-f6e4-586f-88aa-fc22f6ebd424
2026-03-28 14:06:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 680c4e9b-15ae-54e0-a824-8a7fce3528fb with identifier: GJ70%20LXZ
2026-03-28 14:06:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 680c4e9b-15ae-54e0-a824-8a7fce3528fb with identifier: GJ70%20LXZ
2026-03-28 14:06:42 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 680c4e9b-15ae-54e0-a824-8a7fce3528fb with identifier: GJ70%20LXZ to the API
2026-03-28 14:06:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:06:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:06:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GJ70LXZ/698814371/600>
{'auction_title': '',
'c_o_2_emission_value': 127,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_680c4e9b-15ae-54e0-a824-8a7fce3528fb/680c4e9b-15ae-54e0-a824-8a7fce3528fb_expert_report_file_53062d49-9ac0-4e77-8b2d-b0dc7356f747.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=GJ70%20LXZ-GB',
'category': 'Car',
'color': 'black',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.0L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol',
'id': '680c4e9b-15ae-54e0-a824-8a7fce3528fb',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'GJ70 LXZ',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=GJ70%20LXZ&vehicleType=*',
'listing': 'auction',
'location': 'Bedford',
'make': 'VOLKSWAGEN',
'model': 'POLO',
'odometer': 57687,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 11,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_680c4e9b-15ae-54e0-a824-8a7fce3528fb/680c4e9b-15ae-54e0-a824-8a7fce3528fb_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 50358,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GJ70LXZ/698814371/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_680c4e9b-15ae-54e0-a824-8a7fce3528fb/680c4e9b-15ae-54e0-a824-8a7fce3528fb_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 48098,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GJ70LXZ/698814387/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_680c4e9b-15ae-54e0-a824-8a7fce3528fb/680c4e9b-15ae-54e0-a824-8a7fce3528fb_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 44315,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GJ70LXZ/698814406/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_680c4e9b-15ae-54e0-a824-8a7fce3528fb/680c4e9b-15ae-54e0-a824-8a7fce3528fb_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 43686,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GJ70LXZ/698814418/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_680c4e9b-15ae-54e0-a824-8a7fce3528fb/680c4e9b-15ae-54e0-a824-8a7fce3528fb_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 44200,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GJ70LXZ/698814440/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_680c4e9b-15ae-54e0-a824-8a7fce3528fb/680c4e9b-15ae-54e0-a824-8a7fce3528fb_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 44243,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GJ70LXZ/698814451/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_680c4e9b-15ae-54e0-a824-8a7fce3528fb/680c4e9b-15ae-54e0-a824-8a7fce3528fb_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 93411,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GJ70LXZ/698814478/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_680c4e9b-15ae-54e0-a824-8a7fce3528fb/680c4e9b-15ae-54e0-a824-8a7fce3528fb_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 71733,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GJ70LXZ/698814503/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_680c4e9b-15ae-54e0-a824-8a7fce3528fb/680c4e9b-15ae-54e0-a824-8a7fce3528fb_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 89624,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GJ70LXZ/698814526/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_680c4e9b-15ae-54e0-a824-8a7fce3528fb/680c4e9b-15ae-54e0-a824-8a7fce3528fb_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 80506,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GJ70LXZ/698814543/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-01-01',
'seller_name': None,
'title': 'VOLKSWAGEN POLO 1.0 TSI 95 MATCH Hatchback',
'transmission': 'manual',
'trim': 'TSI 95 MATCH',
'vin': 'WVWZZZAWZLU073185',
'year': 2020}
2026-03-28 14:06:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GJ70%2520LXZ%27 HTTP/1.1" 200 None
2026-03-28 14:06:42 [bca.uk] INFO: Saving data for GJ70%20LXZ: {'created_time': 1774706802.680435, 'last_price_update_time': 1774706802.680446, 'auction_closing_time': 1774864800.0}
2026-03-28 14:06:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='GJ70%2520LXZ') HTTP/1.1" 204 0
2026-03-28 14:06:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GK66WPY/698996520/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/GK66WPY/42809827?sv=2020-08-04&st=2026-03-28T14%3A06%3A24Z&se=2026-03-28T14%3A31%3A24Z&sr=b&sp=r&sig=o38p1n2nvobOwynrpVnEPlBMUIA211EoJMva9vtfiY0%3D)
2026-03-28 14:06:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GL11XOW/698717191/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/GL11XOW/42810476?sv=2020-08-04&st=2026-03-28T14%3A06%3A24Z&se=2026-03-28T14%3A31%3A24Z&sr=b&sp=r&sig=Z2KlPx5wKthhayrUXNoIRMZ89bgZHolJc7BL3Q6T4LE%3D)
2026-03-28 14:06:42 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RV60TZO/698707962/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698707962>
2026-03-28 14:06:42 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GK66WPY/698996514/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698996514>
2026-03-28 14:06:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GK66WPY/698996546/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/GK66WPY/42809827?sv=2020-08-04&st=2026-03-28T14%3A06%3A24Z&se=2026-03-28T14%3A31%3A24Z&sr=b&sp=r&sig=o38p1n2nvobOwynrpVnEPlBMUIA211EoJMva9vtfiY0%3D)
2026-03-28 14:06:42 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YB57FZC/697429839/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=697429839>
2026-03-28 14:06:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YB57FZC/697429844/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YB57FZC/42780945?sv=2020-08-04&st=2026-03-28T14%3A06%3A24Z&se=2026-03-28T14%3A31%3A24Z&sr=b&sp=r&sig=kASeFsaHouQL63iaTeQp41zLaxTJgFeMsVL%2BJCZ14I4%3D)
2026-03-28 14:06:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YB57FZC/697429856/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YB57FZC/42780945?sv=2020-08-04&st=2026-03-28T14%3A06%3A24Z&se=2026-03-28T14%3A31%3A24Z&sr=b&sp=r&sig=kASeFsaHouQL63iaTeQp41zLaxTJgFeMsVL%2BJCZ14I4%3D)
2026-03-28 14:06:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:06:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c3a1850>
2026-03-28 14:06:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:06:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:06:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:06:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_aa05e46e-6535-54ec-9d2a-990536e25c18/aa05e46e-6535-54ec-9d2a-990536e25c18_image_0.jpg HTTP/1.1" 201 0
2026-03-28 14:06:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FBN10FFD%252F698729590%252F600') HTTP/1.1" 204 0
2026-03-28 14:06:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BN10FFD/698729590/600 saved to cache
2026-03-28 14:06:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item aa05e46e-6535-54ec-9d2a-990536e25c18
2026-03-28 14:06:42 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: aa05e46e-6535-54ec-9d2a-990536e25c18, skipping ID generation
2026-03-28 14:06:42 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item aa05e46e-6535-54ec-9d2a-990536e25c18 sending to next pipeline
2026-03-28 14:06:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: aa05e46e-6535-54ec-9d2a-990536e25c18, identifier: BN10%20FFD
2026-03-28 14:06:42 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:06:42 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:06:42 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:06:42 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:06:42 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:06:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:06:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c703ed0>
2026-03-28 14:06:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:06:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:06:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:06:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3e1a668c-07f1-5b40-8f70-ce6f3b64756d/3e1a668c-07f1-5b40-8f70-ce6f3b64756d_image_7.jpg HTTP/1.1" 201 0
2026-03-28 14:06:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FGK66WPY%252F698996564%252F600') HTTP/1.1" 204 0
2026-03-28 14:06:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GK66WPY/698996564/600 saved to cache
2026-03-28 14:06:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 3e1a668c-07f1-5b40-8f70-ce6f3b64756d
2026-03-28 14:06:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:06:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c703410>
2026-03-28 14:06:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:06:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:06:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:06:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_011230be-e1a4-58b5-92df-e152edda7f73/011230be-e1a4-58b5-92df-e152edda7f73_image_5.jpg HTTP/1.1" 201 0
2026-03-28 14:06:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FGL11XOW%252F698717256%252F600') HTTP/1.1" 204 0
2026-03-28 14:06:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GL11XOW/698717256/600 saved to cache
2026-03-28 14:06:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 011230be-e1a4-58b5-92df-e152edda7f73
2026-03-28 14:06:43 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:06:43 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:06:43 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:06:43 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:06:43 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:06:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:06:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2d8d4910>
2026-03-28 14:06:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:06:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:06:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:06:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b9b1844a-f6e4-586f-88aa-fc22f6ebd424/b9b1844a-f6e4-586f-88aa-fc22f6ebd424_image_7.jpg HTTP/1.1" 201 0
2026-03-28 14:06:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FYB57FZC%252F697429863%252F600') HTTP/1.1" 204 0
2026-03-28 14:06:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YB57FZC/697429863/600 saved to cache
2026-03-28 14:06:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item b9b1844a-f6e4-586f-88aa-fc22f6ebd424
2026-03-28 14:06:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:06:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c96bf90>
2026-03-28 14:06:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:06:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:06:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:06:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b9b1844a-f6e4-586f-88aa-fc22f6ebd424/b9b1844a-f6e4-586f-88aa-fc22f6ebd424_image_5.jpg HTTP/1.1" 201 0
2026-03-28 14:06:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FYB57FZC%252F697429849%252F600') HTTP/1.1" 204 0
2026-03-28 14:06:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YB57FZC/697429849/600 saved to cache
2026-03-28 14:06:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item b9b1844a-f6e4-586f-88aa-fc22f6ebd424
2026-03-28 14:06:43 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:06:43 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:06:43 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:06:43 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:06:43 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:06:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:06:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2de7b850>
2026-03-28 14:06:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:06:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:06:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:06:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_be5cf8be-a032-55c5-880a-33e1f5f6185e/be5cf8be-a032-55c5-880a-33e1f5f6185e_image_6.jpg HTTP/1.1" 201 0
2026-03-28 14:06:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FRV60TZO%252F698708089%252F600') HTTP/1.1" 204 0
2026-03-28 14:06:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RV60TZO/698708089/600 saved to cache
2026-03-28 14:06:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item be5cf8be-a032-55c5-880a-33e1f5f6185e
2026-03-28 14:06:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: aa05e46e-6535-54ec-9d2a-990536e25c18 with identifier: BN10%20FFD
2026-03-28 14:06:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: aa05e46e-6535-54ec-9d2a-990536e25c18 with identifier: BN10%20FFD
2026-03-28 14:06:43 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: aa05e46e-6535-54ec-9d2a-990536e25c18 with identifier: BN10%20FFD to the API
2026-03-28 14:06:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:06:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:06:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BN10FFD/698729590/600>
{'auction_title': '',
'c_o_2_emission_value': 159,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aa05e46e-6535-54ec-9d2a-990536e25c18/aa05e46e-6535-54ec-9d2a-990536e25c18_expert_report_file_b1350618-f45b-495c-9310-6622c4ce6668.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=BN10%20FFD-GB',
'category': 'Car',
'color': 'black',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.6L',
'expiration_date': '2026-03-29T10:00:00Z',
'fuel_type': 'Petrol',
'id': 'aa05e46e-6535-54ec-9d2a-990536e25c18',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'BN10 FFD',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=BN10%20FFD&vehicleType=*',
'listing': 'auction',
'location': 'Blackbushe',
'make': 'RENAULT',
'model': 'MEGANE',
'odometer': 77851,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 11,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aa05e46e-6535-54ec-9d2a-990536e25c18/aa05e46e-6535-54ec-9d2a-990536e25c18_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 54107,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BN10FFD/698729590/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aa05e46e-6535-54ec-9d2a-990536e25c18/aa05e46e-6535-54ec-9d2a-990536e25c18_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 51304,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BN10FFD/698729607/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aa05e46e-6535-54ec-9d2a-990536e25c18/aa05e46e-6535-54ec-9d2a-990536e25c18_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 51945,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BN10FFD/698729622/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aa05e46e-6535-54ec-9d2a-990536e25c18/aa05e46e-6535-54ec-9d2a-990536e25c18_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 54136,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BN10FFD/698729643/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aa05e46e-6535-54ec-9d2a-990536e25c18/aa05e46e-6535-54ec-9d2a-990536e25c18_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 53217,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BN10FFD/698729664/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aa05e46e-6535-54ec-9d2a-990536e25c18/aa05e46e-6535-54ec-9d2a-990536e25c18_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 48854,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BN10FFD/698729680/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aa05e46e-6535-54ec-9d2a-990536e25c18/aa05e46e-6535-54ec-9d2a-990536e25c18_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 75588,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BN10FFD/698729703/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aa05e46e-6535-54ec-9d2a-990536e25c18/aa05e46e-6535-54ec-9d2a-990536e25c18_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 67094,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BN10FFD/698729720/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aa05e46e-6535-54ec-9d2a-990536e25c18/aa05e46e-6535-54ec-9d2a-990536e25c18_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 79156,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BN10FFD/698729736/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aa05e46e-6535-54ec-9d2a-990536e25c18/aa05e46e-6535-54ec-9d2a-990536e25c18_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 71196,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BN10FFD/698729752/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2010-01-01',
'seller_name': None,
'title': 'RENAULT MEGANE 1.6 16V I-MUSIC Hatchback',
'transmission': 'manual',
'trim': '16V I-MUSIC',
'vin': 'VF1BZ0H0542777371',
'year': 2010}
2026-03-28 14:06:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BN10%2520FFD%27 HTTP/1.1" 200 None
2026-03-28 14:06:43 [bca.uk] INFO: Saving data for BN10%20FFD: {'created_time': 1774706803.517068, 'last_price_update_time': 1774706803.51708, 'auction_closing_time': 1774778400.0}
2026-03-28 14:06:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='BN10%2520FFD') HTTP/1.1" 204 0
2026-03-28 14:06:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GL11XOW/698717172/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/GL11XOW/42810476?sv=2020-08-04&st=2026-03-28T14%3A06%3A24Z&se=2026-03-28T14%3A31%3A24Z&sr=b&sp=r&sig=Z2KlPx5wKthhayrUXNoIRMZ89bgZHolJc7BL3Q6T4LE%3D)
2026-03-28 14:06:43 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GK66WPY/698996502/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698996502>
2026-03-28 14:06:43 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YB57FZC/697429820/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=YB57FZC-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-28 14:06:43 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GK66WPY/698996489/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=GK66WPY-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-28 14:06:43 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YB57FZC/697429833/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=697429833>
2026-03-28 14:06:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GK66WPY/698996514/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/GK66WPY/42809827?sv=2020-08-04&st=2026-03-28T14%3A06%3A24Z&se=2026-03-28T14%3A31%3A24Z&sr=b&sp=r&sig=o38p1n2nvobOwynrpVnEPlBMUIA211EoJMva9vtfiY0%3D)
2026-03-28 14:06:43 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BP67XDB/698934110/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698934110>
2026-03-28 14:06:43 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/WJZ9285/42807443?sv=2020-08-04&st=2026-03-28T14%3A06%3A43Z&se=2026-03-28T14%3A31%3A43Z&sr=b&sp=r&sig=kzptaA1%2FD51a3%2B3HLrofooYM2z1oDwBGLmUC%2BIEZYW0%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=WJZ%209285-GB>
2026-03-28 14:06:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:06:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c130d90>
2026-03-28 14:06:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:06:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:06:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:06:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3e1a668c-07f1-5b40-8f70-ce6f3b64756d/3e1a668c-07f1-5b40-8f70-ce6f3b64756d_image_4.jpg HTTP/1.1" 201 0
2026-03-28 14:06:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FGK66WPY%252F698996520%252F600') HTTP/1.1" 204 0
2026-03-28 14:06:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GK66WPY/698996520/600 saved to cache
2026-03-28 14:06:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 3e1a668c-07f1-5b40-8f70-ce6f3b64756d
2026-03-28 14:06:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:06:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2d8ec610>
2026-03-28 14:06:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:06:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:06:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:06:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_011230be-e1a4-58b5-92df-e152edda7f73/011230be-e1a4-58b5-92df-e152edda7f73_image_2.jpg HTTP/1.1" 201 0
2026-03-28 14:06:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FGL11XOW%252F698717191%252F600') HTTP/1.1" 204 0
2026-03-28 14:06:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GL11XOW/698717191/600 saved to cache
2026-03-28 14:06:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 011230be-e1a4-58b5-92df-e152edda7f73
2026-03-28 14:06:43 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:06:43 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:06:43 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:06:43 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:06:43 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:06:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:06:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c9b5890>
2026-03-28 14:06:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:06:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:06:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:06:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3e1a668c-07f1-5b40-8f70-ce6f3b64756d/3e1a668c-07f1-5b40-8f70-ce6f3b64756d_image_6.jpg HTTP/1.1" 201 0
2026-03-28 14:06:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FGK66WPY%252F698996546%252F600') HTTP/1.1" 204 0
2026-03-28 14:06:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GK66WPY/698996546/600 saved to cache
2026-03-28 14:06:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 3e1a668c-07f1-5b40-8f70-ce6f3b64756d
2026-03-28 14:06:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:06:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2dbbdbd0>
2026-03-28 14:06:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:06:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:06:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:06:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b9b1844a-f6e4-586f-88aa-fc22f6ebd424/b9b1844a-f6e4-586f-88aa-fc22f6ebd424_image_4.jpg HTTP/1.1" 201 0
2026-03-28 14:06:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FYB57FZC%252F697429844%252F600') HTTP/1.1" 204 0
2026-03-28 14:06:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YB57FZC/697429844/600 saved to cache
2026-03-28 14:06:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item b9b1844a-f6e4-586f-88aa-fc22f6ebd424
2026-03-28 14:06:43 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:06:43 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:06:43 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:06:43 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:06:43 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:06:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:06:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2de3c750>
2026-03-28 14:06:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:06:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:06:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:06:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b9b1844a-f6e4-586f-88aa-fc22f6ebd424/b9b1844a-f6e4-586f-88aa-fc22f6ebd424_image_6.jpg HTTP/1.1" 201 0
2026-03-28 14:06:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FYB57FZC%252F697429856%252F600') HTTP/1.1" 204 0
2026-03-28 14:06:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YB57FZC/697429856/600 saved to cache
2026-03-28 14:06:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item b9b1844a-f6e4-586f-88aa-fc22f6ebd424
2026-03-28 14:06:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:06:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c98c290>
2026-03-28 14:06:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:06:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:06:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:06:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_011230be-e1a4-58b5-92df-e152edda7f73/011230be-e1a4-58b5-92df-e152edda7f73_image_1.jpg HTTP/1.1" 201 0
2026-03-28 14:06:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FGL11XOW%252F698717172%252F600') HTTP/1.1" 204 0
2026-03-28 14:06:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GL11XOW/698717172/600 saved to cache
2026-03-28 14:06:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 011230be-e1a4-58b5-92df-e152edda7f73
2026-03-28 14:06:43 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 011230be-e1a4-58b5-92df-e152edda7f73, skipping ID generation
2026-03-28 14:06:43 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 011230be-e1a4-58b5-92df-e152edda7f73 sending to next pipeline
2026-03-28 14:06:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 011230be-e1a4-58b5-92df-e152edda7f73, identifier: GL11%20XOW
2026-03-28 14:06:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:06:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2ca06210>
2026-03-28 14:06:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:06:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:06:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:06:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3e1a668c-07f1-5b40-8f70-ce6f3b64756d/3e1a668c-07f1-5b40-8f70-ce6f3b64756d_image_3.jpg HTTP/1.1" 201 0
2026-03-28 14:06:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FGK66WPY%252F698996514%252F600') HTTP/1.1" 204 0
2026-03-28 14:06:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GK66WPY/698996514/600 saved to cache
2026-03-28 14:06:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 3e1a668c-07f1-5b40-8f70-ce6f3b64756d
2026-03-28 14:06:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 011230be-e1a4-58b5-92df-e152edda7f73 with identifier: GL11%20XOW
2026-03-28 14:06:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 011230be-e1a4-58b5-92df-e152edda7f73 with identifier: GL11%20XOW
2026-03-28 14:06:44 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 011230be-e1a4-58b5-92df-e152edda7f73 with identifier: GL11%20XOW to the API
2026-03-28 14:06:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:06:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:06:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GL11XOW/698717172/600>
{'auction_title': '',
'c_o_2_emission_value': 133,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_011230be-e1a4-58b5-92df-e152edda7f73/011230be-e1a4-58b5-92df-e152edda7f73_expert_report_file_8dbe7601-ed5a-4d19-b2f9-880346f2abf6.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=GL11%20XOW-GB',
'category': 'Car',
'color': 'black',
'currency': 'GBP',
'doors_number': 2,
'engine': '1.6L',
'expiration_date': '2026-03-29T10:00:00Z',
'fuel_type': 'Petrol',
'id': '011230be-e1a4-58b5-92df-e152edda7f73',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'GL11 XOW',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=GL11%20XOW&vehicleType=*',
'listing': 'auction',
'location': 'Blackbushe',
'make': 'MINI',
'model': 'ONE',
'odometer': 103586,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 13,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_011230be-e1a4-58b5-92df-e152edda7f73/011230be-e1a4-58b5-92df-e152edda7f73_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 56402,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GL11XOW/698717151/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_011230be-e1a4-58b5-92df-e152edda7f73/011230be-e1a4-58b5-92df-e152edda7f73_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 53454,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GL11XOW/698717172/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_011230be-e1a4-58b5-92df-e152edda7f73/011230be-e1a4-58b5-92df-e152edda7f73_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 52064,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GL11XOW/698717191/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_011230be-e1a4-58b5-92df-e152edda7f73/011230be-e1a4-58b5-92df-e152edda7f73_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 53226,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GL11XOW/698717219/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_011230be-e1a4-58b5-92df-e152edda7f73/011230be-e1a4-58b5-92df-e152edda7f73_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 52024,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GL11XOW/698717235/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_011230be-e1a4-58b5-92df-e152edda7f73/011230be-e1a4-58b5-92df-e152edda7f73_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 51085,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GL11XOW/698717256/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_011230be-e1a4-58b5-92df-e152edda7f73/011230be-e1a4-58b5-92df-e152edda7f73_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 81738,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GL11XOW/698717277/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_011230be-e1a4-58b5-92df-e152edda7f73/011230be-e1a4-58b5-92df-e152edda7f73_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 41062,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GL11XOW/698717301/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_011230be-e1a4-58b5-92df-e152edda7f73/011230be-e1a4-58b5-92df-e152edda7f73_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 78556,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GL11XOW/698717326/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_011230be-e1a4-58b5-92df-e152edda7f73/011230be-e1a4-58b5-92df-e152edda7f73_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 77227,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GL11XOW/698717345/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2011-01-01',
'seller_name': None,
'title': 'MINI ONE 1.6 Convertible',
'transmission': 'manual',
'trim': '',
'vin': 'WMWZM32020T130321',
'year': 2011}
2026-03-28 14:06:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GL11%2520XOW%27 HTTP/1.1" 200 None
2026-03-28 14:06:44 [bca.uk] INFO: Saving data for GL11%20XOW: {'created_time': 1774706804.312704, 'last_price_update_time': 1774706804.312715, 'auction_closing_time': 1774778400.0}
2026-03-28 14:06:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='GL11%2520XOW') HTTP/1.1" 204 0
2026-03-28 14:06:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RV60TZO/698707962/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/RV60TZO/42810285?sv=2020-08-04&st=2026-03-28T14%3A06%3A24Z&se=2026-03-28T14%3A31%3A24Z&sr=b&sp=r&sig=0wfV7eTXgj18RoXJ9dVJaCh0eej2XdKr%2F9zBrTgYLZs%3D)
2026-03-28 14:06:44 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BP67XDB/698934081/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698934081>
2026-03-28 14:06:44 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/AX15GHV/42810027?sv=2020-08-04&st=2026-03-28T14%3A06%3A43Z&se=2026-03-28T14%3A31%3A43Z&sr=b&sp=r&sig=JJpF40Yp%2FobLJQr3JyJKHMCuyadOw6pOe%2FflxZRZmFI%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=AX15%20GHV-GB>
2026-03-28 14:06:44 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KM11UUD/698915361/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698915361>
2026-03-28 14:06:44 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LK64NEJ/698947193/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698947193>
2026-03-28 14:06:44 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/DE04GDK/42809821?sv=2020-08-04&st=2026-03-28T14%3A06%3A43Z&se=2026-03-28T14%3A31%3A43Z&sr=b&sp=r&sig=Wg9UX1XBSOfklscjKMokjHFFw1lKRjgTlp8OjJ%2B2vVw%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=DE04%20GDK-GB>
2026-03-28 14:06:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YB57FZC/697429839/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YB57FZC/42780945?sv=2020-08-04&st=2026-03-28T14%3A06%3A24Z&se=2026-03-28T14%3A31%3A24Z&sr=b&sp=r&sig=kASeFsaHouQL63iaTeQp41zLaxTJgFeMsVL%2BJCZ14I4%3D)
2026-03-28 14:06:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/WJZ9285/42807443?sv=2020-08-04&st=2026-03-28T14%3A06%3A43Z&se=2026-03-28T14%3A31%3A43Z&sr=b&sp=r&sig=kzptaA1%2FD51a3%2B3HLrofooYM2z1oDwBGLmUC%2BIEZYW0%3D> (referer: https://www.bca.co.uk/)
2026-03-28 14:06:44 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CK18AEJ/698910480/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698910480>
2026-03-28 14:06:44 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YD70WOM/42810030?sv=2020-08-04&st=2026-03-28T14%3A06%3A44Z&se=2026-03-28T14%3A31%3A44Z&sr=b&sp=r&sig=zY0GlfRSinGMYhbbj%2BSacZWH49j2OuV6ot7DWpDFe%2Fk%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=YD70%20WOM-GB>
2026-03-28 14:06:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GK66WPY/698996502/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/GK66WPY/42809827?sv=2020-08-04&st=2026-03-28T14%3A06%3A24Z&se=2026-03-28T14%3A31%3A24Z&sr=b&sp=r&sig=o38p1n2nvobOwynrpVnEPlBMUIA211EoJMva9vtfiY0%3D)
2026-03-28 14:06:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BP67XDB/698934110/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/BP67XDB/42810422?sv=2020-08-04&st=2026-03-28T14%3A03%3A52Z&se=2026-03-28T14%3A28%3A52Z&sr=b&sp=r&sig=Logn8Hbry8lNDBo7BHyP%2FFQM2Uo9ZZUQT4uyTv5b%2Bn0%3D)
2026-03-28 14:06:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GK66WPY/698996489/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/GK66WPY/42809827?sv=2020-08-04&st=2026-03-28T14%3A06%3A24Z&se=2026-03-28T14%3A31%3A24Z&sr=b&sp=r&sig=o38p1n2nvobOwynrpVnEPlBMUIA211EoJMva9vtfiY0%3D)
2026-03-28 14:06:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YB57FZC/697429833/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YB57FZC/42780945?sv=2020-08-04&st=2026-03-28T14%3A06%3A24Z&se=2026-03-28T14%3A31%3A24Z&sr=b&sp=r&sig=kASeFsaHouQL63iaTeQp41zLaxTJgFeMsVL%2BJCZ14I4%3D)
2026-03-28 14:06:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YB57FZC/697429820/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YB57FZC/42780945?sv=2020-08-04&st=2026-03-28T14%3A06%3A24Z&se=2026-03-28T14%3A31%3A24Z&sr=b&sp=r&sig=kASeFsaHouQL63iaTeQp41zLaxTJgFeMsVL%2BJCZ14I4%3D)
2026-03-28 14:06:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:06:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c98cfd0>
2026-03-28 14:06:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:06:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:06:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:06:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_be5cf8be-a032-55c5-880a-33e1f5f6185e/be5cf8be-a032-55c5-880a-33e1f5f6185e_image_2.jpg HTTP/1.1" 201 0
2026-03-28 14:06:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FRV60TZO%252F698707962%252F600') HTTP/1.1" 204 0
2026-03-28 14:06:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RV60TZO/698707962/600 saved to cache
2026-03-28 14:06:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item be5cf8be-a032-55c5-880a-33e1f5f6185e
2026-03-28 14:06:44 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: be5cf8be-a032-55c5-880a-33e1f5f6185e, skipping ID generation
2026-03-28 14:06:44 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item be5cf8be-a032-55c5-880a-33e1f5f6185e sending to next pipeline
2026-03-28 14:06:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: be5cf8be-a032-55c5-880a-33e1f5f6185e, identifier: RV60%20TZO
2026-03-28 14:06:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: be5cf8be-a032-55c5-880a-33e1f5f6185e with identifier: RV60%20TZO
2026-03-28 14:06:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: be5cf8be-a032-55c5-880a-33e1f5f6185e with identifier: RV60%20TZO
2026-03-28 14:06:44 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: be5cf8be-a032-55c5-880a-33e1f5f6185e with identifier: RV60%20TZO to the API
2026-03-28 14:06:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:06:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:06:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RV60TZO/698707962/600>
{'auction_title': '',
'c_o_2_emission_value': 115,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_be5cf8be-a032-55c5-880a-33e1f5f6185e/be5cf8be-a032-55c5-880a-33e1f5f6185e_expert_report_file_242a587c-e04c-4d1b-b85a-b34cd0913cda.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=RV60%20TZO-GB',
'category': 'Car',
'color': 'black',
'currency': 'GBP',
'doors_number': 3,
'engine': '2.0L',
'expiration_date': '2026-03-29T10:00:00Z',
'fuel_type': 'Diesel',
'id': 'be5cf8be-a032-55c5-880a-33e1f5f6185e',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'RV60 TZO',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=RV60%20TZO&vehicleType=*',
'listing': 'auction',
'location': 'Blackbushe',
'make': 'AUDI',
'model': 'A3',
'odometer': 146857,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 11,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_be5cf8be-a032-55c5-880a-33e1f5f6185e/be5cf8be-a032-55c5-880a-33e1f5f6185e_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 55438,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RV60TZO/698707911/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_be5cf8be-a032-55c5-880a-33e1f5f6185e/be5cf8be-a032-55c5-880a-33e1f5f6185e_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 52294,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RV60TZO/698707933/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_be5cf8be-a032-55c5-880a-33e1f5f6185e/be5cf8be-a032-55c5-880a-33e1f5f6185e_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 50962,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RV60TZO/698707962/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_be5cf8be-a032-55c5-880a-33e1f5f6185e/be5cf8be-a032-55c5-880a-33e1f5f6185e_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 53422,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RV60TZO/698707998/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_be5cf8be-a032-55c5-880a-33e1f5f6185e/be5cf8be-a032-55c5-880a-33e1f5f6185e_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 51628,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RV60TZO/698708036/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_be5cf8be-a032-55c5-880a-33e1f5f6185e/be5cf8be-a032-55c5-880a-33e1f5f6185e_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 50428,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RV60TZO/698708062/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_be5cf8be-a032-55c5-880a-33e1f5f6185e/be5cf8be-a032-55c5-880a-33e1f5f6185e_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 76519,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RV60TZO/698708089/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_be5cf8be-a032-55c5-880a-33e1f5f6185e/be5cf8be-a032-55c5-880a-33e1f5f6185e_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 50623,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RV60TZO/698708121/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_be5cf8be-a032-55c5-880a-33e1f5f6185e/be5cf8be-a032-55c5-880a-33e1f5f6185e_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 83227,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RV60TZO/698708188/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_be5cf8be-a032-55c5-880a-33e1f5f6185e/be5cf8be-a032-55c5-880a-33e1f5f6185e_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 70066,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RV60TZO/698708232/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2010-01-01',
'seller_name': None,
'title': 'AUDI A3 2.0 TDI 140 BLACK ED.S/S Hatchback',
'transmission': 'manual',
'trim': 'TDI 140 BLACK ED.S/S',
'vin': 'WAUZZZ8P6BA031315',
'year': 2010}
2026-03-28 14:06:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27RV60%2520TZO%27 HTTP/1.1" 200 None
2026-03-28 14:06:44 [bca.uk] INFO: Saving data for RV60%20TZO: {'created_time': 1774706804.920854, 'last_price_update_time': 1774706804.920865, 'auction_closing_time': 1774778400.0}
2026-03-28 14:06:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='RV60%2520TZO') HTTP/1.1" 204 0
2026-03-28 14:06:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BP67XDB/698934081/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/BP67XDB/42810422?sv=2020-08-04&st=2026-03-28T14%3A03%3A52Z&se=2026-03-28T14%3A28%3A52Z&sr=b&sp=r&sig=Logn8Hbry8lNDBo7BHyP%2FFQM2Uo9ZZUQT4uyTv5b%2Bn0%3D)
2026-03-28 14:06:44 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LK64NEJ/698947168/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698947168>
2026-03-28 14:06:44 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BP67XDB/698934061/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698934061>
2026-03-28 14:06:44 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DF12VWL/698228887/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698228887>
2026-03-28 14:06:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LK64NEJ/698947193/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LK64NEJ/42810513?sv=2020-08-04&st=2026-03-28T14%3A03%3A51Z&se=2026-03-28T14%3A28%3A51Z&sr=b&sp=r&sig=dZi6EyBOQ2GoK8knfBZtxM9S6O3yD8ghOm4nMLyaJjo%3D)
2026-03-28 14:06:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KM11UUD/698915361/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/KM11UUD/42809630?sv=2020-08-04&st=2026-03-28T14%3A03%3A52Z&se=2026-03-28T14%3A28%3A52Z&sr=b&sp=r&sig=S16ojkv9p8NH2wa7caJZQVn%2BDGo%2BREXS30Hz2ckWR%2FA%3D)
2026-03-28 14:06:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/AX15GHV/42810027?sv=2020-08-04&st=2026-03-28T14%3A06%3A43Z&se=2026-03-28T14%3A31%3A43Z&sr=b&sp=r&sig=JJpF40Yp%2FobLJQr3JyJKHMCuyadOw6pOe%2FflxZRZmFI%3D> (referer: https://www.bca.co.uk/)
2026-03-28 14:06:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:06:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2ca05890>
2026-03-28 14:06:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:06:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:06:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:06:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b9b1844a-f6e4-586f-88aa-fc22f6ebd424/b9b1844a-f6e4-586f-88aa-fc22f6ebd424_image_3.jpg HTTP/1.1" 201 0
2026-03-28 14:06:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FYB57FZC%252F697429839%252F600') HTTP/1.1" 204 0
2026-03-28 14:06:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YB57FZC/697429839/600 saved to cache
2026-03-28 14:06:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item b9b1844a-f6e4-586f-88aa-fc22f6ebd424
2026-03-28 14:06:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:06:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2d984910>
2026-03-28 14:06:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:06:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:06:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:06:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a149de9c-cfcc-5dd2-a714-96be3f56b350/a149de9c-cfcc-5dd2-a714-96be3f56b350_expert_report_file_7c62181b-67f1-431f-97e6-14aab86e2a62.pdf HTTP/1.1" 201 0
2026-03-28 14:06:45 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item a149de9c-cfcc-5dd2-a714-96be3f56b350
2026-03-28 14:06:45 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: a149de9c-cfcc-5dd2-a714-96be3f56b350, skipping ID generation
2026-03-28 14:06:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item a149de9c-cfcc-5dd2-a714-96be3f56b350
2026-03-28 14:06:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DWJZ9285-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-28 14:06:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=WJZ9285-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-28 14:06:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:06:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c12c250>
2026-03-28 14:06:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:06:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:06:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:06:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3e1a668c-07f1-5b40-8f70-ce6f3b64756d/3e1a668c-07f1-5b40-8f70-ce6f3b64756d_image_2.jpg HTTP/1.1" 201 0
2026-03-28 14:06:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FGK66WPY%252F698996502%252F600') HTTP/1.1" 204 0
2026-03-28 14:06:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GK66WPY/698996502/600 saved to cache
2026-03-28 14:06:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 3e1a668c-07f1-5b40-8f70-ce6f3b64756d
2026-03-28 14:06:45 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:06:45 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:06:45 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:06:45 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:06:45 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:06:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:06:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c12fd90>
2026-03-28 14:06:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:06:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:06:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:06:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_090813ec-adc2-5b7f-923f-58bcb47db483/090813ec-adc2-5b7f-923f-58bcb47db483_image_8.jpg HTTP/1.1" 201 0
2026-03-28 14:06:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FBP67XDB%252F698934110%252F600') HTTP/1.1" 204 0
2026-03-28 14:06:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BP67XDB/698934110/600 saved to cache
2026-03-28 14:06:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 090813ec-adc2-5b7f-923f-58bcb47db483
2026-03-28 14:06:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:06:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c995790>
2026-03-28 14:06:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:06:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:06:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:06:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3e1a668c-07f1-5b40-8f70-ce6f3b64756d/3e1a668c-07f1-5b40-8f70-ce6f3b64756d_image_0.jpg HTTP/1.1" 201 0
2026-03-28 14:06:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FGK66WPY%252F698996489%252F600') HTTP/1.1" 204 0
2026-03-28 14:06:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GK66WPY/698996489/600 saved to cache
2026-03-28 14:06:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 3e1a668c-07f1-5b40-8f70-ce6f3b64756d
2026-03-28 14:06:45 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 3e1a668c-07f1-5b40-8f70-ce6f3b64756d, skipping ID generation
2026-03-28 14:06:45 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 3e1a668c-07f1-5b40-8f70-ce6f3b64756d sending to next pipeline
2026-03-28 14:06:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 3e1a668c-07f1-5b40-8f70-ce6f3b64756d, identifier: GK66%20WPY
2026-03-28 14:06:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:06:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2d7b52d0>
2026-03-28 14:06:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:06:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:06:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:06:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b9b1844a-f6e4-586f-88aa-fc22f6ebd424/b9b1844a-f6e4-586f-88aa-fc22f6ebd424_image_2.jpg HTTP/1.1" 201 0
2026-03-28 14:06:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FYB57FZC%252F697429833%252F600') HTTP/1.1" 204 0
2026-03-28 14:06:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YB57FZC/697429833/600 saved to cache
2026-03-28 14:06:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item b9b1844a-f6e4-586f-88aa-fc22f6ebd424
2026-03-28 14:06:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:06:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c8d91d0>
2026-03-28 14:06:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:06:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:06:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:06:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b9b1844a-f6e4-586f-88aa-fc22f6ebd424/b9b1844a-f6e4-586f-88aa-fc22f6ebd424_image_0.jpg HTTP/1.1" 201 0
2026-03-28 14:06:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FYB57FZC%252F697429820%252F600') HTTP/1.1" 204 0
2026-03-28 14:06:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YB57FZC/697429820/600 saved to cache
2026-03-28 14:06:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item b9b1844a-f6e4-586f-88aa-fc22f6ebd424
2026-03-28 14:06:45 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: b9b1844a-f6e4-586f-88aa-fc22f6ebd424, skipping ID generation
2026-03-28 14:06:45 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item b9b1844a-f6e4-586f-88aa-fc22f6ebd424 sending to next pipeline
2026-03-28 14:06:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: b9b1844a-f6e4-586f-88aa-fc22f6ebd424, identifier: YB57%20FZC
2026-03-28 14:06:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/DE04GDK/42809821?sv=2020-08-04&st=2026-03-28T14%3A06%3A43Z&se=2026-03-28T14%3A31%3A43Z&sr=b&sp=r&sig=Wg9UX1XBSOfklscjKMokjHFFw1lKRjgTlp8OjJ%2B2vVw%3D> (referer: https://www.bca.co.uk/)
2026-03-28 14:06:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 3e1a668c-07f1-5b40-8f70-ce6f3b64756d with identifier: GK66%20WPY
2026-03-28 14:06:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 3e1a668c-07f1-5b40-8f70-ce6f3b64756d with identifier: GK66%20WPY
2026-03-28 14:06:45 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 3e1a668c-07f1-5b40-8f70-ce6f3b64756d with identifier: GK66%20WPY to the API
2026-03-28 14:06:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:06:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:06:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GK66WPY/698996489/600>
{'auction_title': '',
'c_o_2_emission_value': 117,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3e1a668c-07f1-5b40-8f70-ce6f3b64756d/3e1a668c-07f1-5b40-8f70-ce6f3b64756d_expert_report_file_9fbcde14-d1df-4aa9-82cb-657e048e42bc.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=GK66%20WPY-GB',
'category': 'Car',
'color': 'white',
'currency': 'GBP',
'doors_number': 5,
'engine': '2.0L',
'expiration_date': '2026-03-29T10:00:00Z',
'fuel_type': 'Diesel',
'id': '3e1a668c-07f1-5b40-8f70-ce6f3b64756d',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'GK66 WPY',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=GK66%20WPY&vehicleType=*',
'listing': 'auction',
'location': 'Bedford',
'make': 'VOLVO',
'model': 'XC60',
'odometer': 112942,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 11,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3e1a668c-07f1-5b40-8f70-ce6f3b64756d/3e1a668c-07f1-5b40-8f70-ce6f3b64756d_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 48463,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GK66WPY/698996489/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3e1a668c-07f1-5b40-8f70-ce6f3b64756d/3e1a668c-07f1-5b40-8f70-ce6f3b64756d_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 46154,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GK66WPY/698996494/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3e1a668c-07f1-5b40-8f70-ce6f3b64756d/3e1a668c-07f1-5b40-8f70-ce6f3b64756d_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 46344,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GK66WPY/698996502/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3e1a668c-07f1-5b40-8f70-ce6f3b64756d/3e1a668c-07f1-5b40-8f70-ce6f3b64756d_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 44772,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GK66WPY/698996514/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3e1a668c-07f1-5b40-8f70-ce6f3b64756d/3e1a668c-07f1-5b40-8f70-ce6f3b64756d_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 45455,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GK66WPY/698996520/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3e1a668c-07f1-5b40-8f70-ce6f3b64756d/3e1a668c-07f1-5b40-8f70-ce6f3b64756d_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 43485,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GK66WPY/698996529/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3e1a668c-07f1-5b40-8f70-ce6f3b64756d/3e1a668c-07f1-5b40-8f70-ce6f3b64756d_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 87707,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GK66WPY/698996546/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3e1a668c-07f1-5b40-8f70-ce6f3b64756d/3e1a668c-07f1-5b40-8f70-ce6f3b64756d_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 64175,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GK66WPY/698996564/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3e1a668c-07f1-5b40-8f70-ce6f3b64756d/3e1a668c-07f1-5b40-8f70-ce6f3b64756d_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 74542,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GK66WPY/698996579/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3e1a668c-07f1-5b40-8f70-ce6f3b64756d/3e1a668c-07f1-5b40-8f70-ce6f3b64756d_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 66295,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GK66WPY/698996596/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-01-01',
'seller_name': None,
'title': 'VOLVO XC60 2.0 D4 190 2WD SE Estate',
'transmission': 'manual',
'trim': 'D4 190 2WD SE',
'vin': 'YV1DZA8C1H2070095',
'year': 2016}
2026-03-28 14:06:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GK66%2520WPY%27 HTTP/1.1" 200 None
2026-03-28 14:06:45 [bca.uk] INFO: Saving data for GK66%20WPY: {'created_time': 1774706805.898616, 'last_price_update_time': 1774706805.898632, 'auction_closing_time': 1774778400.0}
2026-03-28 14:06:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='GK66%2520WPY') HTTP/1.1" 204 0
2026-03-28 14:06:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: b9b1844a-f6e4-586f-88aa-fc22f6ebd424 with identifier: YB57%20FZC
2026-03-28 14:06:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: b9b1844a-f6e4-586f-88aa-fc22f6ebd424 with identifier: YB57%20FZC
2026-03-28 14:06:46 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: b9b1844a-f6e4-586f-88aa-fc22f6ebd424 with identifier: YB57%20FZC to the API
2026-03-28 14:06:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:06:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:06:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YB57FZC/697429820/600>
{'auction_title': '',
'c_o_2_emission_value': 183,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b9b1844a-f6e4-586f-88aa-fc22f6ebd424/b9b1844a-f6e4-586f-88aa-fc22f6ebd424_expert_report_file_1555b607-c1a2-4b35-8c75-21bba344d1a6.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=YB57%20FZC-GB',
'category': 'Car',
'color': 'black',
'currency': 'GBP',
'doors_number': 2,
'engine': '2.0L',
'expiration_date': '2026-03-29T10:00:00Z',
'fuel_type': 'Petrol',
'id': 'b9b1844a-f6e4-586f-88aa-fc22f6ebd424',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'YB57 FZC',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=YB57%20FZC&vehicleType=*',
'listing': 'auction',
'location': 'Bedford',
'make': 'AUDI',
'model': 'TT',
'odometer': 98220,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 11,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b9b1844a-f6e4-586f-88aa-fc22f6ebd424/b9b1844a-f6e4-586f-88aa-fc22f6ebd424_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 50603,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YB57FZC/697429820/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b9b1844a-f6e4-586f-88aa-fc22f6ebd424/b9b1844a-f6e4-586f-88aa-fc22f6ebd424_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 49135,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YB57FZC/697429828/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b9b1844a-f6e4-586f-88aa-fc22f6ebd424/b9b1844a-f6e4-586f-88aa-fc22f6ebd424_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 47334,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YB57FZC/697429833/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b9b1844a-f6e4-586f-88aa-fc22f6ebd424/b9b1844a-f6e4-586f-88aa-fc22f6ebd424_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 45682,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YB57FZC/697429839/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b9b1844a-f6e4-586f-88aa-fc22f6ebd424/b9b1844a-f6e4-586f-88aa-fc22f6ebd424_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 46528,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YB57FZC/697429844/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b9b1844a-f6e4-586f-88aa-fc22f6ebd424/b9b1844a-f6e4-586f-88aa-fc22f6ebd424_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 45192,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YB57FZC/697429849/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b9b1844a-f6e4-586f-88aa-fc22f6ebd424/b9b1844a-f6e4-586f-88aa-fc22f6ebd424_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 108061,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YB57FZC/697429856/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b9b1844a-f6e4-586f-88aa-fc22f6ebd424/b9b1844a-f6e4-586f-88aa-fc22f6ebd424_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 81676,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YB57FZC/697429863/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b9b1844a-f6e4-586f-88aa-fc22f6ebd424/b9b1844a-f6e4-586f-88aa-fc22f6ebd424_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 92710,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YB57FZC/697429875/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b9b1844a-f6e4-586f-88aa-fc22f6ebd424/b9b1844a-f6e4-586f-88aa-fc22f6ebd424_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 93134,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YB57FZC/697429882/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2007-01-01',
'seller_name': None,
'title': 'AUDI TT 2.0 TFSI Coupe',
'transmission': 'manual',
'trim': 'TFSI',
'vin': 'TRUZZZ8J481029866',
'year': 2007}
2026-03-28 14:06:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YB57%2520FZC%27 HTTP/1.1" 200 None
2026-03-28 14:06:46 [bca.uk] INFO: Saving data for YB57%20FZC: {'created_time': 1774706806.37222, 'last_price_update_time': 1774706806.372231, 'auction_closing_time': 1774778400.0}
2026-03-28 14:06:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='YB57%2520FZC') HTTP/1.1" 204 0
2026-03-28 14:06:46 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YE57GFG/42810397?sv=2020-08-04&st=2026-03-28T14%3A06%3A44Z&se=2026-03-28T14%3A31%3A44Z&sr=b&sp=r&sig=vSjrPH68LNj6fTz0HIFdhL8jclPi5cOXfzhmxBIBToI%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=YE57%20GFG-GB>
2026-03-28 14:06:46 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YS71HNL/42810026?sv=2020-08-04&st=2026-03-28T14%3A06%3A45Z&se=2026-03-28T14%3A31%3A45Z&sr=b&sp=r&sig=6LwnywW%2BQSGBv6J3youIITLgitPmhomB08N22i%2FPNp8%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=YS71%20HNL-GB>
2026-03-28 14:06:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698802569%27 HTTP/1.1" 200 None
2026-03-28 14:06:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698802569 not downloaded yet
2026-03-28 14:06:46 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DF12VWL/698228854/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698228854>
2026-03-28 14:06:46 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CK18AEJ/698910455/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698910455>
2026-03-28 14:06:46 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LK64NEJ/698947141/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698947141>
2026-03-28 14:06:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CK18AEJ/698910480/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/CK18AEJ/42809519?sv=2020-08-04&st=2026-03-28T14%3A03%3A52Z&se=2026-03-28T14%3A28%3A52Z&sr=b&sp=r&sig=tMAO1WCWalJ7mXIWRlCxzQ1Rx0voh0Hr3%2FaR8xfgZTg%3D)
2026-03-28 14:06:46 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:06:46 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:06:46 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:06:46 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:06:46 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:06:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:06:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2d89e3d0>
2026-03-28 14:06:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:06:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:06:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:06:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_090813ec-adc2-5b7f-923f-58bcb47db483/090813ec-adc2-5b7f-923f-58bcb47db483_image_7.jpg HTTP/1.1" 201 0
2026-03-28 14:06:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FBP67XDB%252F698934081%252F600') HTTP/1.1" 204 0
2026-03-28 14:06:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BP67XDB/698934081/600 saved to cache
2026-03-28 14:06:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 090813ec-adc2-5b7f-923f-58bcb47db483
2026-03-28 14:06:46 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:06:46 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:06:46 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:06:46 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:06:46 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:06:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:06:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2d84ead0>
2026-03-28 14:06:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:06:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:06:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:06:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bb105475-65fd-5601-86d0-a8590c56bf0b/bb105475-65fd-5601-86d0-a8590c56bf0b_image_9.jpg HTTP/1.1" 201 0
2026-03-28 14:06:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLK64NEJ%252F698947193%252F600') HTTP/1.1" 204 0
2026-03-28 14:06:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LK64NEJ/698947193/600 saved to cache
2026-03-28 14:06:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item bb105475-65fd-5601-86d0-a8590c56bf0b
2026-03-28 14:06:46 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:06:46 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:06:46 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:06:46 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:06:46 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:06:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:06:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c819310>
2026-03-28 14:06:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:06:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:06:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:06:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7ba82627-3d66-5970-bb5d-b19d751b9eb4/7ba82627-3d66-5970-bb5d-b19d751b9eb4_image_7.jpg HTTP/1.1" 201 0
2026-03-28 14:06:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FKM11UUD%252F698915361%252F600') HTTP/1.1" 204 0
2026-03-28 14:06:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KM11UUD/698915361/600 saved to cache
2026-03-28 14:06:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 7ba82627-3d66-5970-bb5d-b19d751b9eb4
2026-03-28 14:06:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:06:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2d84d890>
2026-03-28 14:06:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:06:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:06:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:06:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_605bb574-f032-5f24-9f53-91befb051fec/605bb574-f032-5f24-9f53-91befb051fec_expert_report_file_e4c87ee1-a851-4562-9385-42c5881e7f41.pdf HTTP/1.1" 201 0
2026-03-28 14:06:46 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item 605bb574-f032-5f24-9f53-91befb051fec
2026-03-28 14:06:46 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 605bb574-f032-5f24-9f53-91befb051fec, skipping ID generation
2026-03-28 14:06:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 605bb574-f032-5f24-9f53-91befb051fec
2026-03-28 14:06:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DAX15GHV-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-28 14:06:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=AX15GHV-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-28 14:06:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YD70WOM/42810030?sv=2020-08-04&st=2026-03-28T14%3A06%3A44Z&se=2026-03-28T14%3A31%3A44Z&sr=b&sp=r&sig=zY0GlfRSinGMYhbbj%2BSacZWH49j2OuV6ot7DWpDFe%2Fk%3D> (referer: https://www.bca.co.uk/)
2026-03-28 14:06:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698802593%27 HTTP/1.1" 200 None
2026-03-28 14:06:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698802593 not downloaded yet
2026-03-28 14:06:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698225924%27 HTTP/1.1" 200 None
2026-03-28 14:06:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698225924 not downloaded yet
2026-03-28 14:06:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:06:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2deab150>
2026-03-28 14:06:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:06:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:06:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:06:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_842ae7be-18fd-5ebf-ace8-89e5a9f85a09/842ae7be-18fd-5ebf-ace8-89e5a9f85a09_expert_report_file_1788d936-8224-4798-ba54-3208f80a838e.pdf HTTP/1.1" 201 0
2026-03-28 14:06:46 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item 842ae7be-18fd-5ebf-ace8-89e5a9f85a09
2026-03-28 14:06:46 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 842ae7be-18fd-5ebf-ace8-89e5a9f85a09, skipping ID generation
2026-03-28 14:06:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 842ae7be-18fd-5ebf-ace8-89e5a9f85a09
2026-03-28 14:06:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DDE04GDK-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-28 14:06:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=DE04GDK-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-28 14:06:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DF12VWL/698228887/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/DF12VWL/42797174?sv=2020-08-04&st=2026-03-28T14%3A03%3A51Z&se=2026-03-28T14%3A28%3A51Z&sr=b&sp=r&sig=0mRjBtvz6tka1D82qBQ3%2FRs63GOtrqyuAG7vdnh5S9c%3D)
2026-03-28 14:06:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698802624%27 HTTP/1.1" 200 None
2026-03-28 14:06:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698802624 not downloaded yet
2026-03-28 14:06:46 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:06:46 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:06:46 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:06:46 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:06:46 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:06:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:06:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a1fd3ba50>
2026-03-28 14:06:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:06:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:06:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:06:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_954e7a8e-294d-583e-8576-18c9af402ec0/954e7a8e-294d-583e-8576-18c9af402ec0_image_8.jpg HTTP/1.1" 201 0
2026-03-28 14:06:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FCK18AEJ%252F698910480%252F600') HTTP/1.1" 204 0
2026-03-28 14:06:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CK18AEJ/698910480/600 saved to cache
2026-03-28 14:06:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 954e7a8e-294d-583e-8576-18c9af402ec0
2026-03-28 14:06:46 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WU19VDC/698045660/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698045660>
2026-03-28 14:06:46 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KM11UUD/698915312/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698915312>
2026-03-28 14:06:46 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BP67XDB/698934036/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698934036>
2026-03-28 14:06:46 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YA12SZX/42810210?sv=2020-08-04&st=2026-03-28T14%3A06%3A46Z&se=2026-03-28T14%3A31%3A46Z&sr=b&sp=r&sig=zAue20Kp3xOQLoka9kg3BuP79gs5tNiiEWLbZWTA87w%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=YA12%20SZX-GB>
2026-03-28 14:06:46 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YM19HXY/42810006?sv=2020-08-04&st=2026-03-28T14%3A06%3A46Z&se=2026-03-28T14%3A31%3A46Z&sr=b&sp=r&sig=pY0duj0al0Djhca%2BC3PKfnyx3TV8v5FU4mqV41pF6EU%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=YM19%20HXY-GB>
2026-03-28 14:06:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698225929%27 HTTP/1.1" 200 None
2026-03-28 14:06:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698225929 not downloaded yet
2026-03-28 14:06:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698934169%27 HTTP/1.1" 200 None
2026-03-28 14:06:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698934169 not downloaded yet
2026-03-28 14:06:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LK64NEJ/698947168/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LK64NEJ/42810513?sv=2020-08-04&st=2026-03-28T14%3A03%3A51Z&se=2026-03-28T14%3A28%3A51Z&sr=b&sp=r&sig=dZi6EyBOQ2GoK8knfBZtxM9S6O3yD8ghOm4nMLyaJjo%3D)
2026-03-28 14:06:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BP67XDB/698934061/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/BP67XDB/42810422?sv=2020-08-04&st=2026-03-28T14%3A03%3A52Z&se=2026-03-28T14%3A28%3A52Z&sr=b&sp=r&sig=Logn8Hbry8lNDBo7BHyP%2FFQM2Uo9ZZUQT4uyTv5b%2Bn0%3D)
2026-03-28 14:06:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698802645%27 HTTP/1.1" 200 None
2026-03-28 14:06:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698802645 not downloaded yet
2026-03-28 14:06:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:06:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c8b9090>
2026-03-28 14:06:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:06:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:06:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:06:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d4588dea-a04d-50d3-a9af-4f8459203fea/d4588dea-a04d-50d3-a9af-4f8459203fea_expert_report_file_0da466ff-630c-4dcf-8bbd-4b48ff29361a.pdf HTTP/1.1" 201 0
2026-03-28 14:06:46 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item d4588dea-a04d-50d3-a9af-4f8459203fea
2026-03-28 14:06:46 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: d4588dea-a04d-50d3-a9af-4f8459203fea, skipping ID generation
2026-03-28 14:06:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item d4588dea-a04d-50d3-a9af-4f8459203fea
2026-03-28 14:06:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DYD70WOM-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-28 14:06:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=YD70WOM-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-28 14:06:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698225935%27 HTTP/1.1" 200 None
2026-03-28 14:06:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698225935 not downloaded yet
2026-03-28 14:06:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698934177%27 HTTP/1.1" 200 None
2026-03-28 14:06:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698934177 not downloaded yet
2026-03-28 14:06:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698802675%27 HTTP/1.1" 200 None
2026-03-28 14:06:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698802675 not downloaded yet
2026-03-28 14:06:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698484955%27 HTTP/1.1" 200 None
2026-03-28 14:06:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698484955 not downloaded yet
2026-03-28 14:06:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LK64NEJ/698947141/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LK64NEJ/42810513?sv=2020-08-04&st=2026-03-28T14%3A03%3A51Z&se=2026-03-28T14%3A28%3A51Z&sr=b&sp=r&sig=dZi6EyBOQ2GoK8knfBZtxM9S6O3yD8ghOm4nMLyaJjo%3D)
2026-03-28 14:06:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698225941%27 HTTP/1.1" 200 None
2026-03-28 14:06:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698225941 not downloaded yet
2026-03-28 14:06:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698934187%27 HTTP/1.1" 200 None
2026-03-28 14:06:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698934187 not downloaded yet
2026-03-28 14:06:46 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:06:46 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:06:46 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:06:46 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:06:46 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:06:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:06:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2d8e5810>
2026-03-28 14:06:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:06:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:06:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:06:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_40991700-d0e5-5255-930d-6ca8fe3c072d/40991700-d0e5-5255-930d-6ca8fe3c072d_image_9.jpg HTTP/1.1" 201 0
2026-03-28 14:06:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FDF12VWL%252F698228887%252F600') HTTP/1.1" 204 0
2026-03-28 14:06:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DF12VWL/698228887/600 saved to cache
2026-03-28 14:06:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 40991700-d0e5-5255-930d-6ca8fe3c072d
2026-03-28 14:06:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698802705%27 HTTP/1.1" 200 None
2026-03-28 14:06:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698802705 not downloaded yet
2026-03-28 14:06:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698484961%27 HTTP/1.1" 200 None
2026-03-28 14:06:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698484961 not downloaded yet
2026-03-28 14:06:47 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WJZ9285/698802569/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698802569>
2026-03-28 14:06:47 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WJZ9285/698802593/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698802593>
2026-03-28 14:06:47 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WJZ9285/698802550/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=WJZ9285-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-28 14:06:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CK18AEJ/698910455/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/CK18AEJ/42809519?sv=2020-08-04&st=2026-03-28T14%3A03%3A52Z&se=2026-03-28T14%3A28%3A52Z&sr=b&sp=r&sig=tMAO1WCWalJ7mXIWRlCxzQ1Rx0voh0Hr3%2FaR8xfgZTg%3D)
2026-03-28 14:06:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DF12VWL/698228854/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/DF12VWL/42797174?sv=2020-08-04&st=2026-03-28T14%3A03%3A51Z&se=2026-03-28T14%3A28%3A51Z&sr=b&sp=r&sig=0mRjBtvz6tka1D82qBQ3%2FRs63GOtrqyuAG7vdnh5S9c%3D)
2026-03-28 14:06:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698225946%27 HTTP/1.1" 200 None
2026-03-28 14:06:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698225946 not downloaded yet
2026-03-28 14:06:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698934195%27 HTTP/1.1" 200 None
2026-03-28 14:06:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698934195 not downloaded yet
2026-03-28 14:06:47 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:06:47 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:06:47 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:06:47 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:06:47 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:06:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:06:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2ddabe10>
2026-03-28 14:06:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:06:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:06:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:06:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bb105475-65fd-5601-86d0-a8590c56bf0b/bb105475-65fd-5601-86d0-a8590c56bf0b_image_8.jpg HTTP/1.1" 201 0
2026-03-28 14:06:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLK64NEJ%252F698947168%252F600') HTTP/1.1" 204 0
2026-03-28 14:06:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LK64NEJ/698947168/600 saved to cache
2026-03-28 14:06:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item bb105475-65fd-5601-86d0-a8590c56bf0b
2026-03-28 14:06:47 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:06:47 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:06:47 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:06:47 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:06:47 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:06:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:06:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a1fe3bb90>
2026-03-28 14:06:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:06:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:06:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:06:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_090813ec-adc2-5b7f-923f-58bcb47db483/090813ec-adc2-5b7f-923f-58bcb47db483_image_6.jpg HTTP/1.1" 201 0
2026-03-28 14:06:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FBP67XDB%252F698934061%252F600') HTTP/1.1" 204 0
2026-03-28 14:06:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BP67XDB/698934061/600 saved to cache
2026-03-28 14:06:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 090813ec-adc2-5b7f-923f-58bcb47db483
2026-03-28 14:06:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698802730%27 HTTP/1.1" 200 None
2026-03-28 14:06:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698802730 not downloaded yet
2026-03-28 14:06:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698484967%27 HTTP/1.1" 200 None
2026-03-28 14:06:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698484967 not downloaded yet
2026-03-28 14:06:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YS71HNL/42810026?sv=2020-08-04&st=2026-03-28T14%3A06%3A45Z&se=2026-03-28T14%3A31%3A45Z&sr=b&sp=r&sig=6LwnywW%2BQSGBv6J3youIITLgitPmhomB08N22i%2FPNp8%3D> (referer: https://www.bca.co.uk/)
2026-03-28 14:06:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698225958%27 HTTP/1.1" 200 None
2026-03-28 14:06:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698225958 not downloaded yet
2026-03-28 14:06:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698934210%27 HTTP/1.1" 200 None
2026-03-28 14:06:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698934210 not downloaded yet
2026-03-28 14:06:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YE57GFG/42810397?sv=2020-08-04&st=2026-03-28T14%3A06%3A44Z&se=2026-03-28T14%3A31%3A44Z&sr=b&sp=r&sig=vSjrPH68LNj6fTz0HIFdhL8jclPi5cOXfzhmxBIBToI%3D> (referer: https://www.bca.co.uk/)
2026-03-28 14:06:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698802751%27 HTTP/1.1" 200 None
2026-03-28 14:06:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698802751 not downloaded yet
2026-03-28 14:06:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698484969%27 HTTP/1.1" 200 None
2026-03-28 14:06:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698484969 not downloaded yet
2026-03-28 14:06:47 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:06:47 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:06:47 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:06:47 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:06:47 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:06:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:06:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2de7b610>
2026-03-28 14:06:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:06:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:06:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:06:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bb105475-65fd-5601-86d0-a8590c56bf0b/bb105475-65fd-5601-86d0-a8590c56bf0b_image_7.jpg HTTP/1.1" 201 0
2026-03-28 14:06:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLK64NEJ%252F698947141%252F600') HTTP/1.1" 204 0
2026-03-28 14:06:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LK64NEJ/698947141/600 saved to cache
2026-03-28 14:06:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item bb105475-65fd-5601-86d0-a8590c56bf0b
2026-03-28 14:06:47 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:06:47 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:06:47 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:06:47 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:06:47 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:06:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:06:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c701c50>
2026-03-28 14:06:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:06:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:06:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:06:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_954e7a8e-294d-583e-8576-18c9af402ec0/954e7a8e-294d-583e-8576-18c9af402ec0_image_7.jpg HTTP/1.1" 201 0
2026-03-28 14:06:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FCK18AEJ%252F698910455%252F600') HTTP/1.1" 204 0
2026-03-28 14:06:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CK18AEJ/698910455/600 saved to cache
2026-03-28 14:06:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 954e7a8e-294d-583e-8576-18c9af402ec0
2026-03-28 14:06:47 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:06:47 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:06:47 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:06:47 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:06:47 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:06:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:06:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a1fe76a10>
2026-03-28 14:06:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:06:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:06:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:06:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_40991700-d0e5-5255-930d-6ca8fe3c072d/40991700-d0e5-5255-930d-6ca8fe3c072d_image_8.jpg HTTP/1.1" 201 0
2026-03-28 14:06:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FDF12VWL%252F698228854%252F600') HTTP/1.1" 204 0
2026-03-28 14:06:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DF12VWL/698228854/600 saved to cache
2026-03-28 14:06:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 40991700-d0e5-5255-930d-6ca8fe3c072d
2026-03-28 14:06:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YM19HXY/42810006?sv=2020-08-04&st=2026-03-28T14%3A06%3A46Z&se=2026-03-28T14%3A31%3A46Z&sr=b&sp=r&sig=pY0duj0al0Djhca%2BC3PKfnyx3TV8v5FU4mqV41pF6EU%3D> (referer: https://www.bca.co.uk/)
2026-03-28 14:06:47 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WJZ9285/698802624/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698802624>
2026-03-28 14:06:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BP67XDB/698934036/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/BP67XDB/42810422?sv=2020-08-04&st=2026-03-28T14%3A03%3A52Z&se=2026-03-28T14%3A28%3A52Z&sr=b&sp=r&sig=Logn8Hbry8lNDBo7BHyP%2FFQM2Uo9ZZUQT4uyTv5b%2Bn0%3D)
2026-03-28 14:06:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698225965%27 HTTP/1.1" 200 None
2026-03-28 14:06:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698225965 not downloaded yet
2026-03-28 14:06:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698934241%27 HTTP/1.1" 200 None
2026-03-28 14:06:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698934241 not downloaded yet
2026-03-28 14:06:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KM11UUD/698915312/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/KM11UUD/42809630?sv=2020-08-04&st=2026-03-28T14%3A03%3A52Z&se=2026-03-28T14%3A28%3A52Z&sr=b&sp=r&sig=S16ojkv9p8NH2wa7caJZQVn%2BDGo%2BREXS30Hz2ckWR%2FA%3D)
2026-03-28 14:06:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698802765%27 HTTP/1.1" 200 None
2026-03-28 14:06:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698802765 not downloaded yet
2026-03-28 14:06:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698484976%27 HTTP/1.1" 200 None
2026-03-28 14:06:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698484976 not downloaded yet
2026-03-28 14:06:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WU19VDC/698045660/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/WU19VDC/42792335?sv=2020-08-04&st=2026-03-28T14%3A03%3A50Z&se=2026-03-28T14%3A28%3A50Z&sr=b&sp=r&sig=Mqd3JjFAqa%2F7fy72g8Zcx8u%2F7XgFrycUpKRkPg1JOjA%3D)
2026-03-28 14:06:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698225979%27 HTTP/1.1" 200 None
2026-03-28 14:06:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698225979 not downloaded yet
2026-03-28 14:06:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698934277%27 HTTP/1.1" 200 None
2026-03-28 14:06:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698934277 not downloaded yet
2026-03-28 14:06:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:06:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c40c590>
2026-03-28 14:06:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:06:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:06:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:06:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_407ba07a-d347-557e-98dd-c9e1e020c5c1/407ba07a-d347-557e-98dd-c9e1e020c5c1_expert_report_file_8f1e01e8-6aeb-4bae-adea-e5317ca32814.pdf HTTP/1.1" 201 0
2026-03-28 14:06:47 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item 407ba07a-d347-557e-98dd-c9e1e020c5c1
2026-03-28 14:06:47 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 407ba07a-d347-557e-98dd-c9e1e020c5c1, skipping ID generation
2026-03-28 14:06:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 407ba07a-d347-557e-98dd-c9e1e020c5c1
2026-03-28 14:06:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DYS71HNL-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-28 14:06:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=YS71HNL-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-28 14:06:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:06:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2d7403d0>
2026-03-28 14:06:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:06:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:06:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:06:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7a0ff710-890b-5157-a73c-3a4a72d88d1e/7a0ff710-890b-5157-a73c-3a4a72d88d1e_expert_report_file_0ac65636-8d34-481e-9d64-dd74c3374bd1.pdf HTTP/1.1" 201 0
2026-03-28 14:06:47 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item 7a0ff710-890b-5157-a73c-3a4a72d88d1e
2026-03-28 14:06:47 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 7a0ff710-890b-5157-a73c-3a4a72d88d1e, skipping ID generation
2026-03-28 14:06:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 7a0ff710-890b-5157-a73c-3a4a72d88d1e
2026-03-28 14:06:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DYE57GFG-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-28 14:06:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=YE57GFG-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-28 14:06:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YA12SZX/42810210?sv=2020-08-04&st=2026-03-28T14%3A06%3A46Z&se=2026-03-28T14%3A31%3A46Z&sr=b&sp=r&sig=zAue20Kp3xOQLoka9kg3BuP79gs5tNiiEWLbZWTA87w%3D> (referer: https://www.bca.co.uk/)
2026-03-28 14:06:47 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DE04GDK/698934177/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698934177>
2026-03-28 14:06:47 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DE04GDK/698934159/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=DE04GDK-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-28 14:06:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WJZ9285/698802593/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/WJZ9285/42807443?sv=2020-08-04&st=2026-03-28T14%3A06%3A43Z&se=2026-03-28T14%3A31%3A43Z&sr=b&sp=r&sig=kzptaA1%2FD51a3%2B3HLrofooYM2z1oDwBGLmUC%2BIEZYW0%3D)
2026-03-28 14:06:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WJZ9285/698802550/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/WJZ9285/42807443?sv=2020-08-04&st=2026-03-28T14%3A06%3A43Z&se=2026-03-28T14%3A31%3A43Z&sr=b&sp=r&sig=kzptaA1%2FD51a3%2B3HLrofooYM2z1oDwBGLmUC%2BIEZYW0%3D)
2026-03-28 14:06:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698484984%27 HTTP/1.1" 200 None
2026-03-28 14:06:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698484984 not downloaded yet
2026-03-28 14:06:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WJZ9285/698802569/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/WJZ9285/42807443?sv=2020-08-04&st=2026-03-28T14%3A06%3A43Z&se=2026-03-28T14%3A31%3A43Z&sr=b&sp=r&sig=kzptaA1%2FD51a3%2B3HLrofooYM2z1oDwBGLmUC%2BIEZYW0%3D)
2026-03-28 14:06:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698225988%27 HTTP/1.1" 200 None
2026-03-28 14:06:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698225988 not downloaded yet
2026-03-28 14:06:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698934310%27 HTTP/1.1" 200 None
2026-03-28 14:06:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698934310 not downloaded yet
2026-03-28 14:06:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698284817%27 HTTP/1.1" 200 None
2026-03-28 14:06:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698284817 not downloaded yet
2026-03-28 14:06:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698947271%27 HTTP/1.1" 200 None
2026-03-28 14:06:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698947271 not downloaded yet
2026-03-28 14:06:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698484992%27 HTTP/1.1" 200 None
2026-03-28 14:06:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698484992 not downloaded yet
2026-03-28 14:06:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:06:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2d985450>
2026-03-28 14:06:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:06:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:06:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:06:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_755211f2-f13f-55e0-85f5-1079296d0fd3/755211f2-f13f-55e0-85f5-1079296d0fd3_expert_report_file_b5da1aae-0ed7-40b6-9229-f9e2c6b98e7f.pdf HTTP/1.1" 201 0
2026-03-28 14:06:47 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item 755211f2-f13f-55e0-85f5-1079296d0fd3
2026-03-28 14:06:47 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 755211f2-f13f-55e0-85f5-1079296d0fd3, skipping ID generation
2026-03-28 14:06:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 755211f2-f13f-55e0-85f5-1079296d0fd3
2026-03-28 14:06:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DYM19HXY-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-28 14:06:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=YM19HXY-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-28 14:06:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:06:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a1fe8e750>
2026-03-28 14:06:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:06:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:06:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:06:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_090813ec-adc2-5b7f-923f-58bcb47db483/090813ec-adc2-5b7f-923f-58bcb47db483_image_5.jpg HTTP/1.1" 201 0
2026-03-28 14:06:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FBP67XDB%252F698934036%252F600') HTTP/1.1" 204 0
2026-03-28 14:06:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BP67XDB/698934036/600 saved to cache
2026-03-28 14:06:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 090813ec-adc2-5b7f-923f-58bcb47db483
2026-03-28 14:06:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:06:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c7407d0>
2026-03-28 14:06:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:06:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:06:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:06:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7ba82627-3d66-5970-bb5d-b19d751b9eb4/7ba82627-3d66-5970-bb5d-b19d751b9eb4_image_5.jpg HTTP/1.1" 201 0
2026-03-28 14:06:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FKM11UUD%252F698915312%252F600') HTTP/1.1" 204 0
2026-03-28 14:06:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KM11UUD/698915312/600 saved to cache
2026-03-28 14:06:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 7ba82627-3d66-5970-bb5d-b19d751b9eb4
2026-03-28 14:06:48 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:06:48 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:06:48 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:06:48 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:06:48 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:06:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:06:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c58a950>
2026-03-28 14:06:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:06:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:06:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:06:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2c7ab10e-203f-5d5d-b669-d394e3cfab8d/2c7ab10e-203f-5d5d-b669-d394e3cfab8d_image_9.jpg HTTP/1.1" 201 0
2026-03-28 14:06:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FWU19VDC%252F698045660%252F600') HTTP/1.1" 204 0
2026-03-28 14:06:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WU19VDC/698045660/600 saved to cache
2026-03-28 14:06:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 2c7ab10e-203f-5d5d-b669-d394e3cfab8d
2026-03-28 14:06:48 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AX15GHV/698225941/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698225941>
2026-03-28 14:06:48 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DE04GDK/698934187/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698934187>
2026-03-28 14:06:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WJZ9285/698802624/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/WJZ9285/42807443?sv=2020-08-04&st=2026-03-28T14%3A06%3A43Z&se=2026-03-28T14%3A31%3A43Z&sr=b&sp=r&sig=kzptaA1%2FD51a3%2B3HLrofooYM2z1oDwBGLmUC%2BIEZYW0%3D)
2026-03-28 14:06:48 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WJZ9285/698802730/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698802730>
2026-03-28 14:06:48 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DE04GDK/698934210/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698934210>
2026-03-28 14:06:48 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AX15GHV/698225958/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698225958>
2026-03-28 14:06:48 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YD70WOM/698484967/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698484967>
2026-03-28 14:06:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698934334%27 HTTP/1.1" 200 None
2026-03-28 14:06:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698934334 not downloaded yet
2026-03-28 14:06:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698284821%27 HTTP/1.1" 200 None
2026-03-28 14:06:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698284821 not downloaded yet
2026-03-28 14:06:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698947281%27 HTTP/1.1" 200 None
2026-03-28 14:06:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698947281 not downloaded yet
2026-03-28 14:06:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698485002%27 HTTP/1.1" 200 None
2026-03-28 14:06:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698485002 not downloaded yet
2026-03-28 14:06:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698042701%27 HTTP/1.1" 200 None
2026-03-28 14:06:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698042701 not downloaded yet
2026-03-28 14:06:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698284827%27 HTTP/1.1" 200 None
2026-03-28 14:06:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698284827 not downloaded yet
2026-03-28 14:06:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698947297%27 HTTP/1.1" 200 None
2026-03-28 14:06:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698947297 not downloaded yet
2026-03-28 14:06:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:06:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c8d9ed0>
2026-03-28 14:06:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:06:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:06:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:06:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0673e591-45ac-5d50-a3e1-15ce73402302/0673e591-45ac-5d50-a3e1-15ce73402302_expert_report_file_b8a5e848-ebb1-480c-9d05-10754f5fde12.pdf HTTP/1.1" 201 0
2026-03-28 14:06:48 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item 0673e591-45ac-5d50-a3e1-15ce73402302
2026-03-28 14:06:48 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 0673e591-45ac-5d50-a3e1-15ce73402302, skipping ID generation
2026-03-28 14:06:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 0673e591-45ac-5d50-a3e1-15ce73402302
2026-03-28 14:06:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DYA12SZX-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-28 14:06:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=YA12SZX-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-28 14:06:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:06:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c9250d0>
2026-03-28 14:06:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:06:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:06:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:06:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a149de9c-cfcc-5dd2-a714-96be3f56b350/a149de9c-cfcc-5dd2-a714-96be3f56b350_image_2.jpg HTTP/1.1" 201 0
2026-03-28 14:06:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FWJZ9285%252F698802593%252F600') HTTP/1.1" 204 0
2026-03-28 14:06:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WJZ9285/698802593/600 saved to cache
2026-03-28 14:06:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item a149de9c-cfcc-5dd2-a714-96be3f56b350
2026-03-28 14:06:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:06:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2d8dab10>
2026-03-28 14:06:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:06:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:06:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:06:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a149de9c-cfcc-5dd2-a714-96be3f56b350/a149de9c-cfcc-5dd2-a714-96be3f56b350_image_0.jpg HTTP/1.1" 201 0
2026-03-28 14:06:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FWJZ9285%252F698802550%252F600') HTTP/1.1" 204 0
2026-03-28 14:06:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WJZ9285/698802550/600 saved to cache
2026-03-28 14:06:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item a149de9c-cfcc-5dd2-a714-96be3f56b350
2026-03-28 14:06:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:06:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a1fdb5850>
2026-03-28 14:06:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:06:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:06:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:06:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a149de9c-cfcc-5dd2-a714-96be3f56b350/a149de9c-cfcc-5dd2-a714-96be3f56b350_image_1.jpg HTTP/1.1" 201 0
2026-03-28 14:06:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FWJZ9285%252F698802569%252F600') HTTP/1.1" 204 0
2026-03-28 14:06:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WJZ9285/698802569/600 saved to cache
2026-03-28 14:06:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item a149de9c-cfcc-5dd2-a714-96be3f56b350
2026-03-28 14:06:48 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DE04GDK/698934241/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698934241>
2026-03-28 14:06:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698485011%27 HTTP/1.1" 200 None
2026-03-28 14:06:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698485011 not downloaded yet
2026-03-28 14:06:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698042714%27 HTTP/1.1" 200 None
2026-03-28 14:06:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698042714 not downloaded yet
2026-03-28 14:06:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DE04GDK/698934177/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/DE04GDK/42809821?sv=2020-08-04&st=2026-03-28T14%3A06%3A43Z&se=2026-03-28T14%3A31%3A43Z&sr=b&sp=r&sig=Wg9UX1XBSOfklscjKMokjHFFw1lKRjgTlp8OjJ%2B2vVw%3D)
2026-03-28 14:06:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DE04GDK/698934159/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/DE04GDK/42809821?sv=2020-08-04&st=2026-03-28T14%3A06%3A43Z&se=2026-03-28T14%3A31%3A43Z&sr=b&sp=r&sig=Wg9UX1XBSOfklscjKMokjHFFw1lKRjgTlp8OjJ%2B2vVw%3D)
2026-03-28 14:06:48 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YD70WOM/698484969/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698484969>
2026-03-28 14:06:48 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YD70WOM/698484976/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698484976>
2026-03-28 14:06:48 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AX15GHV/698225965/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698225965>
2026-03-28 14:06:48 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WJZ9285/698802765/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698802765>
2026-03-28 14:06:48 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YD70WOM/698484984/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698484984>
2026-03-28 14:06:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698284830%27 HTTP/1.1" 200 None
2026-03-28 14:06:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698284830 not downloaded yet
2026-03-28 14:06:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698947309%27 HTTP/1.1" 200 None
2026-03-28 14:06:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698947309 not downloaded yet
2026-03-28 14:06:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698941318%27 HTTP/1.1" 200 None
2026-03-28 14:06:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698941318 not downloaded yet
2026-03-28 14:06:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698042731%27 HTTP/1.1" 200 None
2026-03-28 14:06:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698042731 not downloaded yet
2026-03-28 14:06:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:06:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2d6d63d0>
2026-03-28 14:06:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:06:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:06:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:06:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a149de9c-cfcc-5dd2-a714-96be3f56b350/a149de9c-cfcc-5dd2-a714-96be3f56b350_image_3.jpg HTTP/1.1" 201 0
2026-03-28 14:06:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FWJZ9285%252F698802624%252F600') HTTP/1.1" 204 0
2026-03-28 14:06:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WJZ9285/698802624/600 saved to cache
2026-03-28 14:06:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item a149de9c-cfcc-5dd2-a714-96be3f56b350
2026-03-28 14:06:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698284834%27 HTTP/1.1" 200 None
2026-03-28 14:06:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698284834 not downloaded yet
2026-03-28 14:06:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698947322%27 HTTP/1.1" 200 None
2026-03-28 14:06:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698947322 not downloaded yet
2026-03-28 14:06:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698941328%27 HTTP/1.1" 200 None
2026-03-28 14:06:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698941328 not downloaded yet
2026-03-28 14:06:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YD70WOM/698484967/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YD70WOM/42810030?sv=2020-08-04&st=2026-03-28T14%3A06%3A44Z&se=2026-03-28T14%3A31%3A44Z&sr=b&sp=r&sig=zY0GlfRSinGMYhbbj%2BSacZWH49j2OuV6ot7DWpDFe%2Fk%3D)
2026-03-28 14:06:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698042746%27 HTTP/1.1" 200 None
2026-03-28 14:06:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698042746 not downloaded yet
2026-03-28 14:06:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698284843%27 HTTP/1.1" 200 None
2026-03-28 14:06:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698284843 not downloaded yet
2026-03-28 14:06:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698947349%27 HTTP/1.1" 200 None
2026-03-28 14:06:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698947349 not downloaded yet
2026-03-28 14:06:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698941347%27 HTTP/1.1" 200 None
2026-03-28 14:06:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698941347 not downloaded yet
2026-03-28 14:06:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:06:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c67df50>
2026-03-28 14:06:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:06:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:06:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:06:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_842ae7be-18fd-5ebf-ace8-89e5a9f85a09/842ae7be-18fd-5ebf-ace8-89e5a9f85a09_image_2.jpg HTTP/1.1" 201 0
2026-03-28 14:06:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FDE04GDK%252F698934177%252F600') HTTP/1.1" 204 0
2026-03-28 14:06:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DE04GDK/698934177/600 saved to cache
2026-03-28 14:06:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 842ae7be-18fd-5ebf-ace8-89e5a9f85a09
2026-03-28 14:06:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:06:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a30236510>
2026-03-28 14:06:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:06:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:06:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:06:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_842ae7be-18fd-5ebf-ace8-89e5a9f85a09/842ae7be-18fd-5ebf-ace8-89e5a9f85a09_image_0.jpg HTTP/1.1" 201 0
2026-03-28 14:06:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FDE04GDK%252F698934159%252F600') HTTP/1.1" 204 0
2026-03-28 14:06:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DE04GDK/698934159/600 saved to cache
2026-03-28 14:06:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 842ae7be-18fd-5ebf-ace8-89e5a9f85a09
2026-03-28 14:06:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DE04GDK/698934210/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/DE04GDK/42809821?sv=2020-08-04&st=2026-03-28T14%3A06%3A43Z&se=2026-03-28T14%3A31%3A43Z&sr=b&sp=r&sig=Wg9UX1XBSOfklscjKMokjHFFw1lKRjgTlp8OjJ%2B2vVw%3D)
2026-03-28 14:06:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WJZ9285/698802730/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/WJZ9285/42807443?sv=2020-08-04&st=2026-03-28T14%3A06%3A43Z&se=2026-03-28T14%3A31%3A43Z&sr=b&sp=r&sig=kzptaA1%2FD51a3%2B3HLrofooYM2z1oDwBGLmUC%2BIEZYW0%3D)
2026-03-28 14:06:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698042762%27 HTTP/1.1" 200 None
2026-03-28 14:06:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698042762 not downloaded yet
2026-03-28 14:06:48 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YE57GFG/698947271/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698947271>
2026-03-28 14:06:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DE04GDK/698934187/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/DE04GDK/42809821?sv=2020-08-04&st=2026-03-28T14%3A06%3A43Z&se=2026-03-28T14%3A31%3A43Z&sr=b&sp=r&sig=Wg9UX1XBSOfklscjKMokjHFFw1lKRjgTlp8OjJ%2B2vVw%3D)
2026-03-28 14:06:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AX15GHV/698225941/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/AX15GHV/42810027?sv=2020-08-04&st=2026-03-28T14%3A06%3A43Z&se=2026-03-28T14%3A31%3A43Z&sr=b&sp=r&sig=JJpF40Yp%2FobLJQr3JyJKHMCuyadOw6pOe%2FflxZRZmFI%3D)
2026-03-28 14:06:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AX15GHV/698225958/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/AX15GHV/42810027?sv=2020-08-04&st=2026-03-28T14%3A06%3A43Z&se=2026-03-28T14%3A31%3A43Z&sr=b&sp=r&sig=JJpF40Yp%2FobLJQr3JyJKHMCuyadOw6pOe%2FflxZRZmFI%3D)
2026-03-28 14:06:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DE04GDK/698934241/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/DE04GDK/42809821?sv=2020-08-04&st=2026-03-28T14%3A06%3A43Z&se=2026-03-28T14%3A31%3A43Z&sr=b&sp=r&sig=Wg9UX1XBSOfklscjKMokjHFFw1lKRjgTlp8OjJ%2B2vVw%3D)
2026-03-28 14:06:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698284853%27 HTTP/1.1" 200 None
2026-03-28 14:06:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698284853 not downloaded yet
2026-03-28 14:06:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698947387%27 HTTP/1.1" 200 None
2026-03-28 14:06:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698947387 not downloaded yet
2026-03-28 14:06:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698941364%27 HTTP/1.1" 200 None
2026-03-28 14:06:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698941364 not downloaded yet
2026-03-28 14:06:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698042784%27 HTTP/1.1" 200 None
2026-03-28 14:06:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698042784 not downloaded yet
2026-03-28 14:06:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:06:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2eb11650>
2026-03-28 14:06:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:06:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:06:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:06:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d4588dea-a04d-50d3-a9af-4f8459203fea/d4588dea-a04d-50d3-a9af-4f8459203fea_image_3.jpg HTTP/1.1" 201 0
2026-03-28 14:06:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FYD70WOM%252F698484967%252F600') HTTP/1.1" 204 0
2026-03-28 14:06:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YD70WOM/698484967/600 saved to cache
2026-03-28 14:06:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item d4588dea-a04d-50d3-a9af-4f8459203fea
2026-03-28 14:06:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698284865%27 HTTP/1.1" 200 None
2026-03-28 14:06:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698284865 not downloaded yet
2026-03-28 14:06:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698947421%27 HTTP/1.1" 200 None
2026-03-28 14:06:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698947421 not downloaded yet
2026-03-28 14:06:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698941378%27 HTTP/1.1" 200 None
2026-03-28 14:06:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698941378 not downloaded yet
2026-03-28 14:06:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YD70WOM/698484984/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YD70WOM/42810030?sv=2020-08-04&st=2026-03-28T14%3A06%3A44Z&se=2026-03-28T14%3A31%3A44Z&sr=b&sp=r&sig=zY0GlfRSinGMYhbbj%2BSacZWH49j2OuV6ot7DWpDFe%2Fk%3D)
2026-03-28 14:06:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AX15GHV/698225965/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/AX15GHV/42810027?sv=2020-08-04&st=2026-03-28T14%3A06%3A43Z&se=2026-03-28T14%3A31%3A43Z&sr=b&sp=r&sig=JJpF40Yp%2FobLJQr3JyJKHMCuyadOw6pOe%2FflxZRZmFI%3D)
2026-03-28 14:06:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698042801%27 HTTP/1.1" 200 None
2026-03-28 14:06:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698042801 not downloaded yet
2026-03-28 14:06:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WJZ9285/698802765/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/WJZ9285/42807443?sv=2020-08-04&st=2026-03-28T14%3A06%3A43Z&se=2026-03-28T14%3A31%3A43Z&sr=b&sp=r&sig=kzptaA1%2FD51a3%2B3HLrofooYM2z1oDwBGLmUC%2BIEZYW0%3D)
2026-03-28 14:06:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YD70WOM/698484969/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YD70WOM/42810030?sv=2020-08-04&st=2026-03-28T14%3A06%3A44Z&se=2026-03-28T14%3A31%3A44Z&sr=b&sp=r&sig=zY0GlfRSinGMYhbbj%2BSacZWH49j2OuV6ot7DWpDFe%2Fk%3D)
2026-03-28 14:06:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698284877%27 HTTP/1.1" 200 None
2026-03-28 14:06:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698284877 not downloaded yet
2026-03-28 14:06:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698947444%27 HTTP/1.1" 200 None
2026-03-28 14:06:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698947444 not downloaded yet
2026-03-28 14:06:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698941402%27 HTTP/1.1" 200 None
2026-03-28 14:06:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698941402 not downloaded yet
2026-03-28 14:06:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:06:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c59cb10>
2026-03-28 14:06:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:06:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:06:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:06:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_842ae7be-18fd-5ebf-ace8-89e5a9f85a09/842ae7be-18fd-5ebf-ace8-89e5a9f85a09_image_5.jpg HTTP/1.1" 201 0
2026-03-28 14:06:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FDE04GDK%252F698934210%252F600') HTTP/1.1" 204 0
2026-03-28 14:06:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DE04GDK/698934210/600 saved to cache
2026-03-28 14:06:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 842ae7be-18fd-5ebf-ace8-89e5a9f85a09
2026-03-28 14:06:49 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:06:49 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:06:49 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:06:49 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:06:49 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:06:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:06:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2d9f8d50>
2026-03-28 14:06:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:06:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:06:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:06:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a149de9c-cfcc-5dd2-a714-96be3f56b350/a149de9c-cfcc-5dd2-a714-96be3f56b350_image_7.jpg HTTP/1.1" 201 0
2026-03-28 14:06:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FWJZ9285%252F698802730%252F600') HTTP/1.1" 204 0
2026-03-28 14:06:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WJZ9285/698802730/600 saved to cache
2026-03-28 14:06:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item a149de9c-cfcc-5dd2-a714-96be3f56b350
2026-03-28 14:06:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:06:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c996f50>
2026-03-28 14:06:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:06:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:06:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:06:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_842ae7be-18fd-5ebf-ace8-89e5a9f85a09/842ae7be-18fd-5ebf-ace8-89e5a9f85a09_image_3.jpg HTTP/1.1" 201 0
2026-03-28 14:06:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FDE04GDK%252F698934187%252F600') HTTP/1.1" 204 0
2026-03-28 14:06:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DE04GDK/698934187/600 saved to cache
2026-03-28 14:06:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 842ae7be-18fd-5ebf-ace8-89e5a9f85a09
2026-03-28 14:06:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:06:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2d837c10>
2026-03-28 14:06:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:06:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:06:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:06:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_605bb574-f032-5f24-9f53-91befb051fec/605bb574-f032-5f24-9f53-91befb051fec_image_4.jpg HTTP/1.1" 201 0
2026-03-28 14:06:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FAX15GHV%252F698225941%252F600') HTTP/1.1" 204 0
2026-03-28 14:06:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AX15GHV/698225941/600 saved to cache
2026-03-28 14:06:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 605bb574-f032-5f24-9f53-91befb051fec
2026-03-28 14:06:49 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:06:49 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:06:49 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:06:49 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:06:49 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:06:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:06:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2dbba490>
2026-03-28 14:06:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:06:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:06:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:06:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_605bb574-f032-5f24-9f53-91befb051fec/605bb574-f032-5f24-9f53-91befb051fec_image_6.jpg HTTP/1.1" 201 0
2026-03-28 14:06:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FAX15GHV%252F698225958%252F600') HTTP/1.1" 204 0
2026-03-28 14:06:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AX15GHV/698225958/600 saved to cache
2026-03-28 14:06:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 605bb574-f032-5f24-9f53-91befb051fec
2026-03-28 14:06:49 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:06:49 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:06:49 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:06:49 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:06:49 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:06:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:06:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2d9fa7d0>
2026-03-28 14:06:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:06:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:06:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:06:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_842ae7be-18fd-5ebf-ace8-89e5a9f85a09/842ae7be-18fd-5ebf-ace8-89e5a9f85a09_image_6.jpg HTTP/1.1" 201 0
2026-03-28 14:06:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FDE04GDK%252F698934241%252F600') HTTP/1.1" 204 0
2026-03-28 14:06:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DE04GDK/698934241/600 saved to cache
2026-03-28 14:06:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 842ae7be-18fd-5ebf-ace8-89e5a9f85a09
2026-03-28 14:06:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YD70WOM/698484976/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YD70WOM/42810030?sv=2020-08-04&st=2026-03-28T14%3A06%3A44Z&se=2026-03-28T14%3A31%3A44Z&sr=b&sp=r&sig=zY0GlfRSinGMYhbbj%2BSacZWH49j2OuV6ot7DWpDFe%2Fk%3D)
2026-03-28 14:06:49 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YD70WOM/698485011/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698485011>
2026-03-28 14:06:49 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YM19HXY/698042714/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698042714>
2026-03-28 14:06:49 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YA12SZX/698941328/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698941328>
2026-03-28 14:06:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698042815%27 HTTP/1.1" 200 None
2026-03-28 14:06:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698042815 not downloaded yet
2026-03-28 14:06:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698941427%27 HTTP/1.1" 200 None
2026-03-28 14:06:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698941427 not downloaded yet
2026-03-28 14:06:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698042828%27 HTTP/1.1" 200 None
2026-03-28 14:06:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698042828 not downloaded yet
2026-03-28 14:06:49 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:06:49 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:06:49 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:06:49 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:06:49 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:06:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:06:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c9c99d0>
2026-03-28 14:06:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:06:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:06:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:06:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d4588dea-a04d-50d3-a9af-4f8459203fea/d4588dea-a04d-50d3-a9af-4f8459203fea_image_6.jpg HTTP/1.1" 201 0
2026-03-28 14:06:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FYD70WOM%252F698484984%252F600') HTTP/1.1" 204 0
2026-03-28 14:06:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YD70WOM/698484984/600 saved to cache
2026-03-28 14:06:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item d4588dea-a04d-50d3-a9af-4f8459203fea
2026-03-28 14:06:49 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:06:49 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:06:49 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:06:49 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:06:49 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:06:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:06:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2d9d0dd0>
2026-03-28 14:06:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:06:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:06:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:06:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_605bb574-f032-5f24-9f53-91befb051fec/605bb574-f032-5f24-9f53-91befb051fec_image_7.jpg HTTP/1.1" 201 0
2026-03-28 14:06:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FAX15GHV%252F698225965%252F600') HTTP/1.1" 204 0
2026-03-28 14:06:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AX15GHV/698225965/600 saved to cache
2026-03-28 14:06:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 605bb574-f032-5f24-9f53-91befb051fec
2026-03-28 14:06:49 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:06:49 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:06:49 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:06:49 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:06:49 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:06:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:06:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2dd95e50>
2026-03-28 14:06:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:06:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:06:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:06:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a149de9c-cfcc-5dd2-a714-96be3f56b350/a149de9c-cfcc-5dd2-a714-96be3f56b350_image_9.jpg HTTP/1.1" 201 0
2026-03-28 14:06:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FWJZ9285%252F698802765%252F600') HTTP/1.1" 204 0
2026-03-28 14:06:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WJZ9285/698802765/600 saved to cache
2026-03-28 14:06:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item a149de9c-cfcc-5dd2-a714-96be3f56b350
2026-03-28 14:06:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:06:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2dccb8d0>
2026-03-28 14:06:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:06:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:06:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:06:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d4588dea-a04d-50d3-a9af-4f8459203fea/d4588dea-a04d-50d3-a9af-4f8459203fea_image_4.jpg HTTP/1.1" 201 0
2026-03-28 14:06:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FYD70WOM%252F698484969%252F600') HTTP/1.1" 204 0
2026-03-28 14:06:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YD70WOM/698484969/600 saved to cache
2026-03-28 14:06:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item d4588dea-a04d-50d3-a9af-4f8459203fea
2026-03-28 14:06:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698941445%27 HTTP/1.1" 200 None
2026-03-28 14:06:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698941445 not downloaded yet
2026-03-28 14:06:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YE57GFG/698947271/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YE57GFG/42810397?sv=2020-08-04&st=2026-03-28T14%3A06%3A44Z&se=2026-03-28T14%3A31%3A44Z&sr=b&sp=r&sig=vSjrPH68LNj6fTz0HIFdhL8jclPi5cOXfzhmxBIBToI%3D)
2026-03-28 14:06:49 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YE57GFG/698947322/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698947322>
2026-03-28 14:06:49 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YM19HXY/698042762/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698042762>
2026-03-28 14:06:49 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YM19HXY/698042746/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698042746>
2026-03-28 14:06:49 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YS71HNL/698284843/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698284843>
2026-03-28 14:06:49 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YA12SZX/698941347/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698941347>
2026-03-28 14:06:49 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YA12SZX/698941378/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698941378>
2026-03-28 14:06:49 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YE57GFG/698947349/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698947349>
2026-03-28 14:06:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698941464%27 HTTP/1.1" 200 None
2026-03-28 14:06:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698941464 not downloaded yet
2026-03-28 14:06:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:06:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2d7abf10>
2026-03-28 14:06:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:06:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:06:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:06:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d4588dea-a04d-50d3-a9af-4f8459203fea/d4588dea-a04d-50d3-a9af-4f8459203fea_image_5.jpg HTTP/1.1" 201 0
2026-03-28 14:06:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FYD70WOM%252F698484976%252F600') HTTP/1.1" 204 0
2026-03-28 14:06:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YD70WOM/698484976/600 saved to cache
2026-03-28 14:06:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item d4588dea-a04d-50d3-a9af-4f8459203fea
2026-03-28 14:06:49 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YS71HNL/698284865/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698284865>
2026-03-28 14:06:49 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YE57GFG/698947421/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698947421>
2026-03-28 14:06:49 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YM19HXY/698042801/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698042801>
2026-03-28 14:06:49 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YM19HXY/698042784/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698042784>
2026-03-28 14:06:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YA12SZX/698941328/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YA12SZX/42810210?sv=2020-08-04&st=2026-03-28T14%3A06%3A46Z&se=2026-03-28T14%3A31%3A46Z&sr=b&sp=r&sig=zAue20Kp3xOQLoka9kg3BuP79gs5tNiiEWLbZWTA87w%3D)
2026-03-28 14:06:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YM19HXY/698042714/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YM19HXY/42810006?sv=2020-08-04&st=2026-03-28T14%3A06%3A46Z&se=2026-03-28T14%3A31%3A46Z&sr=b&sp=r&sig=pY0duj0al0Djhca%2BC3PKfnyx3TV8v5FU4mqV41pF6EU%3D)
2026-03-28 14:06:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:06:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c9fa490>
2026-03-28 14:06:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:06:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:06:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:06:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7a0ff710-890b-5157-a73c-3a4a72d88d1e/7a0ff710-890b-5157-a73c-3a4a72d88d1e_image_1.jpg HTTP/1.1" 201 0
2026-03-28 14:06:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FYE57GFG%252F698947271%252F600') HTTP/1.1" 204 0
2026-03-28 14:06:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YE57GFG/698947271/600 saved to cache
2026-03-28 14:06:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 7a0ff710-890b-5157-a73c-3a4a72d88d1e
2026-03-28 14:06:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YD70WOM/698485011/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YD70WOM/42810030?sv=2020-08-04&st=2026-03-28T14%3A06%3A44Z&se=2026-03-28T14%3A31%3A44Z&sr=b&sp=r&sig=zY0GlfRSinGMYhbbj%2BSacZWH49j2OuV6ot7DWpDFe%2Fk%3D)
2026-03-28 14:06:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YE57GFG/698947322/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YE57GFG/42810397?sv=2020-08-04&st=2026-03-28T14%3A06%3A44Z&se=2026-03-28T14%3A31%3A44Z&sr=b&sp=r&sig=vSjrPH68LNj6fTz0HIFdhL8jclPi5cOXfzhmxBIBToI%3D)
2026-03-28 14:06:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YE57GFG/698947349/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YE57GFG/42810397?sv=2020-08-04&st=2026-03-28T14%3A06%3A44Z&se=2026-03-28T14%3A31%3A44Z&sr=b&sp=r&sig=vSjrPH68LNj6fTz0HIFdhL8jclPi5cOXfzhmxBIBToI%3D)
2026-03-28 14:06:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YA12SZX/698941378/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YA12SZX/42810210?sv=2020-08-04&st=2026-03-28T14%3A06%3A46Z&se=2026-03-28T14%3A31%3A46Z&sr=b&sp=r&sig=zAue20Kp3xOQLoka9kg3BuP79gs5tNiiEWLbZWTA87w%3D)
2026-03-28 14:06:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YA12SZX/698941347/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YA12SZX/42810210?sv=2020-08-04&st=2026-03-28T14%3A06%3A46Z&se=2026-03-28T14%3A31%3A46Z&sr=b&sp=r&sig=zAue20Kp3xOQLoka9kg3BuP79gs5tNiiEWLbZWTA87w%3D)
2026-03-28 14:06:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:06:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2ca8be10>
2026-03-28 14:06:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:06:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:06:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:06:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0673e591-45ac-5d50-a3e1-15ce73402302/0673e591-45ac-5d50-a3e1-15ce73402302_image_2.jpg HTTP/1.1" 201 0
2026-03-28 14:06:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FYA12SZX%252F698941328%252F600') HTTP/1.1" 204 0
2026-03-28 14:06:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YA12SZX/698941328/600 saved to cache
2026-03-28 14:06:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 0673e591-45ac-5d50-a3e1-15ce73402302
2026-03-28 14:06:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YM19HXY/698042746/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YM19HXY/42810006?sv=2020-08-04&st=2026-03-28T14%3A06%3A46Z&se=2026-03-28T14%3A31%3A46Z&sr=b&sp=r&sig=pY0duj0al0Djhca%2BC3PKfnyx3TV8v5FU4mqV41pF6EU%3D)
2026-03-28 14:06:49 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YM19HXY/698042828/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698042828>
2026-03-28 14:06:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YM19HXY/698042762/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YM19HXY/42810006?sv=2020-08-04&st=2026-03-28T14%3A06%3A46Z&se=2026-03-28T14%3A31%3A46Z&sr=b&sp=r&sig=pY0duj0al0Djhca%2BC3PKfnyx3TV8v5FU4mqV41pF6EU%3D)
2026-03-28 14:06:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:06:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c7ceb10>
2026-03-28 14:06:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:06:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:06:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:06:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_755211f2-f13f-55e0-85f5-1079296d0fd3/755211f2-f13f-55e0-85f5-1079296d0fd3_image_2.jpg HTTP/1.1" 201 0
2026-03-28 14:06:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FYM19HXY%252F698042714%252F600') HTTP/1.1" 204 0
2026-03-28 14:06:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YM19HXY/698042714/600 saved to cache
2026-03-28 14:06:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 755211f2-f13f-55e0-85f5-1079296d0fd3
2026-03-28 14:06:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YS71HNL/698284843/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YS71HNL/42810026?sv=2020-08-04&st=2026-03-28T14%3A06%3A45Z&se=2026-03-28T14%3A31%3A45Z&sr=b&sp=r&sig=6LwnywW%2BQSGBv6J3youIITLgitPmhomB08N22i%2FPNp8%3D)
2026-03-28 14:06:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YE57GFG/698947421/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YE57GFG/42810397?sv=2020-08-04&st=2026-03-28T14%3A06%3A44Z&se=2026-03-28T14%3A31%3A44Z&sr=b&sp=r&sig=vSjrPH68LNj6fTz0HIFdhL8jclPi5cOXfzhmxBIBToI%3D)
2026-03-28 14:06:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YS71HNL/698284865/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YS71HNL/42810026?sv=2020-08-04&st=2026-03-28T14%3A06%3A45Z&se=2026-03-28T14%3A31%3A45Z&sr=b&sp=r&sig=6LwnywW%2BQSGBv6J3youIITLgitPmhomB08N22i%2FPNp8%3D)
2026-03-28 14:06:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YM19HXY/698042801/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YM19HXY/42810006?sv=2020-08-04&st=2026-03-28T14%3A06%3A46Z&se=2026-03-28T14%3A31%3A46Z&sr=b&sp=r&sig=pY0duj0al0Djhca%2BC3PKfnyx3TV8v5FU4mqV41pF6EU%3D)
2026-03-28 14:06:49 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:06:49 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:06:49 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:06:49 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:06:49 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:06:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:06:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c3a9750>
2026-03-28 14:06:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:06:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:06:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:06:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d4588dea-a04d-50d3-a9af-4f8459203fea/d4588dea-a04d-50d3-a9af-4f8459203fea_image_9.jpg HTTP/1.1" 201 0
2026-03-28 14:06:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FYD70WOM%252F698485011%252F600') HTTP/1.1" 204 0
2026-03-28 14:06:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YD70WOM/698485011/600 saved to cache
2026-03-28 14:06:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item d4588dea-a04d-50d3-a9af-4f8459203fea
2026-03-28 14:06:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:06:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2ca89f90>
2026-03-28 14:06:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:06:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:06:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:06:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7a0ff710-890b-5157-a73c-3a4a72d88d1e/7a0ff710-890b-5157-a73c-3a4a72d88d1e_image_5.jpg HTTP/1.1" 201 0
2026-03-28 14:06:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FYE57GFG%252F698947322%252F600') HTTP/1.1" 204 0
2026-03-28 14:06:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YE57GFG/698947322/600 saved to cache
2026-03-28 14:06:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 7a0ff710-890b-5157-a73c-3a4a72d88d1e
2026-03-28 14:06:50 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:06:50 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:06:50 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:06:50 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:06:50 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:06:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:06:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c9a0250>
2026-03-28 14:06:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:06:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:06:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:06:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7a0ff710-890b-5157-a73c-3a4a72d88d1e/7a0ff710-890b-5157-a73c-3a4a72d88d1e_image_6.jpg HTTP/1.1" 201 0
2026-03-28 14:06:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FYE57GFG%252F698947349%252F600') HTTP/1.1" 204 0
2026-03-28 14:06:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YE57GFG/698947349/600 saved to cache
2026-03-28 14:06:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 7a0ff710-890b-5157-a73c-3a4a72d88d1e
2026-03-28 14:06:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YM19HXY/698042784/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YM19HXY/42810006?sv=2020-08-04&st=2026-03-28T14%3A06%3A46Z&se=2026-03-28T14%3A31%3A46Z&sr=b&sp=r&sig=pY0duj0al0Djhca%2BC3PKfnyx3TV8v5FU4mqV41pF6EU%3D)
2026-03-28 14:06:50 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YA12SZX/698941445/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698941445>
2026-03-28 14:06:50 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YA12SZX/698941464/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698941464>
2026-03-28 14:06:50 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YA12SZX/698941427/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698941427>
2026-03-28 14:06:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:06:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2dcc9b50>
2026-03-28 14:06:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:06:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:06:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:06:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0673e591-45ac-5d50-a3e1-15ce73402302/0673e591-45ac-5d50-a3e1-15ce73402302_image_5.jpg HTTP/1.1" 201 0
2026-03-28 14:06:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FYA12SZX%252F698941378%252F600') HTTP/1.1" 204 0
2026-03-28 14:06:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YA12SZX/698941378/600 saved to cache
2026-03-28 14:06:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 0673e591-45ac-5d50-a3e1-15ce73402302
2026-03-28 14:06:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:06:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c9d8650>
2026-03-28 14:06:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:06:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:06:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:06:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0673e591-45ac-5d50-a3e1-15ce73402302/0673e591-45ac-5d50-a3e1-15ce73402302_image_3.jpg HTTP/1.1" 201 0
2026-03-28 14:06:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FYA12SZX%252F698941347%252F600') HTTP/1.1" 204 0
2026-03-28 14:06:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YA12SZX/698941347/600 saved to cache
2026-03-28 14:06:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 0673e591-45ac-5d50-a3e1-15ce73402302
2026-03-28 14:06:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:06:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c429490>
2026-03-28 14:06:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:06:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:06:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:06:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_755211f2-f13f-55e0-85f5-1079296d0fd3/755211f2-f13f-55e0-85f5-1079296d0fd3_image_4.jpg HTTP/1.1" 201 0
2026-03-28 14:06:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FYM19HXY%252F698042746%252F600') HTTP/1.1" 204 0
2026-03-28 14:06:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YM19HXY/698042746/600 saved to cache
2026-03-28 14:06:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 755211f2-f13f-55e0-85f5-1079296d0fd3
2026-03-28 14:06:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:06:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c16dd90>
2026-03-28 14:06:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:06:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:06:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:06:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_755211f2-f13f-55e0-85f5-1079296d0fd3/755211f2-f13f-55e0-85f5-1079296d0fd3_image_5.jpg HTTP/1.1" 201 0
2026-03-28 14:06:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FYM19HXY%252F698042762%252F600') HTTP/1.1" 204 0
2026-03-28 14:06:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YM19HXY/698042762/600 saved to cache
2026-03-28 14:06:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 755211f2-f13f-55e0-85f5-1079296d0fd3
2026-03-28 14:06:50 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:06:50 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:06:50 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:06:50 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:06:50 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:06:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:06:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c9ea950>
2026-03-28 14:06:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:06:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:06:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:06:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_407ba07a-d347-557e-98dd-c9e1e020c5c1/407ba07a-d347-557e-98dd-c9e1e020c5c1_image_6.jpg HTTP/1.1" 201 0
2026-03-28 14:06:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FYS71HNL%252F698284843%252F600') HTTP/1.1" 204 0
2026-03-28 14:06:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YS71HNL/698284843/600 saved to cache
2026-03-28 14:06:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 407ba07a-d347-557e-98dd-c9e1e020c5c1
2026-03-28 14:06:50 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:06:50 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:06:50 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:06:50 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:06:50 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:06:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:06:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c3a8190>
2026-03-28 14:06:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:06:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:06:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:06:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7a0ff710-890b-5157-a73c-3a4a72d88d1e/7a0ff710-890b-5157-a73c-3a4a72d88d1e_image_8.jpg HTTP/1.1" 201 0
2026-03-28 14:06:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FYE57GFG%252F698947421%252F600') HTTP/1.1" 204 0
2026-03-28 14:06:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YE57GFG/698947421/600 saved to cache
2026-03-28 14:06:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 7a0ff710-890b-5157-a73c-3a4a72d88d1e
2026-03-28 14:06:50 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:06:50 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:06:50 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:06:50 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:06:50 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:06:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:06:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c702a90>
2026-03-28 14:06:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:06:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:06:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:06:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_407ba07a-d347-557e-98dd-c9e1e020c5c1/407ba07a-d347-557e-98dd-c9e1e020c5c1_image_8.jpg HTTP/1.1" 201 0
2026-03-28 14:06:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FYS71HNL%252F698284865%252F600') HTTP/1.1" 204 0
2026-03-28 14:06:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YS71HNL/698284865/600 saved to cache
2026-03-28 14:06:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 407ba07a-d347-557e-98dd-c9e1e020c5c1
2026-03-28 14:06:50 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:06:50 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:06:50 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:06:50 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:06:50 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:06:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:06:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2d9f8a10>
2026-03-28 14:06:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:06:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:06:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:06:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_755211f2-f13f-55e0-85f5-1079296d0fd3/755211f2-f13f-55e0-85f5-1079296d0fd3_image_7.jpg HTTP/1.1" 201 0
2026-03-28 14:06:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FYM19HXY%252F698042801%252F600') HTTP/1.1" 204 0
2026-03-28 14:06:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YM19HXY/698042801/600 saved to cache
2026-03-28 14:06:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 755211f2-f13f-55e0-85f5-1079296d0fd3
2026-03-28 14:06:50 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YA12SZX/698941402/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698941402>
2026-03-28 14:06:50 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YE57GFG/698947444/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698947444>
2026-03-28 14:06:50 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YS71HNL/698284877/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698284877>
2026-03-28 14:06:50 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YM19HXY/698042815/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698042815>
2026-03-28 14:06:50 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:06:50 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:06:50 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:06:50 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:06:50 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:06:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:06:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a30620650>
2026-03-28 14:06:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:06:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:06:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:06:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_755211f2-f13f-55e0-85f5-1079296d0fd3/755211f2-f13f-55e0-85f5-1079296d0fd3_image_6.jpg HTTP/1.1" 201 0
2026-03-28 14:06:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FYM19HXY%252F698042784%252F600') HTTP/1.1" 204 0
2026-03-28 14:06:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YM19HXY/698042784/600 saved to cache
2026-03-28 14:06:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 755211f2-f13f-55e0-85f5-1079296d0fd3
2026-03-28 14:06:50 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YA12SZX/698941364/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698941364>
2026-03-28 14:06:50 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YS71HNL/698284853/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698284853>
2026-03-28 14:06:50 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YM19HXY/698042731/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698042731>
2026-03-28 14:06:50 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YS71HNL/698284834/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698284834>
2026-03-28 14:06:50 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YA12SZX/698941318/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698941318>
2026-03-28 14:06:50 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YE57GFG/698947387/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698947387>
2026-03-28 14:06:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YM19HXY/698042828/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YM19HXY/42810006?sv=2020-08-04&st=2026-03-28T14%3A06%3A46Z&se=2026-03-28T14%3A31%3A46Z&sr=b&sp=r&sig=pY0duj0al0Djhca%2BC3PKfnyx3TV8v5FU4mqV41pF6EU%3D)
2026-03-28 14:06:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YA12SZX/698941445/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YA12SZX/42810210?sv=2020-08-04&st=2026-03-28T14%3A06%3A46Z&se=2026-03-28T14%3A31%3A46Z&sr=b&sp=r&sig=zAue20Kp3xOQLoka9kg3BuP79gs5tNiiEWLbZWTA87w%3D)
2026-03-28 14:06:50 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YE57GFG/698947309/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698947309>
2026-03-28 14:06:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YM19HXY/698042815/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YM19HXY/42810006?sv=2020-08-04&st=2026-03-28T14%3A06%3A46Z&se=2026-03-28T14%3A31%3A46Z&sr=b&sp=r&sig=pY0duj0al0Djhca%2BC3PKfnyx3TV8v5FU4mqV41pF6EU%3D)
2026-03-28 14:06:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YE57GFG/698947444/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YE57GFG/42810397?sv=2020-08-04&st=2026-03-28T14%3A06%3A44Z&se=2026-03-28T14%3A31%3A44Z&sr=b&sp=r&sig=vSjrPH68LNj6fTz0HIFdhL8jclPi5cOXfzhmxBIBToI%3D)
2026-03-28 14:06:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YA12SZX/698941464/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YA12SZX/42810210?sv=2020-08-04&st=2026-03-28T14%3A06%3A46Z&se=2026-03-28T14%3A31%3A46Z&sr=b&sp=r&sig=zAue20Kp3xOQLoka9kg3BuP79gs5tNiiEWLbZWTA87w%3D)
2026-03-28 14:06:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YA12SZX/698941427/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YA12SZX/42810210?sv=2020-08-04&st=2026-03-28T14%3A06%3A46Z&se=2026-03-28T14%3A31%3A46Z&sr=b&sp=r&sig=zAue20Kp3xOQLoka9kg3BuP79gs5tNiiEWLbZWTA87w%3D)
2026-03-28 14:06:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YA12SZX/698941402/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YA12SZX/42810210?sv=2020-08-04&st=2026-03-28T14%3A06%3A46Z&se=2026-03-28T14%3A31%3A46Z&sr=b&sp=r&sig=zAue20Kp3xOQLoka9kg3BuP79gs5tNiiEWLbZWTA87w%3D)
2026-03-28 14:06:50 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:06:50 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:06:50 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:06:50 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:06:50 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:06:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:06:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2dbbae50>
2026-03-28 14:06:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:06:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:06:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:06:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_755211f2-f13f-55e0-85f5-1079296d0fd3/755211f2-f13f-55e0-85f5-1079296d0fd3_image_9.jpg HTTP/1.1" 201 0
2026-03-28 14:06:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FYM19HXY%252F698042828%252F600') HTTP/1.1" 204 0
2026-03-28 14:06:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YM19HXY/698042828/600 saved to cache
2026-03-28 14:06:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 755211f2-f13f-55e0-85f5-1079296d0fd3
2026-03-28 14:06:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YS71HNL/698284853/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YS71HNL/42810026?sv=2020-08-04&st=2026-03-28T14%3A06%3A45Z&se=2026-03-28T14%3A31%3A45Z&sr=b&sp=r&sig=6LwnywW%2BQSGBv6J3youIITLgitPmhomB08N22i%2FPNp8%3D)
2026-03-28 14:06:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YA12SZX/698941364/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YA12SZX/42810210?sv=2020-08-04&st=2026-03-28T14%3A06%3A46Z&se=2026-03-28T14%3A31%3A46Z&sr=b&sp=r&sig=zAue20Kp3xOQLoka9kg3BuP79gs5tNiiEWLbZWTA87w%3D)
2026-03-28 14:06:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YM19HXY/698042731/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YM19HXY/42810006?sv=2020-08-04&st=2026-03-28T14%3A06%3A46Z&se=2026-03-28T14%3A31%3A46Z&sr=b&sp=r&sig=pY0duj0al0Djhca%2BC3PKfnyx3TV8v5FU4mqV41pF6EU%3D)
2026-03-28 14:06:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YE57GFG/698947387/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YE57GFG/42810397?sv=2020-08-04&st=2026-03-28T14%3A06%3A44Z&se=2026-03-28T14%3A31%3A44Z&sr=b&sp=r&sig=vSjrPH68LNj6fTz0HIFdhL8jclPi5cOXfzhmxBIBToI%3D)
2026-03-28 14:06:50 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YS71HNL/698284830/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698284830>
2026-03-28 14:06:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YA12SZX/698941318/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YA12SZX/42810210?sv=2020-08-04&st=2026-03-28T14%3A06%3A46Z&se=2026-03-28T14%3A31%3A46Z&sr=b&sp=r&sig=zAue20Kp3xOQLoka9kg3BuP79gs5tNiiEWLbZWTA87w%3D)
2026-03-28 14:06:50 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:06:50 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:06:50 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:06:50 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:06:50 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:06:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:06:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2dcf4a90>
2026-03-28 14:06:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:06:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:06:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:06:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0673e591-45ac-5d50-a3e1-15ce73402302/0673e591-45ac-5d50-a3e1-15ce73402302_image_8.jpg HTTP/1.1" 201 0
2026-03-28 14:06:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FYA12SZX%252F698941445%252F600') HTTP/1.1" 204 0
2026-03-28 14:06:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YA12SZX/698941445/600 saved to cache
2026-03-28 14:06:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 0673e591-45ac-5d50-a3e1-15ce73402302
2026-03-28 14:06:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YS71HNL/698284834/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YS71HNL/42810026?sv=2020-08-04&st=2026-03-28T14%3A06%3A45Z&se=2026-03-28T14%3A31%3A45Z&sr=b&sp=r&sig=6LwnywW%2BQSGBv6J3youIITLgitPmhomB08N22i%2FPNp8%3D)
2026-03-28 14:06:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YE57GFG/698947309/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YE57GFG/42810397?sv=2020-08-04&st=2026-03-28T14%3A06%3A44Z&se=2026-03-28T14%3A31%3A44Z&sr=b&sp=r&sig=vSjrPH68LNj6fTz0HIFdhL8jclPi5cOXfzhmxBIBToI%3D)
2026-03-28 14:06:50 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:06:50 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:06:50 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:06:50 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:06:50 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:06:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:06:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a1fe3ce90>
2026-03-28 14:06:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:06:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:06:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:06:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_755211f2-f13f-55e0-85f5-1079296d0fd3/755211f2-f13f-55e0-85f5-1079296d0fd3_image_8.jpg HTTP/1.1" 201 0
2026-03-28 14:06:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FYM19HXY%252F698042815%252F600') HTTP/1.1" 204 0
2026-03-28 14:06:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YM19HXY/698042815/600 saved to cache
2026-03-28 14:06:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 755211f2-f13f-55e0-85f5-1079296d0fd3
2026-03-28 14:06:50 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:06:50 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:06:50 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:06:50 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:06:50 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:06:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:06:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a1fe60190>
2026-03-28 14:06:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:06:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:06:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:06:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7a0ff710-890b-5157-a73c-3a4a72d88d1e/7a0ff710-890b-5157-a73c-3a4a72d88d1e_image_9.jpg HTTP/1.1" 201 0
2026-03-28 14:06:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FYE57GFG%252F698947444%252F600') HTTP/1.1" 204 0
2026-03-28 14:06:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YE57GFG/698947444/600 saved to cache
2026-03-28 14:06:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 7a0ff710-890b-5157-a73c-3a4a72d88d1e
2026-03-28 14:06:50 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:06:50 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:06:50 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:06:50 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:06:50 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:06:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:06:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c533910>
2026-03-28 14:06:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:06:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:06:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:06:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0673e591-45ac-5d50-a3e1-15ce73402302/0673e591-45ac-5d50-a3e1-15ce73402302_image_9.jpg HTTP/1.1" 201 0
2026-03-28 14:06:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FYA12SZX%252F698941464%252F600') HTTP/1.1" 204 0
2026-03-28 14:06:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YA12SZX/698941464/600 saved to cache
2026-03-28 14:06:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 0673e591-45ac-5d50-a3e1-15ce73402302
2026-03-28 14:06:50 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:06:50 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:06:50 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:06:50 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:06:50 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:06:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:06:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c9b4b10>
2026-03-28 14:06:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:06:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:06:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:06:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0673e591-45ac-5d50-a3e1-15ce73402302/0673e591-45ac-5d50-a3e1-15ce73402302_image_7.jpg HTTP/1.1" 201 0
2026-03-28 14:06:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FYA12SZX%252F698941427%252F600') HTTP/1.1" 204 0
2026-03-28 14:06:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YA12SZX/698941427/600 saved to cache
2026-03-28 14:06:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 0673e591-45ac-5d50-a3e1-15ce73402302
2026-03-28 14:06:50 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:06:50 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:06:50 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:06:50 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:06:50 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:06:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:06:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2d990210>
2026-03-28 14:06:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:06:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:06:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:06:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0673e591-45ac-5d50-a3e1-15ce73402302/0673e591-45ac-5d50-a3e1-15ce73402302_image_6.jpg HTTP/1.1" 201 0
2026-03-28 14:06:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FYA12SZX%252F698941402%252F600') HTTP/1.1" 204 0
2026-03-28 14:06:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YA12SZX/698941402/600 saved to cache
2026-03-28 14:06:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 0673e591-45ac-5d50-a3e1-15ce73402302
2026-03-28 14:06:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YS71HNL/698284877/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YS71HNL/42810026?sv=2020-08-04&st=2026-03-28T14%3A06%3A45Z&se=2026-03-28T14%3A31%3A45Z&sr=b&sp=r&sig=6LwnywW%2BQSGBv6J3youIITLgitPmhomB08N22i%2FPNp8%3D)
2026-03-28 14:06:50 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YS71HNL/698284827/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698284827>
2026-03-28 14:06:50 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YE57GFG/698947297/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698947297>
2026-03-28 14:06:50 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YD70WOM/698485002/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698485002>
2026-03-28 14:06:50 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YM19HXY/698042701/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698042701>
2026-03-28 14:06:50 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YA12SZX/698941310/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=YA12SZX-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-28 14:06:50 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YE57GFG/698947281/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698947281>
2026-03-28 14:06:50 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:06:50 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:06:50 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:06:50 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:06:50 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:06:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:06:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2d9d3810>
2026-03-28 14:06:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:06:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:06:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:06:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_407ba07a-d347-557e-98dd-c9e1e020c5c1/407ba07a-d347-557e-98dd-c9e1e020c5c1_image_7.jpg HTTP/1.1" 201 0
2026-03-28 14:06:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FYS71HNL%252F698284853%252F600') HTTP/1.1" 204 0
2026-03-28 14:06:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YS71HNL/698284853/600 saved to cache
2026-03-28 14:06:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 407ba07a-d347-557e-98dd-c9e1e020c5c1
2026-03-28 14:06:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:06:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c9b5b50>
2026-03-28 14:06:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:06:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:06:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:06:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0673e591-45ac-5d50-a3e1-15ce73402302/0673e591-45ac-5d50-a3e1-15ce73402302_image_4.jpg HTTP/1.1" 201 0
2026-03-28 14:06:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FYA12SZX%252F698941364%252F600') HTTP/1.1" 204 0
2026-03-28 14:06:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YA12SZX/698941364/600 saved to cache
2026-03-28 14:06:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 0673e591-45ac-5d50-a3e1-15ce73402302
2026-03-28 14:06:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:06:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2d83a490>
2026-03-28 14:06:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:06:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:06:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:06:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_755211f2-f13f-55e0-85f5-1079296d0fd3/755211f2-f13f-55e0-85f5-1079296d0fd3_image_3.jpg HTTP/1.1" 201 0
2026-03-28 14:06:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FYM19HXY%252F698042731%252F600') HTTP/1.1" 204 0
2026-03-28 14:06:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YM19HXY/698042731/600 saved to cache
2026-03-28 14:06:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 755211f2-f13f-55e0-85f5-1079296d0fd3
2026-03-28 14:06:51 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:06:51 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:06:51 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:06:51 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:06:51 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:06:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:06:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a1fe8d890>
2026-03-28 14:06:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:06:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:06:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:06:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7a0ff710-890b-5157-a73c-3a4a72d88d1e/7a0ff710-890b-5157-a73c-3a4a72d88d1e_image_7.jpg HTTP/1.1" 201 0
2026-03-28 14:06:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FYE57GFG%252F698947387%252F600') HTTP/1.1" 204 0
2026-03-28 14:06:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YE57GFG/698947387/600 saved to cache
2026-03-28 14:06:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 7a0ff710-890b-5157-a73c-3a4a72d88d1e
2026-03-28 14:06:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:06:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c98fad0>
2026-03-28 14:06:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:06:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:06:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:06:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0673e591-45ac-5d50-a3e1-15ce73402302/0673e591-45ac-5d50-a3e1-15ce73402302_image_1.jpg HTTP/1.1" 201 0
2026-03-28 14:06:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FYA12SZX%252F698941318%252F600') HTTP/1.1" 204 0
2026-03-28 14:06:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YA12SZX/698941318/600 saved to cache
2026-03-28 14:06:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 0673e591-45ac-5d50-a3e1-15ce73402302
2026-03-28 14:06:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:06:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c103310>
2026-03-28 14:06:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:06:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:06:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:06:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_407ba07a-d347-557e-98dd-c9e1e020c5c1/407ba07a-d347-557e-98dd-c9e1e020c5c1_image_5.jpg HTTP/1.1" 201 0
2026-03-28 14:06:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FYS71HNL%252F698284834%252F600') HTTP/1.1" 204 0
2026-03-28 14:06:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YS71HNL/698284834/600 saved to cache
2026-03-28 14:06:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 407ba07a-d347-557e-98dd-c9e1e020c5c1
2026-03-28 14:06:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:06:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2dea9090>
2026-03-28 14:06:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:06:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:06:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:06:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7a0ff710-890b-5157-a73c-3a4a72d88d1e/7a0ff710-890b-5157-a73c-3a4a72d88d1e_image_4.jpg HTTP/1.1" 201 0
2026-03-28 14:06:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FYE57GFG%252F698947309%252F600') HTTP/1.1" 204 0
2026-03-28 14:06:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YE57GFG/698947309/600 saved to cache
2026-03-28 14:06:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 7a0ff710-890b-5157-a73c-3a4a72d88d1e
2026-03-28 14:06:51 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YS71HNL/698284821/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698284821>
2026-03-28 14:06:51 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:06:51 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:06:51 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:06:51 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:06:51 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:06:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:06:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2de54590>
2026-03-28 14:06:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:06:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:06:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:06:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_407ba07a-d347-557e-98dd-c9e1e020c5c1/407ba07a-d347-557e-98dd-c9e1e020c5c1_image_9.jpg HTTP/1.1" 201 0
2026-03-28 14:06:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FYS71HNL%252F698284877%252F600') HTTP/1.1" 204 0
2026-03-28 14:06:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YS71HNL/698284877/600 saved to cache
2026-03-28 14:06:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 407ba07a-d347-557e-98dd-c9e1e020c5c1
2026-03-28 14:06:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YS71HNL/698284830/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YS71HNL/42810026?sv=2020-08-04&st=2026-03-28T14%3A06%3A45Z&se=2026-03-28T14%3A31%3A45Z&sr=b&sp=r&sig=6LwnywW%2BQSGBv6J3youIITLgitPmhomB08N22i%2FPNp8%3D)
2026-03-28 14:06:51 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DE04GDK/698934310/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698934310>
2026-03-28 14:06:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YE57GFG/698947281/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YE57GFG/42810397?sv=2020-08-04&st=2026-03-28T14%3A06%3A44Z&se=2026-03-28T14%3A31%3A44Z&sr=b&sp=r&sig=vSjrPH68LNj6fTz0HIFdhL8jclPi5cOXfzhmxBIBToI%3D)
2026-03-28 14:06:51 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YM19HXY/698042688/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=YM19HXY-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-28 14:06:51 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YD70WOM/698484992/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698484992>
2026-03-28 14:06:51 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AX15GHV/698225988/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698225988>
2026-03-28 14:06:51 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DE04GDK/698934334/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698934334>
2026-03-28 14:06:51 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YS71HNL/698284817/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698284817>
2026-03-28 14:06:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YA12SZX/698941310/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YA12SZX/42810210?sv=2020-08-04&st=2026-03-28T14%3A06%3A46Z&se=2026-03-28T14%3A31%3A46Z&sr=b&sp=r&sig=zAue20Kp3xOQLoka9kg3BuP79gs5tNiiEWLbZWTA87w%3D)
2026-03-28 14:06:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:06:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2dd55b90>
2026-03-28 14:06:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:06:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:06:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:06:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_407ba07a-d347-557e-98dd-c9e1e020c5c1/407ba07a-d347-557e-98dd-c9e1e020c5c1_image_4.jpg HTTP/1.1" 201 0
2026-03-28 14:06:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FYS71HNL%252F698284830%252F600') HTTP/1.1" 204 0
2026-03-28 14:06:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YS71HNL/698284830/600 saved to cache
2026-03-28 14:06:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 407ba07a-d347-557e-98dd-c9e1e020c5c1
2026-03-28 14:06:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YM19HXY/698042701/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YM19HXY/42810006?sv=2020-08-04&st=2026-03-28T14%3A06%3A46Z&se=2026-03-28T14%3A31%3A46Z&sr=b&sp=r&sig=pY0duj0al0Djhca%2BC3PKfnyx3TV8v5FU4mqV41pF6EU%3D)
2026-03-28 14:06:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YS71HNL/698284821/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YS71HNL/42810026?sv=2020-08-04&st=2026-03-28T14%3A06%3A45Z&se=2026-03-28T14%3A31%3A45Z&sr=b&sp=r&sig=6LwnywW%2BQSGBv6J3youIITLgitPmhomB08N22i%2FPNp8%3D)
2026-03-28 14:06:51 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YE57GFG/698947253/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=YE57GFG-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-28 14:06:51 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YS71HNL/698284814/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=YS71HNL-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-28 14:06:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YD70WOM/698485002/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YD70WOM/42810030?sv=2020-08-04&st=2026-03-28T14%3A06%3A44Z&se=2026-03-28T14%3A31%3A44Z&sr=b&sp=r&sig=zY0GlfRSinGMYhbbj%2BSacZWH49j2OuV6ot7DWpDFe%2Fk%3D)
2026-03-28 14:06:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:06:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c14b910>
2026-03-28 14:06:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:06:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:06:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:06:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7a0ff710-890b-5157-a73c-3a4a72d88d1e/7a0ff710-890b-5157-a73c-3a4a72d88d1e_image_2.jpg HTTP/1.1" 201 0
2026-03-28 14:06:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FYE57GFG%252F698947281%252F600') HTTP/1.1" 204 0
2026-03-28 14:06:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YE57GFG/698947281/600 saved to cache
2026-03-28 14:06:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 7a0ff710-890b-5157-a73c-3a4a72d88d1e
2026-03-28 14:06:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:06:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a30234850>
2026-03-28 14:06:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:06:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:06:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:06:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0673e591-45ac-5d50-a3e1-15ce73402302/0673e591-45ac-5d50-a3e1-15ce73402302_image_0.jpg HTTP/1.1" 201 0
2026-03-28 14:06:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FYA12SZX%252F698941310%252F600') HTTP/1.1" 204 0
2026-03-28 14:06:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YA12SZX/698941310/600 saved to cache
2026-03-28 14:06:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 0673e591-45ac-5d50-a3e1-15ce73402302
2026-03-28 14:06:52 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 0673e591-45ac-5d50-a3e1-15ce73402302, skipping ID generation
2026-03-28 14:06:52 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 0673e591-45ac-5d50-a3e1-15ce73402302 sending to next pipeline
2026-03-28 14:06:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 0673e591-45ac-5d50-a3e1-15ce73402302, identifier: YA12%20SZX
2026-03-28 14:06:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YS71HNL/698284827/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YS71HNL/42810026?sv=2020-08-04&st=2026-03-28T14%3A06%3A45Z&se=2026-03-28T14%3A31%3A45Z&sr=b&sp=r&sig=6LwnywW%2BQSGBv6J3youIITLgitPmhomB08N22i%2FPNp8%3D)
2026-03-28 14:06:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 0673e591-45ac-5d50-a3e1-15ce73402302 with identifier: YA12%20SZX
2026-03-28 14:06:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 0673e591-45ac-5d50-a3e1-15ce73402302 with identifier: YA12%20SZX
2026-03-28 14:06:52 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 0673e591-45ac-5d50-a3e1-15ce73402302 with identifier: YA12%20SZX to the API
2026-03-28 14:06:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:06:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:06:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YA12SZX/698941310/600>
{'auction_title': '',
'c_o_2_emission_value': 130,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0673e591-45ac-5d50-a3e1-15ce73402302/0673e591-45ac-5d50-a3e1-15ce73402302_expert_report_file_b8a5e848-ebb1-480c-9d05-10754f5fde12.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=YA12%20SZX-GB',
'category': 'Car',
'color': 'black',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.6L',
'expiration_date': '2026-03-29T10:00:00Z',
'fuel_type': 'Diesel',
'id': '0673e591-45ac-5d50-a3e1-15ce73402302',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'YA12 SZX',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=YA12%20SZX&vehicleType=*',
'listing': 'auction',
'location': 'Manchester',
'make': 'PEUGEOT',
'model': '3008',
'odometer': 147574,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 11,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0673e591-45ac-5d50-a3e1-15ce73402302/0673e591-45ac-5d50-a3e1-15ce73402302_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 46825,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YA12SZX/698941310/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0673e591-45ac-5d50-a3e1-15ce73402302/0673e591-45ac-5d50-a3e1-15ce73402302_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 44561,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YA12SZX/698941318/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0673e591-45ac-5d50-a3e1-15ce73402302/0673e591-45ac-5d50-a3e1-15ce73402302_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 44317,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YA12SZX/698941328/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0673e591-45ac-5d50-a3e1-15ce73402302/0673e591-45ac-5d50-a3e1-15ce73402302_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 47048,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YA12SZX/698941347/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0673e591-45ac-5d50-a3e1-15ce73402302/0673e591-45ac-5d50-a3e1-15ce73402302_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 44460,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YA12SZX/698941364/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0673e591-45ac-5d50-a3e1-15ce73402302/0673e591-45ac-5d50-a3e1-15ce73402302_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 41270,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YA12SZX/698941378/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0673e591-45ac-5d50-a3e1-15ce73402302/0673e591-45ac-5d50-a3e1-15ce73402302_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 109637,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YA12SZX/698941402/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0673e591-45ac-5d50-a3e1-15ce73402302/0673e591-45ac-5d50-a3e1-15ce73402302_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 76107,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YA12SZX/698941427/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0673e591-45ac-5d50-a3e1-15ce73402302/0673e591-45ac-5d50-a3e1-15ce73402302_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 79773,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YA12SZX/698941445/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0673e591-45ac-5d50-a3e1-15ce73402302/0673e591-45ac-5d50-a3e1-15ce73402302_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 78771,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YA12SZX/698941464/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2012-01-01',
'seller_name': None,
'title': 'PEUGEOT 3008 1.6 HDI 112 ACTIVE II MPV',
'transmission': 'manual',
'trim': 'HDI 112 ACTIVE II',
'vin': 'VF30U9HR8CS179542',
'year': 2012}
2026-03-28 14:06:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YA12%2520SZX%27 HTTP/1.1" 200 None
2026-03-28 14:06:52 [bca.uk] INFO: Saving data for YA12%20SZX: {'created_time': 1774706812.696504, 'last_price_update_time': 1774706812.696515, 'auction_closing_time': 1774778400.0}
2026-03-28 14:06:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='YA12%2520SZX') HTTP/1.1" 204 0
2026-03-28 14:06:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DE04GDK/698934310/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/DE04GDK/42809821?sv=2020-08-04&st=2026-03-28T14%3A06%3A43Z&se=2026-03-28T14%3A31%3A43Z&sr=b&sp=r&sig=Wg9UX1XBSOfklscjKMokjHFFw1lKRjgTlp8OjJ%2B2vVw%3D)
2026-03-28 14:06:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YE57GFG/698947297/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YE57GFG/42810397?sv=2020-08-04&st=2026-03-28T14%3A06%3A44Z&se=2026-03-28T14%3A31%3A44Z&sr=b&sp=r&sig=vSjrPH68LNj6fTz0HIFdhL8jclPi5cOXfzhmxBIBToI%3D)
2026-03-28 14:06:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YM19HXY/698042688/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YM19HXY/42810006?sv=2020-08-04&st=2026-03-28T14%3A06%3A46Z&se=2026-03-28T14%3A31%3A46Z&sr=b&sp=r&sig=pY0duj0al0Djhca%2BC3PKfnyx3TV8v5FU4mqV41pF6EU%3D)
2026-03-28 14:06:52 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DE04GDK/698934277/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698934277>
2026-03-28 14:06:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AX15GHV/698225988/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/AX15GHV/42810027?sv=2020-08-04&st=2026-03-28T14%3A06%3A43Z&se=2026-03-28T14%3A31%3A43Z&sr=b&sp=r&sig=JJpF40Yp%2FobLJQr3JyJKHMCuyadOw6pOe%2FflxZRZmFI%3D)
2026-03-28 14:06:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YD70WOM/698484992/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YD70WOM/42810030?sv=2020-08-04&st=2026-03-28T14%3A06%3A44Z&se=2026-03-28T14%3A31%3A44Z&sr=b&sp=r&sig=zY0GlfRSinGMYhbbj%2BSacZWH49j2OuV6ot7DWpDFe%2Fk%3D)
2026-03-28 14:06:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DE04GDK/698934334/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/DE04GDK/42809821?sv=2020-08-04&st=2026-03-28T14%3A06%3A43Z&se=2026-03-28T14%3A31%3A43Z&sr=b&sp=r&sig=Wg9UX1XBSOfklscjKMokjHFFw1lKRjgTlp8OjJ%2B2vVw%3D)
2026-03-28 14:06:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:06:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c9274d0>
2026-03-28 14:06:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:06:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:06:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:06:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_755211f2-f13f-55e0-85f5-1079296d0fd3/755211f2-f13f-55e0-85f5-1079296d0fd3_image_1.jpg HTTP/1.1" 201 0
2026-03-28 14:06:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FYM19HXY%252F698042701%252F600') HTTP/1.1" 204 0
2026-03-28 14:06:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YM19HXY/698042701/600 saved to cache
2026-03-28 14:06:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 755211f2-f13f-55e0-85f5-1079296d0fd3
2026-03-28 14:06:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:06:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2d83b9d0>
2026-03-28 14:06:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:06:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:06:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:06:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_407ba07a-d347-557e-98dd-c9e1e020c5c1/407ba07a-d347-557e-98dd-c9e1e020c5c1_image_2.jpg HTTP/1.1" 201 0
2026-03-28 14:06:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FYS71HNL%252F698284821%252F600') HTTP/1.1" 204 0
2026-03-28 14:06:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YS71HNL/698284821/600 saved to cache
2026-03-28 14:06:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 407ba07a-d347-557e-98dd-c9e1e020c5c1
2026-03-28 14:06:52 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:06:52 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:06:52 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:06:52 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:06:52 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:06:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:06:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c139f10>
2026-03-28 14:06:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:06:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:06:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:06:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d4588dea-a04d-50d3-a9af-4f8459203fea/d4588dea-a04d-50d3-a9af-4f8459203fea_image_8.jpg HTTP/1.1" 201 0
2026-03-28 14:06:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FYD70WOM%252F698485002%252F600') HTTP/1.1" 204 0
2026-03-28 14:06:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YD70WOM/698485002/600 saved to cache
2026-03-28 14:06:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item d4588dea-a04d-50d3-a9af-4f8459203fea
2026-03-28 14:06:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:06:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c628210>
2026-03-28 14:06:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:06:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:06:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:06:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_407ba07a-d347-557e-98dd-c9e1e020c5c1/407ba07a-d347-557e-98dd-c9e1e020c5c1_image_3.jpg HTTP/1.1" 201 0
2026-03-28 14:06:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FYS71HNL%252F698284827%252F600') HTTP/1.1" 204 0
2026-03-28 14:06:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YS71HNL/698284827/600 saved to cache
2026-03-28 14:06:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 407ba07a-d347-557e-98dd-c9e1e020c5c1
2026-03-28 14:06:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YS71HNL/698284814/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YS71HNL/42810026?sv=2020-08-04&st=2026-03-28T14%3A06%3A45Z&se=2026-03-28T14%3A31%3A45Z&sr=b&sp=r&sig=6LwnywW%2BQSGBv6J3youIITLgitPmhomB08N22i%2FPNp8%3D)
2026-03-28 14:06:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YE57GFG/698947253/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YE57GFG/42810397?sv=2020-08-04&st=2026-03-28T14%3A06%3A44Z&se=2026-03-28T14%3A31%3A44Z&sr=b&sp=r&sig=vSjrPH68LNj6fTz0HIFdhL8jclPi5cOXfzhmxBIBToI%3D)
2026-03-28 14:06:52 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AX15GHV/698225979/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698225979>
2026-03-28 14:06:52 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WJZ9285/698802751/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698802751>
2026-03-28 14:06:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YS71HNL/698284817/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YS71HNL/42810026?sv=2020-08-04&st=2026-03-28T14%3A06%3A45Z&se=2026-03-28T14%3A31%3A45Z&sr=b&sp=r&sig=6LwnywW%2BQSGBv6J3youIITLgitPmhomB08N22i%2FPNp8%3D)
2026-03-28 14:06:52 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AX15GHV/698225946/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698225946>
2026-03-28 14:06:52 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DE04GDK/698934195/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698934195>
2026-03-28 14:06:52 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:06:52 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:06:52 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:06:52 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:06:52 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:06:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:06:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2ca52890>
2026-03-28 14:06:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:06:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:06:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:06:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_842ae7be-18fd-5ebf-ace8-89e5a9f85a09/842ae7be-18fd-5ebf-ace8-89e5a9f85a09_image_8.jpg HTTP/1.1" 201 0
2026-03-28 14:06:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FDE04GDK%252F698934310%252F600') HTTP/1.1" 204 0
2026-03-28 14:06:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DE04GDK/698934310/600 saved to cache
2026-03-28 14:06:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 842ae7be-18fd-5ebf-ace8-89e5a9f85a09
2026-03-28 14:06:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:06:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c4d0810>
2026-03-28 14:06:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:06:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:06:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:06:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7a0ff710-890b-5157-a73c-3a4a72d88d1e/7a0ff710-890b-5157-a73c-3a4a72d88d1e_image_3.jpg HTTP/1.1" 201 0
2026-03-28 14:06:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FYE57GFG%252F698947297%252F600') HTTP/1.1" 204 0
2026-03-28 14:06:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YE57GFG/698947297/600 saved to cache
2026-03-28 14:06:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 7a0ff710-890b-5157-a73c-3a4a72d88d1e
2026-03-28 14:06:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:06:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2dea9b90>
2026-03-28 14:06:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:06:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:06:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:06:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_755211f2-f13f-55e0-85f5-1079296d0fd3/755211f2-f13f-55e0-85f5-1079296d0fd3_image_0.jpg HTTP/1.1" 201 0
2026-03-28 14:06:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FYM19HXY%252F698042688%252F600') HTTP/1.1" 204 0
2026-03-28 14:06:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YM19HXY/698042688/600 saved to cache
2026-03-28 14:06:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 755211f2-f13f-55e0-85f5-1079296d0fd3
2026-03-28 14:06:53 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 755211f2-f13f-55e0-85f5-1079296d0fd3, skipping ID generation
2026-03-28 14:06:53 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 755211f2-f13f-55e0-85f5-1079296d0fd3 sending to next pipeline
2026-03-28 14:06:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 755211f2-f13f-55e0-85f5-1079296d0fd3, identifier: YM19%20HXY
2026-03-28 14:06:53 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:06:53 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:06:53 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:06:53 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:06:53 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:06:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:06:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2dd86110>
2026-03-28 14:06:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:06:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:06:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:06:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_605bb574-f032-5f24-9f53-91befb051fec/605bb574-f032-5f24-9f53-91befb051fec_image_9.jpg HTTP/1.1" 201 0
2026-03-28 14:06:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FAX15GHV%252F698225988%252F600') HTTP/1.1" 204 0
2026-03-28 14:06:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AX15GHV/698225988/600 saved to cache
2026-03-28 14:06:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 605bb574-f032-5f24-9f53-91befb051fec
2026-03-28 14:06:53 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:06:53 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:06:53 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:06:53 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:06:53 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:06:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:06:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a1fe019d0>
2026-03-28 14:06:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:06:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:06:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:06:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d4588dea-a04d-50d3-a9af-4f8459203fea/d4588dea-a04d-50d3-a9af-4f8459203fea_image_7.jpg HTTP/1.1" 201 0
2026-03-28 14:06:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FYD70WOM%252F698484992%252F600') HTTP/1.1" 204 0
2026-03-28 14:06:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YD70WOM/698484992/600 saved to cache
2026-03-28 14:06:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item d4588dea-a04d-50d3-a9af-4f8459203fea
2026-03-28 14:06:53 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:06:53 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:06:53 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:06:53 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:06:53 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:06:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:06:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2dd348d0>
2026-03-28 14:06:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:06:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:06:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:06:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_842ae7be-18fd-5ebf-ace8-89e5a9f85a09/842ae7be-18fd-5ebf-ace8-89e5a9f85a09_image_9.jpg HTTP/1.1" 201 0
2026-03-28 14:06:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FDE04GDK%252F698934334%252F600') HTTP/1.1" 204 0
2026-03-28 14:06:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DE04GDK/698934334/600 saved to cache
2026-03-28 14:06:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 842ae7be-18fd-5ebf-ace8-89e5a9f85a09
2026-03-28 14:06:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 755211f2-f13f-55e0-85f5-1079296d0fd3 with identifier: YM19%20HXY
2026-03-28 14:06:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 755211f2-f13f-55e0-85f5-1079296d0fd3 with identifier: YM19%20HXY
2026-03-28 14:06:53 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 755211f2-f13f-55e0-85f5-1079296d0fd3 with identifier: YM19%20HXY to the API
2026-03-28 14:06:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:06:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:06:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YM19HXY/698042688/600>
{'auction_title': '',
'c_o_2_emission_value': 110,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_755211f2-f13f-55e0-85f5-1079296d0fd3/755211f2-f13f-55e0-85f5-1079296d0fd3_expert_report_file_b5da1aae-0ed7-40b6-9229-f9e2c6b98e7f.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=YM19%20HXY-GB',
'category': 'Car',
'color': 'grey',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.0L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol',
'id': '755211f2-f13f-55e0-85f5-1079296d0fd3',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'YM19 HXY',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=YM19%20HXY&vehicleType=*',
'listing': 'auction',
'location': 'Brighouse',
'make': 'FORD',
'model': 'FIESTA',
'odometer': 27667,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 11,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_755211f2-f13f-55e0-85f5-1079296d0fd3/755211f2-f13f-55e0-85f5-1079296d0fd3_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 50644,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YM19HXY/698042688/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_755211f2-f13f-55e0-85f5-1079296d0fd3/755211f2-f13f-55e0-85f5-1079296d0fd3_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 49590,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YM19HXY/698042701/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_755211f2-f13f-55e0-85f5-1079296d0fd3/755211f2-f13f-55e0-85f5-1079296d0fd3_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 43912,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YM19HXY/698042714/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_755211f2-f13f-55e0-85f5-1079296d0fd3/755211f2-f13f-55e0-85f5-1079296d0fd3_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 44026,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YM19HXY/698042731/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_755211f2-f13f-55e0-85f5-1079296d0fd3/755211f2-f13f-55e0-85f5-1079296d0fd3_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 43902,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YM19HXY/698042746/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_755211f2-f13f-55e0-85f5-1079296d0fd3/755211f2-f13f-55e0-85f5-1079296d0fd3_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 44336,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YM19HXY/698042762/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_755211f2-f13f-55e0-85f5-1079296d0fd3/755211f2-f13f-55e0-85f5-1079296d0fd3_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 94391,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YM19HXY/698042784/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_755211f2-f13f-55e0-85f5-1079296d0fd3/755211f2-f13f-55e0-85f5-1079296d0fd3_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 80096,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YM19HXY/698042801/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_755211f2-f13f-55e0-85f5-1079296d0fd3/755211f2-f13f-55e0-85f5-1079296d0fd3_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 89635,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YM19HXY/698042815/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_755211f2-f13f-55e0-85f5-1079296d0fd3/755211f2-f13f-55e0-85f5-1079296d0fd3_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 78568,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YM19HXY/698042828/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-01-01',
'seller_name': None,
'title': 'FORD FIESTA 1.0 E/B 125 TITANIUM Hatchback',
'transmission': 'manual',
'trim': 'E/B 125 TITANIUM',
'vin': 'WF0JXXGAHJKK13523',
'year': 2019}
2026-03-28 14:06:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YM19%2520HXY%27 HTTP/1.1" 200 None
2026-03-28 14:06:53 [bca.uk] INFO: Saving data for YM19%20HXY: {'created_time': 1774706813.698929, 'last_price_update_time': 1774706813.698943, 'auction_closing_time': 1774864800.0}
2026-03-28 14:06:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='YM19%2520HXY') HTTP/1.1" 204 0
2026-03-28 14:06:53 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YD70WOM/698484961/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698484961>
2026-03-28 14:06:53 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AX15GHV/698225935/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698225935>
2026-03-28 14:06:53 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YD70WOM/698484955/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698484955>
2026-03-28 14:06:53 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WJZ9285/698802675/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698802675>
2026-03-28 14:06:53 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WJZ9285/698802705/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698802705>
2026-03-28 14:06:53 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YD70WOM/698484950/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=YD70WOM-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-28 14:06:53 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WJZ9285/698802645/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698802645>
2026-03-28 14:06:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DE04GDK/698934277/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/DE04GDK/42809821?sv=2020-08-04&st=2026-03-28T14%3A06%3A43Z&se=2026-03-28T14%3A31%3A43Z&sr=b&sp=r&sig=Wg9UX1XBSOfklscjKMokjHFFw1lKRjgTlp8OjJ%2B2vVw%3D)
2026-03-28 14:06:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:06:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2d742e50>
2026-03-28 14:06:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:06:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:06:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:06:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_407ba07a-d347-557e-98dd-c9e1e020c5c1/407ba07a-d347-557e-98dd-c9e1e020c5c1_image_0.jpg HTTP/1.1" 201 0
2026-03-28 14:06:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FYS71HNL%252F698284814%252F600') HTTP/1.1" 204 0
2026-03-28 14:06:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YS71HNL/698284814/600 saved to cache
2026-03-28 14:06:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 407ba07a-d347-557e-98dd-c9e1e020c5c1
2026-03-28 14:06:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:06:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2d7430d0>
2026-03-28 14:06:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:06:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:06:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:06:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7a0ff710-890b-5157-a73c-3a4a72d88d1e/7a0ff710-890b-5157-a73c-3a4a72d88d1e_image_0.jpg HTTP/1.1" 201 0
2026-03-28 14:06:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FYE57GFG%252F698947253%252F600') HTTP/1.1" 204 0
2026-03-28 14:06:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YE57GFG/698947253/600 saved to cache
2026-03-28 14:06:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 7a0ff710-890b-5157-a73c-3a4a72d88d1e
2026-03-28 14:06:53 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 7a0ff710-890b-5157-a73c-3a4a72d88d1e, skipping ID generation
2026-03-28 14:06:53 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 7a0ff710-890b-5157-a73c-3a4a72d88d1e sending to next pipeline
2026-03-28 14:06:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 7a0ff710-890b-5157-a73c-3a4a72d88d1e, identifier: YE57%20GFG
2026-03-28 14:06:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:06:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c534a10>
2026-03-28 14:06:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:06:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:06:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:06:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_407ba07a-d347-557e-98dd-c9e1e020c5c1/407ba07a-d347-557e-98dd-c9e1e020c5c1_image_1.jpg HTTP/1.1" 201 0
2026-03-28 14:06:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FYS71HNL%252F698284817%252F600') HTTP/1.1" 204 0
2026-03-28 14:06:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YS71HNL/698284817/600 saved to cache
2026-03-28 14:06:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 407ba07a-d347-557e-98dd-c9e1e020c5c1
2026-03-28 14:06:54 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 407ba07a-d347-557e-98dd-c9e1e020c5c1, skipping ID generation
2026-03-28 14:06:54 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 407ba07a-d347-557e-98dd-c9e1e020c5c1 sending to next pipeline
2026-03-28 14:06:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 407ba07a-d347-557e-98dd-c9e1e020c5c1, identifier: YS71%20HNL
2026-03-28 14:06:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 7a0ff710-890b-5157-a73c-3a4a72d88d1e with identifier: YE57%20GFG
2026-03-28 14:06:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 7a0ff710-890b-5157-a73c-3a4a72d88d1e with identifier: YE57%20GFG
2026-03-28 14:06:54 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 7a0ff710-890b-5157-a73c-3a4a72d88d1e with identifier: YE57%20GFG to the API
2026-03-28 14:06:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:06:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:06:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YE57GFG/698947253/600>
{'auction_title': '',
'c_o_2_emission_value': 191,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7a0ff710-890b-5157-a73c-3a4a72d88d1e/7a0ff710-890b-5157-a73c-3a4a72d88d1e_expert_report_file_0ac65636-8d34-481e-9d64-dd74c3374bd1.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=YE57%20GFG-GB',
'category': 'Car',
'color': 'blue',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.6L',
'expiration_date': '2026-03-29T10:00:00Z',
'fuel_type': 'Petrol',
'id': '7a0ff710-890b-5157-a73c-3a4a72d88d1e',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'YE57 GFG',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=YE57%20GFG&vehicleType=*',
'listing': 'auction',
'location': 'Manchester',
'make': 'RENAULT',
'model': 'SCENIC',
'odometer': 99475,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 11,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7a0ff710-890b-5157-a73c-3a4a72d88d1e/7a0ff710-890b-5157-a73c-3a4a72d88d1e_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 44209,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YE57GFG/698947253/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7a0ff710-890b-5157-a73c-3a4a72d88d1e/7a0ff710-890b-5157-a73c-3a4a72d88d1e_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 45156,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YE57GFG/698947271/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7a0ff710-890b-5157-a73c-3a4a72d88d1e/7a0ff710-890b-5157-a73c-3a4a72d88d1e_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 44976,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YE57GFG/698947281/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7a0ff710-890b-5157-a73c-3a4a72d88d1e/7a0ff710-890b-5157-a73c-3a4a72d88d1e_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 44621,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YE57GFG/698947297/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7a0ff710-890b-5157-a73c-3a4a72d88d1e/7a0ff710-890b-5157-a73c-3a4a72d88d1e_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 45389,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YE57GFG/698947309/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7a0ff710-890b-5157-a73c-3a4a72d88d1e/7a0ff710-890b-5157-a73c-3a4a72d88d1e_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 44993,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YE57GFG/698947322/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7a0ff710-890b-5157-a73c-3a4a72d88d1e/7a0ff710-890b-5157-a73c-3a4a72d88d1e_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 91707,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YE57GFG/698947349/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7a0ff710-890b-5157-a73c-3a4a72d88d1e/7a0ff710-890b-5157-a73c-3a4a72d88d1e_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 72901,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YE57GFG/698947387/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7a0ff710-890b-5157-a73c-3a4a72d88d1e/7a0ff710-890b-5157-a73c-3a4a72d88d1e_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 83706,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YE57GFG/698947421/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7a0ff710-890b-5157-a73c-3a4a72d88d1e/7a0ff710-890b-5157-a73c-3a4a72d88d1e_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 65348,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YE57GFG/698947444/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2007-01-01',
'seller_name': None,
'title': 'RENAULT SCENIC 1.6 VVT DYNAMIQUE MPV',
'transmission': 'automatic',
'trim': 'VVT DYNAMIQUE',
'vin': 'VF1JM1R0A38690912',
'year': 2007}
2026-03-28 14:06:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YE57%2520GFG%27 HTTP/1.1" 200 None
2026-03-28 14:06:54 [bca.uk] INFO: Saving data for YE57%20GFG: {'created_time': 1774706814.556164, 'last_price_update_time': 1774706814.556177, 'auction_closing_time': 1774778400.0}
2026-03-28 14:06:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='YE57%2520GFG') HTTP/1.1" 204 0
2026-03-28 14:06:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 407ba07a-d347-557e-98dd-c9e1e020c5c1 with identifier: YS71%20HNL
2026-03-28 14:06:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 407ba07a-d347-557e-98dd-c9e1e020c5c1 with identifier: YS71%20HNL
2026-03-28 14:06:54 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 407ba07a-d347-557e-98dd-c9e1e020c5c1 with identifier: YS71%20HNL to the API
2026-03-28 14:06:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:06:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:06:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YS71HNL/698284817/600>
{'auction_title': '',
'c_o_2_emission_value': 112,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_407ba07a-d347-557e-98dd-c9e1e020c5c1/407ba07a-d347-557e-98dd-c9e1e020c5c1_expert_report_file_8f1e01e8-6aeb-4bae-adea-e5317ca32814.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=YS71%20HNL-GB',
'category': 'Car',
'color': 'black',
'currency': 'GBP',
'doors_number': 3,
'engine': '1.0L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol',
'id': '407ba07a-d347-557e-98dd-c9e1e020c5c1',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'YS71 HNL',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=YS71%20HNL&vehicleType=*',
'listing': 'auction',
'location': 'Brighouse',
'make': 'FIAT',
'model': '500',
'odometer': 27474,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 11,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_407ba07a-d347-557e-98dd-c9e1e020c5c1/407ba07a-d347-557e-98dd-c9e1e020c5c1_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 46888,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YS71HNL/698284814/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_407ba07a-d347-557e-98dd-c9e1e020c5c1/407ba07a-d347-557e-98dd-c9e1e020c5c1_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 45220,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YS71HNL/698284817/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_407ba07a-d347-557e-98dd-c9e1e020c5c1/407ba07a-d347-557e-98dd-c9e1e020c5c1_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 43314,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YS71HNL/698284821/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_407ba07a-d347-557e-98dd-c9e1e020c5c1/407ba07a-d347-557e-98dd-c9e1e020c5c1_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 43338,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YS71HNL/698284827/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_407ba07a-d347-557e-98dd-c9e1e020c5c1/407ba07a-d347-557e-98dd-c9e1e020c5c1_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 39835,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YS71HNL/698284830/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_407ba07a-d347-557e-98dd-c9e1e020c5c1/407ba07a-d347-557e-98dd-c9e1e020c5c1_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 40321,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YS71HNL/698284834/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_407ba07a-d347-557e-98dd-c9e1e020c5c1/407ba07a-d347-557e-98dd-c9e1e020c5c1_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 109711,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YS71HNL/698284843/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_407ba07a-d347-557e-98dd-c9e1e020c5c1/407ba07a-d347-557e-98dd-c9e1e020c5c1_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 54858,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YS71HNL/698284853/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_407ba07a-d347-557e-98dd-c9e1e020c5c1/407ba07a-d347-557e-98dd-c9e1e020c5c1_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 87789,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YS71HNL/698284865/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_407ba07a-d347-557e-98dd-c9e1e020c5c1/407ba07a-d347-557e-98dd-c9e1e020c5c1_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 88520,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YS71HNL/698284877/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-01-01',
'seller_name': None,
'title': 'FIAT 500 1.0 M/H HEY GOOGLE Hatchback',
'transmission': 'manual',
'trim': 'M/H HEY GOOGLE',
'vin': 'ZFACF1DJ2NJF59730',
'year': 2022}
2026-03-28 14:06:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YS71%2520HNL%27 HTTP/1.1" 200 None
2026-03-28 14:06:54 [bca.uk] INFO: Saving data for YS71%20HNL: {'created_time': 1774706814.96178, 'last_price_update_time': 1774706814.961791, 'auction_closing_time': 1774864800.0}
2026-03-28 14:06:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='YS71%2520HNL') HTTP/1.1" 204 0
2026-03-28 14:06:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DE04GDK/698934195/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/DE04GDK/42809821?sv=2020-08-04&st=2026-03-28T14%3A06%3A43Z&se=2026-03-28T14%3A31%3A43Z&sr=b&sp=r&sig=Wg9UX1XBSOfklscjKMokjHFFw1lKRjgTlp8OjJ%2B2vVw%3D)
2026-03-28 14:06:54 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AX15GHV/698225924/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698225924>
2026-03-28 14:06:54 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AX15GHV/698225929/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698225929>
2026-03-28 14:06:54 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DE04GDK/698934169/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698934169>
2026-03-28 14:06:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AX15GHV/698225946/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/AX15GHV/42810027?sv=2020-08-04&st=2026-03-28T14%3A06%3A43Z&se=2026-03-28T14%3A31%3A43Z&sr=b&sp=r&sig=JJpF40Yp%2FobLJQr3JyJKHMCuyadOw6pOe%2FflxZRZmFI%3D)
2026-03-28 14:06:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WJZ9285/698802645/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/WJZ9285/42807443?sv=2020-08-04&st=2026-03-28T14%3A06%3A43Z&se=2026-03-28T14%3A31%3A43Z&sr=b&sp=r&sig=kzptaA1%2FD51a3%2B3HLrofooYM2z1oDwBGLmUC%2BIEZYW0%3D)
2026-03-28 14:06:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AX15GHV/698225979/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/AX15GHV/42810027?sv=2020-08-04&st=2026-03-28T14%3A06%3A43Z&se=2026-03-28T14%3A31%3A43Z&sr=b&sp=r&sig=JJpF40Yp%2FobLJQr3JyJKHMCuyadOw6pOe%2FflxZRZmFI%3D)
2026-03-28 14:06:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WJZ9285/698802751/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/WJZ9285/42807443?sv=2020-08-04&st=2026-03-28T14%3A06%3A43Z&se=2026-03-28T14%3A31%3A43Z&sr=b&sp=r&sig=kzptaA1%2FD51a3%2B3HLrofooYM2z1oDwBGLmUC%2BIEZYW0%3D)
2026-03-28 14:06:55 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:06:55 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:06:55 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:06:55 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:06:55 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:06:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:06:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a3008e250>
2026-03-28 14:06:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:06:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:06:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:06:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_842ae7be-18fd-5ebf-ace8-89e5a9f85a09/842ae7be-18fd-5ebf-ace8-89e5a9f85a09_image_7.jpg HTTP/1.1" 201 0
2026-03-28 14:06:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FDE04GDK%252F698934277%252F600') HTTP/1.1" 204 0
2026-03-28 14:06:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DE04GDK/698934277/600 saved to cache
2026-03-28 14:06:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 842ae7be-18fd-5ebf-ace8-89e5a9f85a09
2026-03-28 14:06:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:06:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2d901350>
2026-03-28 14:06:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:06:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:06:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:06:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_842ae7be-18fd-5ebf-ace8-89e5a9f85a09/842ae7be-18fd-5ebf-ace8-89e5a9f85a09_image_4.jpg HTTP/1.1" 201 0
2026-03-28 14:06:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FDE04GDK%252F698934195%252F600') HTTP/1.1" 204 0
2026-03-28 14:06:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DE04GDK/698934195/600 saved to cache
2026-03-28 14:06:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 842ae7be-18fd-5ebf-ace8-89e5a9f85a09
2026-03-28 14:06:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YD70WOM/698484961/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YD70WOM/42810030?sv=2020-08-04&st=2026-03-28T14%3A06%3A44Z&se=2026-03-28T14%3A31%3A44Z&sr=b&sp=r&sig=zY0GlfRSinGMYhbbj%2BSacZWH49j2OuV6ot7DWpDFe%2Fk%3D)
2026-03-28 14:06:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DE04GDK/698934169/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/DE04GDK/42809821?sv=2020-08-04&st=2026-03-28T14%3A06%3A43Z&se=2026-03-28T14%3A31%3A43Z&sr=b&sp=r&sig=Wg9UX1XBSOfklscjKMokjHFFw1lKRjgTlp8OjJ%2B2vVw%3D)
2026-03-28 14:06:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YD70WOM/698484950/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YD70WOM/42810030?sv=2020-08-04&st=2026-03-28T14%3A06%3A44Z&se=2026-03-28T14%3A31%3A44Z&sr=b&sp=r&sig=zY0GlfRSinGMYhbbj%2BSacZWH49j2OuV6ot7DWpDFe%2Fk%3D)
2026-03-28 14:06:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YD70WOM/698484955/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YD70WOM/42810030?sv=2020-08-04&st=2026-03-28T14%3A06%3A44Z&se=2026-03-28T14%3A31%3A44Z&sr=b&sp=r&sig=zY0GlfRSinGMYhbbj%2BSacZWH49j2OuV6ot7DWpDFe%2Fk%3D)
2026-03-28 14:06:55 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AX15GHV/698225917/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=AX15GHV-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-28 14:06:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:06:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c127dd0>
2026-03-28 14:06:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:06:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:06:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:06:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_605bb574-f032-5f24-9f53-91befb051fec/605bb574-f032-5f24-9f53-91befb051fec_image_5.jpg HTTP/1.1" 201 0
2026-03-28 14:06:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FAX15GHV%252F698225946%252F600') HTTP/1.1" 204 0
2026-03-28 14:06:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AX15GHV/698225946/600 saved to cache
2026-03-28 14:06:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 605bb574-f032-5f24-9f53-91befb051fec
2026-03-28 14:06:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:06:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c126750>
2026-03-28 14:06:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:06:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:06:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:06:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a149de9c-cfcc-5dd2-a714-96be3f56b350/a149de9c-cfcc-5dd2-a714-96be3f56b350_image_4.jpg HTTP/1.1" 201 0
2026-03-28 14:06:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FWJZ9285%252F698802645%252F600') HTTP/1.1" 204 0
2026-03-28 14:06:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WJZ9285/698802645/600 saved to cache
2026-03-28 14:06:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item a149de9c-cfcc-5dd2-a714-96be3f56b350
2026-03-28 14:06:55 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:06:55 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:06:55 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:06:55 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:06:55 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:06:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:06:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2dd55550>
2026-03-28 14:06:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:06:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:06:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:06:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_605bb574-f032-5f24-9f53-91befb051fec/605bb574-f032-5f24-9f53-91befb051fec_image_8.jpg HTTP/1.1" 201 0
2026-03-28 14:06:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FAX15GHV%252F698225979%252F600') HTTP/1.1" 204 0
2026-03-28 14:06:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AX15GHV/698225979/600 saved to cache
2026-03-28 14:06:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 605bb574-f032-5f24-9f53-91befb051fec
2026-03-28 14:06:55 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:06:55 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:06:55 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:06:55 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:06:55 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:06:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:06:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a1fdb46d0>
2026-03-28 14:06:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:06:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:06:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:06:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a149de9c-cfcc-5dd2-a714-96be3f56b350/a149de9c-cfcc-5dd2-a714-96be3f56b350_image_8.jpg HTTP/1.1" 201 0
2026-03-28 14:06:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FWJZ9285%252F698802751%252F600') HTTP/1.1" 204 0
2026-03-28 14:06:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WJZ9285/698802751/600 saved to cache
2026-03-28 14:06:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item a149de9c-cfcc-5dd2-a714-96be3f56b350
2026-03-28 14:06:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WJZ9285/698802675/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/WJZ9285/42807443?sv=2020-08-04&st=2026-03-28T14%3A06%3A43Z&se=2026-03-28T14%3A31%3A43Z&sr=b&sp=r&sig=kzptaA1%2FD51a3%2B3HLrofooYM2z1oDwBGLmUC%2BIEZYW0%3D)
2026-03-28 14:06:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AX15GHV/698225935/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/AX15GHV/42810027?sv=2020-08-04&st=2026-03-28T14%3A06%3A43Z&se=2026-03-28T14%3A31%3A43Z&sr=b&sp=r&sig=JJpF40Yp%2FobLJQr3JyJKHMCuyadOw6pOe%2FflxZRZmFI%3D)
2026-03-28 14:06:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AX15GHV/698225929/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/AX15GHV/42810027?sv=2020-08-04&st=2026-03-28T14%3A06%3A43Z&se=2026-03-28T14%3A31%3A43Z&sr=b&sp=r&sig=JJpF40Yp%2FobLJQr3JyJKHMCuyadOw6pOe%2FflxZRZmFI%3D)
2026-03-28 14:06:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AX15GHV/698225924/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/AX15GHV/42810027?sv=2020-08-04&st=2026-03-28T14%3A06%3A43Z&se=2026-03-28T14%3A31%3A43Z&sr=b&sp=r&sig=JJpF40Yp%2FobLJQr3JyJKHMCuyadOw6pOe%2FflxZRZmFI%3D)
2026-03-28 14:06:55 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DF12VWL/698228838/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698228838>
2026-03-28 14:06:55 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CK18AEJ/698910428/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698910428>
2026-03-28 14:06:55 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LK64NEJ/698947115/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698947115>
2026-03-28 14:06:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WJZ9285/698802705/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/WJZ9285/42807443?sv=2020-08-04&st=2026-03-28T14%3A06%3A43Z&se=2026-03-28T14%3A31%3A43Z&sr=b&sp=r&sig=kzptaA1%2FD51a3%2B3HLrofooYM2z1oDwBGLmUC%2BIEZYW0%3D)
2026-03-28 14:06:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:06:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2dd56f50>
2026-03-28 14:06:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:06:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:06:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:06:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d4588dea-a04d-50d3-a9af-4f8459203fea/d4588dea-a04d-50d3-a9af-4f8459203fea_image_2.jpg HTTP/1.1" 201 0
2026-03-28 14:06:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FYD70WOM%252F698484961%252F600') HTTP/1.1" 204 0
2026-03-28 14:06:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YD70WOM/698484961/600 saved to cache
2026-03-28 14:06:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item d4588dea-a04d-50d3-a9af-4f8459203fea
2026-03-28 14:06:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:06:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a1fe380d0>
2026-03-28 14:06:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:06:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:06:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:06:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_842ae7be-18fd-5ebf-ace8-89e5a9f85a09/842ae7be-18fd-5ebf-ace8-89e5a9f85a09_image_1.jpg HTTP/1.1" 201 0
2026-03-28 14:06:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FDE04GDK%252F698934169%252F600') HTTP/1.1" 204 0
2026-03-28 14:06:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DE04GDK/698934169/600 saved to cache
2026-03-28 14:06:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 842ae7be-18fd-5ebf-ace8-89e5a9f85a09
2026-03-28 14:06:55 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 842ae7be-18fd-5ebf-ace8-89e5a9f85a09, skipping ID generation
2026-03-28 14:06:55 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 842ae7be-18fd-5ebf-ace8-89e5a9f85a09 sending to next pipeline
2026-03-28 14:06:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 842ae7be-18fd-5ebf-ace8-89e5a9f85a09, identifier: DE04%20GDK
2026-03-28 14:06:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:06:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2de03bd0>
2026-03-28 14:06:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:06:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:06:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:06:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d4588dea-a04d-50d3-a9af-4f8459203fea/d4588dea-a04d-50d3-a9af-4f8459203fea_image_0.jpg HTTP/1.1" 201 0
2026-03-28 14:06:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FYD70WOM%252F698484950%252F600') HTTP/1.1" 204 0
2026-03-28 14:06:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YD70WOM/698484950/600 saved to cache
2026-03-28 14:06:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item d4588dea-a04d-50d3-a9af-4f8459203fea
2026-03-28 14:06:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:06:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2d7b7a90>
2026-03-28 14:06:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:06:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:06:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:06:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d4588dea-a04d-50d3-a9af-4f8459203fea/d4588dea-a04d-50d3-a9af-4f8459203fea_image_1.jpg HTTP/1.1" 201 0
2026-03-28 14:06:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FYD70WOM%252F698484955%252F600') HTTP/1.1" 204 0
2026-03-28 14:06:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YD70WOM/698484955/600 saved to cache
2026-03-28 14:06:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item d4588dea-a04d-50d3-a9af-4f8459203fea
2026-03-28 14:06:55 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: d4588dea-a04d-50d3-a9af-4f8459203fea, skipping ID generation
2026-03-28 14:06:55 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item d4588dea-a04d-50d3-a9af-4f8459203fea sending to next pipeline
2026-03-28 14:06:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: d4588dea-a04d-50d3-a9af-4f8459203fea, identifier: YD70%20WOM
2026-03-28 14:06:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 842ae7be-18fd-5ebf-ace8-89e5a9f85a09 with identifier: DE04%20GDK
2026-03-28 14:06:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 842ae7be-18fd-5ebf-ace8-89e5a9f85a09 with identifier: DE04%20GDK
2026-03-28 14:06:55 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 842ae7be-18fd-5ebf-ace8-89e5a9f85a09 with identifier: DE04%20GDK to the API
2026-03-28 14:06:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:06:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:06:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DE04GDK/698934169/600>
{'auction_title': '',
'c_o_2_emission_value': 142,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_842ae7be-18fd-5ebf-ace8-89e5a9f85a09/842ae7be-18fd-5ebf-ace8-89e5a9f85a09_expert_report_file_1788d936-8224-4798-ba54-3208f80a838e.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=DE04%20GDK-GB',
'category': 'Car',
'color': 'red',
'currency': 'GBP',
'doors_number': 3,
'engine': '1.2L',
'expiration_date': '2026-03-29T10:00:00Z',
'fuel_type': 'Petrol',
'id': '842ae7be-18fd-5ebf-ace8-89e5a9f85a09',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'DE04 GDK',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=DE04%20GDK&vehicleType=*',
'listing': 'auction',
'location': 'Manchester',
'make': 'VOLKSWAGEN',
'model': 'POLO',
'odometer': 83858,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 11,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_842ae7be-18fd-5ebf-ace8-89e5a9f85a09/842ae7be-18fd-5ebf-ace8-89e5a9f85a09_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 44943,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DE04GDK/698934159/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_842ae7be-18fd-5ebf-ace8-89e5a9f85a09/842ae7be-18fd-5ebf-ace8-89e5a9f85a09_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 45897,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DE04GDK/698934169/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_842ae7be-18fd-5ebf-ace8-89e5a9f85a09/842ae7be-18fd-5ebf-ace8-89e5a9f85a09_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 45374,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DE04GDK/698934177/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_842ae7be-18fd-5ebf-ace8-89e5a9f85a09/842ae7be-18fd-5ebf-ace8-89e5a9f85a09_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 45026,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DE04GDK/698934187/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_842ae7be-18fd-5ebf-ace8-89e5a9f85a09/842ae7be-18fd-5ebf-ace8-89e5a9f85a09_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 43403,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DE04GDK/698934195/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_842ae7be-18fd-5ebf-ace8-89e5a9f85a09/842ae7be-18fd-5ebf-ace8-89e5a9f85a09_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 42675,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DE04GDK/698934210/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_842ae7be-18fd-5ebf-ace8-89e5a9f85a09/842ae7be-18fd-5ebf-ace8-89e5a9f85a09_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 99587,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DE04GDK/698934241/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_842ae7be-18fd-5ebf-ace8-89e5a9f85a09/842ae7be-18fd-5ebf-ace8-89e5a9f85a09_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 50339,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DE04GDK/698934277/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_842ae7be-18fd-5ebf-ace8-89e5a9f85a09/842ae7be-18fd-5ebf-ace8-89e5a9f85a09_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 88065,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DE04GDK/698934310/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_842ae7be-18fd-5ebf-ace8-89e5a9f85a09/842ae7be-18fd-5ebf-ace8-89e5a9f85a09_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 84747,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DE04GDK/698934334/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2004-01-01',
'seller_name': None,
'title': 'VOLKSWAGEN POLO 1.2 E 55 Hatchback',
'transmission': 'manual',
'trim': 'E 55',
'vin': 'WVWZZZ9NZ4Y146877',
'year': 2004}
2026-03-28 14:06:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DE04%2520GDK%27 HTTP/1.1" 200 None
2026-03-28 14:06:56 [bca.uk] INFO: Saving data for DE04%20GDK: {'created_time': 1774706816.162719, 'last_price_update_time': 1774706816.162734, 'auction_closing_time': 1774778400.0}
2026-03-28 14:06:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='DE04%2520GDK') HTTP/1.1" 204 0
2026-03-28 14:06:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: d4588dea-a04d-50d3-a9af-4f8459203fea with identifier: YD70%20WOM
2026-03-28 14:06:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: d4588dea-a04d-50d3-a9af-4f8459203fea with identifier: YD70%20WOM
2026-03-28 14:06:56 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: d4588dea-a04d-50d3-a9af-4f8459203fea with identifier: YD70%20WOM to the API
2026-03-28 14:06:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:06:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:06:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YD70WOM/698484955/600>
{'auction_title': '',
'c_o_2_emission_value': 155,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d4588dea-a04d-50d3-a9af-4f8459203fea/d4588dea-a04d-50d3-a9af-4f8459203fea_expert_report_file_0da466ff-630c-4dcf-8bbd-4b48ff29361a.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=YD70%20WOM-GB',
'category': 'Car',
'color': 'black',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.5L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol',
'id': 'd4588dea-a04d-50d3-a9af-4f8459203fea',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'YD70 WOM',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=YD70%20WOM&vehicleType=*',
'listing': 'auction',
'location': 'Brighouse',
'make': 'MG MOTOR UK',
'model': 'ZS',
'odometer': 41262,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 11,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d4588dea-a04d-50d3-a9af-4f8459203fea/d4588dea-a04d-50d3-a9af-4f8459203fea_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 48932,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YD70WOM/698484950/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d4588dea-a04d-50d3-a9af-4f8459203fea/d4588dea-a04d-50d3-a9af-4f8459203fea_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 46367,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YD70WOM/698484955/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d4588dea-a04d-50d3-a9af-4f8459203fea/d4588dea-a04d-50d3-a9af-4f8459203fea_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 44169,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YD70WOM/698484961/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d4588dea-a04d-50d3-a9af-4f8459203fea/d4588dea-a04d-50d3-a9af-4f8459203fea_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 44700,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YD70WOM/698484967/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d4588dea-a04d-50d3-a9af-4f8459203fea/d4588dea-a04d-50d3-a9af-4f8459203fea_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 42131,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YD70WOM/698484969/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d4588dea-a04d-50d3-a9af-4f8459203fea/d4588dea-a04d-50d3-a9af-4f8459203fea_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 40747,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YD70WOM/698484976/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d4588dea-a04d-50d3-a9af-4f8459203fea/d4588dea-a04d-50d3-a9af-4f8459203fea_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 92547,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YD70WOM/698484984/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d4588dea-a04d-50d3-a9af-4f8459203fea/d4588dea-a04d-50d3-a9af-4f8459203fea_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 78971,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YD70WOM/698484992/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d4588dea-a04d-50d3-a9af-4f8459203fea/d4588dea-a04d-50d3-a9af-4f8459203fea_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 92418,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YD70WOM/698485002/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d4588dea-a04d-50d3-a9af-4f8459203fea/d4588dea-a04d-50d3-a9af-4f8459203fea_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 76164,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YD70WOM/698485011/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-01-01',
'seller_name': None,
'title': 'MG MOTOR UK ZS 1.5 VTI-TECH EXCITE Hatchback',
'transmission': 'manual',
'trim': 'VTI-TECH EXCITE',
'vin': 'SDPW7BBDALZ145363',
'year': 2020}
2026-03-28 14:06:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YD70%2520WOM%27 HTTP/1.1" 200 None
2026-03-28 14:06:56 [bca.uk] INFO: Saving data for YD70%20WOM: {'created_time': 1774706816.616881, 'last_price_update_time': 1774706816.616895, 'auction_closing_time': 1774864800.0}
2026-03-28 14:06:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='YD70%2520WOM') HTTP/1.1" 204 0
2026-03-28 14:06:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AX15GHV/698225917/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/AX15GHV/42810027?sv=2020-08-04&st=2026-03-28T14%3A06%3A43Z&se=2026-03-28T14%3A31%3A43Z&sr=b&sp=r&sig=JJpF40Yp%2FobLJQr3JyJKHMCuyadOw6pOe%2FflxZRZmFI%3D)
2026-03-28 14:06:56 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DF12VWL/698228819/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698228819>
2026-03-28 14:06:56 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LK64NEJ/698947086/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698947086>
2026-03-28 14:06:56 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CK18AEJ/698910404/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698910404>
2026-03-28 14:06:56 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BP67XDB/698934010/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698934010>
2026-03-28 14:06:56 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WU19VDC/698045650/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698045650>
2026-03-28 14:06:56 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KM11UUD/698915278/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698915278>
2026-03-28 14:06:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LK64NEJ/698947115/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LK64NEJ/42810513?sv=2020-08-04&st=2026-03-28T14%3A03%3A51Z&se=2026-03-28T14%3A28%3A51Z&sr=b&sp=r&sig=dZi6EyBOQ2GoK8knfBZtxM9S6O3yD8ghOm4nMLyaJjo%3D)
2026-03-28 14:06:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.bca.co.uk/api/search?q=&pageSize=100&page=13&sort=MostRecentlyAdded> (referer: https://www.bca.co.uk/search) ['zyte-api']
2026-03-28 14:06:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:06:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c42bad0>
2026-03-28 14:06:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:06:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:06:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:06:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a149de9c-cfcc-5dd2-a714-96be3f56b350/a149de9c-cfcc-5dd2-a714-96be3f56b350_image_5.jpg HTTP/1.1" 201 0
2026-03-28 14:06:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FWJZ9285%252F698802675%252F600') HTTP/1.1" 204 0
2026-03-28 14:06:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WJZ9285/698802675/600 saved to cache
2026-03-28 14:06:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item a149de9c-cfcc-5dd2-a714-96be3f56b350
2026-03-28 14:06:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:06:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2de008d0>
2026-03-28 14:06:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:06:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:06:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:06:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_605bb574-f032-5f24-9f53-91befb051fec/605bb574-f032-5f24-9f53-91befb051fec_image_3.jpg HTTP/1.1" 201 0
2026-03-28 14:06:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FAX15GHV%252F698225935%252F600') HTTP/1.1" 204 0
2026-03-28 14:06:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AX15GHV/698225935/600 saved to cache
2026-03-28 14:06:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 605bb574-f032-5f24-9f53-91befb051fec
2026-03-28 14:06:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:06:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c629090>
2026-03-28 14:06:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:06:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:06:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:06:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_605bb574-f032-5f24-9f53-91befb051fec/605bb574-f032-5f24-9f53-91befb051fec_image_2.jpg HTTP/1.1" 201 0
2026-03-28 14:06:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FAX15GHV%252F698225929%252F600') HTTP/1.1" 204 0
2026-03-28 14:06:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AX15GHV/698225929/600 saved to cache
2026-03-28 14:06:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 605bb574-f032-5f24-9f53-91befb051fec
2026-03-28 14:06:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:06:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c95de10>
2026-03-28 14:06:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:06:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:06:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:06:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_605bb574-f032-5f24-9f53-91befb051fec/605bb574-f032-5f24-9f53-91befb051fec_image_1.jpg HTTP/1.1" 201 0
2026-03-28 14:06:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FAX15GHV%252F698225924%252F600') HTTP/1.1" 204 0
2026-03-28 14:06:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AX15GHV/698225924/600 saved to cache
2026-03-28 14:06:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 605bb574-f032-5f24-9f53-91befb051fec
2026-03-28 14:06:57 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:06:57 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:06:57 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:06:57 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:06:57 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:06:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:06:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c9b6790>
2026-03-28 14:06:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:06:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:06:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:06:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a149de9c-cfcc-5dd2-a714-96be3f56b350/a149de9c-cfcc-5dd2-a714-96be3f56b350_image_6.jpg HTTP/1.1" 201 0
2026-03-28 14:06:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FWJZ9285%252F698802705%252F600') HTTP/1.1" 204 0
2026-03-28 14:06:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WJZ9285/698802705/600 saved to cache
2026-03-28 14:06:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item a149de9c-cfcc-5dd2-a714-96be3f56b350
2026-03-28 14:06:57 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: a149de9c-cfcc-5dd2-a714-96be3f56b350, skipping ID generation
2026-03-28 14:06:57 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item a149de9c-cfcc-5dd2-a714-96be3f56b350 sending to next pipeline
2026-03-28 14:06:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: a149de9c-cfcc-5dd2-a714-96be3f56b350, identifier: WJZ%209285
2026-03-28 14:06:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: a149de9c-cfcc-5dd2-a714-96be3f56b350 with identifier: WJZ%209285
2026-03-28 14:06:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: a149de9c-cfcc-5dd2-a714-96be3f56b350 with identifier: WJZ%209285
2026-03-28 14:06:57 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: a149de9c-cfcc-5dd2-a714-96be3f56b350 with identifier: WJZ%209285 to the API
2026-03-28 14:06:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:06:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:06:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WJZ9285/698802705/600>
{'auction_title': '',
'c_o_2_emission_value': 114,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a149de9c-cfcc-5dd2-a714-96be3f56b350/a149de9c-cfcc-5dd2-a714-96be3f56b350_expert_report_file_7c62181b-67f1-431f-97e6-14aab86e2a62.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=WJZ%209285-GB',
'category': 'Car',
'color': 'black',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.2L',
'expiration_date': '2026-03-29T10:00:00Z',
'fuel_type': 'Petrol',
'id': 'a149de9c-cfcc-5dd2-a714-96be3f56b350',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'WJZ 9285',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=WJZ%209285&vehicleType=*',
'listing': 'auction',
'location': 'Manchester',
'make': 'PEUGEOT',
'model': '2008',
'odometer': 70234,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 11,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a149de9c-cfcc-5dd2-a714-96be3f56b350/a149de9c-cfcc-5dd2-a714-96be3f56b350_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 46790,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WJZ9285/698802550/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a149de9c-cfcc-5dd2-a714-96be3f56b350/a149de9c-cfcc-5dd2-a714-96be3f56b350_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 47107,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WJZ9285/698802569/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a149de9c-cfcc-5dd2-a714-96be3f56b350/a149de9c-cfcc-5dd2-a714-96be3f56b350_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 45668,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WJZ9285/698802593/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a149de9c-cfcc-5dd2-a714-96be3f56b350/a149de9c-cfcc-5dd2-a714-96be3f56b350_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 46381,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WJZ9285/698802624/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a149de9c-cfcc-5dd2-a714-96be3f56b350/a149de9c-cfcc-5dd2-a714-96be3f56b350_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 44363,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WJZ9285/698802645/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a149de9c-cfcc-5dd2-a714-96be3f56b350/a149de9c-cfcc-5dd2-a714-96be3f56b350_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 42269,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WJZ9285/698802675/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a149de9c-cfcc-5dd2-a714-96be3f56b350/a149de9c-cfcc-5dd2-a714-96be3f56b350_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 76633,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WJZ9285/698802705/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a149de9c-cfcc-5dd2-a714-96be3f56b350/a149de9c-cfcc-5dd2-a714-96be3f56b350_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 49385,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WJZ9285/698802730/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a149de9c-cfcc-5dd2-a714-96be3f56b350/a149de9c-cfcc-5dd2-a714-96be3f56b350_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 82324,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WJZ9285/698802751/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a149de9c-cfcc-5dd2-a714-96be3f56b350/a149de9c-cfcc-5dd2-a714-96be3f56b350_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 95984,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WJZ9285/698802765/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-01-01',
'seller_name': None,
'title': 'PEUGEOT 2008 1.2 VTI ALLURE MPV',
'transmission': 'manual',
'trim': 'VTI ALLURE',
'vin': 'VF3CUHMZ0FY020415',
'year': 2015}
2026-03-28 14:06:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WJZ%25209285%27 HTTP/1.1" 200 None
2026-03-28 14:06:57 [bca.uk] INFO: Saving data for WJZ%209285: {'created_time': 1774706817.710988, 'last_price_update_time': 1774706817.711, 'auction_closing_time': 1774778400.0}
2026-03-28 14:06:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='WJZ%25209285') HTTP/1.1" 204 0
2026-03-28 14:06:57 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/T400WRS/42810019?sv=2020-08-04&st=2026-03-28T14%3A06%3A56Z&se=2026-03-28T14%3A31%3A56Z&sr=b&sp=r&sig=kIZj2tqr%2BfocLXmzFxOg%2F2cX7%2FfCCdSGle1KfN6FfvQ%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=T400%20WRS-GB>
2026-03-28 14:06:57 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BV61MVO/698928702/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698928702>
2026-03-28 14:06:57 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/KEZ9481/42810228?sv=2020-08-04&st=2026-03-28T14%3A06%3A56Z&se=2026-03-28T14%3A31%3A56Z&sr=b&sp=r&sig=DDPGn%2BcxbHbdqwyGWf309ifFTIM3Acs6kuQRt8vCf2E%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=KEZ%209481-GB>
2026-03-28 14:06:57 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CK18AEJ/698910391/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698910391>
2026-03-28 14:06:57 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KV16LDZ/698296923/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698296923>
2026-03-28 14:06:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KM11UUD/698915278/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/KM11UUD/42809630?sv=2020-08-04&st=2026-03-28T14%3A03%3A52Z&se=2026-03-28T14%3A28%3A52Z&sr=b&sp=r&sig=S16ojkv9p8NH2wa7caJZQVn%2BDGo%2BREXS30Hz2ckWR%2FA%3D)
2026-03-28 14:06:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DF12VWL/698228838/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/DF12VWL/42797174?sv=2020-08-04&st=2026-03-28T14%3A03%3A51Z&se=2026-03-28T14%3A28%3A51Z&sr=b&sp=r&sig=0mRjBtvz6tka1D82qBQ3%2FRs63GOtrqyuAG7vdnh5S9c%3D)
2026-03-28 14:06:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CK18AEJ/698910428/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/CK18AEJ/42809519?sv=2020-08-04&st=2026-03-28T14%3A03%3A52Z&se=2026-03-28T14%3A28%3A52Z&sr=b&sp=r&sig=tMAO1WCWalJ7mXIWRlCxzQ1Rx0voh0Hr3%2FaR8xfgZTg%3D)
2026-03-28 14:06:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:06:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c95eb10>
2026-03-28 14:06:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:06:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:06:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:06:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_605bb574-f032-5f24-9f53-91befb051fec/605bb574-f032-5f24-9f53-91befb051fec_image_0.jpg HTTP/1.1" 201 0
2026-03-28 14:06:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FAX15GHV%252F698225917%252F600') HTTP/1.1" 204 0
2026-03-28 14:06:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AX15GHV/698225917/600 saved to cache
2026-03-28 14:06:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 605bb574-f032-5f24-9f53-91befb051fec
2026-03-28 14:06:57 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 605bb574-f032-5f24-9f53-91befb051fec, skipping ID generation
2026-03-28 14:06:57 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 605bb574-f032-5f24-9f53-91befb051fec sending to next pipeline
2026-03-28 14:06:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 605bb574-f032-5f24-9f53-91befb051fec, identifier: AX15%20GHV
2026-03-28 14:06:57 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:06:57 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:06:57 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:06:57 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:06:57 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:06:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:06:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c3a3350>
2026-03-28 14:06:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:06:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:06:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:06:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bb105475-65fd-5601-86d0-a8590c56bf0b/bb105475-65fd-5601-86d0-a8590c56bf0b_image_6.jpg HTTP/1.1" 201 0
2026-03-28 14:06:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLK64NEJ%252F698947115%252F600') HTTP/1.1" 204 0
2026-03-28 14:06:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LK64NEJ/698947115/600 saved to cache
2026-03-28 14:06:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item bb105475-65fd-5601-86d0-a8590c56bf0b
2026-03-28 14:06:58 [bca.uk] INFO: Total items found: 100
2026-03-28 14:06:58 [bca.uk] INFO: Requesting URL: https://www.bca.co.uk/api/search?q=&pageSize=100&page=14&sort=MostRecentlyAdded
2026-03-28 14:06:58 [bca.uk] INFO: Sending search API request with Bearer token (length=1492)
2026-03-28 14:06:58 [scrapy_zyte_api._params] WARNING: Request <GET https://www.bca.co.uk/api/search?q=&pageSize=100&page=14&sort=MostRecentlyAdded> defines the Zyte API customHttpRequestHeaders parameter, overriding Request.headers. Use Request.headers instead.
2026-03-28 14:06:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 605bb574-f032-5f24-9f53-91befb051fec with identifier: AX15%20GHV
2026-03-28 14:06:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 605bb574-f032-5f24-9f53-91befb051fec with identifier: AX15%20GHV
2026-03-28 14:06:58 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 605bb574-f032-5f24-9f53-91befb051fec with identifier: AX15%20GHV to the API
2026-03-28 14:06:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:06:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:06:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AX15GHV/698225917/600>
{'auction_title': '',
'c_o_2_emission_value': 97,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_605bb574-f032-5f24-9f53-91befb051fec/605bb574-f032-5f24-9f53-91befb051fec_expert_report_file_e4c87ee1-a851-4562-9385-42c5881e7f41.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=AX15%20GHV-GB',
'category': 'Car',
'color': 'white',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.0L',
'expiration_date': '2026-03-29T10:00:00Z',
'fuel_type': 'Petrol',
'id': '605bb574-f032-5f24-9f53-91befb051fec',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'AX15 GHV',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=AX15%20GHV&vehicleType=*',
'listing': 'auction',
'location': 'Brighouse',
'make': 'SMART',
'model': 'FORFOUR',
'odometer': 69453,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 11,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_605bb574-f032-5f24-9f53-91befb051fec/605bb574-f032-5f24-9f53-91befb051fec_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 45802,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AX15GHV/698225917/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_605bb574-f032-5f24-9f53-91befb051fec/605bb574-f032-5f24-9f53-91befb051fec_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 44982,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AX15GHV/698225924/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_605bb574-f032-5f24-9f53-91befb051fec/605bb574-f032-5f24-9f53-91befb051fec_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 43858,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AX15GHV/698225929/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_605bb574-f032-5f24-9f53-91befb051fec/605bb574-f032-5f24-9f53-91befb051fec_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 41471,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AX15GHV/698225935/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_605bb574-f032-5f24-9f53-91befb051fec/605bb574-f032-5f24-9f53-91befb051fec_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 43158,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AX15GHV/698225941/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_605bb574-f032-5f24-9f53-91befb051fec/605bb574-f032-5f24-9f53-91befb051fec_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 42062,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AX15GHV/698225946/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_605bb574-f032-5f24-9f53-91befb051fec/605bb574-f032-5f24-9f53-91befb051fec_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 81963,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AX15GHV/698225958/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_605bb574-f032-5f24-9f53-91befb051fec/605bb574-f032-5f24-9f53-91befb051fec_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 66632,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AX15GHV/698225965/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_605bb574-f032-5f24-9f53-91befb051fec/605bb574-f032-5f24-9f53-91befb051fec_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 88402,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AX15GHV/698225979/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_605bb574-f032-5f24-9f53-91befb051fec/605bb574-f032-5f24-9f53-91befb051fec_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 83022,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AX15GHV/698225988/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-01-01',
'seller_name': None,
'title': 'SMART FORFOUR 1.0 71 PASSION Hatchback',
'transmission': 'manual',
'trim': '71 PASSION',
'vin': 'WME4530422Y017504',
'year': 2015}
2026-03-28 14:06:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27AX15%2520GHV%27 HTTP/1.1" 200 None
2026-03-28 14:06:58 [bca.uk] INFO: Saving data for AX15%20GHV: {'created_time': 1774706818.411565, 'last_price_update_time': 1774706818.411576, 'auction_closing_time': 1774778400.0}
2026-03-28 14:06:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='AX15%2520GHV') HTTP/1.1" 204 0
2026-03-28 14:06:58 [bca.uk] INFO: Found listing with ID: KM14%20HWD
2026-03-28 14:06:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KM14%2520HWD%27 HTTP/1.1" 200 None
2026-03-28 14:06:58 [bca.uk] INFO: Scrape type for KM14%20HWD: 0
2026-03-28 14:06:58 [bca.uk] INFO: Found listing with ID: DX65%20UOP
2026-03-28 14:06:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DX65%2520UOP%27 HTTP/1.1" 200 None
2026-03-28 14:06:58 [bca.uk] INFO: Scrape type for DX65%20UOP: 0
2026-03-28 14:06:58 [bca.uk] INFO: Found listing with ID: BD13%20YCM
2026-03-28 14:06:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BD13%2520YCM%27 HTTP/1.1" 200 None
2026-03-28 14:06:58 [bca.uk] INFO: Scrape type for BD13%20YCM: 0
2026-03-28 14:06:58 [bca.uk] INFO: Found listing with ID: SF69%20ZBX
2026-03-28 14:06:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SF69%2520ZBX%27 HTTP/1.1" 200 None
2026-03-28 14:06:58 [bca.uk] INFO: Scrape type for SF69%20ZBX: 0
2026-03-28 14:06:58 [bca.uk] INFO: Found listing with ID: SD60%20OBV
2026-03-28 14:06:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SD60%2520OBV%27 HTTP/1.1" 200 None
2026-03-28 14:06:58 [bca.uk] INFO: Scrape type for SD60%20OBV: 0
2026-03-28 14:06:58 [bca.uk] INFO: Found listing with ID: LR18%20TNX
2026-03-28 14:06:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LR18%2520TNX%27 HTTP/1.1" 200 None
2026-03-28 14:06:58 [bca.uk] INFO: Scrape type for LR18%20TNX: 0
2026-03-28 14:06:58 [bca.uk] INFO: Found listing with ID: GY69%20LZL
2026-03-28 14:06:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GY69%2520LZL%27 HTTP/1.1" 200 None
2026-03-28 14:06:58 [bca.uk] INFO: Scrape type for GY69%20LZL: 0
2026-03-28 14:06:58 [bca.uk] INFO: Found listing with ID: EY68%20NKD
2026-03-28 14:06:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27EY68%2520NKD%27 HTTP/1.1" 200 None
2026-03-28 14:06:58 [bca.uk] INFO: Scrape type for EY68%20NKD: 0
2026-03-28 14:06:58 [bca.uk] INFO: Found listing with ID: VA19%20XRY
2026-03-28 14:06:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27VA19%2520XRY%27 HTTP/1.1" 200 None
2026-03-28 14:06:58 [bca.uk] INFO: Scrape type for VA19%20XRY: 0
2026-03-28 14:06:58 [bca.uk] INFO: Found listing with ID: SD14%20UCC
2026-03-28 14:06:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SD14%2520UCC%27 HTTP/1.1" 200 None
2026-03-28 14:06:58 [bca.uk] INFO: Scrape type for SD14%20UCC: 0
2026-03-28 14:06:58 [bca.uk] INFO: Found listing with ID: PL68%20ZCX
2026-03-28 14:06:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27PL68%2520ZCX%27 HTTP/1.1" 200 None
2026-03-28 14:06:58 [bca.uk] INFO: Scrape type for PL68%20ZCX: 0
2026-03-28 14:06:58 [bca.uk] INFO: Found listing with ID: PK14%20VAX
2026-03-28 14:06:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27PK14%2520VAX%27 HTTP/1.1" 200 None
2026-03-28 14:06:58 [bca.uk] INFO: Scrape type for PK14%20VAX: 0
2026-03-28 14:06:58 [bca.uk] INFO: Found listing with ID: PF65%20SSV
2026-03-28 14:06:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27PF65%2520SSV%27 HTTP/1.1" 200 None
2026-03-28 14:06:58 [bca.uk] INFO: Scrape type for PF65%20SSV: 0
2026-03-28 14:06:58 [bca.uk] INFO: Found listing with ID: NG13%20GKJ
2026-03-28 14:06:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27NG13%2520GKJ%27 HTTP/1.1" 200 None
2026-03-28 14:06:58 [bca.uk] INFO: Scrape type for NG13%20GKJ: 0
2026-03-28 14:06:58 [bca.uk] INFO: Found listing with ID: MF64%20ZPZ
2026-03-28 14:06:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MF64%2520ZPZ%27 HTTP/1.1" 200 None
2026-03-28 14:06:58 [bca.uk] INFO: Scrape type for MF64%20ZPZ: 0
2026-03-28 14:06:58 [bca.uk] INFO: Found listing with ID: HW69%20EOS
2026-03-28 14:06:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27HW69%2520EOS%27 HTTP/1.1" 200 None
2026-03-28 14:06:58 [bca.uk] INFO: Scrape type for HW69%20EOS: 0
2026-03-28 14:06:58 [bca.uk] INFO: Found listing with ID: FP70%20XEN
2026-03-28 14:06:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FP70%2520XEN%27 HTTP/1.1" 200 None
2026-03-28 14:06:58 [bca.uk] INFO: Scrape type for FP70%20XEN: 0
2026-03-28 14:06:58 [bca.uk] INFO: Found listing with ID: FJ16%20YOR
2026-03-28 14:06:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FJ16%2520YOR%27 HTTP/1.1" 200 None
2026-03-28 14:06:58 [bca.uk] INFO: Scrape type for FJ16%20YOR: 0
2026-03-28 14:06:58 [bca.uk] INFO: Found listing with ID: FD20%20CUW
2026-03-28 14:06:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FD20%2520CUW%27 HTTP/1.1" 200 None
2026-03-28 14:06:58 [bca.uk] INFO: Scrape type for FD20%20CUW: 0
2026-03-28 14:06:58 [bca.uk] INFO: Found listing with ID: DN60%20UCJ
2026-03-28 14:06:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DN60%2520UCJ%27 HTTP/1.1" 200 None
2026-03-28 14:06:58 [bca.uk] INFO: Scrape type for DN60%20UCJ: 0
2026-03-28 14:06:58 [bca.uk] INFO: Found listing with ID: BX19%20MWY
2026-03-28 14:06:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BX19%2520MWY%27 HTTP/1.1" 200 None
2026-03-28 14:06:58 [bca.uk] INFO: Scrape type for BX19%20MWY: 0
2026-03-28 14:06:58 [bca.uk] INFO: Found listing with ID: BK64%20WXM
2026-03-28 14:06:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BK64%2520WXM%27 HTTP/1.1" 200 None
2026-03-28 14:06:58 [bca.uk] INFO: Scrape type for BK64%20WXM: 0
2026-03-28 14:06:58 [bca.uk] INFO: Found listing with ID: YM19%20ZGY
2026-03-28 14:06:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YM19%2520ZGY%27 HTTP/1.1" 200 None
2026-03-28 14:06:58 [bca.uk] INFO: Scrape type for YM19%20ZGY: 0
2026-03-28 14:06:58 [bca.uk] INFO: Found listing with ID: SV64%20UUP
2026-03-28 14:06:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SV64%2520UUP%27 HTTP/1.1" 200 None
2026-03-28 14:06:58 [bca.uk] INFO: Scrape type for SV64%20UUP: 0
2026-03-28 14:06:58 [bca.uk] INFO: Found listing with ID: RX11%20HTV
2026-03-28 14:06:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27RX11%2520HTV%27 HTTP/1.1" 200 None
2026-03-28 14:06:58 [bca.uk] INFO: Scrape type for RX11%20HTV: 0
2026-03-28 14:06:58 [bca.uk] INFO: Found listing with ID: RA65%20EUT
2026-03-28 14:06:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27RA65%2520EUT%27 HTTP/1.1" 200 None
2026-03-28 14:06:58 [bca.uk] INFO: Scrape type for RA65%20EUT: 0
2026-03-28 14:06:58 [bca.uk] INFO: Found listing with ID: OV66%20ZBZ
2026-03-28 14:06:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27OV66%2520ZBZ%27 HTTP/1.1" 200 None
2026-03-28 14:06:58 [bca.uk] INFO: Scrape type for OV66%20ZBZ: 0
2026-03-28 14:06:58 [bca.uk] INFO: Found listing with ID: NK16%20EGE
2026-03-28 14:06:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27NK16%2520EGE%27 HTTP/1.1" 200 None
2026-03-28 14:06:58 [bca.uk] INFO: Scrape type for NK16%20EGE: 0
2026-03-28 14:06:58 [bca.uk] INFO: Found listing with ID: MT10%20XMZ
2026-03-28 14:06:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MT10%2520XMZ%27 HTTP/1.1" 200 None
2026-03-28 14:06:58 [bca.uk] INFO: Scrape type for MT10%20XMZ: 0
2026-03-28 14:06:58 [bca.uk] INFO: Found listing with ID: LY16%20JJK
2026-03-28 14:06:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LY16%2520JJK%27 HTTP/1.1" 200 None
2026-03-28 14:06:58 [bca.uk] INFO: Scrape type for LY16%20JJK: 0
2026-03-28 14:06:58 [bca.uk] INFO: Found listing with ID: LN09%20XAL
2026-03-28 14:06:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LN09%2520XAL%27 HTTP/1.1" 200 None
2026-03-28 14:06:58 [bca.uk] INFO: Scrape type for LN09%20XAL: 0
2026-03-28 14:06:58 [bca.uk] INFO: Found listing with ID: LM12%20MLU
2026-03-28 14:06:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LM12%2520MLU%27 HTTP/1.1" 200 None
2026-03-28 14:06:58 [bca.uk] INFO: Scrape type for LM12%20MLU: 0
2026-03-28 14:06:58 [bca.uk] INFO: Found listing with ID: HY16%20EOC
2026-03-28 14:06:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27HY16%2520EOC%27 HTTP/1.1" 200 None
2026-03-28 14:06:58 [bca.uk] INFO: Scrape type for HY16%20EOC: 0
2026-03-28 14:06:58 [bca.uk] INFO: Found listing with ID: HN08%20FLX
2026-03-28 14:06:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27HN08%2520FLX%27 HTTP/1.1" 200 None
2026-03-28 14:06:58 [bca.uk] INFO: Scrape type for HN08%20FLX: 0
2026-03-28 14:06:58 [bca.uk] INFO: Found listing with ID: EU15%20WHR
2026-03-28 14:06:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27EU15%2520WHR%27 HTTP/1.1" 200 None
2026-03-28 14:06:59 [bca.uk] INFO: Scrape type for EU15%20WHR: 0
2026-03-28 14:06:59 [bca.uk] INFO: Found listing with ID: EA66%20LNX
2026-03-28 14:06:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27EA66%2520LNX%27 HTTP/1.1" 200 None
2026-03-28 14:06:59 [bca.uk] INFO: Scrape type for EA66%20LNX: 0
2026-03-28 14:06:59 [bca.uk] INFO: Found listing with ID: EA10%20ODR
2026-03-28 14:06:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27EA10%2520ODR%27 HTTP/1.1" 200 None
2026-03-28 14:06:59 [bca.uk] INFO: Scrape type for EA10%20ODR: 0
2026-03-28 14:06:59 [bca.uk] INFO: Found listing with ID: CX71%20YVZ
2026-03-28 14:06:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27CX71%2520YVZ%27 HTTP/1.1" 200 None
2026-03-28 14:06:59 [bca.uk] INFO: Scrape type for CX71%20YVZ: 0
2026-03-28 14:06:59 [bca.uk] INFO: Found listing with ID: CV62%20SNJ
2026-03-28 14:06:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27CV62%2520SNJ%27 HTTP/1.1" 200 None
2026-03-28 14:06:59 [bca.uk] INFO: Scrape type for CV62%20SNJ: 0
2026-03-28 14:06:59 [bca.uk] INFO: Found listing with ID: CE53%20GKN
2026-03-28 14:06:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27CE53%2520GKN%27 HTTP/1.1" 200 None
2026-03-28 14:06:59 [bca.uk] INFO: Scrape type for CE53%20GKN: 0
2026-03-28 14:06:59 [bca.uk] INFO: Found listing with ID: BK16%20VKS
2026-03-28 14:06:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BK16%2520VKS%27 HTTP/1.1" 200 None
2026-03-28 14:06:59 [bca.uk] INFO: Scrape type for BK16%20VKS: 0
2026-03-28 14:06:59 [bca.uk] INFO: Found listing with ID: AJ62%20YSE
2026-03-28 14:06:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27AJ62%2520YSE%27 HTTP/1.1" 200 None
2026-03-28 14:06:59 [bca.uk] INFO: Scrape type for AJ62%20YSE: 0
2026-03-28 14:06:59 [bca.uk] INFO: Found listing with ID: AY57%20YXB
2026-03-28 14:06:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27AY57%2520YXB%27 HTTP/1.1" 200 None
2026-03-28 14:06:59 [bca.uk] INFO: Scrape type for AY57%20YXB: 0
2026-03-28 14:06:59 [bca.uk] INFO: Found listing with ID: AF69%20UFS
2026-03-28 14:06:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27AF69%2520UFS%27 HTTP/1.1" 200 None
2026-03-28 14:06:59 [bca.uk] INFO: Scrape type for AF69%20UFS: 0
2026-03-28 14:06:59 [bca.uk] INFO: Found listing with ID: WN09%20MYP
2026-03-28 14:06:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WN09%2520MYP%27 HTTP/1.1" 200 None
2026-03-28 14:06:59 [bca.uk] INFO: Scrape type for WN09%20MYP: 0
2026-03-28 14:06:59 [bca.uk] INFO: Found listing with ID: PY61%20EWD
2026-03-28 14:06:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27PY61%2520EWD%27 HTTP/1.1" 200 None
2026-03-28 14:06:59 [bca.uk] INFO: Scrape type for PY61%20EWD: 0
2026-03-28 14:06:59 [bca.uk] INFO: Found listing with ID: MT61%20WPK
2026-03-28 14:06:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MT61%2520WPK%27 HTTP/1.1" 200 None
2026-03-28 14:06:59 [bca.uk] INFO: Scrape type for MT61%20WPK: 0
2026-03-28 14:06:59 [bca.uk] INFO: Found listing with ID: EF66%20LFH
2026-03-28 14:06:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27EF66%2520LFH%27 HTTP/1.1" 200 None
2026-03-28 14:06:59 [bca.uk] INFO: Scrape type for EF66%20LFH: 0
2026-03-28 14:06:59 [bca.uk] INFO: Found listing with ID: AV18%20UVO
2026-03-28 14:06:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27AV18%2520UVO%27 HTTP/1.1" 200 None
2026-03-28 14:06:59 [bca.uk] INFO: Scrape type for AV18%20UVO: 0
2026-03-28 14:06:59 [bca.uk] INFO: Found listing with ID: AP13%20PNX
2026-03-28 14:06:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27AP13%2520PNX%27 HTTP/1.1" 200 None
2026-03-28 14:06:59 [bca.uk] INFO: Scrape type for AP13%20PNX: 0
2026-03-28 14:06:59 [bca.uk] INFO: Found listing with ID: GL20%20NXU
2026-03-28 14:06:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GL20%2520NXU%27 HTTP/1.1" 200 None
2026-03-28 14:06:59 [bca.uk] INFO: Scrape type for GL20%20NXU: 0
2026-03-28 14:06:59 [bca.uk] INFO: Found listing with ID: OY12%20USJ
2026-03-28 14:06:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27OY12%2520USJ%27 HTTP/1.1" 200 None
2026-03-28 14:06:59 [bca.uk] INFO: Scrape type for OY12%20USJ: 0
2026-03-28 14:06:59 [bca.uk] INFO: Found listing with ID: LX12%20WRZ
2026-03-28 14:06:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LX12%2520WRZ%27 HTTP/1.1" 200 None
2026-03-28 14:06:59 [bca.uk] INFO: Scrape type for LX12%20WRZ: 0
2026-03-28 14:06:59 [bca.uk] INFO: Found listing with ID: DA15%20GVJ
2026-03-28 14:06:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DA15%2520GVJ%27 HTTP/1.1" 200 None
2026-03-28 14:06:59 [bca.uk] INFO: Scrape type for DA15%20GVJ: 0
2026-03-28 14:06:59 [bca.uk] INFO: Found listing with ID: MA18%20EAW
2026-03-28 14:06:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MA18%2520EAW%27 HTTP/1.1" 200 None
2026-03-28 14:06:59 [bca.uk] INFO: Scrape type for MA18%20EAW: 0
2026-03-28 14:06:59 [bca.uk] INFO: Found listing with ID: WJ07%20XMW
2026-03-28 14:06:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WJ07%2520XMW%27 HTTP/1.1" 200 None
2026-03-28 14:06:59 [bca.uk] INFO: Scrape type for WJ07%20XMW: 0
2026-03-28 14:06:59 [bca.uk] INFO: Found listing with ID: TGZ%201807
2026-03-28 14:06:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27TGZ%25201807%27 HTTP/1.1" 200 None
2026-03-28 14:06:59 [bca.uk] INFO: Scrape type for TGZ%201807: 0
2026-03-28 14:06:59 [bca.uk] INFO: Found listing with ID: YJ66%20AAP
2026-03-28 14:06:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YJ66%2520AAP%27 HTTP/1.1" 200 None
2026-03-28 14:06:59 [bca.uk] INFO: Scrape type for YJ66%20AAP: 0
2026-03-28 14:06:59 [bca.uk] INFO: Found listing with ID: BN10%20OKD
2026-03-28 14:06:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BN10%2520OKD%27 HTTP/1.1" 200 None
2026-03-28 14:06:59 [bca.uk] INFO: Scrape type for BN10%20OKD: 0
2026-03-28 14:06:59 [bca.uk] INFO: Found listing with ID: HY73%20KHK
2026-03-28 14:06:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27HY73%2520KHK%27 HTTP/1.1" 200 None
2026-03-28 14:06:59 [bca.uk] INFO: Scrape type for HY73%20KHK: 0
2026-03-28 14:06:59 [bca.uk] INFO: Found listing with ID: WG22%20GHY
2026-03-28 14:06:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WG22%2520GHY%27 HTTP/1.1" 200 None
2026-03-28 14:06:59 [bca.uk] INFO: Scrape type for WG22%20GHY: 0
2026-03-28 14:06:59 [bca.uk] INFO: Found listing with ID: EN71%20UET
2026-03-28 14:06:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27EN71%2520UET%27 HTTP/1.1" 200 None
2026-03-28 14:06:59 [bca.uk] INFO: Scrape type for EN71%20UET: 0
2026-03-28 14:06:59 [bca.uk] INFO: Found listing with ID: GL71%20USX
2026-03-28 14:06:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GL71%2520USX%27 HTTP/1.1" 200 None
2026-03-28 14:06:59 [bca.uk] INFO: Scrape type for GL71%20USX: 0
2026-03-28 14:06:59 [bca.uk] INFO: Found listing with ID: LF72%20EGY
2026-03-28 14:06:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LF72%2520EGY%27 HTTP/1.1" 200 None
2026-03-28 14:06:59 [bca.uk] INFO: Scrape type for LF72%20EGY: 0
2026-03-28 14:06:59 [bca.uk] INFO: Found listing with ID: LG23%20XZX
2026-03-28 14:06:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LG23%2520XZX%27 HTTP/1.1" 200 None
2026-03-28 14:06:59 [bca.uk] INFO: Scrape type for LG23%20XZX: 0
2026-03-28 14:06:59 [bca.uk] INFO: Found listing with ID: FL21%20VDZ
2026-03-28 14:06:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FL21%2520VDZ%27 HTTP/1.1" 200 None
2026-03-28 14:06:59 [bca.uk] INFO: Scrape type for FL21%20VDZ: 0
2026-03-28 14:06:59 [bca.uk] INFO: Found listing with ID: K321%20PXX
2026-03-28 14:06:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27K321%2520PXX%27 HTTP/1.1" 200 None
2026-03-28 14:06:59 [bca.uk] INFO: Scrape type for K321%20PXX: 0
2026-03-28 14:06:59 [bca.uk] INFO: Found listing with ID: SB69%20LYC
2026-03-28 14:06:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SB69%2520LYC%27 HTTP/1.1" 200 None
2026-03-28 14:06:59 [bca.uk] INFO: Scrape type for SB69%20LYC: 0
2026-03-28 14:06:59 [bca.uk] INFO: Found listing with ID: NC23%20XLD
2026-03-28 14:06:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27NC23%2520XLD%27 HTTP/1.1" 200 None
2026-03-28 14:06:59 [bca.uk] INFO: Scrape type for NC23%20XLD: 0
2026-03-28 14:06:59 [bca.uk] INFO: Found listing with ID: DU17%20AZG
2026-03-28 14:06:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DU17%2520AZG%27 HTTP/1.1" 200 None
2026-03-28 14:06:59 [bca.uk] INFO: Scrape type for DU17%20AZG: 0
2026-03-28 14:06:59 [bca.uk] INFO: Found listing with ID: X5%20GTD
2026-03-28 14:06:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27X5%2520GTD%27 HTTP/1.1" 200 None
2026-03-28 14:06:59 [bca.uk] INFO: Scrape type for X5%20GTD: 0
2026-03-28 14:06:59 [bca.uk] INFO: Found listing with ID: CV64%20BKG
2026-03-28 14:06:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27CV64%2520BKG%27 HTTP/1.1" 200 None
2026-03-28 14:06:59 [bca.uk] INFO: Scrape type for CV64%20BKG: 0
2026-03-28 14:06:59 [bca.uk] INFO: Found listing with ID: SG17%20PZK
2026-03-28 14:06:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SG17%2520PZK%27 HTTP/1.1" 200 None
2026-03-28 14:06:59 [bca.uk] INFO: Scrape type for SG17%20PZK: 0
2026-03-28 14:06:59 [bca.uk] INFO: Found listing with ID: YS67%20ATN
2026-03-28 14:06:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YS67%2520ATN%27 HTTP/1.1" 200 None
2026-03-28 14:06:59 [bca.uk] INFO: Scrape type for YS67%20ATN: 0
2026-03-28 14:06:59 [bca.uk] INFO: Found listing with ID: VE17%20RTZ
2026-03-28 14:06:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27VE17%2520RTZ%27 HTTP/1.1" 200 None
2026-03-28 14:06:59 [bca.uk] INFO: Scrape type for VE17%20RTZ: 0
2026-03-28 14:06:59 [bca.uk] INFO: Found listing with ID: SN63%20FMO
2026-03-28 14:06:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SN63%2520FMO%27 HTTP/1.1" 200 None
2026-03-28 14:06:59 [bca.uk] INFO: Scrape type for SN63%20FMO: 0
2026-03-28 14:06:59 [bca.uk] INFO: Found listing with ID: SY63%20KOV
2026-03-28 14:06:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SY63%2520KOV%27 HTTP/1.1" 200 None
2026-03-28 14:06:59 [bca.uk] INFO: Scrape type for SY63%20KOV: 0
2026-03-28 14:06:59 [bca.uk] INFO: Found listing with ID: SK70%20VVP
2026-03-28 14:06:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SK70%2520VVP%27 HTTP/1.1" 200 None
2026-03-28 14:06:59 [bca.uk] INFO: Scrape type for SK70%20VVP: 0
2026-03-28 14:06:59 [bca.uk] INFO: Found listing with ID: SR70%20FBU
2026-03-28 14:06:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SR70%2520FBU%27 HTTP/1.1" 200 None
2026-03-28 14:06:59 [bca.uk] INFO: Scrape type for SR70%20FBU: 0
2026-03-28 14:06:59 [bca.uk] INFO: Found listing with ID: FD66%20JYF
2026-03-28 14:06:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FD66%2520JYF%27 HTTP/1.1" 200 None
2026-03-28 14:06:59 [bca.uk] INFO: Scrape type for FD66%20JYF: 0
2026-03-28 14:06:59 [bca.uk] INFO: Found listing with ID: L8%20ULV
2026-03-28 14:06:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27L8%2520ULV%27 HTTP/1.1" 200 None
2026-03-28 14:06:59 [bca.uk] INFO: Scrape type for L8%20ULV: 0
2026-03-28 14:06:59 [bca.uk] INFO: Found listing with ID: LL12%20SVJ
2026-03-28 14:06:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LL12%2520SVJ%27 HTTP/1.1" 200 None
2026-03-28 14:06:59 [bca.uk] INFO: Scrape type for LL12%20SVJ: 0
2026-03-28 14:06:59 [bca.uk] INFO: Found listing with ID: SL12%20ADV
2026-03-28 14:06:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SL12%2520ADV%27 HTTP/1.1" 200 None
2026-03-28 14:06:59 [bca.uk] INFO: Scrape type for SL12%20ADV: 0
2026-03-28 14:06:59 [bca.uk] INFO: Found listing with ID: GJ67%20OET
2026-03-28 14:06:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GJ67%2520OET%27 HTTP/1.1" 200 None
2026-03-28 14:06:59 [bca.uk] INFO: Scrape type for GJ67%20OET: 0
2026-03-28 14:06:59 [bca.uk] INFO: Found listing with ID: SL66%20WTO
2026-03-28 14:06:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SL66%2520WTO%27 HTTP/1.1" 200 None
2026-03-28 14:06:59 [bca.uk] INFO: Scrape type for SL66%20WTO: 0
2026-03-28 14:06:59 [bca.uk] INFO: Found listing with ID: EJ02%20EGU
2026-03-28 14:06:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27EJ02%2520EGU%27 HTTP/1.1" 200 None
2026-03-28 14:06:59 [bca.uk] INFO: Scrape type for EJ02%20EGU: 0
2026-03-28 14:06:59 [bca.uk] INFO: Found listing with ID: YC10%20PAO
2026-03-28 14:06:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YC10%2520PAO%27 HTTP/1.1" 200 None
2026-03-28 14:07:00 [bca.uk] INFO: Scrape type for YC10%20PAO: 0
2026-03-28 14:07:00 [bca.uk] INFO: Found listing with ID: OV22%20RZK
2026-03-28 14:07:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27OV22%2520RZK%27 HTTP/1.1" 200 None
2026-03-28 14:07:00 [bca.uk] INFO: Scrape type for OV22%20RZK: 0
2026-03-28 14:07:00 [bca.uk] INFO: Found listing with ID: WN20%20RBX
2026-03-28 14:07:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WN20%2520RBX%27 HTTP/1.1" 200 None
2026-03-28 14:07:00 [bca.uk] INFO: Scrape type for WN20%20RBX: 0
2026-03-28 14:07:00 [bca.uk] INFO: Found listing with ID: OF07%20ELF
2026-03-28 14:07:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27OF07%2520ELF%27 HTTP/1.1" 200 None
2026-03-28 14:07:00 [bca.uk] INFO: Scrape type for OF07%20ELF: 0
2026-03-28 14:07:00 [bca.uk] INFO: Found listing with ID: EK16%20AKU
2026-03-28 14:07:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27EK16%2520AKU%27 HTTP/1.1" 200 None
2026-03-28 14:07:00 [bca.uk] INFO: Scrape type for EK16%20AKU: 0
2026-03-28 14:07:00 [bca.uk] INFO: Found listing with ID: RA65%20VLP
2026-03-28 14:07:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27RA65%2520VLP%27 HTTP/1.1" 200 None
2026-03-28 14:07:00 [bca.uk] INFO: Scrape type for RA65%20VLP: 0
2026-03-28 14:07:00 [bca.uk] INFO: Found listing with ID: ST14%20JVM
2026-03-28 14:07:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27ST14%2520JVM%27 HTTP/1.1" 200 None
2026-03-28 14:07:00 [bca.uk] INFO: Scrape type for ST14%20JVM: 0
2026-03-28 14:07:00 [bca.uk] INFO: Found listing with ID: CT59%20HCD
2026-03-28 14:07:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27CT59%2520HCD%27 HTTP/1.1" 200 None
2026-03-28 14:07:00 [bca.uk] INFO: Scrape type for CT59%20HCD: 0
2026-03-28 14:07:00 [bca.uk] INFO: Found listing with ID: EG11%20AZX
2026-03-28 14:07:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27EG11%2520AZX%27 HTTP/1.1" 200 None
2026-03-28 14:07:00 [bca.uk] INFO: Scrape type for EG11%20AZX: 0
2026-03-28 14:07:00 [bca.uk] INFO: Found listing with ID: OV17%20YPT
2026-03-28 14:07:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27OV17%2520YPT%27 HTTP/1.1" 200 None
2026-03-28 14:07:00 [bca.uk] INFO: Scrape type for OV17%20YPT: 0
2026-03-28 14:07:00 [bca.uk] INFO: Found listing with ID: BK07%20WOX
2026-03-28 14:07:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BK07%2520WOX%27 HTTP/1.1" 200 None
2026-03-28 14:07:00 [bca.uk] INFO: Scrape type for BK07%20WOX: 0
2026-03-28 14:07:00 [bca.uk] INFO: Found listing with ID: SC23%20WCG
2026-03-28 14:07:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SC23%2520WCG%27 HTTP/1.1" 200 None
2026-03-28 14:07:00 [bca.uk] INFO: Scrape type for SC23%20WCG: 0
2026-03-28 14:07:00 [bca.uk] INFO: Found listing with ID: WA21%20MYD
2026-03-28 14:07:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WA21%2520MYD%27 HTTP/1.1" 200 None
2026-03-28 14:07:00 [bca.uk] INFO: Scrape type for WA21%20MYD: 0
2026-03-28 14:07:00 [bca.uk] INFO: Found listing with ID: WF22%20CPZ
2026-03-28 14:07:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WF22%2520CPZ%27 HTTP/1.1" 200 None
2026-03-28 14:07:00 [bca.uk] INFO: Scrape type for WF22%20CPZ: 0
2026-03-28 14:07:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LK64NEJ/698947086/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LK64NEJ/42810513?sv=2020-08-04&st=2026-03-28T14%3A03%3A51Z&se=2026-03-28T14%3A28%3A51Z&sr=b&sp=r&sig=dZi6EyBOQ2GoK8knfBZtxM9S6O3yD8ghOm4nMLyaJjo%3D)
2026-03-28 14:07:00 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LK64NEJ/698947067/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698947067>
2026-03-28 14:07:00 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DF12VWL/698228796/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698228796>
2026-03-28 14:07:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CK18AEJ/698910404/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/CK18AEJ/42809519?sv=2020-08-04&st=2026-03-28T14%3A03%3A52Z&se=2026-03-28T14%3A28%3A52Z&sr=b&sp=r&sig=tMAO1WCWalJ7mXIWRlCxzQ1Rx0voh0Hr3%2FaR8xfgZTg%3D)
2026-03-28 14:07:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BP67XDB/698934010/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/BP67XDB/42810422?sv=2020-08-04&st=2026-03-28T14%3A03%3A52Z&se=2026-03-28T14%3A28%3A52Z&sr=b&sp=r&sig=Logn8Hbry8lNDBo7BHyP%2FFQM2Uo9ZZUQT4uyTv5b%2Bn0%3D)
2026-03-28 14:07:00 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/SH22GFY/42809522?sv=2020-08-04&st=2026-03-28T14%3A06%3A58Z&se=2026-03-28T14%3A31%3A58Z&sr=b&sp=r&sig=LF9M3JDhfhAd7nxLqVMWN2qOdCGHrBuIZdqAc9eQvMA%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=SH22%20GFY-GB>
2026-03-28 14:07:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WU19VDC/698045650/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/WU19VDC/42792335?sv=2020-08-04&st=2026-03-28T14%3A03%3A50Z&se=2026-03-28T14%3A28%3A50Z&sr=b&sp=r&sig=Mqd3JjFAqa%2F7fy72g8Zcx8u%2F7XgFrycUpKRkPg1JOjA%3D)
2026-03-28 14:07:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DF12VWL/698228819/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/DF12VWL/42797174?sv=2020-08-04&st=2026-03-28T14%3A03%3A51Z&se=2026-03-28T14%3A28%3A51Z&sr=b&sp=r&sig=0mRjBtvz6tka1D82qBQ3%2FRs63GOtrqyuAG7vdnh5S9c%3D)
2026-03-28 14:07:00 [scrapy_zyte_api._params] WARNING: Request <GET https://www.bca.co.uk/api/search?q=&pageSize=100&page=14&sort=MostRecentlyAdded> defines the Zyte API customHttpRequestHeaders parameter, overriding Request.headers. Use Request.headers instead.
2026-03-28 14:07:00 [scrapy_zyte_api._params] WARNING: Request <GET https://www.bca.co.uk/api/search?q=&pageSize=100&page=14&sort=MostRecentlyAdded> defines the Zyte API customHttpRequestHeaders parameter, overriding Request.headers. Use Request.headers instead.
2026-03-28 14:07:00 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 14:07:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:07:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c93d310>
2026-03-28 14:07:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:07:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:07:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:07:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7ba82627-3d66-5970-bb5d-b19d751b9eb4/7ba82627-3d66-5970-bb5d-b19d751b9eb4_image_3.jpg HTTP/1.1" 201 0
2026-03-28 14:07:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FKM11UUD%252F698915278%252F600') HTTP/1.1" 204 0
2026-03-28 14:07:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KM11UUD/698915278/600 saved to cache
2026-03-28 14:07:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 7ba82627-3d66-5970-bb5d-b19d751b9eb4
2026-03-28 14:07:00 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:07:00 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:07:00 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:07:00 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:07:00 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:07:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:07:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2de10710>
2026-03-28 14:07:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:07:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:07:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:07:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_40991700-d0e5-5255-930d-6ca8fe3c072d/40991700-d0e5-5255-930d-6ca8fe3c072d_image_7.jpg HTTP/1.1" 201 0
2026-03-28 14:07:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FDF12VWL%252F698228838%252F600') HTTP/1.1" 204 0
2026-03-28 14:07:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DF12VWL/698228838/600 saved to cache
2026-03-28 14:07:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 40991700-d0e5-5255-930d-6ca8fe3c072d
2026-03-28 14:07:00 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:07:00 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:07:00 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:07:00 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:07:00 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:07:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:07:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a1fe8e190>
2026-03-28 14:07:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:07:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:07:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:07:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_954e7a8e-294d-583e-8576-18c9af402ec0/954e7a8e-294d-583e-8576-18c9af402ec0_image_6.jpg HTTP/1.1" 201 0
2026-03-28 14:07:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FCK18AEJ%252F698910428%252F600') HTTP/1.1" 204 0
2026-03-28 14:07:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CK18AEJ/698910428/600 saved to cache
2026-03-28 14:07:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 954e7a8e-294d-583e-8576-18c9af402ec0
2026-03-28 14:07:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:07:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a1fe8f890>
2026-03-28 14:07:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:07:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:07:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:07:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bb105475-65fd-5601-86d0-a8590c56bf0b/bb105475-65fd-5601-86d0-a8590c56bf0b_image_5.jpg HTTP/1.1" 201 0
2026-03-28 14:07:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLK64NEJ%252F698947086%252F600') HTTP/1.1" 204 0
2026-03-28 14:07:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LK64NEJ/698947086/600 saved to cache
2026-03-28 14:07:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item bb105475-65fd-5601-86d0-a8590c56bf0b
2026-03-28 14:07:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:07:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c9b6250>
2026-03-28 14:07:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:07:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:07:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:07:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_954e7a8e-294d-583e-8576-18c9af402ec0/954e7a8e-294d-583e-8576-18c9af402ec0_image_5.jpg HTTP/1.1" 201 0
2026-03-28 14:07:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FCK18AEJ%252F698910404%252F600') HTTP/1.1" 204 0
2026-03-28 14:07:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CK18AEJ/698910404/600 saved to cache
2026-03-28 14:07:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 954e7a8e-294d-583e-8576-18c9af402ec0
2026-03-28 14:07:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:07:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a3011b9d0>
2026-03-28 14:07:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:07:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:07:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:07:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_090813ec-adc2-5b7f-923f-58bcb47db483/090813ec-adc2-5b7f-923f-58bcb47db483_image_3.jpg HTTP/1.1" 201 0
2026-03-28 14:07:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FBP67XDB%252F698934010%252F600') HTTP/1.1" 204 0
2026-03-28 14:07:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BP67XDB/698934010/600 saved to cache
2026-03-28 14:07:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 090813ec-adc2-5b7f-923f-58bcb47db483
2026-03-28 14:07:00 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:07:00 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:07:00 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:07:00 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:07:00 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:07:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:07:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c4a8f10>
2026-03-28 14:07:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:07:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:07:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:07:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2c7ab10e-203f-5d5d-b669-d394e3cfab8d/2c7ab10e-203f-5d5d-b669-d394e3cfab8d_image_7.jpg HTTP/1.1" 201 0
2026-03-28 14:07:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FWU19VDC%252F698045650%252F600') HTTP/1.1" 204 0
2026-03-28 14:07:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WU19VDC/698045650/600 saved to cache
2026-03-28 14:07:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 2c7ab10e-203f-5d5d-b669-d394e3cfab8d
2026-03-28 14:07:00 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:07:00 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:07:00 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:07:00 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:07:00 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:07:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:07:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2d83b9d0>
2026-03-28 14:07:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:07:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:07:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:07:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_40991700-d0e5-5255-930d-6ca8fe3c072d/40991700-d0e5-5255-930d-6ca8fe3c072d_image_6.jpg HTTP/1.1" 201 0
2026-03-28 14:07:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FDF12VWL%252F698228819%252F600') HTTP/1.1" 204 0
2026-03-28 14:07:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DF12VWL/698228819/600 saved to cache
2026-03-28 14:07:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 40991700-d0e5-5255-930d-6ca8fe3c072d
2026-03-28 14:07:00 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LK64NEJ/698947049/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698947049>
2026-03-28 14:07:00 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CK18AEJ/698910374/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698910374>
2026-03-28 14:07:00 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YD21LKP/42810029?sv=2020-08-04&st=2026-03-28T14%3A07%3A00Z&se=2026-03-28T14%3A32%3A00Z&sr=b&sp=r&sig=EiPkPHEa%2F3uktliD9Vj4mtSFOMGvF7A9AlPUHHkf2%2B4%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=YD21%20LKP-GB>
2026-03-28 14:07:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CK18AEJ/698910391/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/CK18AEJ/42809519?sv=2020-08-04&st=2026-03-28T14%3A03%3A52Z&se=2026-03-28T14%3A28%3A52Z&sr=b&sp=r&sig=tMAO1WCWalJ7mXIWRlCxzQ1Rx0voh0Hr3%2FaR8xfgZTg%3D)
2026-03-28 14:07:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KV16LDZ/698296923/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/KV16LDZ/42797857?sv=2020-08-04&st=2026-03-28T14%3A03%3A49Z&se=2026-03-28T14%3A28%3A49Z&sr=b&sp=r&sig=7pGIWvim4gxli5cifd615Lw7Q0s6ljm9z8msDK3x6Js%3D)
2026-03-28 14:07:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BV61MVO/698928702/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/BV61MVO/42809949?sv=2020-08-04&st=2026-03-28T14%3A03%3A49Z&se=2026-03-28T14%3A28%3A49Z&sr=b&sp=r&sig=PJNKzVVeJy1FKQt32eUXNOOsoTV6pqchYxeSDnPTh7w%3D)
2026-03-28 14:07:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/T400WRS/42810019?sv=2020-08-04&st=2026-03-28T14%3A06%3A56Z&se=2026-03-28T14%3A31%3A56Z&sr=b&sp=r&sig=kIZj2tqr%2BfocLXmzFxOg%2F2cX7%2FfCCdSGle1KfN6FfvQ%3D> (referer: https://www.bca.co.uk/)
2026-03-28 14:07:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/KEZ9481/42810228?sv=2020-08-04&st=2026-03-28T14%3A06%3A56Z&se=2026-03-28T14%3A31%3A56Z&sr=b&sp=r&sig=DDPGn%2BcxbHbdqwyGWf309ifFTIM3Acs6kuQRt8vCf2E%3D> (referer: https://www.bca.co.uk/)
2026-03-28 14:07:00 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KM11UUD/698915234/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698915234>
2026-03-28 14:07:00 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BP67XDB/698933971/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698933971>
2026-03-28 14:07:00 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DF12VWL/698228782/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698228782>
2026-03-28 14:07:00 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WU19VDC/698045637/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698045637>
2026-03-28 14:07:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LK64NEJ/698947067/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LK64NEJ/42810513?sv=2020-08-04&st=2026-03-28T14%3A03%3A51Z&se=2026-03-28T14%3A28%3A51Z&sr=b&sp=r&sig=dZi6EyBOQ2GoK8knfBZtxM9S6O3yD8ghOm4nMLyaJjo%3D)
2026-03-28 14:07:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DF12VWL/698228796/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/DF12VWL/42797174?sv=2020-08-04&st=2026-03-28T14%3A03%3A51Z&se=2026-03-28T14%3A28%3A51Z&sr=b&sp=r&sig=0mRjBtvz6tka1D82qBQ3%2FRs63GOtrqyuAG7vdnh5S9c%3D)
2026-03-28 14:07:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:07:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2d89df50>
2026-03-28 14:07:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:07:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:07:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:07:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_954e7a8e-294d-583e-8576-18c9af402ec0/954e7a8e-294d-583e-8576-18c9af402ec0_image_4.jpg HTTP/1.1" 201 0
2026-03-28 14:07:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FCK18AEJ%252F698910391%252F600') HTTP/1.1" 204 0
2026-03-28 14:07:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CK18AEJ/698910391/600 saved to cache
2026-03-28 14:07:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 954e7a8e-294d-583e-8576-18c9af402ec0
2026-03-28 14:07:00 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:07:00 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:07:00 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:07:00 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:07:00 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:07:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:07:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c148ed0>
2026-03-28 14:07:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:07:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:07:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:07:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8b90222e-e04a-5b27-ab41-392150aadde5/8b90222e-e04a-5b27-ab41-392150aadde5_image_8.jpg HTTP/1.1" 201 0
2026-03-28 14:07:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FKV16LDZ%252F698296923%252F600') HTTP/1.1" 204 0
2026-03-28 14:07:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KV16LDZ/698296923/600 saved to cache
2026-03-28 14:07:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 8b90222e-e04a-5b27-ab41-392150aadde5
2026-03-28 14:07:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CK18AEJ/698910374/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/CK18AEJ/42809519?sv=2020-08-04&st=2026-03-28T14%3A03%3A52Z&se=2026-03-28T14%3A28%3A52Z&sr=b&sp=r&sig=tMAO1WCWalJ7mXIWRlCxzQ1Rx0voh0Hr3%2FaR8xfgZTg%3D)
2026-03-28 14:07:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LK64NEJ/698947049/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LK64NEJ/42810513?sv=2020-08-04&st=2026-03-28T14%3A03%3A51Z&se=2026-03-28T14%3A28%3A51Z&sr=b&sp=r&sig=dZi6EyBOQ2GoK8knfBZtxM9S6O3yD8ghOm4nMLyaJjo%3D)
2026-03-28 14:07:00 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BV61MVO/698928652/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698928652>
2026-03-28 14:07:00 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KV16LDZ/698296913/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698296913>
2026-03-28 14:07:00 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NL64KGO/698157181/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698157181>
2026-03-28 14:07:00 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/X11BBM/697604017/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=697604017>
2026-03-28 14:07:00 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:07:00 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:07:00 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:07:00 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:07:00 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:07:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:07:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c9dadd0>
2026-03-28 14:07:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:07:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:07:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:07:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6665ad2b-5db8-5cb5-8575-3440dfdc3f0c/6665ad2b-5db8-5cb5-8575-3440dfdc3f0c_image_9.jpg HTTP/1.1" 201 0
2026-03-28 14:07:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FBV61MVO%252F698928702%252F600') HTTP/1.1" 204 0
2026-03-28 14:07:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BV61MVO/698928702/600 saved to cache
2026-03-28 14:07:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 6665ad2b-5db8-5cb5-8575-3440dfdc3f0c
2026-03-28 14:07:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/SH22GFY/42809522?sv=2020-08-04&st=2026-03-28T14%3A06%3A58Z&se=2026-03-28T14%3A31%3A58Z&sr=b&sp=r&sig=LF9M3JDhfhAd7nxLqVMWN2qOdCGHrBuIZdqAc9eQvMA%3D> (referer: https://www.bca.co.uk/)
2026-03-28 14:07:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YD21LKP/42810029?sv=2020-08-04&st=2026-03-28T14%3A07%3A00Z&se=2026-03-28T14%3A32%3A00Z&sr=b&sp=r&sig=EiPkPHEa%2F3uktliD9Vj4mtSFOMGvF7A9AlPUHHkf2%2B4%3D> (referer: https://www.bca.co.uk/)
2026-03-28 14:07:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:07:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2d7aa2d0>
2026-03-28 14:07:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:07:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:07:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:07:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a2c13cca-acdb-56e9-80bf-41e2acf4aed1/a2c13cca-acdb-56e9-80bf-41e2acf4aed1_expert_report_file_abed905b-d731-4403-ac37-a37ca6741086.pdf HTTP/1.1" 201 0
2026-03-28 14:07:01 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item a2c13cca-acdb-56e9-80bf-41e2acf4aed1
2026-03-28 14:07:01 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: a2c13cca-acdb-56e9-80bf-41e2acf4aed1, skipping ID generation
2026-03-28 14:07:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item a2c13cca-acdb-56e9-80bf-41e2acf4aed1
2026-03-28 14:07:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DT400WRS-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-28 14:07:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=T400WRS-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-28 14:07:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:07:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2d9f8b90>
2026-03-28 14:07:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:07:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:07:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:07:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f055b506-0022-5f0e-a7cd-13f0911779b4/f055b506-0022-5f0e-a7cd-13f0911779b4_expert_report_file_2bcec5d9-3cef-4aa7-b068-c72ca5f3c66e.pdf HTTP/1.1" 201 0
2026-03-28 14:07:01 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item f055b506-0022-5f0e-a7cd-13f0911779b4
2026-03-28 14:07:01 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: f055b506-0022-5f0e-a7cd-13f0911779b4, skipping ID generation
2026-03-28 14:07:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item f055b506-0022-5f0e-a7cd-13f0911779b4
2026-03-28 14:07:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DKEZ9481-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-28 14:07:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=KEZ9481-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-28 14:07:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:07:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2dd16c10>
2026-03-28 14:07:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:07:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:07:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:07:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bb105475-65fd-5601-86d0-a8590c56bf0b/bb105475-65fd-5601-86d0-a8590c56bf0b_image_4.jpg HTTP/1.1" 201 0
2026-03-28 14:07:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLK64NEJ%252F698947067%252F600') HTTP/1.1" 204 0
2026-03-28 14:07:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LK64NEJ/698947067/600 saved to cache
2026-03-28 14:07:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item bb105475-65fd-5601-86d0-a8590c56bf0b
2026-03-28 14:07:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:07:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c9bbb90>
2026-03-28 14:07:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:07:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:07:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:07:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_40991700-d0e5-5255-930d-6ca8fe3c072d/40991700-d0e5-5255-930d-6ca8fe3c072d_image_5.jpg HTTP/1.1" 201 0
2026-03-28 14:07:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FDF12VWL%252F698228796%252F600') HTTP/1.1" 204 0
2026-03-28 14:07:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DF12VWL/698228796/600 saved to cache
2026-03-28 14:07:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 40991700-d0e5-5255-930d-6ca8fe3c072d
2026-03-28 14:07:01 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WV16UWB/698284443/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698284443>
2026-03-28 14:07:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WU19VDC/698045637/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/WU19VDC/42792335?sv=2020-08-04&st=2026-03-28T14%3A03%3A50Z&se=2026-03-28T14%3A28%3A50Z&sr=b&sp=r&sig=Mqd3JjFAqa%2F7fy72g8Zcx8u%2F7XgFrycUpKRkPg1JOjA%3D)
2026-03-28 14:07:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BP67XDB/698933971/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/BP67XDB/42810422?sv=2020-08-04&st=2026-03-28T14%3A03%3A52Z&se=2026-03-28T14%3A28%3A52Z&sr=b&sp=r&sig=Logn8Hbry8lNDBo7BHyP%2FFQM2Uo9ZZUQT4uyTv5b%2Bn0%3D)
2026-03-28 14:07:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KM11UUD/698915234/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/KM11UUD/42809630?sv=2020-08-04&st=2026-03-28T14%3A03%3A52Z&se=2026-03-28T14%3A28%3A52Z&sr=b&sp=r&sig=S16ojkv9p8NH2wa7caJZQVn%2BDGo%2BREXS30Hz2ckWR%2FA%3D)
2026-03-28 14:07:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DF12VWL/698228782/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/DF12VWL/42797174?sv=2020-08-04&st=2026-03-28T14%3A03%3A51Z&se=2026-03-28T14%3A28%3A51Z&sr=b&sp=r&sig=0mRjBtvz6tka1D82qBQ3%2FRs63GOtrqyuAG7vdnh5S9c%3D)
2026-03-28 14:07:01 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/ML71WFO/42810333?sv=2020-08-04&st=2026-03-28T14%3A07%3A01Z&se=2026-03-28T14%3A32%3A01Z&sr=b&sp=r&sig=cXBfdYlvFIlLScFId9KF04NOtu6grGZTIAZqQZ2i%2Bn0%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=ML71%20WFO-GB>
2026-03-28 14:07:01 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/WP13WWY/42793381?sv=2020-08-04&st=2026-03-28T14%3A07%3A01Z&se=2026-03-28T14%3A32%3A01Z&sr=b&sp=r&sig=wQS0I02XI5RzxZvAM48J7feAWKIRK81PE6DyEJBKsFc%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=WP13%20WWY-GB>
2026-03-28 14:07:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698069950%27 HTTP/1.1" 200 None
2026-03-28 14:07:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698069950 not downloaded yet
2026-03-28 14:07:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698941309%27 HTTP/1.1" 200 None
2026-03-28 14:07:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698941309 not downloaded yet
2026-03-28 14:07:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/X11BBM/697604017/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/X11BBM/42809514?sv=2020-08-04&st=2026-03-28T14%3A03%3A48Z&se=2026-03-28T14%3A28%3A48Z&sr=b&sp=r&sig=iFv2U%2F%2BmiJcqZ%2BPwwi1Pjq9aw6DZNzQsG5k9GNFr4Nw%3D)
2026-03-28 14:07:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:07:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c9a1c10>
2026-03-28 14:07:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:07:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:07:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:07:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_954e7a8e-294d-583e-8576-18c9af402ec0/954e7a8e-294d-583e-8576-18c9af402ec0_image_3.jpg HTTP/1.1" 201 0
2026-03-28 14:07:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FCK18AEJ%252F698910374%252F600') HTTP/1.1" 204 0
2026-03-28 14:07:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CK18AEJ/698910374/600 saved to cache
2026-03-28 14:07:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 954e7a8e-294d-583e-8576-18c9af402ec0
2026-03-28 14:07:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:07:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c429d50>
2026-03-28 14:07:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:07:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:07:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:07:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bb105475-65fd-5601-86d0-a8590c56bf0b/bb105475-65fd-5601-86d0-a8590c56bf0b_image_3.jpg HTTP/1.1" 201 0
2026-03-28 14:07:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLK64NEJ%252F698947049%252F600') HTTP/1.1" 204 0
2026-03-28 14:07:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LK64NEJ/698947049/600 saved to cache
2026-03-28 14:07:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item bb105475-65fd-5601-86d0-a8590c56bf0b
2026-03-28 14:07:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:07:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a30b106d0>
2026-03-28 14:07:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:07:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:07:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:07:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_95add145-cfdb-56fb-a27d-d877a0432bd6/95add145-cfdb-56fb-a27d-d877a0432bd6_expert_report_file_c87a3a48-4e80-4ca0-a21d-6a214d01ca79.pdf HTTP/1.1" 201 0
2026-03-28 14:07:01 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item 95add145-cfdb-56fb-a27d-d877a0432bd6
2026-03-28 14:07:01 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 95add145-cfdb-56fb-a27d-d877a0432bd6, skipping ID generation
2026-03-28 14:07:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 95add145-cfdb-56fb-a27d-d877a0432bd6
2026-03-28 14:07:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DSH22GFY-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-28 14:07:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=SH22GFY-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-28 14:07:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:07:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c429ed0>
2026-03-28 14:07:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:07:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:07:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:07:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e39beb78-d51f-5fbe-a58d-f26050dd24f6/e39beb78-d51f-5fbe-a58d-f26050dd24f6_expert_report_file_36c2cb97-9c5d-4990-a550-f63692de35d5.pdf HTTP/1.1" 201 0
2026-03-28 14:07:01 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item e39beb78-d51f-5fbe-a58d-f26050dd24f6
2026-03-28 14:07:01 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: e39beb78-d51f-5fbe-a58d-f26050dd24f6, skipping ID generation
2026-03-28 14:07:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item e39beb78-d51f-5fbe-a58d-f26050dd24f6
2026-03-28 14:07:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DYD21LKP-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-28 14:07:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=YD21LKP-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-28 14:07:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698069954%27 HTTP/1.1" 200 None
2026-03-28 14:07:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698069954 not downloaded yet
2026-03-28 14:07:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698941324%27 HTTP/1.1" 200 None
2026-03-28 14:07:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698941324 not downloaded yet
2026-03-28 14:07:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698915544%27 HTTP/1.1" 200 None
2026-03-28 14:07:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698915544 not downloaded yet
2026-03-28 14:07:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698439628%27 HTTP/1.1" 200 None
2026-03-28 14:07:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698439628 not downloaded yet
2026-03-28 14:07:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698069958%27 HTTP/1.1" 200 None
2026-03-28 14:07:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698069958 not downloaded yet
2026-03-28 14:07:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698941343%27 HTTP/1.1" 200 None
2026-03-28 14:07:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698941343 not downloaded yet
2026-03-28 14:07:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:07:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2de00cd0>
2026-03-28 14:07:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:07:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:07:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:07:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2c7ab10e-203f-5d5d-b669-d394e3cfab8d/2c7ab10e-203f-5d5d-b669-d394e3cfab8d_image_5.jpg HTTP/1.1" 201 0
2026-03-28 14:07:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FWU19VDC%252F698045637%252F600') HTTP/1.1" 204 0
2026-03-28 14:07:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WU19VDC/698045637/600 saved to cache
2026-03-28 14:07:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 2c7ab10e-203f-5d5d-b669-d394e3cfab8d
2026-03-28 14:07:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:07:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c9fa6d0>
2026-03-28 14:07:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:07:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:07:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:07:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_090813ec-adc2-5b7f-923f-58bcb47db483/090813ec-adc2-5b7f-923f-58bcb47db483_image_1.jpg HTTP/1.1" 201 0
2026-03-28 14:07:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FBP67XDB%252F698933971%252F600') HTTP/1.1" 204 0
2026-03-28 14:07:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BP67XDB/698933971/600 saved to cache
2026-03-28 14:07:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 090813ec-adc2-5b7f-923f-58bcb47db483
2026-03-28 14:07:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:07:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c768dd0>
2026-03-28 14:07:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:07:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:07:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:07:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7ba82627-3d66-5970-bb5d-b19d751b9eb4/7ba82627-3d66-5970-bb5d-b19d751b9eb4_image_1.jpg HTTP/1.1" 201 0
2026-03-28 14:07:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FKM11UUD%252F698915234%252F600') HTTP/1.1" 204 0
2026-03-28 14:07:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KM11UUD/698915234/600 saved to cache
2026-03-28 14:07:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 7ba82627-3d66-5970-bb5d-b19d751b9eb4
2026-03-28 14:07:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:07:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c16e690>
2026-03-28 14:07:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:07:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:07:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:07:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_40991700-d0e5-5255-930d-6ca8fe3c072d/40991700-d0e5-5255-930d-6ca8fe3c072d_image_4.jpg HTTP/1.1" 201 0
2026-03-28 14:07:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FDF12VWL%252F698228782%252F600') HTTP/1.1" 204 0
2026-03-28 14:07:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DF12VWL/698228782/600 saved to cache
2026-03-28 14:07:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 40991700-d0e5-5255-930d-6ca8fe3c072d
2026-03-28 14:07:01 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:07:01 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:07:01 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:07:01 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:07:01 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:07:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:07:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2de10650>
2026-03-28 14:07:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:07:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:07:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:07:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6f52ae88-a710-5999-b75b-294cfedaf6f8/6f52ae88-a710-5999-b75b-294cfedaf6f8_image_8.jpg HTTP/1.1" 201 0
2026-03-28 14:07:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FX11BBM%252F697604017%252F600') HTTP/1.1" 204 0
2026-03-28 14:07:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/X11BBM/697604017/600 saved to cache
2026-03-28 14:07:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 6f52ae88-a710-5999-b75b-294cfedaf6f8
2026-03-28 14:07:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BV61MVO/698928652/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/BV61MVO/42809949?sv=2020-08-04&st=2026-03-28T14%3A03%3A49Z&se=2026-03-28T14%3A28%3A49Z&sr=b&sp=r&sig=PJNKzVVeJy1FKQt32eUXNOOsoTV6pqchYxeSDnPTh7w%3D)
2026-03-28 14:07:02 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LK64NEJ/698947033/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698947033>
2026-03-28 14:07:02 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DF12VWL/698228771/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698228771>
2026-03-28 14:07:02 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CK18AEJ/698910355/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698910355>
2026-03-28 14:07:02 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/OY67JPV/698108035/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698108035>
2026-03-28 14:07:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698915564%27 HTTP/1.1" 200 None
2026-03-28 14:07:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698915564 not downloaded yet
2026-03-28 14:07:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698439633%27 HTTP/1.1" 200 None
2026-03-28 14:07:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698439633 not downloaded yet
2026-03-28 14:07:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NL64KGO/698157181/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/NL64KGO/42810049?sv=2020-08-04&st=2026-03-28T14%3A03%3A48Z&se=2026-03-28T14%3A28%3A48Z&sr=b&sp=r&sig=GCr8gvM5cBzuZAr6Na7pdcamsQO4tFs2xqxAknQovkg%3D)
2026-03-28 14:07:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698069961%27 HTTP/1.1" 200 None
2026-03-28 14:07:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698069961 not downloaded yet
2026-03-28 14:07:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698941361%27 HTTP/1.1" 200 None
2026-03-28 14:07:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698941361 not downloaded yet
2026-03-28 14:07:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KV16LDZ/698296913/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/KV16LDZ/42797857?sv=2020-08-04&st=2026-03-28T14%3A03%3A49Z&se=2026-03-28T14%3A28%3A49Z&sr=b&sp=r&sig=7pGIWvim4gxli5cifd615Lw7Q0s6ljm9z8msDK3x6Js%3D)
2026-03-28 14:07:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698915586%27 HTTP/1.1" 200 None
2026-03-28 14:07:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698915586 not downloaded yet
2026-03-28 14:07:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698439635%27 HTTP/1.1" 200 None
2026-03-28 14:07:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698439635 not downloaded yet
2026-03-28 14:07:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698069970%27 HTTP/1.1" 200 None
2026-03-28 14:07:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698069970 not downloaded yet
2026-03-28 14:07:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698941379%27 HTTP/1.1" 200 None
2026-03-28 14:07:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698941379 not downloaded yet
2026-03-28 14:07:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/WP13WWY/42793381?sv=2020-08-04&st=2026-03-28T14%3A07%3A01Z&se=2026-03-28T14%3A32%3A01Z&sr=b&sp=r&sig=wQS0I02XI5RzxZvAM48J7feAWKIRK81PE6DyEJBKsFc%3D> (referer: https://www.bca.co.uk/)
2026-03-28 14:07:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698915611%27 HTTP/1.1" 200 None
2026-03-28 14:07:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698915611 not downloaded yet
2026-03-28 14:07:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698439638%27 HTTP/1.1" 200 None
2026-03-28 14:07:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698439638 not downloaded yet
2026-03-28 14:07:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698069973%27 HTTP/1.1" 200 None
2026-03-28 14:07:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698069973 not downloaded yet
2026-03-28 14:07:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698941415%27 HTTP/1.1" 200 None
2026-03-28 14:07:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698941415 not downloaded yet
2026-03-28 14:07:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WV16UWB/698284443/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/WV16UWB/42797605?sv=2020-08-04&st=2026-03-28T14%3A03%3A48Z&se=2026-03-28T14%3A28%3A48Z&sr=b&sp=r&sig=tZmKWGpA7mZ9Rie4bcnpNzrMU30KCOw%2BfaCUNgMn820%3D)
2026-03-28 14:07:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/ML71WFO/42810333?sv=2020-08-04&st=2026-03-28T14%3A07%3A01Z&se=2026-03-28T14%3A32%3A01Z&sr=b&sp=r&sig=cXBfdYlvFIlLScFId9KF04NOtu6grGZTIAZqQZ2i%2Bn0%3D> (referer: https://www.bca.co.uk/)
2026-03-28 14:07:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698915627%27 HTTP/1.1" 200 None
2026-03-28 14:07:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698915627 not downloaded yet
2026-03-28 14:07:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698439643%27 HTTP/1.1" 200 None
2026-03-28 14:07:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698439643 not downloaded yet
2026-03-28 14:07:02 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:07:02 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:07:02 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:07:02 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:07:02 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:07:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:07:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a1fec8910>
2026-03-28 14:07:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:07:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:07:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:07:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6665ad2b-5db8-5cb5-8575-3440dfdc3f0c/6665ad2b-5db8-5cb5-8575-3440dfdc3f0c_image_7.jpg HTTP/1.1" 201 0
2026-03-28 14:07:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FBV61MVO%252F698928652%252F600') HTTP/1.1" 204 0
2026-03-28 14:07:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BV61MVO/698928652/600 saved to cache
2026-03-28 14:07:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 6665ad2b-5db8-5cb5-8575-3440dfdc3f0c
2026-03-28 14:07:02 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:07:02 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:07:02 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:07:02 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:07:02 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:07:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:07:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2dd1c190>
2026-03-28 14:07:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:07:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:07:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:07:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0c3c3ab5-91e6-5450-9be7-ee521ca8a766/0c3c3ab5-91e6-5450-9be7-ee521ca8a766_image_8.jpg HTTP/1.1" 201 0
2026-03-28 14:07:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FNL64KGO%252F698157181%252F600') HTTP/1.1" 204 0
2026-03-28 14:07:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NL64KGO/698157181/600 saved to cache
2026-03-28 14:07:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 0c3c3ab5-91e6-5450-9be7-ee521ca8a766
2026-03-28 14:07:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698069977%27 HTTP/1.1" 200 None
2026-03-28 14:07:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698069977 not downloaded yet
2026-03-28 14:07:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698941474%27 HTTP/1.1" 200 None
2026-03-28 14:07:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698941474 not downloaded yet
2026-03-28 14:07:02 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KEZ9481/698941303/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=KEZ9481-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-28 14:07:02 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/T400WRS/698069947/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=T400WRS-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-28 14:07:02 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KM11UUD/698915221/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=KM11UUD-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-28 14:07:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698915648%27 HTTP/1.1" 200 None
2026-03-28 14:07:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698915648 not downloaded yet
2026-03-28 14:07:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698439650%27 HTTP/1.1" 200 None
2026-03-28 14:07:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698439650 not downloaded yet
2026-03-28 14:07:02 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:07:02 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:07:02 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:07:02 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:07:02 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:07:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:07:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c8dbd50>
2026-03-28 14:07:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:07:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:07:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:07:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8b90222e-e04a-5b27-ab41-392150aadde5/8b90222e-e04a-5b27-ab41-392150aadde5_image_6.jpg HTTP/1.1" 201 0
2026-03-28 14:07:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FKV16LDZ%252F698296913%252F600') HTTP/1.1" 204 0
2026-03-28 14:07:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KV16LDZ/698296913/600 saved to cache
2026-03-28 14:07:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 8b90222e-e04a-5b27-ab41-392150aadde5
2026-03-28 14:07:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/OY67JPV/698108035/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/OY67JPV/42810048?sv=2020-08-04&st=2026-03-28T14%3A03%3A48Z&se=2026-03-28T14%3A28%3A48Z&sr=b&sp=r&sig=3IQnxpRCaMGCrWPQZylbi%2BiY%2FkfXKw1FEE36W3dpRwo%3D)
2026-03-28 14:07:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CK18AEJ/698910355/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/CK18AEJ/42809519?sv=2020-08-04&st=2026-03-28T14%3A03%3A52Z&se=2026-03-28T14%3A28%3A52Z&sr=b&sp=r&sig=tMAO1WCWalJ7mXIWRlCxzQ1Rx0voh0Hr3%2FaR8xfgZTg%3D)
2026-03-28 14:07:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698069983%27 HTTP/1.1" 200 None
2026-03-28 14:07:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698069983 not downloaded yet
2026-03-28 14:07:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698941524%27 HTTP/1.1" 200 None
2026-03-28 14:07:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698941524 not downloaded yet
2026-03-28 14:07:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DF12VWL/698228771/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/DF12VWL/42797174?sv=2020-08-04&st=2026-03-28T14%3A03%3A51Z&se=2026-03-28T14%3A28%3A51Z&sr=b&sp=r&sig=0mRjBtvz6tka1D82qBQ3%2FRs63GOtrqyuAG7vdnh5S9c%3D)
2026-03-28 14:07:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698915673%27 HTTP/1.1" 200 None
2026-03-28 14:07:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698915673 not downloaded yet
2026-03-28 14:07:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698439656%27 HTTP/1.1" 200 None
2026-03-28 14:07:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698439656 not downloaded yet
2026-03-28 14:07:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LK64NEJ/698947033/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LK64NEJ/42810513?sv=2020-08-04&st=2026-03-28T14%3A03%3A51Z&se=2026-03-28T14%3A28%3A51Z&sr=b&sp=r&sig=dZi6EyBOQ2GoK8knfBZtxM9S6O3yD8ghOm4nMLyaJjo%3D)
2026-03-28 14:07:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698069991%27 HTTP/1.1" 200 None
2026-03-28 14:07:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698069991 not downloaded yet
2026-03-28 14:07:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698941540%27 HTTP/1.1" 200 None
2026-03-28 14:07:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698941540 not downloaded yet
2026-03-28 14:07:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:07:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2d8ed890>
2026-03-28 14:07:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:07:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:07:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:07:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8e80177a-614d-57e6-b32b-c4549bde7262/8e80177a-614d-57e6-b32b-c4549bde7262_expert_report_file_980bb9f7-e78b-4672-85cf-dc083b8b298e.pdf HTTP/1.1" 201 0
2026-03-28 14:07:02 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item 8e80177a-614d-57e6-b32b-c4549bde7262
2026-03-28 14:07:02 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 8e80177a-614d-57e6-b32b-c4549bde7262, skipping ID generation
2026-03-28 14:07:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 8e80177a-614d-57e6-b32b-c4549bde7262
2026-03-28 14:07:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DWP13WWY-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-28 14:07:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=WP13WWY-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-28 14:07:02 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:07:02 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:07:02 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:07:02 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:07:02 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:07:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:07:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a1fe51050>
2026-03-28 14:07:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:07:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:07:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:07:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_214771ac-26f4-5760-a178-e14681ff06b8/214771ac-26f4-5760-a178-e14681ff06b8_image_8.jpg HTTP/1.1" 201 0
2026-03-28 14:07:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FWV16UWB%252F698284443%252F600') HTTP/1.1" 204 0
2026-03-28 14:07:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WV16UWB/698284443/600 saved to cache
2026-03-28 14:07:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 214771ac-26f4-5760-a178-e14681ff06b8
2026-03-28 14:07:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:07:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a1fec8390>
2026-03-28 14:07:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:07:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:07:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:07:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_932ab700-a26e-556f-85b5-1bb9734e718c/932ab700-a26e-556f-85b5-1bb9734e718c_expert_report_file_84e1ff92-1a98-478b-b6f1-dc8816a605ce.pdf HTTP/1.1" 201 0
2026-03-28 14:07:02 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item 932ab700-a26e-556f-85b5-1bb9734e718c
2026-03-28 14:07:02 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 932ab700-a26e-556f-85b5-1bb9734e718c, skipping ID generation
2026-03-28 14:07:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 932ab700-a26e-556f-85b5-1bb9734e718c
2026-03-28 14:07:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DML71WFO-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-28 14:07:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=ML71WFO-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-28 14:07:02 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/T400WRS/698069958/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698069958>
2026-03-28 14:07:02 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KEZ9481/698941343/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698941343>
2026-03-28 14:07:02 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YD21LKP/698439635/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698439635>
2026-03-28 14:07:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698915706%27 HTTP/1.1" 200 None
2026-03-28 14:07:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698915706 not downloaded yet
2026-03-28 14:07:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698439665%27 HTTP/1.1" 200 None
2026-03-28 14:07:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698439665 not downloaded yet
2026-03-28 14:07:03 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YD21LKP/698439633/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698439633>
2026-03-28 14:07:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698051980%27 HTTP/1.1" 200 None
2026-03-28 14:07:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698051980 not downloaded yet
2026-03-28 14:07:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698947244%27 HTTP/1.1" 200 None
2026-03-28 14:07:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698947244 not downloaded yet
2026-03-28 14:07:03 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YD21LKP/698439638/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698439638>
2026-03-28 14:07:03 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SH22GFY/698915611/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698915611>
2026-03-28 14:07:03 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FV17TYW/698768046/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698768046>
2026-03-28 14:07:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698915737%27 HTTP/1.1" 200 None
2026-03-28 14:07:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698915737 not downloaded yet
2026-03-28 14:07:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698439675%27 HTTP/1.1" 200 None
2026-03-28 14:07:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698439675 not downloaded yet
2026-03-28 14:07:03 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:07:03 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:07:03 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:07:03 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:07:03 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:07:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:07:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2d6eeb90>
2026-03-28 14:07:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:07:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:07:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:07:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7708aee7-65e8-597e-aa3d-426819c9c319/7708aee7-65e8-597e-aa3d-426819c9c319_image_9.jpg HTTP/1.1" 201 0
2026-03-28 14:07:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FOY67JPV%252F698108035%252F600') HTTP/1.1" 204 0
2026-03-28 14:07:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/OY67JPV/698108035/600 saved to cache
2026-03-28 14:07:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 7708aee7-65e8-597e-aa3d-426819c9c319
2026-03-28 14:07:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:07:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a1fe29bd0>
2026-03-28 14:07:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:07:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:07:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:07:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_954e7a8e-294d-583e-8576-18c9af402ec0/954e7a8e-294d-583e-8576-18c9af402ec0_image_2.jpg HTTP/1.1" 201 0
2026-03-28 14:07:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FCK18AEJ%252F698910355%252F600') HTTP/1.1" 204 0
2026-03-28 14:07:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CK18AEJ/698910355/600 saved to cache
2026-03-28 14:07:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 954e7a8e-294d-583e-8576-18c9af402ec0
2026-03-28 14:07:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:07:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c504750>
2026-03-28 14:07:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:07:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:07:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:07:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_40991700-d0e5-5255-930d-6ca8fe3c072d/40991700-d0e5-5255-930d-6ca8fe3c072d_image_3.jpg HTTP/1.1" 201 0
2026-03-28 14:07:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FDF12VWL%252F698228771%252F600') HTTP/1.1" 204 0
2026-03-28 14:07:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DF12VWL/698228771/600 saved to cache
2026-03-28 14:07:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 40991700-d0e5-5255-930d-6ca8fe3c072d
2026-03-28 14:07:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:07:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2dbea4d0>
2026-03-28 14:07:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:07:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:07:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:07:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bb105475-65fd-5601-86d0-a8590c56bf0b/bb105475-65fd-5601-86d0-a8590c56bf0b_image_2.jpg HTTP/1.1" 201 0
2026-03-28 14:07:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLK64NEJ%252F698947033%252F600') HTTP/1.1" 204 0
2026-03-28 14:07:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LK64NEJ/698947033/600 saved to cache
2026-03-28 14:07:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item bb105475-65fd-5601-86d0-a8590c56bf0b
2026-03-28 14:07:03 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FY66OTD/698150830/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698150830>
2026-03-28 14:07:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KM11UUD/698915221/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/KM11UUD/42809630?sv=2020-08-04&st=2026-03-28T14%3A03%3A52Z&se=2026-03-28T14%3A28%3A52Z&sr=b&sp=r&sig=S16ojkv9p8NH2wa7caJZQVn%2BDGo%2BREXS30Hz2ckWR%2FA%3D)
2026-03-28 14:07:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KEZ9481/698941303/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/KEZ9481/42810228?sv=2020-08-04&st=2026-03-28T14%3A06%3A56Z&se=2026-03-28T14%3A31%3A56Z&sr=b&sp=r&sig=DDPGn%2BcxbHbdqwyGWf309ifFTIM3Acs6kuQRt8vCf2E%3D)
2026-03-28 14:07:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/T400WRS/698069947/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/T400WRS/42810019?sv=2020-08-04&st=2026-03-28T14%3A06%3A56Z&se=2026-03-28T14%3A31%3A56Z&sr=b&sp=r&sig=kIZj2tqr%2BfocLXmzFxOg%2F2cX7%2FfCCdSGle1KfN6FfvQ%3D)
2026-03-28 14:07:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698051988%27 HTTP/1.1" 200 None
2026-03-28 14:07:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698051988 not downloaded yet
2026-03-28 14:07:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698947260%27 HTTP/1.1" 200 None
2026-03-28 14:07:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698947260 not downloaded yet
2026-03-28 14:07:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698052000%27 HTTP/1.1" 200 None
2026-03-28 14:07:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698052000 not downloaded yet
2026-03-28 14:07:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698947272%27 HTTP/1.1" 200 None
2026-03-28 14:07:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698947272 not downloaded yet
2026-03-28 14:07:03 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KEZ9481/698941524/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698941524>
2026-03-28 14:07:03 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/T400WRS/698069983/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698069983>
2026-03-28 14:07:03 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/T400WRS/698069977/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698069977>
2026-03-28 14:07:03 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KEZ9481/698941474/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698941474>
2026-03-28 14:07:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698052011%27 HTTP/1.1" 200 None
2026-03-28 14:07:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698052011 not downloaded yet
2026-03-28 14:07:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698947282%27 HTTP/1.1" 200 None
2026-03-28 14:07:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698947282 not downloaded yet
2026-03-28 14:07:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698052027%27 HTTP/1.1" 200 None
2026-03-28 14:07:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698052027 not downloaded yet
2026-03-28 14:07:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698947295%27 HTTP/1.1" 200 None
2026-03-28 14:07:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698947295 not downloaded yet
2026-03-28 14:07:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/T400WRS/698069958/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/T400WRS/42810019?sv=2020-08-04&st=2026-03-28T14%3A06%3A56Z&se=2026-03-28T14%3A31%3A56Z&sr=b&sp=r&sig=kIZj2tqr%2BfocLXmzFxOg%2F2cX7%2FfCCdSGle1KfN6FfvQ%3D)
2026-03-28 14:07:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YD21LKP/698439635/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YD21LKP/42810029?sv=2020-08-04&st=2026-03-28T14%3A07%3A00Z&se=2026-03-28T14%3A32%3A00Z&sr=b&sp=r&sig=EiPkPHEa%2F3uktliD9Vj4mtSFOMGvF7A9AlPUHHkf2%2B4%3D)
2026-03-28 14:07:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698052041%27 HTTP/1.1" 200 None
2026-03-28 14:07:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698052041 not downloaded yet
2026-03-28 14:07:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698947320%27 HTTP/1.1" 200 None
2026-03-28 14:07:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698947320 not downloaded yet
2026-03-28 14:07:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:07:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c683b10>
2026-03-28 14:07:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:07:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:07:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:07:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7ba82627-3d66-5970-bb5d-b19d751b9eb4/7ba82627-3d66-5970-bb5d-b19d751b9eb4_image_0.jpg HTTP/1.1" 201 0
2026-03-28 14:07:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FKM11UUD%252F698915221%252F600') HTTP/1.1" 204 0
2026-03-28 14:07:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KM11UUD/698915221/600 saved to cache
2026-03-28 14:07:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 7ba82627-3d66-5970-bb5d-b19d751b9eb4
2026-03-28 14:07:03 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 7ba82627-3d66-5970-bb5d-b19d751b9eb4, skipping ID generation
2026-03-28 14:07:03 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 7ba82627-3d66-5970-bb5d-b19d751b9eb4 sending to next pipeline
2026-03-28 14:07:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 7ba82627-3d66-5970-bb5d-b19d751b9eb4, identifier: KM11%20UUD
2026-03-28 14:07:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:07:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2ca8a990>
2026-03-28 14:07:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:07:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:07:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:07:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f055b506-0022-5f0e-a7cd-13f0911779b4/f055b506-0022-5f0e-a7cd-13f0911779b4_image_0.jpg HTTP/1.1" 201 0
2026-03-28 14:07:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FKEZ9481%252F698941303%252F600') HTTP/1.1" 204 0
2026-03-28 14:07:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KEZ9481/698941303/600 saved to cache
2026-03-28 14:07:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item f055b506-0022-5f0e-a7cd-13f0911779b4
2026-03-28 14:07:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:07:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c9b4dd0>
2026-03-28 14:07:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:07:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:07:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:07:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a2c13cca-acdb-56e9-80bf-41e2acf4aed1/a2c13cca-acdb-56e9-80bf-41e2acf4aed1_image_0.jpg HTTP/1.1" 201 0
2026-03-28 14:07:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FT400WRS%252F698069947%252F600') HTTP/1.1" 204 0
2026-03-28 14:07:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/T400WRS/698069947/600 saved to cache
2026-03-28 14:07:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item a2c13cca-acdb-56e9-80bf-41e2acf4aed1
2026-03-28 14:07:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YD21LKP/698439633/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YD21LKP/42810029?sv=2020-08-04&st=2026-03-28T14%3A07%3A00Z&se=2026-03-28T14%3A32%3A00Z&sr=b&sp=r&sig=EiPkPHEa%2F3uktliD9Vj4mtSFOMGvF7A9AlPUHHkf2%2B4%3D)
2026-03-28 14:07:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KEZ9481/698941343/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/KEZ9481/42810228?sv=2020-08-04&st=2026-03-28T14%3A06%3A56Z&se=2026-03-28T14%3A31%3A56Z&sr=b&sp=r&sig=DDPGn%2BcxbHbdqwyGWf309ifFTIM3Acs6kuQRt8vCf2E%3D)
2026-03-28 14:07:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SH22GFY/698915611/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/SH22GFY/42809522?sv=2020-08-04&st=2026-03-28T14%3A06%3A58Z&se=2026-03-28T14%3A31%3A58Z&sr=b&sp=r&sig=LF9M3JDhfhAd7nxLqVMWN2qOdCGHrBuIZdqAc9eQvMA%3D)
2026-03-28 14:07:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YD21LKP/698439638/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YD21LKP/42810029?sv=2020-08-04&st=2026-03-28T14%3A07%3A00Z&se=2026-03-28T14%3A32%3A00Z&sr=b&sp=r&sig=EiPkPHEa%2F3uktliD9Vj4mtSFOMGvF7A9AlPUHHkf2%2B4%3D)
2026-03-28 14:07:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698052056%27 HTTP/1.1" 200 None
2026-03-28 14:07:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698052056 not downloaded yet
2026-03-28 14:07:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698947343%27 HTTP/1.1" 200 None
2026-03-28 14:07:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698947343 not downloaded yet
2026-03-28 14:07:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 7ba82627-3d66-5970-bb5d-b19d751b9eb4 with identifier: KM11%20UUD
2026-03-28 14:07:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 7ba82627-3d66-5970-bb5d-b19d751b9eb4 with identifier: KM11%20UUD
2026-03-28 14:07:04 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 7ba82627-3d66-5970-bb5d-b19d751b9eb4 with identifier: KM11%20UUD to the API
2026-03-28 14:07:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:07:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:07:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KM11UUD/698915221/600>
{'auction_title': '',
'c_o_2_emission_value': 103,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7ba82627-3d66-5970-bb5d-b19d751b9eb4/7ba82627-3d66-5970-bb5d-b19d751b9eb4_expert_report_file_d11bd6ee-08c7-45e0-9613-a67a59280070.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=KM11%20UUD-GB',
'category': 'Car',
'color': 'grey',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.0L',
'expiration_date': '2026-03-29T10:00:00Z',
'fuel_type': 'Petrol',
'id': '7ba82627-3d66-5970-bb5d-b19d751b9eb4',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'KM11 UUD',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=KM11%20UUD&vehicleType=*',
'listing': 'auction',
'location': 'Birmingham - Perry Barr',
'make': 'PEUGEOT',
'model': '107',
'odometer': 81226,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 11,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7ba82627-3d66-5970-bb5d-b19d751b9eb4/7ba82627-3d66-5970-bb5d-b19d751b9eb4_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 48765,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KM11UUD/698915221/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7ba82627-3d66-5970-bb5d-b19d751b9eb4/7ba82627-3d66-5970-bb5d-b19d751b9eb4_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 48053,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KM11UUD/698915234/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7ba82627-3d66-5970-bb5d-b19d751b9eb4/7ba82627-3d66-5970-bb5d-b19d751b9eb4_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 46839,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KM11UUD/698915253/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7ba82627-3d66-5970-bb5d-b19d751b9eb4/7ba82627-3d66-5970-bb5d-b19d751b9eb4_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 47390,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KM11UUD/698915278/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7ba82627-3d66-5970-bb5d-b19d751b9eb4/7ba82627-3d66-5970-bb5d-b19d751b9eb4_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 44898,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KM11UUD/698915297/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7ba82627-3d66-5970-bb5d-b19d751b9eb4/7ba82627-3d66-5970-bb5d-b19d751b9eb4_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 43208,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KM11UUD/698915312/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7ba82627-3d66-5970-bb5d-b19d751b9eb4/7ba82627-3d66-5970-bb5d-b19d751b9eb4_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 88909,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KM11UUD/698915340/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7ba82627-3d66-5970-bb5d-b19d751b9eb4/7ba82627-3d66-5970-bb5d-b19d751b9eb4_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 70118,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KM11UUD/698915361/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7ba82627-3d66-5970-bb5d-b19d751b9eb4/7ba82627-3d66-5970-bb5d-b19d751b9eb4_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 86096,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KM11UUD/698915386/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7ba82627-3d66-5970-bb5d-b19d751b9eb4/7ba82627-3d66-5970-bb5d-b19d751b9eb4_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 72636,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KM11UUD/698915403/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2011-01-01',
'seller_name': None,
'title': 'PEUGEOT 107 1.0 URBAN Hatchback',
'transmission': 'manual',
'trim': 'URBAN',
'vin': 'VF3PNCFB488583356',
'year': 2011}
2026-03-28 14:07:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KM11%2520UUD%27 HTTP/1.1" 200 None
2026-03-28 14:07:04 [bca.uk] INFO: Saving data for KM11%20UUD: {'created_time': 1774706824.710868, 'last_price_update_time': 1774706824.710881, 'auction_closing_time': 1774778400.0}
2026-03-28 14:07:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='KM11%2520UUD') HTTP/1.1" 204 0
2026-03-28 14:07:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FV17TYW/698768046/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/FV17TYW/42807142?sv=2020-08-04&st=2026-03-28T14%3A03%3A46Z&se=2026-03-28T14%3A28%3A46Z&sr=b&sp=r&sig=3LbtNEGnFqYV4bS0F0%2BmsB%2FgfFSYLdditNDmvy7kudU%3D)
2026-03-28 14:07:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.bca.co.uk/api/search?q=&pageSize=100&page=14&sort=MostRecentlyAdded> (referer: https://www.bca.co.uk/search) ['zyte-api']
2026-03-28 14:07:04 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WP13WWY/698051980/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698051980>
2026-03-28 14:07:04 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/ML71WFO/698947244/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698947244>
2026-03-28 14:07:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FY66OTD/698150830/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/FY66OTD/42794791?sv=2020-08-04&st=2026-03-28T14%3A03%3A46Z&se=2026-03-28T14%3A28%3A46Z&sr=b&sp=r&sig=nyWr7cManqycrjqVh9Sq0fegCWU0XCSire1eKcJWKLA%3D)
2026-03-28 14:07:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698052067%27 HTTP/1.1" 200 None
2026-03-28 14:07:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698052067 not downloaded yet
2026-03-28 14:07:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698947374%27 HTTP/1.1" 200 None
2026-03-28 14:07:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698947374 not downloaded yet
2026-03-28 14:07:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698052074%27 HTTP/1.1" 200 None
2026-03-28 14:07:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698052074 not downloaded yet
2026-03-28 14:07:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698947404%27 HTTP/1.1" 200 None
2026-03-28 14:07:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698947404 not downloaded yet
2026-03-28 14:07:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:07:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2d8f3f90>
2026-03-28 14:07:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:07:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:07:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:07:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a2c13cca-acdb-56e9-80bf-41e2acf4aed1/a2c13cca-acdb-56e9-80bf-41e2acf4aed1_image_3.jpg HTTP/1.1" 201 0
2026-03-28 14:07:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FT400WRS%252F698069958%252F600') HTTP/1.1" 204 0
2026-03-28 14:07:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/T400WRS/698069958/600 saved to cache
2026-03-28 14:07:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item a2c13cca-acdb-56e9-80bf-41e2acf4aed1
2026-03-28 14:07:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:07:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c6dd490>
2026-03-28 14:07:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:07:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:07:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:07:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e39beb78-d51f-5fbe-a58d-f26050dd24f6/e39beb78-d51f-5fbe-a58d-f26050dd24f6_image_3.jpg HTTP/1.1" 201 0
2026-03-28 14:07:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FYD21LKP%252F698439635%252F600') HTTP/1.1" 204 0
2026-03-28 14:07:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YD21LKP/698439635/600 saved to cache
2026-03-28 14:07:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item e39beb78-d51f-5fbe-a58d-f26050dd24f6
2026-03-28 14:07:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:07:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2dd16a50>
2026-03-28 14:07:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:07:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:07:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:07:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e39beb78-d51f-5fbe-a58d-f26050dd24f6/e39beb78-d51f-5fbe-a58d-f26050dd24f6_image_2.jpg HTTP/1.1" 201 0
2026-03-28 14:07:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FYD21LKP%252F698439633%252F600') HTTP/1.1" 204 0
2026-03-28 14:07:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YD21LKP/698439633/600 saved to cache
2026-03-28 14:07:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item e39beb78-d51f-5fbe-a58d-f26050dd24f6
2026-03-28 14:07:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:07:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2d8ed4d0>
2026-03-28 14:07:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:07:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:07:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:07:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f055b506-0022-5f0e-a7cd-13f0911779b4/f055b506-0022-5f0e-a7cd-13f0911779b4_image_3.jpg HTTP/1.1" 201 0
2026-03-28 14:07:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FKEZ9481%252F698941343%252F600') HTTP/1.1" 204 0
2026-03-28 14:07:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KEZ9481/698941343/600 saved to cache
2026-03-28 14:07:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item f055b506-0022-5f0e-a7cd-13f0911779b4
2026-03-28 14:07:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:07:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c8c7590>
2026-03-28 14:07:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:07:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:07:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:07:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_95add145-cfdb-56fb-a27d-d877a0432bd6/95add145-cfdb-56fb-a27d-d877a0432bd6_image_4.jpg HTTP/1.1" 201 0
2026-03-28 14:07:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FSH22GFY%252F698915611%252F600') HTTP/1.1" 204 0
2026-03-28 14:07:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SH22GFY/698915611/600 saved to cache
2026-03-28 14:07:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 95add145-cfdb-56fb-a27d-d877a0432bd6
2026-03-28 14:07:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:07:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2de12350>
2026-03-28 14:07:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:07:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:07:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:07:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e39beb78-d51f-5fbe-a58d-f26050dd24f6/e39beb78-d51f-5fbe-a58d-f26050dd24f6_image_4.jpg HTTP/1.1" 201 0
2026-03-28 14:07:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FYD21LKP%252F698439638%252F600') HTTP/1.1" 204 0
2026-03-28 14:07:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YD21LKP/698439638/600 saved to cache
2026-03-28 14:07:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item e39beb78-d51f-5fbe-a58d-f26050dd24f6
2026-03-28 14:07:05 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YD21LKP/698439665/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698439665>
2026-03-28 14:07:05 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WP13WWY/698052027/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698052027>
2026-03-28 14:07:05 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/ML71WFO/698947295/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698947295>
2026-03-28 14:07:05 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/ML71WFO/698947320/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698947320>
2026-03-28 14:07:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KEZ9481/698941524/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/KEZ9481/42810228?sv=2020-08-04&st=2026-03-28T14%3A06%3A56Z&se=2026-03-28T14%3A31%3A56Z&sr=b&sp=r&sig=DDPGn%2BcxbHbdqwyGWf309ifFTIM3Acs6kuQRt8vCf2E%3D)
2026-03-28 14:07:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/T400WRS/698069983/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/T400WRS/42810019?sv=2020-08-04&st=2026-03-28T14%3A06%3A56Z&se=2026-03-28T14%3A31%3A56Z&sr=b&sp=r&sig=kIZj2tqr%2BfocLXmzFxOg%2F2cX7%2FfCCdSGle1KfN6FfvQ%3D)
2026-03-28 14:07:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KEZ9481/698941474/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/KEZ9481/42810228?sv=2020-08-04&st=2026-03-28T14%3A06%3A56Z&se=2026-03-28T14%3A31%3A56Z&sr=b&sp=r&sig=DDPGn%2BcxbHbdqwyGWf309ifFTIM3Acs6kuQRt8vCf2E%3D)
2026-03-28 14:07:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/T400WRS/698069977/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/T400WRS/42810019?sv=2020-08-04&st=2026-03-28T14%3A06%3A56Z&se=2026-03-28T14%3A31%3A56Z&sr=b&sp=r&sig=kIZj2tqr%2BfocLXmzFxOg%2F2cX7%2FfCCdSGle1KfN6FfvQ%3D)
2026-03-28 14:07:05 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:07:05 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:07:05 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:07:05 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:07:05 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:07:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:07:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2dd17fd0>
2026-03-28 14:07:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:07:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:07:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:07:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d7b30cd7-3fb2-520c-9629-4539584c6e2c/d7b30cd7-3fb2-520c-9629-4539584c6e2c_image_9.jpg HTTP/1.1" 201 0
2026-03-28 14:07:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FFV17TYW%252F698768046%252F600') HTTP/1.1" 204 0
2026-03-28 14:07:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FV17TYW/698768046/600 saved to cache
2026-03-28 14:07:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item d7b30cd7-3fb2-520c-9629-4539584c6e2c
2026-03-28 14:07:05 [bca.uk] INFO: Total items found: 100
2026-03-28 14:07:05 [bca.uk] INFO: Requesting URL: https://www.bca.co.uk/api/search?q=&pageSize=100&page=15&sort=MostRecentlyAdded
2026-03-28 14:07:05 [bca.uk] INFO: Sending search API request with Bearer token (length=1492)
2026-03-28 14:07:05 [scrapy_zyte_api._params] WARNING: Request <GET https://www.bca.co.uk/api/search?q=&pageSize=100&page=15&sort=MostRecentlyAdded> defines the Zyte API customHttpRequestHeaders parameter, overriding Request.headers. Use Request.headers instead.
2026-03-28 14:07:05 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:07:05 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:07:05 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:07:05 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:07:05 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:07:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:07:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c18cc10>
2026-03-28 14:07:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:07:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:07:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:07:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_40999011-32af-5ad3-a840-4cb8242ff02a/40999011-32af-5ad3-a840-4cb8242ff02a_image_9.jpg HTTP/1.1" 201 0
2026-03-28 14:07:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FFY66OTD%252F698150830%252F600') HTTP/1.1" 204 0
2026-03-28 14:07:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FY66OTD/698150830/600 saved to cache
2026-03-28 14:07:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 40999011-32af-5ad3-a840-4cb8242ff02a
2026-03-28 14:07:05 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/ML71WFO/698947282/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698947282>
2026-03-28 14:07:05 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/ML71WFO/698947343/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698947343>
2026-03-28 14:07:05 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WP13WWY/698052056/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698052056>
2026-03-28 14:07:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WP13WWY/698051980/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/WP13WWY/42793381?sv=2020-08-04&st=2026-03-28T14%3A07%3A01Z&se=2026-03-28T14%3A32%3A01Z&sr=b&sp=r&sig=wQS0I02XI5RzxZvAM48J7feAWKIRK81PE6DyEJBKsFc%3D)
2026-03-28 14:07:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/ML71WFO/698947244/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/ML71WFO/42810333?sv=2020-08-04&st=2026-03-28T14%3A07%3A01Z&se=2026-03-28T14%3A32%3A01Z&sr=b&sp=r&sig=cXBfdYlvFIlLScFId9KF04NOtu6grGZTIAZqQZ2i%2Bn0%3D)
2026-03-28 14:07:05 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/ML71WFO/698947272/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698947272>
2026-03-28 14:07:05 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WP13WWY/698052041/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698052041>
2026-03-28 14:07:05 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WP13WWY/698052011/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698052011>
2026-03-28 14:07:05 [bca.uk] INFO: Found listing with ID: CE24%20ONH
2026-03-28 14:07:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27CE24%2520ONH%27 HTTP/1.1" 200 None
2026-03-28 14:07:05 [bca.uk] INFO: Scrape type for CE24%20ONH: 0
2026-03-28 14:07:05 [bca.uk] INFO: Found listing with ID: WA66%20WEK
2026-03-28 14:07:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WA66%2520WEK%27 HTTP/1.1" 200 None
2026-03-28 14:07:05 [bca.uk] INFO: Scrape type for WA66%20WEK: 0
2026-03-28 14:07:05 [bca.uk] INFO: Found listing with ID: WO21%20BSX
2026-03-28 14:07:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WO21%2520BSX%27 HTTP/1.1" 200 None
2026-03-28 14:07:05 [bca.uk] INFO: Scrape type for WO21%20BSX: 0
2026-03-28 14:07:05 [bca.uk] INFO: Found listing with ID: X576%20NUB
2026-03-28 14:07:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27X576%2520NUB%27 HTTP/1.1" 200 None
2026-03-28 14:07:05 [bca.uk] INFO: Scrape type for X576%20NUB: 0
2026-03-28 14:07:05 [bca.uk] INFO: Found listing with ID: AE02%20ETE
2026-03-28 14:07:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27AE02%2520ETE%27 HTTP/1.1" 200 None
2026-03-28 14:07:05 [bca.uk] INFO: Scrape type for AE02%20ETE: 0
2026-03-28 14:07:05 [bca.uk] INFO: Found listing with ID: KM65%20UHD
2026-03-28 14:07:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KM65%2520UHD%27 HTTP/1.1" 200 None
2026-03-28 14:07:05 [bca.uk] INFO: Scrape type for KM65%20UHD: 0
2026-03-28 14:07:05 [bca.uk] INFO: Found listing with ID: NY11%20YZP
2026-03-28 14:07:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27NY11%2520YZP%27 HTTP/1.1" 200 None
2026-03-28 14:07:05 [bca.uk] INFO: Scrape type for NY11%20YZP: 0
2026-03-28 14:07:05 [bca.uk] INFO: Found listing with ID: EA11%20ULT
2026-03-28 14:07:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27EA11%2520ULT%27 HTTP/1.1" 200 None
2026-03-28 14:07:05 [bca.uk] INFO: Scrape type for EA11%20ULT: 0
2026-03-28 14:07:05 [bca.uk] INFO: Found listing with ID: OU52%20XKA
2026-03-28 14:07:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27OU52%2520XKA%27 HTTP/1.1" 200 None
2026-03-28 14:07:05 [bca.uk] INFO: Scrape type for OU52%20XKA: 0
2026-03-28 14:07:05 [bca.uk] INFO: Found listing with ID: PJ09%20HHE
2026-03-28 14:07:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27PJ09%2520HHE%27 HTTP/1.1" 200 None
2026-03-28 14:07:05 [bca.uk] INFO: Scrape type for PJ09%20HHE: 0
2026-03-28 14:07:05 [bca.uk] INFO: Found listing with ID: YF21%20WVG
2026-03-28 14:07:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YF21%2520WVG%27 HTTP/1.1" 200 None
2026-03-28 14:07:05 [bca.uk] INFO: Scrape type for YF21%20WVG: 0
2026-03-28 14:07:05 [bca.uk] INFO: Found listing with ID: HK25%20XAY
2026-03-28 14:07:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27HK25%2520XAY%27 HTTP/1.1" 200 None
2026-03-28 14:07:05 [bca.uk] INFO: Scrape type for HK25%20XAY: 0
2026-03-28 14:07:05 [bca.uk] INFO: Found listing with ID: KK24%20AEF
2026-03-28 14:07:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KK24%2520AEF%27 HTTP/1.1" 200 None
2026-03-28 14:07:05 [bca.uk] INFO: Scrape type for KK24%20AEF: 0
2026-03-28 14:07:05 [bca.uk] INFO: Found listing with ID: NA70%20XYD
2026-03-28 14:07:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27NA70%2520XYD%27 HTTP/1.1" 200 None
2026-03-28 14:07:05 [bca.uk] INFO: Scrape type for NA70%20XYD: 0
2026-03-28 14:07:05 [bca.uk] INFO: Found listing with ID: YN64%20XMG
2026-03-28 14:07:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YN64%2520XMG%27 HTTP/1.1" 200 None
2026-03-28 14:07:05 [bca.uk] INFO: Scrape type for YN64%20XMG: 0
2026-03-28 14:07:05 [bca.uk] INFO: Found listing with ID: HPKD81239
2026-03-28 14:07:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27HPKD81239%27 HTTP/1.1" 200 None
2026-03-28 14:07:05 [bca.uk] INFO: Scrape type for HPKD81239: 0
2026-03-28 14:07:05 [bca.uk] INFO: Found listing with ID: CV09%20TWA
2026-03-28 14:07:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27CV09%2520TWA%27 HTTP/1.1" 200 None
2026-03-28 14:07:05 [bca.uk] INFO: Scrape type for CV09%20TWA: 0
2026-03-28 14:07:05 [bca.uk] INFO: Found listing with ID: FY10%20BNJ
2026-03-28 14:07:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FY10%2520BNJ%27 HTTP/1.1" 200 None
2026-03-28 14:07:05 [bca.uk] INFO: Scrape type for FY10%20BNJ: 0
2026-03-28 14:07:05 [bca.uk] INFO: Found listing with ID: MF73%20FAO
2026-03-28 14:07:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MF73%2520FAO%27 HTTP/1.1" 200 None
2026-03-28 14:07:05 [bca.uk] INFO: Scrape type for MF73%20FAO: 0
2026-03-28 14:07:05 [bca.uk] INFO: Found listing with ID: SP22%20OEE
2026-03-28 14:07:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SP22%2520OEE%27 HTTP/1.1" 200 None
2026-03-28 14:07:05 [bca.uk] INFO: Scrape type for SP22%20OEE: 0
2026-03-28 14:07:05 [bca.uk] INFO: Found listing with ID: BW21%20DTN
2026-03-28 14:07:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BW21%2520DTN%27 HTTP/1.1" 200 None
2026-03-28 14:07:05 [bca.uk] INFO: Scrape type for BW21%20DTN: 0
2026-03-28 14:07:05 [bca.uk] INFO: Found listing with ID: MD15%20XGB
2026-03-28 14:07:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MD15%2520XGB%27 HTTP/1.1" 200 None
2026-03-28 14:07:05 [bca.uk] INFO: Scrape type for MD15%20XGB: 0
2026-03-28 14:07:05 [bca.uk] INFO: Found listing with ID: GV70%20RNA
2026-03-28 14:07:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GV70%2520RNA%27 HTTP/1.1" 200 None
2026-03-28 14:07:05 [bca.uk] INFO: Scrape type for GV70%20RNA: 0
2026-03-28 14:07:05 [bca.uk] INFO: Found listing with ID: YS69%20EYY
2026-03-28 14:07:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YS69%2520EYY%27 HTTP/1.1" 200 None
2026-03-28 14:07:05 [bca.uk] INFO: Scrape type for YS69%20EYY: 0
2026-03-28 14:07:05 [bca.uk] INFO: Found listing with ID: DA18%20EDK
2026-03-28 14:07:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DA18%2520EDK%27 HTTP/1.1" 200 None
2026-03-28 14:07:05 [bca.uk] INFO: Scrape type for DA18%20EDK: 0
2026-03-28 14:07:05 [bca.uk] INFO: Found listing with ID: KR17%20WGP
2026-03-28 14:07:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KR17%2520WGP%27 HTTP/1.1" 200 None
2026-03-28 14:07:05 [bca.uk] INFO: Scrape type for KR17%20WGP: 0
2026-03-28 14:07:05 [bca.uk] INFO: Found listing with ID: L10%20CLU
2026-03-28 14:07:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27L10%2520CLU%27 HTTP/1.1" 200 None
2026-03-28 14:07:05 [bca.uk] INFO: Scrape type for L10%20CLU: 0
2026-03-28 14:07:05 [bca.uk] INFO: Found listing with ID: ML12%20ODX
2026-03-28 14:07:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27ML12%2520ODX%27 HTTP/1.1" 200 None
2026-03-28 14:07:05 [bca.uk] INFO: Scrape type for ML12%20ODX: 0
2026-03-28 14:07:05 [bca.uk] INFO: Found listing with ID: PN15%20EZH
2026-03-28 14:07:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27PN15%2520EZH%27 HTTP/1.1" 200 None
2026-03-28 14:07:05 [bca.uk] INFO: Scrape type for PN15%20EZH: 0
2026-03-28 14:07:05 [bca.uk] INFO: Found listing with ID: RX03%20AFU
2026-03-28 14:07:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27RX03%2520AFU%27 HTTP/1.1" 200 None
2026-03-28 14:07:05 [bca.uk] INFO: Scrape type for RX03%20AFU: 0
2026-03-28 14:07:05 [bca.uk] INFO: Found listing with ID: X188%20XCL
2026-03-28 14:07:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27X188%2520XCL%27 HTTP/1.1" 200 None
2026-03-28 14:07:05 [bca.uk] INFO: Scrape type for X188%20XCL: 0
2026-03-28 14:07:05 [bca.uk] INFO: Found listing with ID: YM21%20TYH
2026-03-28 14:07:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YM21%2520TYH%27 HTTP/1.1" 200 None
2026-03-28 14:07:05 [bca.uk] INFO: Scrape type for YM21%20TYH: 0
2026-03-28 14:07:05 [bca.uk] INFO: Found listing with ID: CP15%20POA
2026-03-28 14:07:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27CP15%2520POA%27 HTTP/1.1" 200 None
2026-03-28 14:07:05 [bca.uk] INFO: Scrape type for CP15%20POA: 0
2026-03-28 14:07:05 [bca.uk] INFO: Found listing with ID: YS69%20FCC
2026-03-28 14:07:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YS69%2520FCC%27 HTTP/1.1" 200 None
2026-03-28 14:07:05 [bca.uk] INFO: Scrape type for YS69%20FCC: 0
2026-03-28 14:07:05 [bca.uk] INFO: Found listing with ID: DU22%20SVN
2026-03-28 14:07:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DU22%2520SVN%27 HTTP/1.1" 200 None
2026-03-28 14:07:05 [bca.uk] INFO: Scrape type for DU22%20SVN: 0
2026-03-28 14:07:05 [bca.uk] INFO: Found listing with ID: GF18%20RFX
2026-03-28 14:07:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GF18%2520RFX%27 HTTP/1.1" 200 None
2026-03-28 14:07:05 [bca.uk] INFO: Scrape type for GF18%20RFX: 0
2026-03-28 14:07:05 [bca.uk] INFO: Found listing with ID: LB68%20TVJ
2026-03-28 14:07:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LB68%2520TVJ%27 HTTP/1.1" 200 None
2026-03-28 14:07:05 [bca.uk] INFO: Scrape type for LB68%20TVJ: 0
2026-03-28 14:07:05 [bca.uk] INFO: Found listing with ID: LG21%20HCM
2026-03-28 14:07:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LG21%2520HCM%27 HTTP/1.1" 200 None
2026-03-28 14:07:05 [bca.uk] INFO: Scrape type for LG21%20HCM: 0
2026-03-28 14:07:05 [bca.uk] INFO: Found listing with ID: VK71%20GFX
2026-03-28 14:07:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27VK71%2520GFX%27 HTTP/1.1" 200 None
2026-03-28 14:07:05 [bca.uk] INFO: Scrape type for VK71%20GFX: 0
2026-03-28 14:07:05 [bca.uk] INFO: Found listing with ID: BD69%20XXF
2026-03-28 14:07:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BD69%2520XXF%27 HTTP/1.1" 200 None
2026-03-28 14:07:06 [bca.uk] INFO: Scrape type for BD69%20XXF: 0
2026-03-28 14:07:06 [bca.uk] INFO: Found listing with ID: FG21%20MFN
2026-03-28 14:07:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FG21%2520MFN%27 HTTP/1.1" 200 None
2026-03-28 14:07:06 [bca.uk] INFO: Scrape type for FG21%20MFN: 0
2026-03-28 14:07:06 [bca.uk] INFO: Found listing with ID: YG69%20LWF
2026-03-28 14:07:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YG69%2520LWF%27 HTTP/1.1" 200 None
2026-03-28 14:07:06 [bca.uk] INFO: Scrape type for YG69%20LWF: 0
2026-03-28 14:07:06 [bca.uk] INFO: Found listing with ID: BD21%20GWA
2026-03-28 14:07:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BD21%2520GWA%27 HTTP/1.1" 200 None
2026-03-28 14:07:06 [bca.uk] INFO: Scrape type for BD21%20GWA: 0
2026-03-28 14:07:06 [bca.uk] INFO: Found listing with ID: CP22%20GYW
2026-03-28 14:07:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27CP22%2520GYW%27 HTTP/1.1" 200 None
2026-03-28 14:07:06 [bca.uk] INFO: Scrape type for CP22%20GYW: 2
2026-03-28 14:07:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: afecb2f0-0c7a-5a2a-846c-14ca31804bcd with identifier: CP22%20GYW
2026-03-28 14:07:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item afecb2f0-0c7a-5a2a-846c-14ca31804bcd with scrape type 2
2026-03-28 14:07:06 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item afecb2f0-0c7a-5a2a-846c-14ca31804bcd with scrape type 2
2026-03-28 14:07:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: afecb2f0-0c7a-5a2a-846c-14ca31804bcd, identifier: CP22%20GYW
2026-03-28 14:07:06 [scrapy_zyte_api._params] WARNING: Request <GET https://www.bca.co.uk/api/search?q=&pageSize=100&page=15&sort=MostRecentlyAdded> defines the Zyte API customHttpRequestHeaders parameter, overriding Request.headers. Use Request.headers instead.
2026-03-28 14:07:06 [scrapy_zyte_api._params] WARNING: Request <GET https://www.bca.co.uk/api/search?q=&pageSize=100&page=15&sort=MostRecentlyAdded> defines the Zyte API customHttpRequestHeaders parameter, overriding Request.headers. Use Request.headers instead.
2026-03-28 14:07:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: afecb2f0-0c7a-5a2a-846c-14ca31804bcd with identifier: CP22%20GYW
2026-03-28 14:07:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: afecb2f0-0c7a-5a2a-846c-14ca31804bcd with identifier: CP22%20GYW
2026-03-28 14:07:06 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: afecb2f0-0c7a-5a2a-846c-14ca31804bcd with identifier: CP22%20GYW to the API
2026-03-28 14:07:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:07:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:07:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=14&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 169,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=CP22%20GYW-GB',
'category': 'Car',
'color': 'black',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.5L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Diesel',
'id': 'afecb2f0-0c7a-5a2a-846c-14ca31804bcd',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'CP22 GYW',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=CP22%20GYW&vehicleType=*',
'listing': 'auction',
'location': 'Walsall',
'make': 'VAUXHALL',
'model': 'VIVARO LIFE',
'odometer': 50000,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-01-01',
'seller_name': None,
'title': 'VAUXHALL VIVARO LIFE 1.5 TURBO D 120 L EDITION MPV',
'transmission': 'manual',
'trim': 'TURBO D 120 L EDITION',
'vin': 'VXEVAYHVMNZ033125',
'year': 2022}
2026-03-28 14:07:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27CP22%2520GYW%27 HTTP/1.1" 200 None
2026-03-28 14:07:06 [bca.uk] INFO: Saving data for CP22%20GYW: {'auction_closing_time': 1774864800.0, 'created_time': 1774277302.46739, 'last_price_update_time': 1774706826.705744}
2026-03-28 14:07:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='CP22%2520GYW') HTTP/1.1" 204 0
2026-03-28 14:07:06 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 14:07:06 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:07:06 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:07:06 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:07:06 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:07:06 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:07:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:07:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c9da550>
2026-03-28 14:07:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:07:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:07:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:07:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f055b506-0022-5f0e-a7cd-13f0911779b4/f055b506-0022-5f0e-a7cd-13f0911779b4_image_8.jpg HTTP/1.1" 201 0
2026-03-28 14:07:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FKEZ9481%252F698941524%252F600') HTTP/1.1" 204 0
2026-03-28 14:07:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KEZ9481/698941524/600 saved to cache
2026-03-28 14:07:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item f055b506-0022-5f0e-a7cd-13f0911779b4
2026-03-28 14:07:06 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:07:06 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:07:06 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:07:06 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:07:06 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:07:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:07:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2ca61510>
2026-03-28 14:07:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:07:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:07:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:07:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a2c13cca-acdb-56e9-80bf-41e2acf4aed1/a2c13cca-acdb-56e9-80bf-41e2acf4aed1_image_8.jpg HTTP/1.1" 201 0
2026-03-28 14:07:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FT400WRS%252F698069983%252F600') HTTP/1.1" 204 0
2026-03-28 14:07:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/T400WRS/698069983/600 saved to cache
2026-03-28 14:07:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item a2c13cca-acdb-56e9-80bf-41e2acf4aed1
2026-03-28 14:07:06 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:07:06 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:07:06 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:07:06 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:07:06 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:07:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:07:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2d8eca50>
2026-03-28 14:07:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:07:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:07:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:07:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f055b506-0022-5f0e-a7cd-13f0911779b4/f055b506-0022-5f0e-a7cd-13f0911779b4_image_7.jpg HTTP/1.1" 201 0
2026-03-28 14:07:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FKEZ9481%252F698941474%252F600') HTTP/1.1" 204 0
2026-03-28 14:07:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KEZ9481/698941474/600 saved to cache
2026-03-28 14:07:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item f055b506-0022-5f0e-a7cd-13f0911779b4
2026-03-28 14:07:07 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:07:07 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:07:07 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:07:07 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:07:07 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:07:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:07:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2dea8d10>
2026-03-28 14:07:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:07:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:07:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:07:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a2c13cca-acdb-56e9-80bf-41e2acf4aed1/a2c13cca-acdb-56e9-80bf-41e2acf4aed1_image_7.jpg HTTP/1.1" 201 0
2026-03-28 14:07:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FT400WRS%252F698069977%252F600') HTTP/1.1" 204 0
2026-03-28 14:07:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/T400WRS/698069977/600 saved to cache
2026-03-28 14:07:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item a2c13cca-acdb-56e9-80bf-41e2acf4aed1
2026-03-28 14:07:07 [bca.uk] INFO: Found listing with ID: AD18%20GWP
2026-03-28 14:07:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27AD18%2520GWP%27 HTTP/1.1" 200 None
2026-03-28 14:07:07 [bca.uk] INFO: Scrape type for AD18%20GWP: 0
2026-03-28 14:07:07 [bca.uk] INFO: Found listing with ID: EU68%20NEJ
2026-03-28 14:07:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27EU68%2520NEJ%27 HTTP/1.1" 200 None
2026-03-28 14:07:07 [bca.uk] INFO: Scrape type for EU68%20NEJ: 2
2026-03-28 14:07:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2a9eddaf-d788-5d80-aea5-1bed6f6972ec with identifier: EU68%20NEJ
2026-03-28 14:07:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2a9eddaf-d788-5d80-aea5-1bed6f6972ec with scrape type 2
2026-03-28 14:07:07 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2a9eddaf-d788-5d80-aea5-1bed6f6972ec with scrape type 2
2026-03-28 14:07:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 2a9eddaf-d788-5d80-aea5-1bed6f6972ec, identifier: EU68%20NEJ
2026-03-28 14:07:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 2a9eddaf-d788-5d80-aea5-1bed6f6972ec with identifier: EU68%20NEJ
2026-03-28 14:07:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 2a9eddaf-d788-5d80-aea5-1bed6f6972ec with identifier: EU68%20NEJ
2026-03-28 14:07:07 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 2a9eddaf-d788-5d80-aea5-1bed6f6972ec with identifier: EU68%20NEJ to the API
2026-03-28 14:07:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:07:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:07:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=14&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 107,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=EU68%20NEJ-GB',
'category': 'Car',
'color': 'black',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.0L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol',
'id': '2a9eddaf-d788-5d80-aea5-1bed6f6972ec',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'EU68 NEJ',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=EU68%20NEJ&vehicleType=*',
'listing': 'auction',
'location': 'Thurleigh',
'make': 'FORD',
'model': 'FOCUS',
'odometer': 81337,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-01-01',
'seller_name': None,
'title': 'FORD FOCUS 1.0 E/B 125 TITANIUM Hatchback',
'transmission': 'manual',
'trim': 'E/B 125 TITANIUM',
'vin': 'WF0NXXGCHNJP23128',
'year': 2019}
2026-03-28 14:07:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27EU68%2520NEJ%27 HTTP/1.1" 200 None
2026-03-28 14:07:07 [bca.uk] INFO: Saving data for EU68%20NEJ: {'auction_closing_time': 1774864800.0, 'created_time': 1774276014.421804, 'last_price_update_time': 1774706827.624982}
2026-03-28 14:07:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='EU68%2520NEJ') HTTP/1.1" 204 0
2026-03-28 14:07:07 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WP13WWY/698052074/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698052074>
2026-03-28 14:07:07 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WP13WWY/698052067/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698052067>
2026-03-28 14:07:07 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/ML71WFO/698947374/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698947374>
2026-03-28 14:07:07 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/ML71WFO/698947404/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698947404>
2026-03-28 14:07:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/ML71WFO/698947295/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/ML71WFO/42810333?sv=2020-08-04&st=2026-03-28T14%3A07%3A01Z&se=2026-03-28T14%3A32%3A01Z&sr=b&sp=r&sig=cXBfdYlvFIlLScFId9KF04NOtu6grGZTIAZqQZ2i%2Bn0%3D)
2026-03-28 14:07:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WP13WWY/698052027/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/WP13WWY/42793381?sv=2020-08-04&st=2026-03-28T14%3A07%3A01Z&se=2026-03-28T14%3A32%3A01Z&sr=b&sp=r&sig=wQS0I02XI5RzxZvAM48J7feAWKIRK81PE6DyEJBKsFc%3D)
2026-03-28 14:07:07 [bca.uk] INFO: Found listing with ID: DA72%20RSU
2026-03-28 14:07:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DA72%2520RSU%27 HTTP/1.1" 200 None
2026-03-28 14:07:07 [bca.uk] INFO: Scrape type for DA72%20RSU: 0
2026-03-28 14:07:07 [bca.uk] INFO: Found listing with ID: GD18%20CFO
2026-03-28 14:07:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GD18%2520CFO%27 HTTP/1.1" 200 None
2026-03-28 14:07:07 [bca.uk] INFO: Scrape type for GD18%20CFO: 0
2026-03-28 14:07:07 [bca.uk] INFO: Found listing with ID: MJ69%20AHZ
2026-03-28 14:07:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MJ69%2520AHZ%27 HTTP/1.1" 200 None
2026-03-28 14:07:07 [bca.uk] INFO: Scrape type for MJ69%20AHZ: 0
2026-03-28 14:07:07 [bca.uk] INFO: Found listing with ID: MJ69%20KSF
2026-03-28 14:07:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MJ69%2520KSF%27 HTTP/1.1" 200 None
2026-03-28 14:07:07 [bca.uk] INFO: Scrape type for MJ69%20KSF: 2
2026-03-28 14:07:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e5228cf0-dea9-558d-9d79-cb17e480fee2 with identifier: MJ69%20KSF
2026-03-28 14:07:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e5228cf0-dea9-558d-9d79-cb17e480fee2 with scrape type 2
2026-03-28 14:07:07 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e5228cf0-dea9-558d-9d79-cb17e480fee2 with scrape type 2
2026-03-28 14:07:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: e5228cf0-dea9-558d-9d79-cb17e480fee2, identifier: MJ69%20KSF
2026-03-28 14:07:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:07:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c73f0d0>
2026-03-28 14:07:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:07:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:07:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:07:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8e80177a-614d-57e6-b32b-c4549bde7262/8e80177a-614d-57e6-b32b-c4549bde7262_image_1.jpg HTTP/1.1" 201 0
2026-03-28 14:07:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FWP13WWY%252F698051980%252F600') HTTP/1.1" 204 0
2026-03-28 14:07:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WP13WWY/698051980/600 saved to cache
2026-03-28 14:07:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 8e80177a-614d-57e6-b32b-c4549bde7262
2026-03-28 14:07:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:07:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c8b1890>
2026-03-28 14:07:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:07:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:07:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:07:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_932ab700-a26e-556f-85b5-1bb9734e718c/932ab700-a26e-556f-85b5-1bb9734e718c_image_1.jpg HTTP/1.1" 201 0
2026-03-28 14:07:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FML71WFO%252F698947244%252F600') HTTP/1.1" 204 0
2026-03-28 14:07:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/ML71WFO/698947244/600 saved to cache
2026-03-28 14:07:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 932ab700-a26e-556f-85b5-1bb9734e718c
2026-03-28 14:07:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YD21LKP/698439665/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YD21LKP/42810029?sv=2020-08-04&st=2026-03-28T14%3A07%3A00Z&se=2026-03-28T14%3A32%3A00Z&sr=b&sp=r&sig=EiPkPHEa%2F3uktliD9Vj4mtSFOMGvF7A9AlPUHHkf2%2B4%3D)
2026-03-28 14:07:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/ML71WFO/698947320/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/ML71WFO/42810333?sv=2020-08-04&st=2026-03-28T14%3A07%3A01Z&se=2026-03-28T14%3A32%3A01Z&sr=b&sp=r&sig=cXBfdYlvFIlLScFId9KF04NOtu6grGZTIAZqQZ2i%2Bn0%3D)
2026-03-28 14:07:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: e5228cf0-dea9-558d-9d79-cb17e480fee2 with identifier: MJ69%20KSF
2026-03-28 14:07:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: e5228cf0-dea9-558d-9d79-cb17e480fee2 with identifier: MJ69%20KSF
2026-03-28 14:07:08 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: e5228cf0-dea9-558d-9d79-cb17e480fee2 with identifier: MJ69%20KSF to the API
2026-03-28 14:07:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:07:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:07:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=14&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 119,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=MJ69%20KSF-GB',
'category': 'Car',
'color': 'green',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.5L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol',
'id': 'e5228cf0-dea9-558d-9d79-cb17e480fee2',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'MJ69 KSF',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=MJ69%20KSF&vehicleType=*',
'listing': 'auction',
'location': 'Preston',
'make': 'MINI',
'model': 'COOPER',
'odometer': 16897,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-01-01',
'seller_name': None,
'title': 'MINI COOPER 1.5 EXCLUSIVE STEP Hatchback',
'transmission': 'automatic',
'trim': 'EXCLUSIVE STEP',
'vin': 'WMWXU720102M05195',
'year': 2019}
2026-03-28 14:07:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MJ69%2520KSF%27 HTTP/1.1" 200 None
2026-03-28 14:07:08 [bca.uk] INFO: Saving data for MJ69%20KSF: {'auction_closing_time': 1774864800.0, 'created_time': 1773935784.844278, 'last_price_update_time': 1774706828.263858}
2026-03-28 14:07:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='MJ69%2520KSF') HTTP/1.1" 204 0
2026-03-28 14:07:08 [bca.uk] INFO: Found listing with ID: PJ20%20EKU
2026-03-28 14:07:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27PJ20%2520EKU%27 HTTP/1.1" 200 None
2026-03-28 14:07:08 [bca.uk] INFO: Scrape type for PJ20%20EKU: 0
2026-03-28 14:07:08 [bca.uk] INFO: Found listing with ID: BP68%20KXF
2026-03-28 14:07:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BP68%2520KXF%27 HTTP/1.1" 200 None
2026-03-28 14:07:08 [bca.uk] INFO: Scrape type for BP68%20KXF: 2
2026-03-28 14:07:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2eee11a9-e930-516e-b2a5-0aa32a729ba7 with identifier: BP68%20KXF
2026-03-28 14:07:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2eee11a9-e930-516e-b2a5-0aa32a729ba7 with scrape type 2
2026-03-28 14:07:08 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2eee11a9-e930-516e-b2a5-0aa32a729ba7 with scrape type 2
2026-03-28 14:07:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 2eee11a9-e930-516e-b2a5-0aa32a729ba7, identifier: BP68%20KXF
2026-03-28 14:07:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/ML71WFO/698947272/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/ML71WFO/42810333?sv=2020-08-04&st=2026-03-28T14%3A07%3A01Z&se=2026-03-28T14%3A32%3A01Z&sr=b&sp=r&sig=cXBfdYlvFIlLScFId9KF04NOtu6grGZTIAZqQZ2i%2Bn0%3D)
2026-03-28 14:07:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WP13WWY/698052011/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/WP13WWY/42793381?sv=2020-08-04&st=2026-03-28T14%3A07%3A01Z&se=2026-03-28T14%3A32%3A01Z&sr=b&sp=r&sig=wQS0I02XI5RzxZvAM48J7feAWKIRK81PE6DyEJBKsFc%3D)
2026-03-28 14:07:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/ML71WFO/698947282/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/ML71WFO/42810333?sv=2020-08-04&st=2026-03-28T14%3A07%3A01Z&se=2026-03-28T14%3A32%3A01Z&sr=b&sp=r&sig=cXBfdYlvFIlLScFId9KF04NOtu6grGZTIAZqQZ2i%2Bn0%3D)
2026-03-28 14:07:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 2eee11a9-e930-516e-b2a5-0aa32a729ba7 with identifier: BP68%20KXF
2026-03-28 14:07:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 2eee11a9-e930-516e-b2a5-0aa32a729ba7 with identifier: BP68%20KXF
2026-03-28 14:07:08 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 2eee11a9-e930-516e-b2a5-0aa32a729ba7 with identifier: BP68%20KXF to the API
2026-03-28 14:07:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:07:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:07:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=14&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 116,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=BP68%20KXF-GB',
'category': 'Car',
'color': 'black',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.0L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol',
'id': '2eee11a9-e930-516e-b2a5-0aa32a729ba7',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'BP68 KXF',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=BP68%20KXF&vehicleType=*',
'listing': 'auction',
'location': 'Preston',
'make': 'FORD',
'model': 'FIESTA',
'odometer': 67124,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-01-01',
'seller_name': None,
'title': 'FORD FIESTA 1.0 E/B 140 ST-LINE Hatchback',
'transmission': 'manual',
'trim': 'E/B 140 ST-LINE',
'vin': 'WF0JXXGAHJJJ85872',
'year': 2018}
2026-03-28 14:07:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BP68%2520KXF%27 HTTP/1.1" 200 None
2026-03-28 14:07:08 [bca.uk] INFO: Saving data for BP68%20KXF: {'auction_closing_time': 1774864800.0, 'created_time': 1774015826.501093, 'last_price_update_time': 1774706828.800498}
2026-03-28 14:07:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='BP68%2520KXF') HTTP/1.1" 204 0
2026-03-28 14:07:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/ML71WFO/698947343/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/ML71WFO/42810333?sv=2020-08-04&st=2026-03-28T14%3A07%3A01Z&se=2026-03-28T14%3A32%3A01Z&sr=b&sp=r&sig=cXBfdYlvFIlLScFId9KF04NOtu6grGZTIAZqQZ2i%2Bn0%3D)
2026-03-28 14:07:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WP13WWY/698052041/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/WP13WWY/42793381?sv=2020-08-04&st=2026-03-28T14%3A07%3A01Z&se=2026-03-28T14%3A32%3A01Z&sr=b&sp=r&sig=wQS0I02XI5RzxZvAM48J7feAWKIRK81PE6DyEJBKsFc%3D)
2026-03-28 14:07:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WP13WWY/698052056/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/WP13WWY/42793381?sv=2020-08-04&st=2026-03-28T14%3A07%3A01Z&se=2026-03-28T14%3A32%3A01Z&sr=b&sp=r&sig=wQS0I02XI5RzxZvAM48J7feAWKIRK81PE6DyEJBKsFc%3D)
2026-03-28 14:07:08 [bca.uk] INFO: Found listing with ID: CE68%20OKN
2026-03-28 14:07:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27CE68%2520OKN%27 HTTP/1.1" 200 None
2026-03-28 14:07:08 [bca.uk] INFO: Scrape type for CE68%20OKN: 0
2026-03-28 14:07:08 [bca.uk] INFO: Found listing with ID: DA72%20OGE
2026-03-28 14:07:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DA72%2520OGE%27 HTTP/1.1" 200 None
2026-03-28 14:07:08 [bca.uk] INFO: Scrape type for DA72%20OGE: 2
2026-03-28 14:07:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d830d531-4d69-5288-b792-67b62ccb6c1d with identifier: DA72%20OGE
2026-03-28 14:07:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d830d531-4d69-5288-b792-67b62ccb6c1d with scrape type 2
2026-03-28 14:07:08 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d830d531-4d69-5288-b792-67b62ccb6c1d with scrape type 2
2026-03-28 14:07:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: d830d531-4d69-5288-b792-67b62ccb6c1d, identifier: DA72%20OGE
2026-03-28 14:07:09 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WP13WWY/698052000/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698052000>
2026-03-28 14:07:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: d830d531-4d69-5288-b792-67b62ccb6c1d with identifier: DA72%20OGE
2026-03-28 14:07:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: d830d531-4d69-5288-b792-67b62ccb6c1d with identifier: DA72%20OGE
2026-03-28 14:07:09 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: d830d531-4d69-5288-b792-67b62ccb6c1d with identifier: DA72%20OGE to the API
2026-03-28 14:07:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:07:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:07:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=14&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 109,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=DA72%20OGE-GB',
'category': 'Car',
'color': 'white',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.0L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol',
'id': 'd830d531-4d69-5288-b792-67b62ccb6c1d',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'DA72 OGE',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=DA72%20OGE&vehicleType=*',
'listing': 'auction',
'location': 'Preston',
'make': 'TOYOTA',
'model': 'AYGO X',
'odometer': 36935,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-01-01',
'seller_name': None,
'title': 'TOYOTA AYGO X 1.0 VVT-I PURE Hatchback',
'transmission': 'manual',
'trim': 'VVT-I PURE',
'vin': 'JTDAGNAC200069584',
'year': 2022}
2026-03-28 14:07:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DA72%2520OGE%27 HTTP/1.1" 200 None
2026-03-28 14:07:09 [bca.uk] INFO: Saving data for DA72%20OGE: {'auction_closing_time': 1774864800.0, 'created_time': 1774391453.920784, 'last_price_update_time': 1774706829.364162}
2026-03-28 14:07:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='DA72%2520OGE') HTTP/1.1" 204 0
2026-03-28 14:07:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:07:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c8b1a10>
2026-03-28 14:07:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:07:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:07:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:07:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_932ab700-a26e-556f-85b5-1bb9734e718c/932ab700-a26e-556f-85b5-1bb9734e718c_image_5.jpg HTTP/1.1" 201 0
2026-03-28 14:07:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FML71WFO%252F698947295%252F600') HTTP/1.1" 204 0
2026-03-28 14:07:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/ML71WFO/698947295/600 saved to cache
2026-03-28 14:07:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 932ab700-a26e-556f-85b5-1bb9734e718c
2026-03-28 14:07:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:07:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c12c150>
2026-03-28 14:07:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:07:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:07:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:07:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8e80177a-614d-57e6-b32b-c4549bde7262/8e80177a-614d-57e6-b32b-c4549bde7262_image_5.jpg HTTP/1.1" 201 0
2026-03-28 14:07:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FWP13WWY%252F698052027%252F600') HTTP/1.1" 204 0
2026-03-28 14:07:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WP13WWY/698052027/600 saved to cache
2026-03-28 14:07:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 8e80177a-614d-57e6-b32b-c4549bde7262
2026-03-28 14:07:09 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:07:09 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:07:09 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:07:09 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:07:09 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:07:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:07:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c9d6110>
2026-03-28 14:07:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:07:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:07:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:07:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e39beb78-d51f-5fbe-a58d-f26050dd24f6/e39beb78-d51f-5fbe-a58d-f26050dd24f6_image_8.jpg HTTP/1.1" 201 0
2026-03-28 14:07:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FYD21LKP%252F698439665%252F600') HTTP/1.1" 204 0
2026-03-28 14:07:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YD21LKP/698439665/600 saved to cache
2026-03-28 14:07:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item e39beb78-d51f-5fbe-a58d-f26050dd24f6
2026-03-28 14:07:09 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:07:09 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:07:09 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:07:09 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:07:09 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:07:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:07:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2d7f8ed0>
2026-03-28 14:07:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:07:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:07:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:07:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_932ab700-a26e-556f-85b5-1bb9734e718c/932ab700-a26e-556f-85b5-1bb9734e718c_image_6.jpg HTTP/1.1" 201 0
2026-03-28 14:07:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FML71WFO%252F698947320%252F600') HTTP/1.1" 204 0
2026-03-28 14:07:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/ML71WFO/698947320/600 saved to cache
2026-03-28 14:07:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 932ab700-a26e-556f-85b5-1bb9734e718c
2026-03-28 14:07:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/ML71WFO/698947404/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/ML71WFO/42810333?sv=2020-08-04&st=2026-03-28T14%3A07%3A01Z&se=2026-03-28T14%3A32%3A01Z&sr=b&sp=r&sig=cXBfdYlvFIlLScFId9KF04NOtu6grGZTIAZqQZ2i%2Bn0%3D)
2026-03-28 14:07:09 [bca.uk] INFO: Found listing with ID: DU19%20VFP
2026-03-28 14:07:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DU19%2520VFP%27 HTTP/1.1" 200 None
2026-03-28 14:07:09 [bca.uk] INFO: Scrape type for DU19%20VFP: 0
2026-03-28 14:07:09 [bca.uk] INFO: Found listing with ID: FX20%20RVN
2026-03-28 14:07:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FX20%2520RVN%27 HTTP/1.1" 200 None
2026-03-28 14:07:09 [bca.uk] INFO: Scrape type for FX20%20RVN: 0
2026-03-28 14:07:09 [bca.uk] INFO: Found listing with ID: SW69%20HAX
2026-03-28 14:07:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SW69%2520HAX%27 HTTP/1.1" 200 None
2026-03-28 14:07:09 [bca.uk] INFO: Scrape type for SW69%20HAX: 0
2026-03-28 14:07:09 [bca.uk] INFO: Found listing with ID: EK72%20OTR
2026-03-28 14:07:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27EK72%2520OTR%27 HTTP/1.1" 200 None
2026-03-28 14:07:09 [bca.uk] INFO: Scrape type for EK72%20OTR: 0
2026-03-28 14:07:09 [bca.uk] INFO: Found listing with ID: LB24%20EUL
2026-03-28 14:07:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LB24%2520EUL%27 HTTP/1.1" 200 None
2026-03-28 14:07:09 [bca.uk] INFO: Scrape type for LB24%20EUL: 0
2026-03-28 14:07:09 [bca.uk] INFO: Found listing with ID: NV21%20KXR
2026-03-28 14:07:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27NV21%2520KXR%27 HTTP/1.1" 200 None
2026-03-28 14:07:09 [bca.uk] INFO: Scrape type for NV21%20KXR: 0
2026-03-28 14:07:09 [bca.uk] INFO: Found listing with ID: Y27%20JJL
2026-03-28 14:07:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27Y27%2520JJL%27 HTTP/1.1" 200 None
2026-03-28 14:07:09 [bca.uk] INFO: Scrape type for Y27%20JJL: 2
2026-03-28 14:07:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f657ee2e-7d33-5424-a031-2586a75db48a with identifier: Y27%20JJL
2026-03-28 14:07:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f657ee2e-7d33-5424-a031-2586a75db48a with scrape type 2
2026-03-28 14:07:09 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f657ee2e-7d33-5424-a031-2586a75db48a with scrape type 2
2026-03-28 14:07:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: f657ee2e-7d33-5424-a031-2586a75db48a, identifier: Y27%20JJL
2026-03-28 14:07:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WP13WWY/698052067/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/WP13WWY/42793381?sv=2020-08-04&st=2026-03-28T14%3A07%3A01Z&se=2026-03-28T14%3A32%3A01Z&sr=b&sp=r&sig=wQS0I02XI5RzxZvAM48J7feAWKIRK81PE6DyEJBKsFc%3D)
2026-03-28 14:07:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WP13WWY/698052074/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/WP13WWY/42793381?sv=2020-08-04&st=2026-03-28T14%3A07%3A01Z&se=2026-03-28T14%3A32%3A01Z&sr=b&sp=r&sig=wQS0I02XI5RzxZvAM48J7feAWKIRK81PE6DyEJBKsFc%3D)
2026-03-28 14:07:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/ML71WFO/698947374/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/ML71WFO/42810333?sv=2020-08-04&st=2026-03-28T14%3A07%3A01Z&se=2026-03-28T14%3A32%3A01Z&sr=b&sp=r&sig=cXBfdYlvFIlLScFId9KF04NOtu6grGZTIAZqQZ2i%2Bn0%3D)
2026-03-28 14:07:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: f657ee2e-7d33-5424-a031-2586a75db48a with identifier: Y27%20JJL
2026-03-28 14:07:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: f657ee2e-7d33-5424-a031-2586a75db48a with identifier: Y27%20JJL
2026-03-28 14:07:09 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: f657ee2e-7d33-5424-a031-2586a75db48a with identifier: Y27%20JJL to the API
2026-03-28 14:07:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:07:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:07:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=14&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 164,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=Y27%20JJL-GB',
'category': 'Car',
'color': 'white',
'currency': 'GBP',
'doors_number': 5,
'engine': '2.0L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol',
'id': 'f657ee2e-7d33-5424-a031-2586a75db48a',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'Y27 JJL',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=Y27%20JJL&vehicleType=*',
'listing': 'auction',
'location': 'Crawley',
'make': 'VOLKSWAGEN',
'model': 'GOLF',
'odometer': 54016,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-01-01',
'seller_name': None,
'title': 'VOLKSWAGEN GOLF 2.0 TSI 300 R 4M DSG Hatchback',
'transmission': 'automatic',
'trim': 'TSI 300 R 4M DSG',
'vin': 'WVWZZZAUZKW082475',
'year': 2019}
2026-03-28 14:07:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27Y27%2520JJL%27 HTTP/1.1" 200 None
2026-03-28 14:07:10 [bca.uk] INFO: Saving data for Y27%20JJL: {'auction_closing_time': 1774864800.0, 'created_time': 1774391950.235609, 'last_price_update_time': 1774706830.166415}
2026-03-28 14:07:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='Y27%2520JJL') HTTP/1.1" 204 0
2026-03-28 14:07:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:07:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2deaac50>
2026-03-28 14:07:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:07:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:07:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:07:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_932ab700-a26e-556f-85b5-1bb9734e718c/932ab700-a26e-556f-85b5-1bb9734e718c_image_3.jpg HTTP/1.1" 201 0
2026-03-28 14:07:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FML71WFO%252F698947272%252F600') HTTP/1.1" 204 0
2026-03-28 14:07:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/ML71WFO/698947272/600 saved to cache
2026-03-28 14:07:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 932ab700-a26e-556f-85b5-1bb9734e718c
2026-03-28 14:07:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:07:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c86c110>
2026-03-28 14:07:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:07:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:07:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:07:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8e80177a-614d-57e6-b32b-c4549bde7262/8e80177a-614d-57e6-b32b-c4549bde7262_image_4.jpg HTTP/1.1" 201 0
2026-03-28 14:07:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FWP13WWY%252F698052011%252F600') HTTP/1.1" 204 0
2026-03-28 14:07:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WP13WWY/698052011/600 saved to cache
2026-03-28 14:07:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 8e80177a-614d-57e6-b32b-c4549bde7262
2026-03-28 14:07:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:07:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c588690>
2026-03-28 14:07:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:07:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:07:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:07:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_932ab700-a26e-556f-85b5-1bb9734e718c/932ab700-a26e-556f-85b5-1bb9734e718c_image_4.jpg HTTP/1.1" 201 0
2026-03-28 14:07:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FML71WFO%252F698947282%252F600') HTTP/1.1" 204 0
2026-03-28 14:07:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/ML71WFO/698947282/600 saved to cache
2026-03-28 14:07:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 932ab700-a26e-556f-85b5-1bb9734e718c
2026-03-28 14:07:10 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:07:10 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:07:10 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:07:10 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:07:10 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:07:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:07:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c707550>
2026-03-28 14:07:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:07:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:07:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:07:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_932ab700-a26e-556f-85b5-1bb9734e718c/932ab700-a26e-556f-85b5-1bb9734e718c_image_7.jpg HTTP/1.1" 201 0
2026-03-28 14:07:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FML71WFO%252F698947343%252F600') HTTP/1.1" 204 0
2026-03-28 14:07:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/ML71WFO/698947343/600 saved to cache
2026-03-28 14:07:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 932ab700-a26e-556f-85b5-1bb9734e718c
2026-03-28 14:07:10 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:07:10 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:07:10 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:07:10 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:07:10 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:07:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:07:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c557f50>
2026-03-28 14:07:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:07:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:07:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:07:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8e80177a-614d-57e6-b32b-c4549bde7262/8e80177a-614d-57e6-b32b-c4549bde7262_image_6.jpg HTTP/1.1" 201 0
2026-03-28 14:07:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FWP13WWY%252F698052041%252F600') HTTP/1.1" 204 0
2026-03-28 14:07:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WP13WWY/698052041/600 saved to cache
2026-03-28 14:07:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 8e80177a-614d-57e6-b32b-c4549bde7262
2026-03-28 14:07:10 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:07:10 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:07:10 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:07:10 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:07:10 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:07:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:07:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2ca62f10>
2026-03-28 14:07:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:07:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:07:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:07:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8e80177a-614d-57e6-b32b-c4549bde7262/8e80177a-614d-57e6-b32b-c4549bde7262_image_7.jpg HTTP/1.1" 201 0
2026-03-28 14:07:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FWP13WWY%252F698052056%252F600') HTTP/1.1" 204 0
2026-03-28 14:07:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WP13WWY/698052056/600 saved to cache
2026-03-28 14:07:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 8e80177a-614d-57e6-b32b-c4549bde7262
2026-03-28 14:07:10 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WP13WWY/698051988/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698051988>
2026-03-28 14:07:10 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YD21LKP/698439675/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698439675>
2026-03-28 14:07:10 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/ML71WFO/698947260/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698947260>
2026-03-28 14:07:10 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SH22GFY/698915737/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698915737>
2026-03-28 14:07:10 [bca.uk] INFO: Found listing with ID: AU19%20UPB
2026-03-28 14:07:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27AU19%2520UPB%27 HTTP/1.1" 200 None
2026-03-28 14:07:10 [bca.uk] INFO: Scrape type for AU19%20UPB: 0
2026-03-28 14:07:10 [bca.uk] INFO: Found listing with ID: KW70%20FUH
2026-03-28 14:07:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KW70%2520FUH%27 HTTP/1.1" 200 None
2026-03-28 14:07:10 [bca.uk] INFO: Scrape type for KW70%20FUH: 0
2026-03-28 14:07:10 [bca.uk] INFO: Found listing with ID: SX19%20UXH
2026-03-28 14:07:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SX19%2520UXH%27 HTTP/1.1" 200 None
2026-03-28 14:07:10 [bca.uk] INFO: Scrape type for SX19%20UXH: 0
2026-03-28 14:07:10 [bca.uk] INFO: Found listing with ID: YS22%20UBT
2026-03-28 14:07:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YS22%2520UBT%27 HTTP/1.1" 200 None
2026-03-28 14:07:10 [bca.uk] INFO: Scrape type for YS22%20UBT: 0
2026-03-28 14:07:10 [bca.uk] INFO: Found listing with ID: KJ19%20WBM
2026-03-28 14:07:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KJ19%2520WBM%27 HTTP/1.1" 200 None
2026-03-28 14:07:10 [bca.uk] INFO: Scrape type for KJ19%20WBM: 0
2026-03-28 14:07:10 [bca.uk] INFO: Found listing with ID: KV71%20AEO
2026-03-28 14:07:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KV71%2520AEO%27 HTTP/1.1" 200 None
2026-03-28 14:07:10 [bca.uk] INFO: Scrape type for KV71%20AEO: 0
2026-03-28 14:07:10 [bca.uk] INFO: Found listing with ID: NV19%20UBR
2026-03-28 14:07:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27NV19%2520UBR%27 HTTP/1.1" 200 None
2026-03-28 14:07:10 [bca.uk] INFO: Scrape type for NV19%20UBR: 0
2026-03-28 14:07:10 [bca.uk] INFO: Found listing with ID: RV68%20LBX
2026-03-28 14:07:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27RV68%2520LBX%27 HTTP/1.1" 200 None
2026-03-28 14:07:10 [bca.uk] INFO: Scrape type for RV68%20LBX: 0
2026-03-28 14:07:10 [bca.uk] INFO: Found listing with ID: AO70%20ZYL
2026-03-28 14:07:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27AO70%2520ZYL%27 HTTP/1.1" 200 None
2026-03-28 14:07:10 [bca.uk] INFO: Scrape type for AO70%20ZYL: 0
2026-03-28 14:07:10 [bca.uk] INFO: Found listing with ID: AV72%20FBL
2026-03-28 14:07:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27AV72%2520FBL%27 HTTP/1.1" 200 None
2026-03-28 14:07:10 [bca.uk] INFO: Scrape type for AV72%20FBL: 0
2026-03-28 14:07:10 [bca.uk] INFO: Found listing with ID: AVI%205715
2026-03-28 14:07:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27AVI%25205715%27 HTTP/1.1" 200 None
2026-03-28 14:07:10 [bca.uk] INFO: Scrape type for AVI%205715: 0
2026-03-28 14:07:10 [bca.uk] INFO: Found listing with ID: DS21%20XOB
2026-03-28 14:07:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DS21%2520XOB%27 HTTP/1.1" 200 None
2026-03-28 14:07:10 [bca.uk] INFO: Scrape type for DS21%20XOB: 0
2026-03-28 14:07:10 [bca.uk] INFO: Found listing with ID: GF22%20CZO
2026-03-28 14:07:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GF22%2520CZO%27 HTTP/1.1" 200 None
2026-03-28 14:07:10 [bca.uk] INFO: Scrape type for GF22%20CZO: 0
2026-03-28 14:07:10 [bca.uk] INFO: Found listing with ID: GJ23%20MRO
2026-03-28 14:07:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GJ23%2520MRO%27 HTTP/1.1" 200 None
2026-03-28 14:07:10 [bca.uk] INFO: Scrape type for GJ23%20MRO: 0
2026-03-28 14:07:10 [bca.uk] INFO: Found listing with ID: GV69%20PSU
2026-03-28 14:07:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GV69%2520PSU%27 HTTP/1.1" 200 None
2026-03-28 14:07:10 [bca.uk] INFO: Scrape type for GV69%20PSU: 0
2026-03-28 14:07:10 [bca.uk] INFO: Found listing with ID: GX71%20XBS
2026-03-28 14:07:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GX71%2520XBS%27 HTTP/1.1" 200 None
2026-03-28 14:07:10 [bca.uk] INFO: Scrape type for GX71%20XBS: 0
2026-03-28 14:07:10 [bca.uk] INFO: Found listing with ID: KJ19%20MZZ
2026-03-28 14:07:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KJ19%2520MZZ%27 HTTP/1.1" 200 None
2026-03-28 14:07:10 [bca.uk] INFO: Scrape type for KJ19%20MZZ: 0
2026-03-28 14:07:10 [bca.uk] INFO: Found listing with ID: AK69%20OPY
2026-03-28 14:07:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27AK69%2520OPY%27 HTTP/1.1" 200 None
2026-03-28 14:07:10 [bca.uk] INFO: Scrape type for AK69%20OPY: 0
2026-03-28 14:07:10 [bca.uk] INFO: Found listing with ID: BD19%20VEB
2026-03-28 14:07:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BD19%2520VEB%27 HTTP/1.1" 200 None
2026-03-28 14:07:10 [bca.uk] INFO: Scrape type for BD19%20VEB: 0
2026-03-28 14:07:10 [bca.uk] INFO: Found listing with ID: CV18%20FNN
2026-03-28 14:07:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27CV18%2520FNN%27 HTTP/1.1" 200 None
2026-03-28 14:07:10 [bca.uk] INFO: Scrape type for CV18%20FNN: 0
2026-03-28 14:07:10 [bca.uk] INFO: Found listing with ID: NA69%20ZFR
2026-03-28 14:07:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27NA69%2520ZFR%27 HTTP/1.1" 200 None
2026-03-28 14:07:10 [bca.uk] INFO: Scrape type for NA69%20ZFR: 0
2026-03-28 14:07:10 [bca.uk] INFO: Found listing with ID: NM21%20OBX
2026-03-28 14:07:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27NM21%2520OBX%27 HTTP/1.1" 200 None
2026-03-28 14:07:10 [bca.uk] INFO: Scrape type for NM21%20OBX: 0
2026-03-28 14:07:10 [bca.uk] INFO: Found listing with ID: SK70%20YOM
2026-03-28 14:07:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SK70%2520YOM%27 HTTP/1.1" 200 None
2026-03-28 14:07:10 [bca.uk] INFO: Scrape type for SK70%20YOM: 0
2026-03-28 14:07:10 [bca.uk] INFO: Found listing with ID: BG19%20WNV
2026-03-28 14:07:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BG19%2520WNV%27 HTTP/1.1" 200 None
2026-03-28 14:07:10 [bca.uk] INFO: Scrape type for BG19%20WNV: 0
2026-03-28 14:07:10 [bca.uk] INFO: Found listing with ID: WN19%20VBY
2026-03-28 14:07:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WN19%2520VBY%27 HTTP/1.1" 200 None
2026-03-28 14:07:10 [bca.uk] INFO: Scrape type for WN19%20VBY: 0
2026-03-28 14:07:10 [bca.uk] INFO: Found listing with ID: KP22%20FWN
2026-03-28 14:07:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KP22%2520FWN%27 HTTP/1.1" 200 None
2026-03-28 14:07:10 [bca.uk] INFO: Scrape type for KP22%20FWN: 0
2026-03-28 14:07:10 [bca.uk] INFO: Found listing with ID: YM70%20LGV
2026-03-28 14:07:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YM70%2520LGV%27 HTTP/1.1" 200 None
2026-03-28 14:07:10 [bca.uk] INFO: Scrape type for YM70%20LGV: 0
2026-03-28 14:07:10 [bca.uk] INFO: Found listing with ID: ST72%20HCC
2026-03-28 14:07:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27ST72%2520HCC%27 HTTP/1.1" 200 None
2026-03-28 14:07:11 [bca.uk] INFO: Scrape type for ST72%20HCC: 0
2026-03-28 14:07:11 [bca.uk] INFO: Found listing with ID: BK70%20LBZ
2026-03-28 14:07:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BK70%2520LBZ%27 HTTP/1.1" 200 None
2026-03-28 14:07:11 [bca.uk] INFO: Scrape type for BK70%20LBZ: 0
2026-03-28 14:07:11 [bca.uk] INFO: Found listing with ID: FE72%20GRU
2026-03-28 14:07:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FE72%2520GRU%27 HTTP/1.1" 200 None
2026-03-28 14:07:11 [bca.uk] INFO: Scrape type for FE72%20GRU: 0
2026-03-28 14:07:11 [bca.uk] INFO: Found listing with ID: FG19%20LHD
2026-03-28 14:07:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FG19%2520LHD%27 HTTP/1.1" 200 None
2026-03-28 14:07:11 [bca.uk] INFO: Scrape type for FG19%20LHD: 0
2026-03-28 14:07:11 [bca.uk] INFO: Found listing with ID: FL70%20SXN
2026-03-28 14:07:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FL70%2520SXN%27 HTTP/1.1" 200 None
2026-03-28 14:07:11 [bca.uk] INFO: Scrape type for FL70%20SXN: 0
2026-03-28 14:07:11 [bca.uk] INFO: Found listing with ID: GX69%20EEM
2026-03-28 14:07:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GX69%2520EEM%27 HTTP/1.1" 200 None
2026-03-28 14:07:11 [bca.uk] INFO: Scrape type for GX69%20EEM: 0
2026-03-28 14:07:11 [bca.uk] INFO: Found listing with ID: SD18%20HLO
2026-03-28 14:07:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SD18%2520HLO%27 HTTP/1.1" 200 None
2026-03-28 14:07:11 [bca.uk] INFO: Scrape type for SD18%20HLO: 0
2026-03-28 14:07:11 [bca.uk] INFO: Found listing with ID: AE23%20RSO
2026-03-28 14:07:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27AE23%2520RSO%27 HTTP/1.1" 200 None
2026-03-28 14:07:11 [bca.uk] INFO: Scrape type for AE23%20RSO: 0
2026-03-28 14:07:11 [bca.uk] INFO: Found listing with ID: AO71%20KYW
2026-03-28 14:07:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27AO71%2520KYW%27 HTTP/1.1" 200 None
2026-03-28 14:07:11 [bca.uk] INFO: Scrape type for AO71%20KYW: 2
2026-03-28 14:07:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d0572787-829f-5742-9913-c47b9548a703 with identifier: AO71%20KYW
2026-03-28 14:07:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d0572787-829f-5742-9913-c47b9548a703 with scrape type 2
2026-03-28 14:07:11 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d0572787-829f-5742-9913-c47b9548a703 with scrape type 2
2026-03-28 14:07:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: d0572787-829f-5742-9913-c47b9548a703, identifier: AO71%20KYW
2026-03-28 14:07:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: d0572787-829f-5742-9913-c47b9548a703 with identifier: AO71%20KYW
2026-03-28 14:07:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: d0572787-829f-5742-9913-c47b9548a703 with identifier: AO71%20KYW
2026-03-28 14:07:11 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: d0572787-829f-5742-9913-c47b9548a703 with identifier: AO71%20KYW to the API
2026-03-28 14:07:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:07:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:07:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=14&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 44,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=AO71%20KYW-GB',
'category': 'Car',
'color': 'red',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.5L',
'expiration_date': '2026-03-31T07:00:00Z',
'fuel_type': 'Petrol/Electric',
'id': 'd0572787-829f-5742-9913-c47b9548a703',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': False,
'license_plate': 'AO71 KYW',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=AO71%20KYW&vehicleType=*',
'listing': 'auction',
'location': 'Blackbushe',
'make': 'LAND ROVER',
'model': 'R/R EVOQUE',
'odometer': 17101,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-01-01',
'seller_name': None,
'title': 'LAND ROVER R/R EVOQUE 1.5 P300E 4WD R-DYNAMIC SE Hatchback',
'transmission': 'automatic',
'trim': 'P300E 4WD R-DYNAMIC SE',
'vin': 'SALZA2AT6NH173306',
'year': 2022}
2026-03-28 14:07:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27AO71%2520KYW%27 HTTP/1.1" 200 None
2026-03-28 14:07:11 [bca.uk] INFO: Saving data for AO71%20KYW: {'auction_closing_time': 1774940400.0, 'created_time': 1773930073.081096, 'last_price_update_time': 1774706831.806781}
2026-03-28 14:07:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='AO71%2520KYW') HTTP/1.1" 204 0
2026-03-28 14:07:11 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WP13WWY/698051968/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=WP13WWY-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-28 14:07:11 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/ML71WFO/698947234/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=ML71WFO-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-28 14:07:11 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SH22GFY/698915706/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698915706>
2026-03-28 14:07:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WP13WWY/698052000/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/WP13WWY/42793381?sv=2020-08-04&st=2026-03-28T14%3A07%3A01Z&se=2026-03-28T14%3A32%3A01Z&sr=b&sp=r&sig=wQS0I02XI5RzxZvAM48J7feAWKIRK81PE6DyEJBKsFc%3D)
2026-03-28 14:07:11 [scrapy.extensions.logstats] INFO: Crawled 199 pages (at 35 pages/min), scraped 360 items (at 48 items/min)
2026-03-28 14:07:11 [scrapy.extensions.memusage] INFO: Peak memory usage is 200MiB
2026-03-28 14:07:11 [bca.uk] INFO: Found listing with ID: AP18%20ZGH
2026-03-28 14:07:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27AP18%2520ZGH%27 HTTP/1.1" 200 None
2026-03-28 14:07:11 [bca.uk] INFO: Scrape type for AP18%20ZGH: 0
2026-03-28 14:07:11 [bca.uk] INFO: Found listing with ID: AX19%20VDY
2026-03-28 14:07:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27AX19%2520VDY%27 HTTP/1.1" 200 None
2026-03-28 14:07:11 [bca.uk] INFO: Scrape type for AX19%20VDY: 0
2026-03-28 14:07:11 [bca.uk] INFO: Found listing with ID: BG22%20JMV
2026-03-28 14:07:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BG22%2520JMV%27 HTTP/1.1" 200 None
2026-03-28 14:07:12 [bca.uk] INFO: Scrape type for BG22%20JMV: 0
2026-03-28 14:07:12 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:07:12 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:07:12 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:07:12 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:07:12 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:07:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:07:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2eabf490>
2026-03-28 14:07:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:07:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:07:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:07:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_932ab700-a26e-556f-85b5-1bb9734e718c/932ab700-a26e-556f-85b5-1bb9734e718c_image_9.jpg HTTP/1.1" 201 0
2026-03-28 14:07:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FML71WFO%252F698947404%252F600') HTTP/1.1" 204 0
2026-03-28 14:07:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/ML71WFO/698947404/600 saved to cache
2026-03-28 14:07:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 932ab700-a26e-556f-85b5-1bb9734e718c
2026-03-28 14:07:12 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:07:12 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:07:12 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:07:12 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:07:12 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:07:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:07:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2ca71f10>
2026-03-28 14:07:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:07:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:07:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:07:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8e80177a-614d-57e6-b32b-c4549bde7262/8e80177a-614d-57e6-b32b-c4549bde7262_image_8.jpg HTTP/1.1" 201 0
2026-03-28 14:07:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FWP13WWY%252F698052067%252F600') HTTP/1.1" 204 0
2026-03-28 14:07:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WP13WWY/698052067/600 saved to cache
2026-03-28 14:07:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 8e80177a-614d-57e6-b32b-c4549bde7262
2026-03-28 14:07:12 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:07:12 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:07:12 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:07:12 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:07:12 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:07:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:07:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2ffb3110>
2026-03-28 14:07:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:07:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:07:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:07:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8e80177a-614d-57e6-b32b-c4549bde7262/8e80177a-614d-57e6-b32b-c4549bde7262_image_9.jpg HTTP/1.1" 201 0
2026-03-28 14:07:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FWP13WWY%252F698052074%252F600') HTTP/1.1" 204 0
2026-03-28 14:07:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WP13WWY/698052074/600 saved to cache
2026-03-28 14:07:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 8e80177a-614d-57e6-b32b-c4549bde7262
2026-03-28 14:07:12 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:07:12 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:07:12 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:07:12 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:07:12 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:07:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:07:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2d9d0ad0>
2026-03-28 14:07:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:07:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:07:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:07:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_932ab700-a26e-556f-85b5-1bb9734e718c/932ab700-a26e-556f-85b5-1bb9734e718c_image_8.jpg HTTP/1.1" 201 0
2026-03-28 14:07:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FML71WFO%252F698947374%252F600') HTTP/1.1" 204 0
2026-03-28 14:07:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/ML71WFO/698947374/600 saved to cache
2026-03-28 14:07:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 932ab700-a26e-556f-85b5-1bb9734e718c
2026-03-28 14:07:12 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KEZ9481/698941540/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698941540>
2026-03-28 14:07:12 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/T400WRS/698069991/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698069991>
2026-03-28 14:07:12 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SH22GFY/698915673/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698915673>
2026-03-28 14:07:12 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YD21LKP/698439656/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698439656>
2026-03-28 14:07:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.bca.co.uk/api/search?q=&pageSize=100&page=15&sort=MostRecentlyAdded> (referer: https://www.bca.co.uk/search) ['zyte-api']
2026-03-28 14:07:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:07:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2ca70350>
2026-03-28 14:07:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:07:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:07:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:07:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8e80177a-614d-57e6-b32b-c4549bde7262/8e80177a-614d-57e6-b32b-c4549bde7262_image_3.jpg HTTP/1.1" 201 0
2026-03-28 14:07:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FWP13WWY%252F698052000%252F600') HTTP/1.1" 204 0
2026-03-28 14:07:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WP13WWY/698052000/600 saved to cache
2026-03-28 14:07:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 8e80177a-614d-57e6-b32b-c4549bde7262
2026-03-28 14:07:12 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YD21LKP/698439643/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698439643>
2026-03-28 14:07:12 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YD21LKP/698439650/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698439650>
2026-03-28 14:07:12 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SH22GFY/698915648/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698915648>
2026-03-28 14:07:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/ML71WFO/698947260/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/ML71WFO/42810333?sv=2020-08-04&st=2026-03-28T14%3A07%3A01Z&se=2026-03-28T14%3A32%3A01Z&sr=b&sp=r&sig=cXBfdYlvFIlLScFId9KF04NOtu6grGZTIAZqQZ2i%2Bn0%3D)
2026-03-28 14:07:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WP13WWY/698051988/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/WP13WWY/42793381?sv=2020-08-04&st=2026-03-28T14%3A07%3A01Z&se=2026-03-28T14%3A32%3A01Z&sr=b&sp=r&sig=wQS0I02XI5RzxZvAM48J7feAWKIRK81PE6DyEJBKsFc%3D)
2026-03-28 14:07:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SH22GFY/698915706/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/SH22GFY/42809522?sv=2020-08-04&st=2026-03-28T14%3A06%3A58Z&se=2026-03-28T14%3A31%3A58Z&sr=b&sp=r&sig=LF9M3JDhfhAd7nxLqVMWN2qOdCGHrBuIZdqAc9eQvMA%3D)
2026-03-28 14:07:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SH22GFY/698915737/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/SH22GFY/42809522?sv=2020-08-04&st=2026-03-28T14%3A06%3A58Z&se=2026-03-28T14%3A31%3A58Z&sr=b&sp=r&sig=LF9M3JDhfhAd7nxLqVMWN2qOdCGHrBuIZdqAc9eQvMA%3D)
2026-03-28 14:07:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YD21LKP/698439675/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YD21LKP/42810029?sv=2020-08-04&st=2026-03-28T14%3A07%3A00Z&se=2026-03-28T14%3A32%3A00Z&sr=b&sp=r&sig=EiPkPHEa%2F3uktliD9Vj4mtSFOMGvF7A9AlPUHHkf2%2B4%3D)
2026-03-28 14:07:12 [bca.uk] INFO: Total items found: 100
2026-03-28 14:07:12 [bca.uk] INFO: Requesting URL: https://www.bca.co.uk/api/search?q=&pageSize=100&page=16&sort=MostRecentlyAdded
2026-03-28 14:07:12 [bca.uk] INFO: Sending search API request with Bearer token (length=1492)
2026-03-28 14:07:12 [scrapy_zyte_api._params] WARNING: Request <GET https://www.bca.co.uk/api/search?q=&pageSize=100&page=16&sort=MostRecentlyAdded> defines the Zyte API customHttpRequestHeaders parameter, overriding Request.headers. Use Request.headers instead.
2026-03-28 14:07:12 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SH22GFY/698915627/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698915627>
2026-03-28 14:07:12 [bca.uk] INFO: Found listing with ID: BJ23%20DSV
2026-03-28 14:07:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BJ23%2520DSV%27 HTTP/1.1" 200 None
2026-03-28 14:07:12 [bca.uk] INFO: Scrape type for BJ23%20DSV: 0
2026-03-28 14:07:12 [bca.uk] INFO: Found listing with ID: BK22%20FCG
2026-03-28 14:07:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BK22%2520FCG%27 HTTP/1.1" 200 None
2026-03-28 14:07:12 [bca.uk] INFO: Scrape type for BK22%20FCG: 0
2026-03-28 14:07:12 [bca.uk] INFO: Found listing with ID: BP73%20OOG
2026-03-28 14:07:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BP73%2520OOG%27 HTTP/1.1" 200 None
2026-03-28 14:07:12 [bca.uk] INFO: Scrape type for BP73%20OOG: 0
2026-03-28 14:07:12 [bca.uk] INFO: Found listing with ID: CE19%20CEK
2026-03-28 14:07:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27CE19%2520CEK%27 HTTP/1.1" 200 None
2026-03-28 14:07:12 [bca.uk] INFO: Scrape type for CE19%20CEK: 0
2026-03-28 14:07:12 [bca.uk] INFO: Found listing with ID: DP22%20TKE
2026-03-28 14:07:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DP22%2520TKE%27 HTTP/1.1" 200 None
2026-03-28 14:07:12 [bca.uk] INFO: Scrape type for DP22%20TKE: 0
2026-03-28 14:07:12 [bca.uk] INFO: Found listing with ID: DS19%20NSN
2026-03-28 14:07:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DS19%2520NSN%27 HTTP/1.1" 200 None
2026-03-28 14:07:12 [bca.uk] INFO: Scrape type for DS19%20NSN: 0
2026-03-28 14:07:12 [bca.uk] INFO: Found listing with ID: DS71%20EAY
2026-03-28 14:07:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DS71%2520EAY%27 HTTP/1.1" 200 None
2026-03-28 14:07:12 [bca.uk] INFO: Scrape type for DS71%20EAY: 0
2026-03-28 14:07:12 [bca.uk] INFO: Found listing with ID: EA23%20BKN
2026-03-28 14:07:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27EA23%2520BKN%27 HTTP/1.1" 200 None
2026-03-28 14:07:12 [bca.uk] INFO: Scrape type for EA23%20BKN: 0
2026-03-28 14:07:12 [bca.uk] INFO: Found listing with ID: EY22%20KYZ
2026-03-28 14:07:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27EY22%2520KYZ%27 HTTP/1.1" 200 None
2026-03-28 14:07:12 [bca.uk] INFO: Scrape type for EY22%20KYZ: 0
2026-03-28 14:07:12 [bca.uk] INFO: Found listing with ID: FJ22%20YBP
2026-03-28 14:07:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FJ22%2520YBP%27 HTTP/1.1" 200 None
2026-03-28 14:07:12 [bca.uk] INFO: Scrape type for FJ22%20YBP: 0
2026-03-28 14:07:12 [bca.uk] INFO: Found listing with ID: GN70%20XMW
2026-03-28 14:07:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GN70%2520XMW%27 HTTP/1.1" 200 None
2026-03-28 14:07:12 [bca.uk] INFO: Scrape type for GN70%20XMW: 0
2026-03-28 14:07:12 [bca.uk] INFO: Found listing with ID: GX19%20TVF
2026-03-28 14:07:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GX19%2520TVF%27 HTTP/1.1" 200 None
2026-03-28 14:07:12 [bca.uk] INFO: Scrape type for GX19%20TVF: 0
2026-03-28 14:07:12 [bca.uk] INFO: Found listing with ID: HD22%20GPZ
2026-03-28 14:07:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27HD22%2520GPZ%27 HTTP/1.1" 200 None
2026-03-28 14:07:12 [bca.uk] INFO: Scrape type for HD22%20GPZ: 0
2026-03-28 14:07:12 [bca.uk] INFO: Found listing with ID: J4%20JYG
2026-03-28 14:07:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27J4%2520JYG%27 HTTP/1.1" 200 None
2026-03-28 14:07:12 [bca.uk] INFO: Scrape type for J4%20JYG: 0
2026-03-28 14:07:12 [bca.uk] INFO: Found listing with ID: JR09%20HOG
2026-03-28 14:07:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27JR09%2520HOG%27 HTTP/1.1" 200 None
2026-03-28 14:07:12 [bca.uk] INFO: Scrape type for JR09%20HOG: 0
2026-03-28 14:07:12 [bca.uk] INFO: Found listing with ID: KS69%20YCG
2026-03-28 14:07:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KS69%2520YCG%27 HTTP/1.1" 200 None
2026-03-28 14:07:12 [bca.uk] INFO: Scrape type for KS69%20YCG: 2
2026-03-28 14:07:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 62da4629-a089-5f66-a254-ecc0233d9742 with identifier: KS69%20YCG
2026-03-28 14:07:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 62da4629-a089-5f66-a254-ecc0233d9742 with scrape type 2
2026-03-28 14:07:12 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 62da4629-a089-5f66-a254-ecc0233d9742 with scrape type 2
2026-03-28 14:07:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 62da4629-a089-5f66-a254-ecc0233d9742, identifier: KS69%20YCG
2026-03-28 14:07:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 62da4629-a089-5f66-a254-ecc0233d9742 with identifier: KS69%20YCG
2026-03-28 14:07:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 62da4629-a089-5f66-a254-ecc0233d9742 with identifier: KS69%20YCG
2026-03-28 14:07:12 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 62da4629-a089-5f66-a254-ecc0233d9742 with identifier: KS69%20YCG to the API
2026-03-28 14:07:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:07:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:07:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=15&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 69,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=KS69%20YCG-GB',
'category': 'Car',
'color': 'black',
'currency': 'GBP',
'doors_number': 5,
'engine': '2.0L',
'expiration_date': '2026-03-31T07:00:00Z',
'fuel_type': 'Petrol/Electric',
'id': '62da4629-a089-5f66-a254-ecc0233d9742',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'KS69 YCG',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=KS69%20YCG&vehicleType=*',
'listing': 'auction',
'location': 'Bridgwater',
'make': 'LAND ROVER',
'model': 'R/R SPORT',
'odometer': 60570,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-01-01',
'seller_name': None,
'title': 'LAND ROVER R/R SPORT 2.0 P400E AUTOBIOGRAPHY DYNAMIC StationWagon',
'transmission': 'automatic',
'trim': 'P400E AUTOBIOGRAPHY DYNAMIC',
'vin': 'SALWA2AY2LA701444',
'year': 2019}
2026-03-28 14:07:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KS69%2520YCG%27 HTTP/1.1" 200 None
2026-03-28 14:07:13 [bca.uk] INFO: Saving data for KS69%20YCG: {'auction_closing_time': 1774940400.0, 'created_time': 1773933688.873559, 'last_price_update_time': 1774706833.089155}
2026-03-28 14:07:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='KS69%2520YCG') HTTP/1.1" 204 0
2026-03-28 14:07:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WP13WWY/698051968/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/WP13WWY/42793381?sv=2020-08-04&st=2026-03-28T14%3A07%3A01Z&se=2026-03-28T14%3A32%3A01Z&sr=b&sp=r&sig=wQS0I02XI5RzxZvAM48J7feAWKIRK81PE6DyEJBKsFc%3D)
2026-03-28 14:07:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/ML71WFO/698947234/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/ML71WFO/42810333?sv=2020-08-04&st=2026-03-28T14%3A07%3A01Z&se=2026-03-28T14%3A32%3A01Z&sr=b&sp=r&sig=cXBfdYlvFIlLScFId9KF04NOtu6grGZTIAZqQZ2i%2Bn0%3D)
2026-03-28 14:07:13 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KEZ9481/698941415/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698941415>
2026-03-28 14:07:13 [bca.uk] INFO: Found listing with ID: LA71%20YYO
2026-03-28 14:07:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LA71%2520YYO%27 HTTP/1.1" 200 None
2026-03-28 14:07:13 [bca.uk] INFO: Scrape type for LA71%20YYO: 0
2026-03-28 14:07:13 [bca.uk] INFO: Found listing with ID: LC22%20EAY
2026-03-28 14:07:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LC22%2520EAY%27 HTTP/1.1" 200 None
2026-03-28 14:07:13 [bca.uk] INFO: Scrape type for LC22%20EAY: 0
2026-03-28 14:07:13 [bca.uk] INFO: Found listing with ID: LL22%20MGO
2026-03-28 14:07:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LL22%2520MGO%27 HTTP/1.1" 200 None
2026-03-28 14:07:13 [bca.uk] INFO: Scrape type for LL22%20MGO: 2
2026-03-28 14:07:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e96a7ea3-223c-5eb4-a6d1-184500bc493a with identifier: LL22%20MGO
2026-03-28 14:07:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e96a7ea3-223c-5eb4-a6d1-184500bc493a with scrape type 2
2026-03-28 14:07:13 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e96a7ea3-223c-5eb4-a6d1-184500bc493a with scrape type 2
2026-03-28 14:07:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: e96a7ea3-223c-5eb4-a6d1-184500bc493a, identifier: LL22%20MGO
2026-03-28 14:07:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YD21LKP/698439656/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YD21LKP/42810029?sv=2020-08-04&st=2026-03-28T14%3A07%3A00Z&se=2026-03-28T14%3A32%3A00Z&sr=b&sp=r&sig=EiPkPHEa%2F3uktliD9Vj4mtSFOMGvF7A9AlPUHHkf2%2B4%3D)
2026-03-28 14:07:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KEZ9481/698941540/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/KEZ9481/42810228?sv=2020-08-04&st=2026-03-28T14%3A06%3A56Z&se=2026-03-28T14%3A31%3A56Z&sr=b&sp=r&sig=DDPGn%2BcxbHbdqwyGWf309ifFTIM3Acs6kuQRt8vCf2E%3D)
2026-03-28 14:07:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SH22GFY/698915673/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/SH22GFY/42809522?sv=2020-08-04&st=2026-03-28T14%3A06%3A58Z&se=2026-03-28T14%3A31%3A58Z&sr=b&sp=r&sig=LF9M3JDhfhAd7nxLqVMWN2qOdCGHrBuIZdqAc9eQvMA%3D)
2026-03-28 14:07:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/T400WRS/698069991/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/T400WRS/42810019?sv=2020-08-04&st=2026-03-28T14%3A06%3A56Z&se=2026-03-28T14%3A31%3A56Z&sr=b&sp=r&sig=kIZj2tqr%2BfocLXmzFxOg%2F2cX7%2FfCCdSGle1KfN6FfvQ%3D)
2026-03-28 14:07:13 [scrapy_zyte_api._params] WARNING: Request <GET https://www.bca.co.uk/api/search?q=&pageSize=100&page=16&sort=MostRecentlyAdded> defines the Zyte API customHttpRequestHeaders parameter, overriding Request.headers. Use Request.headers instead.
2026-03-28 14:07:13 [scrapy_zyte_api._params] WARNING: Request <GET https://www.bca.co.uk/api/search?q=&pageSize=100&page=16&sort=MostRecentlyAdded> defines the Zyte API customHttpRequestHeaders parameter, overriding Request.headers. Use Request.headers instead.
2026-03-28 14:07:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: e96a7ea3-223c-5eb4-a6d1-184500bc493a with identifier: LL22%20MGO
2026-03-28 14:07:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: e96a7ea3-223c-5eb4-a6d1-184500bc493a with identifier: LL22%20MGO
2026-03-28 14:07:13 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: e96a7ea3-223c-5eb4-a6d1-184500bc493a with identifier: LL22%20MGO to the API
2026-03-28 14:07:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:07:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:07:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=15&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 52,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=LL22%20MGO-GB',
'category': 'Car',
'color': 'grey',
'currency': 'GBP',
'doors_number': 5,
'engine': '2.0L',
'expiration_date': '2026-03-31T07:00:00Z',
'fuel_type': 'Petrol/Electric',
'id': 'e96a7ea3-223c-5eb4-a6d1-184500bc493a',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'LL22 MGO',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=LL22%20MGO&vehicleType=*',
'listing': 'auction',
'location': 'Manchester',
'make': 'JAGUAR',
'model': 'F-PACE',
'odometer': 48962,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-01-01',
'seller_name': None,
'title': 'JAGUAR F-PACE 2.0 P400E AWD R-DYNAMIC BLACK StationWagon',
'transmission': 'automatic',
'trim': 'P400E AWD R-DYNAMIC BLACK',
'vin': 'SADCA2AY3NA691721',
'year': 2022}
2026-03-28 14:07:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LL22%2520MGO%27 HTTP/1.1" 200 None
2026-03-28 14:07:13 [bca.uk] INFO: Saving data for LL22%20MGO: {'auction_closing_time': 1774940400.0, 'created_time': 1773933690.487703, 'last_price_update_time': 1774706833.702114}
2026-03-28 14:07:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='LL22%2520MGO') HTTP/1.1" 204 0
2026-03-28 14:07:13 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 14:07:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:07:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c1245d0>
2026-03-28 14:07:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:07:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:07:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:07:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_932ab700-a26e-556f-85b5-1bb9734e718c/932ab700-a26e-556f-85b5-1bb9734e718c_image_2.jpg HTTP/1.1" 201 0
2026-03-28 14:07:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FML71WFO%252F698947260%252F600') HTTP/1.1" 204 0
2026-03-28 14:07:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/ML71WFO/698947260/600 saved to cache
2026-03-28 14:07:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 932ab700-a26e-556f-85b5-1bb9734e718c
2026-03-28 14:07:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:07:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c9f8690>
2026-03-28 14:07:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:07:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:07:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:07:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8e80177a-614d-57e6-b32b-c4549bde7262/8e80177a-614d-57e6-b32b-c4549bde7262_image_2.jpg HTTP/1.1" 201 0
2026-03-28 14:07:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FWP13WWY%252F698051988%252F600') HTTP/1.1" 204 0
2026-03-28 14:07:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WP13WWY/698051988/600 saved to cache
2026-03-28 14:07:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 8e80177a-614d-57e6-b32b-c4549bde7262
2026-03-28 14:07:13 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:07:13 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:07:13 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:07:13 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:07:13 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:07:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:07:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2d69d750>
2026-03-28 14:07:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:07:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:07:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:07:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_95add145-cfdb-56fb-a27d-d877a0432bd6/95add145-cfdb-56fb-a27d-d877a0432bd6_image_8.jpg HTTP/1.1" 201 0
2026-03-28 14:07:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FSH22GFY%252F698915706%252F600') HTTP/1.1" 204 0
2026-03-28 14:07:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SH22GFY/698915706/600 saved to cache
2026-03-28 14:07:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 95add145-cfdb-56fb-a27d-d877a0432bd6
2026-03-28 14:07:13 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:07:13 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:07:13 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:07:13 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:07:13 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:07:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:07:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2dbeba10>
2026-03-28 14:07:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:07:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:07:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:07:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_95add145-cfdb-56fb-a27d-d877a0432bd6/95add145-cfdb-56fb-a27d-d877a0432bd6_image_9.jpg HTTP/1.1" 201 0
2026-03-28 14:07:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FSH22GFY%252F698915737%252F600') HTTP/1.1" 204 0
2026-03-28 14:07:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SH22GFY/698915737/600 saved to cache
2026-03-28 14:07:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 95add145-cfdb-56fb-a27d-d877a0432bd6
2026-03-28 14:07:13 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:07:13 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:07:13 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:07:13 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:07:13 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:07:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:07:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2ca8b650>
2026-03-28 14:07:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:07:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:07:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:07:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e39beb78-d51f-5fbe-a58d-f26050dd24f6/e39beb78-d51f-5fbe-a58d-f26050dd24f6_image_9.jpg HTTP/1.1" 201 0
2026-03-28 14:07:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FYD21LKP%252F698439675%252F600') HTTP/1.1" 204 0
2026-03-28 14:07:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YD21LKP/698439675/600 saved to cache
2026-03-28 14:07:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item e39beb78-d51f-5fbe-a58d-f26050dd24f6
2026-03-28 14:07:13 [bca.uk] INFO: Found listing with ID: LV22%20KXJ
2026-03-28 14:07:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LV22%2520KXJ%27 HTTP/1.1" 200 None
2026-03-28 14:07:13 [bca.uk] INFO: Scrape type for LV22%20KXJ: 0
2026-03-28 14:07:13 [bca.uk] INFO: Found listing with ID: ML19%20OBE
2026-03-28 14:07:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27ML19%2520OBE%27 HTTP/1.1" 200 None
2026-03-28 14:07:13 [bca.uk] INFO: Scrape type for ML19%20OBE: 0
2026-03-28 14:07:13 [bca.uk] INFO: Found listing with ID: NC22%20CZK
2026-03-28 14:07:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27NC22%2520CZK%27 HTTP/1.1" 200 None
2026-03-28 14:07:13 [bca.uk] INFO: Scrape type for NC22%20CZK: 0
2026-03-28 14:07:13 [bca.uk] INFO: Found listing with ID: NX72%20PHY
2026-03-28 14:07:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27NX72%2520PHY%27 HTTP/1.1" 200 None
2026-03-28 14:07:13 [bca.uk] INFO: Scrape type for NX72%20PHY: 2
2026-03-28 14:07:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 09324292-c8d2-5557-8032-73fdb91db684 with identifier: NX72%20PHY
2026-03-28 14:07:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 09324292-c8d2-5557-8032-73fdb91db684 with scrape type 2
2026-03-28 14:07:13 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 09324292-c8d2-5557-8032-73fdb91db684 with scrape type 2
2026-03-28 14:07:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 09324292-c8d2-5557-8032-73fdb91db684, identifier: NX72%20PHY
2026-03-28 14:07:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SH22GFY/698915648/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/SH22GFY/42809522?sv=2020-08-04&st=2026-03-28T14%3A06%3A58Z&se=2026-03-28T14%3A31%3A58Z&sr=b&sp=r&sig=LF9M3JDhfhAd7nxLqVMWN2qOdCGHrBuIZdqAc9eQvMA%3D)
2026-03-28 14:07:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 09324292-c8d2-5557-8032-73fdb91db684 with identifier: NX72%20PHY
2026-03-28 14:07:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 09324292-c8d2-5557-8032-73fdb91db684 with identifier: NX72%20PHY
2026-03-28 14:07:14 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 09324292-c8d2-5557-8032-73fdb91db684 with identifier: NX72%20PHY to the API
2026-03-28 14:07:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:07:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:07:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=15&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 33,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=NX72%20PHY-GB',
'category': 'Car',
'color': 'red',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.5L',
'expiration_date': '2026-03-31T07:00:00Z',
'fuel_type': 'Petrol/Electric',
'id': '09324292-c8d2-5557-8032-73fdb91db684',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': False,
'license_plate': 'NX72 PHY',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=NX72%20PHY&vehicleType=*',
'listing': 'auction',
'location': 'Newcastle-u-Tyne',
'make': 'LAND ROVER',
'model': 'R/R EVOQUE',
'odometer': 25478,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-01-01',
'seller_name': None,
'title': 'LAND ROVER R/R EVOQUE 1.5 P300E 4WD R-DYNAMIC S Hatchback',
'transmission': 'automatic',
'trim': 'P300E 4WD R-DYNAMIC S',
'vin': 'SALZA2AT6PH207943',
'year': 2022}
2026-03-28 14:07:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27NX72%2520PHY%27 HTTP/1.1" 200 None
2026-03-28 14:07:14 [bca.uk] INFO: Saving data for NX72%20PHY: {'auction_closing_time': 1774940400.0, 'created_time': 1773843527.458863, 'last_price_update_time': 1774706834.409372}
2026-03-28 14:07:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='NX72%2520PHY') HTTP/1.1" 204 0
2026-03-28 14:07:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:07:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2de54e10>
2026-03-28 14:07:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:07:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:07:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:07:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8e80177a-614d-57e6-b32b-c4549bde7262/8e80177a-614d-57e6-b32b-c4549bde7262_image_0.jpg HTTP/1.1" 201 0
2026-03-28 14:07:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FWP13WWY%252F698051968%252F600') HTTP/1.1" 204 0
2026-03-28 14:07:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WP13WWY/698051968/600 saved to cache
2026-03-28 14:07:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 8e80177a-614d-57e6-b32b-c4549bde7262
2026-03-28 14:07:14 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 8e80177a-614d-57e6-b32b-c4549bde7262, skipping ID generation
2026-03-28 14:07:14 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 8e80177a-614d-57e6-b32b-c4549bde7262 sending to next pipeline
2026-03-28 14:07:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 8e80177a-614d-57e6-b32b-c4549bde7262, identifier: WP13%20WWY
2026-03-28 14:07:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:07:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2dbba710>
2026-03-28 14:07:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:07:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:07:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:07:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_932ab700-a26e-556f-85b5-1bb9734e718c/932ab700-a26e-556f-85b5-1bb9734e718c_image_0.jpg HTTP/1.1" 201 0
2026-03-28 14:07:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FML71WFO%252F698947234%252F600') HTTP/1.1" 204 0
2026-03-28 14:07:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/ML71WFO/698947234/600 saved to cache
2026-03-28 14:07:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 932ab700-a26e-556f-85b5-1bb9734e718c
2026-03-28 14:07:14 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 932ab700-a26e-556f-85b5-1bb9734e718c, skipping ID generation
2026-03-28 14:07:14 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 932ab700-a26e-556f-85b5-1bb9734e718c sending to next pipeline
2026-03-28 14:07:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 932ab700-a26e-556f-85b5-1bb9734e718c, identifier: ML71%20WFO
2026-03-28 14:07:14 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/T400WRS/698069970/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698069970>
2026-03-28 14:07:14 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/T400WRS/698069973/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698069973>
2026-03-28 14:07:14 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SH22GFY/698915586/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698915586>
2026-03-28 14:07:14 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KEZ9481/698941361/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698941361>
2026-03-28 14:07:14 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KEZ9481/698941379/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698941379>
2026-03-28 14:07:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YD21LKP/698439643/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YD21LKP/42810029?sv=2020-08-04&st=2026-03-28T14%3A07%3A00Z&se=2026-03-28T14%3A32%3A00Z&sr=b&sp=r&sig=EiPkPHEa%2F3uktliD9Vj4mtSFOMGvF7A9AlPUHHkf2%2B4%3D)
2026-03-28 14:07:14 [bca.uk] INFO: Found listing with ID: OV69%20LRU
2026-03-28 14:07:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27OV69%2520LRU%27 HTTP/1.1" 200 None
2026-03-28 14:07:14 [bca.uk] INFO: Scrape type for OV69%20LRU: 0
2026-03-28 14:07:14 [bca.uk] INFO: Found listing with ID: PX22%20ZKE
2026-03-28 14:07:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27PX22%2520ZKE%27 HTTP/1.1" 200 None
2026-03-28 14:07:14 [bca.uk] INFO: Scrape type for PX22%20ZKE: 0
2026-03-28 14:07:14 [bca.uk] INFO: Found listing with ID: PY67%20LKC
2026-03-28 14:07:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27PY67%2520LKC%27 HTTP/1.1" 200 None
2026-03-28 14:07:14 [bca.uk] INFO: Scrape type for PY67%20LKC: 0
2026-03-28 14:07:14 [bca.uk] INFO: Found listing with ID: RA15%20RYY
2026-03-28 14:07:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27RA15%2520RYY%27 HTTP/1.1" 200 None
2026-03-28 14:07:14 [bca.uk] INFO: Scrape type for RA15%20RYY: 2
2026-03-28 14:07:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4201ffed-3c15-5701-9bc2-782b7dab9812 with identifier: RA15%20RYY
2026-03-28 14:07:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4201ffed-3c15-5701-9bc2-782b7dab9812 with scrape type 2
2026-03-28 14:07:14 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4201ffed-3c15-5701-9bc2-782b7dab9812 with scrape type 2
2026-03-28 14:07:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 4201ffed-3c15-5701-9bc2-782b7dab9812, identifier: RA15%20RYY
2026-03-28 14:07:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 8e80177a-614d-57e6-b32b-c4549bde7262 with identifier: WP13%20WWY
2026-03-28 14:07:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 8e80177a-614d-57e6-b32b-c4549bde7262 with identifier: WP13%20WWY
2026-03-28 14:07:14 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 8e80177a-614d-57e6-b32b-c4549bde7262 with identifier: WP13%20WWY to the API
2026-03-28 14:07:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:07:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:07:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WP13WWY/698051968/600>
{'auction_title': '',
'c_o_2_emission_value': 189,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8e80177a-614d-57e6-b32b-c4549bde7262/8e80177a-614d-57e6-b32b-c4549bde7262_expert_report_file_980bb9f7-e78b-4672-85cf-dc083b8b298e.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=WP13%20WWY-GB',
'category': 'Car',
'color': 'blue',
'currency': 'GBP',
'doors_number': 5,
'engine': '3.0L',
'expiration_date': '2026-03-29T10:00:00Z',
'fuel_type': 'Diesel',
'id': '8e80177a-614d-57e6-b32b-c4549bde7262',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'WP13 WWY',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=WP13%20WWY&vehicleType=*',
'listing': 'auction',
'location': 'Bridgwater',
'make': 'VOLKSWAGEN',
'model': 'TOUAREG',
'odometer': 153909,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 12,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8e80177a-614d-57e6-b32b-c4549bde7262/8e80177a-614d-57e6-b32b-c4549bde7262_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 54009,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WP13WWY/698051968/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8e80177a-614d-57e6-b32b-c4549bde7262/8e80177a-614d-57e6-b32b-c4549bde7262_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 54520,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WP13WWY/698051980/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8e80177a-614d-57e6-b32b-c4549bde7262/8e80177a-614d-57e6-b32b-c4549bde7262_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 51647,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WP13WWY/698051988/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8e80177a-614d-57e6-b32b-c4549bde7262/8e80177a-614d-57e6-b32b-c4549bde7262_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 50432,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WP13WWY/698052000/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8e80177a-614d-57e6-b32b-c4549bde7262/8e80177a-614d-57e6-b32b-c4549bde7262_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 48165,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WP13WWY/698052011/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8e80177a-614d-57e6-b32b-c4549bde7262/8e80177a-614d-57e6-b32b-c4549bde7262_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 48865,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WP13WWY/698052027/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8e80177a-614d-57e6-b32b-c4549bde7262/8e80177a-614d-57e6-b32b-c4549bde7262_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 84810,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WP13WWY/698052041/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8e80177a-614d-57e6-b32b-c4549bde7262/8e80177a-614d-57e6-b32b-c4549bde7262_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 76823,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WP13WWY/698052056/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8e80177a-614d-57e6-b32b-c4549bde7262/8e80177a-614d-57e6-b32b-c4549bde7262_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 90479,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WP13WWY/698052067/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8e80177a-614d-57e6-b32b-c4549bde7262/8e80177a-614d-57e6-b32b-c4549bde7262_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 75971,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WP13WWY/698052074/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2013-01-01',
'seller_name': None,
'title': 'VOLKSWAGEN TOUAREG 3.0 V6 TDI 245 SE TIP StationWagon',
'transmission': 'manual',
'trim': 'V6 TDI 245 SE TIP',
'vin': 'WVGZZZ7PZDD041578',
'year': 2013}
2026-03-28 14:07:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WP13%2520WWY%27 HTTP/1.1" 200 None
2026-03-28 14:07:15 [bca.uk] INFO: Saving data for WP13%20WWY: {'created_time': 1774706835.321117, 'last_price_update_time': 1774706835.321129, 'auction_closing_time': 1774778400.0}
2026-03-28 14:07:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='WP13%2520WWY') HTTP/1.1" 204 0
2026-03-28 14:07:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 932ab700-a26e-556f-85b5-1bb9734e718c with identifier: ML71%20WFO
2026-03-28 14:07:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 932ab700-a26e-556f-85b5-1bb9734e718c with identifier: ML71%20WFO
2026-03-28 14:07:15 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 932ab700-a26e-556f-85b5-1bb9734e718c with identifier: ML71%20WFO to the API
2026-03-28 14:07:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:07:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:07:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/ML71WFO/698947234/600>
{'auction_title': '',
'c_o_2_emission_value': 121,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_932ab700-a26e-556f-85b5-1bb9734e718c/932ab700-a26e-556f-85b5-1bb9734e718c_expert_report_file_84e1ff92-1a98-478b-b6f1-dc8816a605ce.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=ML71%20WFO-GB',
'category': 'Car',
'color': 'black',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.0L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol',
'id': '932ab700-a26e-556f-85b5-1bb9734e718c',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'ML71 WFO',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=ML71%20WFO&vehicleType=*',
'listing': 'auction',
'location': 'Manchester',
'make': 'SEAT',
'model': 'ARONA',
'odometer': 37242,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 11,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_932ab700-a26e-556f-85b5-1bb9734e718c/932ab700-a26e-556f-85b5-1bb9734e718c_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 46450,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/ML71WFO/698947234/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_932ab700-a26e-556f-85b5-1bb9734e718c/932ab700-a26e-556f-85b5-1bb9734e718c_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 46080,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/ML71WFO/698947244/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_932ab700-a26e-556f-85b5-1bb9734e718c/932ab700-a26e-556f-85b5-1bb9734e718c_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 46458,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/ML71WFO/698947260/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_932ab700-a26e-556f-85b5-1bb9734e718c/932ab700-a26e-556f-85b5-1bb9734e718c_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 47684,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/ML71WFO/698947272/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_932ab700-a26e-556f-85b5-1bb9734e718c/932ab700-a26e-556f-85b5-1bb9734e718c_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 44824,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/ML71WFO/698947282/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_932ab700-a26e-556f-85b5-1bb9734e718c/932ab700-a26e-556f-85b5-1bb9734e718c_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 41755,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/ML71WFO/698947295/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_932ab700-a26e-556f-85b5-1bb9734e718c/932ab700-a26e-556f-85b5-1bb9734e718c_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 96582,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/ML71WFO/698947320/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_932ab700-a26e-556f-85b5-1bb9734e718c/932ab700-a26e-556f-85b5-1bb9734e718c_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 76470,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/ML71WFO/698947343/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_932ab700-a26e-556f-85b5-1bb9734e718c/932ab700-a26e-556f-85b5-1bb9734e718c_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 93310,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/ML71WFO/698947374/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_932ab700-a26e-556f-85b5-1bb9734e718c/932ab700-a26e-556f-85b5-1bb9734e718c_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 89121,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/ML71WFO/698947404/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-01-01',
'seller_name': None,
'title': 'SEAT ARONA 1.0 TSI 110 FR Hatchback',
'transmission': 'manual',
'trim': 'TSI 110 FR',
'vin': 'VSSZZZKJZNR023355',
'year': 2021}
2026-03-28 14:07:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27ML71%2520WFO%27 HTTP/1.1" 200 None
2026-03-28 14:07:15 [bca.uk] INFO: Saving data for ML71%20WFO: {'created_time': 1774706835.800984, 'last_price_update_time': 1774706835.800997, 'auction_closing_time': 1774864800.0}
2026-03-28 14:07:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='ML71%2520WFO') HTTP/1.1" 204 0
2026-03-28 14:07:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YD21LKP/698439650/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YD21LKP/42810029?sv=2020-08-04&st=2026-03-28T14%3A07%3A00Z&se=2026-03-28T14%3A32%3A00Z&sr=b&sp=r&sig=EiPkPHEa%2F3uktliD9Vj4mtSFOMGvF7A9AlPUHHkf2%2B4%3D)
2026-03-28 14:07:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 4201ffed-3c15-5701-9bc2-782b7dab9812 with identifier: RA15%20RYY
2026-03-28 14:07:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 4201ffed-3c15-5701-9bc2-782b7dab9812 with identifier: RA15%20RYY
2026-03-28 14:07:15 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 4201ffed-3c15-5701-9bc2-782b7dab9812 with identifier: RA15%20RYY to the API
2026-03-28 14:07:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:07:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:07:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=15&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 179,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=RA15%20RYY-GB',
'category': 'Car',
'color': 'grey',
'currency': 'GBP',
'doors_number': 4,
'engine': '2.0L',
'expiration_date': '2026-03-31T07:00:00Z',
'fuel_type': 'Petrol',
'id': '4201ffed-3c15-5701-9bc2-782b7dab9812',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'RA15 RYY',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=RA15%20RYY&vehicleType=*',
'listing': 'auction',
'location': 'Newcastle-u-Tyne',
'make': 'JAGUAR',
'model': 'XE',
'odometer': 100022,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-01-01',
'seller_name': None,
'title': 'JAGUAR XE 2.0 T 240 R SPORT Saloon',
'transmission': 'automatic',
'trim': 'T 240 R SPORT',
'vin': 'SAJAB4AG4GA910709',
'year': 2015}
2026-03-28 14:07:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27RA15%2520RYY%27 HTTP/1.1" 200 None
2026-03-28 14:07:16 [bca.uk] INFO: Saving data for RA15%20RYY: {'auction_closing_time': 1774940400.0, 'created_time': 1773933610.898813, 'last_price_update_time': 1774706836.166366}
2026-03-28 14:07:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='RA15%2520RYY') HTTP/1.1" 204 0
2026-03-28 14:07:16 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:07:16 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:07:16 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:07:16 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:07:16 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:07:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:07:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2dd05610>
2026-03-28 14:07:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:07:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:07:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:07:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e39beb78-d51f-5fbe-a58d-f26050dd24f6/e39beb78-d51f-5fbe-a58d-f26050dd24f6_image_7.jpg HTTP/1.1" 201 0
2026-03-28 14:07:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FYD21LKP%252F698439656%252F600') HTTP/1.1" 204 0
2026-03-28 14:07:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YD21LKP/698439656/600 saved to cache
2026-03-28 14:07:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item e39beb78-d51f-5fbe-a58d-f26050dd24f6
2026-03-28 14:07:16 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:07:16 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:07:16 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:07:16 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:07:16 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:07:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:07:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a1fe53750>
2026-03-28 14:07:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:07:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:07:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:07:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f055b506-0022-5f0e-a7cd-13f0911779b4/f055b506-0022-5f0e-a7cd-13f0911779b4_image_9.jpg HTTP/1.1" 201 0
2026-03-28 14:07:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FKEZ9481%252F698941540%252F600') HTTP/1.1" 204 0
2026-03-28 14:07:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KEZ9481/698941540/600 saved to cache
2026-03-28 14:07:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item f055b506-0022-5f0e-a7cd-13f0911779b4
2026-03-28 14:07:16 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:07:16 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:07:16 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:07:16 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:07:16 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:07:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:07:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c9a2550>
2026-03-28 14:07:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:07:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:07:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:07:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_95add145-cfdb-56fb-a27d-d877a0432bd6/95add145-cfdb-56fb-a27d-d877a0432bd6_image_7.jpg HTTP/1.1" 201 0
2026-03-28 14:07:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FSH22GFY%252F698915673%252F600') HTTP/1.1" 204 0
2026-03-28 14:07:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SH22GFY/698915673/600 saved to cache
2026-03-28 14:07:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 95add145-cfdb-56fb-a27d-d877a0432bd6
2026-03-28 14:07:16 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:07:16 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:07:16 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:07:16 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:07:16 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:07:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:07:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c8e2350>
2026-03-28 14:07:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:07:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:07:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:07:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a2c13cca-acdb-56e9-80bf-41e2acf4aed1/a2c13cca-acdb-56e9-80bf-41e2acf4aed1_image_9.jpg HTTP/1.1" 201 0
2026-03-28 14:07:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FT400WRS%252F698069991%252F600') HTTP/1.1" 204 0
2026-03-28 14:07:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/T400WRS/698069991/600 saved to cache
2026-03-28 14:07:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item a2c13cca-acdb-56e9-80bf-41e2acf4aed1
2026-03-28 14:07:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SH22GFY/698915627/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/SH22GFY/42809522?sv=2020-08-04&st=2026-03-28T14%3A06%3A58Z&se=2026-03-28T14%3A31%3A58Z&sr=b&sp=r&sig=LF9M3JDhfhAd7nxLqVMWN2qOdCGHrBuIZdqAc9eQvMA%3D)
2026-03-28 14:07:16 [bca.uk] INFO: Found listing with ID: RJ72%20VOD
2026-03-28 14:07:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27RJ72%2520VOD%27 HTTP/1.1" 200 None
2026-03-28 14:07:16 [bca.uk] INFO: Scrape type for RJ72%20VOD: 2
2026-03-28 14:07:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2ca78dce-584a-5dac-a9d2-555e2bef9f74 with identifier: RJ72%20VOD
2026-03-28 14:07:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2ca78dce-584a-5dac-a9d2-555e2bef9f74 with scrape type 2
2026-03-28 14:07:16 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2ca78dce-584a-5dac-a9d2-555e2bef9f74 with scrape type 2
2026-03-28 14:07:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 2ca78dce-584a-5dac-a9d2-555e2bef9f74, identifier: RJ72%20VOD
2026-03-28 14:07:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 2ca78dce-584a-5dac-a9d2-555e2bef9f74 with identifier: RJ72%20VOD
2026-03-28 14:07:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 2ca78dce-584a-5dac-a9d2-555e2bef9f74 with identifier: RJ72%20VOD
2026-03-28 14:07:16 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 2ca78dce-584a-5dac-a9d2-555e2bef9f74 with identifier: RJ72%20VOD to the API
2026-03-28 14:07:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:07:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:07:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=15&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 34,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=RJ72%20VOD-GB',
'category': 'Car',
'color': 'blue',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.5L',
'expiration_date': '2026-03-31T07:00:00Z',
'fuel_type': 'Petrol/Electric',
'id': '2ca78dce-584a-5dac-a9d2-555e2bef9f74',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': False,
'license_plate': 'RJ72 VOD',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=RJ72%20VOD&vehicleType=*',
'listing': 'auction',
'location': 'Blackbushe',
'make': 'LAND ROVER',
'model': 'R/R EVOQUE',
'odometer': 30857,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-01-01',
'seller_name': None,
'title': 'LAND ROVER R/R EVOQUE 1.5 P300E 4WD R-DYNAMIC SE Hatchback',
'transmission': 'automatic',
'trim': 'P300E 4WD R-DYNAMIC SE',
'vin': 'SALZA2AT6PH207005',
'year': 2022}
2026-03-28 14:07:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27RJ72%2520VOD%27 HTTP/1.1" 200 None
2026-03-28 14:07:17 [bca.uk] INFO: Saving data for RJ72%20VOD: {'auction_closing_time': 1774940400.0, 'created_time': 1774016068.225202, 'last_price_update_time': 1774706837.056283}
2026-03-28 14:07:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='RJ72%2520VOD') HTTP/1.1" 204 0
2026-03-28 14:07:17 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:07:17 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:07:17 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:07:17 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:07:17 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:07:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:07:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2d846910>
2026-03-28 14:07:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:07:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:07:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:07:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_95add145-cfdb-56fb-a27d-d877a0432bd6/95add145-cfdb-56fb-a27d-d877a0432bd6_image_6.jpg HTTP/1.1" 201 0
2026-03-28 14:07:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FSH22GFY%252F698915648%252F600') HTTP/1.1" 204 0
2026-03-28 14:07:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SH22GFY/698915648/600 saved to cache
2026-03-28 14:07:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 95add145-cfdb-56fb-a27d-d877a0432bd6
2026-03-28 14:07:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:07:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a3018bc10>
2026-03-28 14:07:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:07:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:07:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:07:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e39beb78-d51f-5fbe-a58d-f26050dd24f6/e39beb78-d51f-5fbe-a58d-f26050dd24f6_image_5.jpg HTTP/1.1" 201 0
2026-03-28 14:07:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FYD21LKP%252F698439643%252F600') HTTP/1.1" 204 0
2026-03-28 14:07:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YD21LKP/698439643/600 saved to cache
2026-03-28 14:07:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item e39beb78-d51f-5fbe-a58d-f26050dd24f6
2026-03-28 14:07:17 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YD21LKP/698439628/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698439628>
2026-03-28 14:07:17 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/T400WRS/698069954/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698069954>
2026-03-28 14:07:17 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SH22GFY/698915564/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698915564>
2026-03-28 14:07:17 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SH22GFY/698915544/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698915544>
2026-03-28 14:07:17 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/T400WRS/698069961/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698069961>
2026-03-28 14:07:17 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KEZ9481/698941324/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698941324>
2026-03-28 14:07:17 [bca.uk] INFO: Found listing with ID: SA21%20KZD
2026-03-28 14:07:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SA21%2520KZD%27 HTTP/1.1" 200 None
2026-03-28 14:07:17 [bca.uk] INFO: Scrape type for SA21%20KZD: 2
2026-03-28 14:07:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 84dd8e9d-4791-54d8-a4c1-6077c7b204d9 with identifier: SA21%20KZD
2026-03-28 14:07:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 84dd8e9d-4791-54d8-a4c1-6077c7b204d9 with scrape type 2
2026-03-28 14:07:17 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 84dd8e9d-4791-54d8-a4c1-6077c7b204d9 with scrape type 2
2026-03-28 14:07:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 84dd8e9d-4791-54d8-a4c1-6077c7b204d9, identifier: SA21%20KZD
2026-03-28 14:07:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KEZ9481/698941415/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/KEZ9481/42810228?sv=2020-08-04&st=2026-03-28T14%3A06%3A56Z&se=2026-03-28T14%3A31%3A56Z&sr=b&sp=r&sig=DDPGn%2BcxbHbdqwyGWf309ifFTIM3Acs6kuQRt8vCf2E%3D)
2026-03-28 14:07:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 84dd8e9d-4791-54d8-a4c1-6077c7b204d9 with identifier: SA21%20KZD
2026-03-28 14:07:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-28 14:07:17 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=bronze HTTP/1.1" 200 None
2026-03-28 14:07:17 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-28 14:07:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-28 14:07:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 84dd8e9d-4791-54d8-a4c1-6077c7b204d9 with identifier: SA21%20KZD
2026-03-28 14:07:17 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 84dd8e9d-4791-54d8-a4c1-6077c7b204d9 with identifier: SA21%20KZD to the API
2026-03-28 14:07:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:07:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:07:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=15&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 173,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=SA21%20KZD-GB',
'category': 'Car',
'color': 'bronze',
'currency': 'GBP',
'doors_number': 5,
'engine': '2.0L',
'expiration_date': '2026-03-31T07:00:00Z',
'fuel_type': 'Diesel',
'id': '84dd8e9d-4791-54d8-a4c1-6077c7b204d9',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'SA21 KZD',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=SA21%20KZD&vehicleType=*',
'listing': 'auction',
'location': 'Manchester',
'make': 'LAND ROVER',
'model': 'R/R VELAR',
'odometer': 50970,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-01-01',
'seller_name': None,
'title': 'LAND ROVER R/R VELAR 2.0 D200 EDITION StationWagon',
'transmission': 'automatic',
'trim': 'D200 EDITION',
'vin': 'SALYA2ANXMA307772',
'year': 2021}
2026-03-28 14:07:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SA21%2520KZD%27 HTTP/1.1" 200 None
2026-03-28 14:07:17 [bca.uk] INFO: Saving data for SA21%20KZD: {'auction_closing_time': 1774940400.0, 'created_time': 1774016077.319235, 'last_price_update_time': 1774706837.812638}
2026-03-28 14:07:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='SA21%2520KZD') HTTP/1.1" 204 0
2026-03-28 14:07:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KEZ9481/698941379/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/KEZ9481/42810228?sv=2020-08-04&st=2026-03-28T14%3A06%3A56Z&se=2026-03-28T14%3A31%3A56Z&sr=b&sp=r&sig=DDPGn%2BcxbHbdqwyGWf309ifFTIM3Acs6kuQRt8vCf2E%3D)
2026-03-28 14:07:17 [bca.uk] INFO: Found listing with ID: SD71%20YFN
2026-03-28 14:07:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SD71%2520YFN%27 HTTP/1.1" 200 None
2026-03-28 14:07:17 [bca.uk] INFO: Scrape type for SD71%20YFN: 0
2026-03-28 14:07:17 [bca.uk] INFO: Found listing with ID: SN22%20BGA
2026-03-28 14:07:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SN22%2520BGA%27 HTTP/1.1" 200 None
2026-03-28 14:07:17 [bca.uk] INFO: Scrape type for SN22%20BGA: 2
2026-03-28 14:07:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a0a60866-3687-55a3-ae9f-0c47d8a4cd8a with identifier: SN22%20BGA
2026-03-28 14:07:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a0a60866-3687-55a3-ae9f-0c47d8a4cd8a with scrape type 2
2026-03-28 14:07:17 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a0a60866-3687-55a3-ae9f-0c47d8a4cd8a with scrape type 2
2026-03-28 14:07:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: a0a60866-3687-55a3-ae9f-0c47d8a4cd8a, identifier: SN22%20BGA
2026-03-28 14:07:17 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:07:17 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:07:17 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:07:17 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:07:17 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:07:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:07:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c139110>
2026-03-28 14:07:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:07:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:07:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:07:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e39beb78-d51f-5fbe-a58d-f26050dd24f6/e39beb78-d51f-5fbe-a58d-f26050dd24f6_image_6.jpg HTTP/1.1" 201 0
2026-03-28 14:07:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FYD21LKP%252F698439650%252F600') HTTP/1.1" 204 0
2026-03-28 14:07:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YD21LKP/698439650/600 saved to cache
2026-03-28 14:07:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item e39beb78-d51f-5fbe-a58d-f26050dd24f6
2026-03-28 14:07:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:07:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2de13250>
2026-03-28 14:07:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:07:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:07:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:07:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_95add145-cfdb-56fb-a27d-d877a0432bd6/95add145-cfdb-56fb-a27d-d877a0432bd6_image_5.jpg HTTP/1.1" 201 0
2026-03-28 14:07:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FSH22GFY%252F698915627%252F600') HTTP/1.1" 204 0
2026-03-28 14:07:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SH22GFY/698915627/600 saved to cache
2026-03-28 14:07:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 95add145-cfdb-56fb-a27d-d877a0432bd6
2026-03-28 14:07:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KEZ9481/698941361/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/KEZ9481/42810228?sv=2020-08-04&st=2026-03-28T14%3A06%3A56Z&se=2026-03-28T14%3A31%3A56Z&sr=b&sp=r&sig=DDPGn%2BcxbHbdqwyGWf309ifFTIM3Acs6kuQRt8vCf2E%3D)
2026-03-28 14:07:18 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YD21LKP/698439624/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=YD21LKP-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-28 14:07:18 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SH22GFY/698915526/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=SH22GFY-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-28 14:07:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SH22GFY/698915586/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/SH22GFY/42809522?sv=2020-08-04&st=2026-03-28T14%3A06%3A58Z&se=2026-03-28T14%3A31%3A58Z&sr=b&sp=r&sig=LF9M3JDhfhAd7nxLqVMWN2qOdCGHrBuIZdqAc9eQvMA%3D)
2026-03-28 14:07:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/T400WRS/698069970/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/T400WRS/42810019?sv=2020-08-04&st=2026-03-28T14%3A06%3A56Z&se=2026-03-28T14%3A31%3A56Z&sr=b&sp=r&sig=kIZj2tqr%2BfocLXmzFxOg%2F2cX7%2FfCCdSGle1KfN6FfvQ%3D)
2026-03-28 14:07:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: a0a60866-3687-55a3-ae9f-0c47d8a4cd8a with identifier: SN22%20BGA
2026-03-28 14:07:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: a0a60866-3687-55a3-ae9f-0c47d8a4cd8a with identifier: SN22%20BGA
2026-03-28 14:07:18 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: a0a60866-3687-55a3-ae9f-0c47d8a4cd8a with identifier: SN22%20BGA to the API
2026-03-28 14:07:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:07:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:07:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=15&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 37,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=SN22%20BGA-GB',
'category': 'Car',
'color': 'black',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.5L',
'expiration_date': '2026-03-31T07:00:00Z',
'fuel_type': 'Petrol/Electric',
'id': 'a0a60866-3687-55a3-ae9f-0c47d8a4cd8a',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': False,
'license_plate': 'SN22 BGA',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=SN22%20BGA&vehicleType=*',
'listing': 'auction',
'location': 'Livingston',
'make': 'LAND ROVER',
'model': 'DISCOVERY SPORT',
'odometer': 33543,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-01-01',
'seller_name': None,
'title': 'LAND ROVER DISCOVERY SPORT 1.5 P300E R-DYNAMIC SE (5ST) '
'StationWagon',
'transmission': 'automatic',
'trim': 'P300E R-DYNAMIC SE (5ST)',
'vin': 'SALCA2AT3PH919011',
'year': 2022}
2026-03-28 14:07:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SN22%2520BGA%27 HTTP/1.1" 200 None
2026-03-28 14:07:18 [bca.uk] INFO: Saving data for SN22%20BGA: {'auction_closing_time': 1774940400.0, 'created_time': 1773930104.644568, 'last_price_update_time': 1774706838.381643}
2026-03-28 14:07:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='SN22%2520BGA') HTTP/1.1" 204 0
2026-03-28 14:07:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/T400WRS/698069973/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/T400WRS/42810019?sv=2020-08-04&st=2026-03-28T14%3A06%3A56Z&se=2026-03-28T14%3A31%3A56Z&sr=b&sp=r&sig=kIZj2tqr%2BfocLXmzFxOg%2F2cX7%2FfCCdSGle1KfN6FfvQ%3D)
2026-03-28 14:07:18 [bca.uk] INFO: Found listing with ID: SR23%20NZS
2026-03-28 14:07:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SR23%2520NZS%27 HTTP/1.1" 200 None
2026-03-28 14:07:18 [bca.uk] INFO: Scrape type for SR23%20NZS: 0
2026-03-28 14:07:18 [bca.uk] INFO: Found listing with ID: ST09%20ARY
2026-03-28 14:07:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27ST09%2520ARY%27 HTTP/1.1" 200 None
2026-03-28 14:07:18 [bca.uk] INFO: Scrape type for ST09%20ARY: 2
2026-03-28 14:07:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 235f406b-50f8-5b92-9a9b-c7f78ca9e59f with identifier: ST09%20ARY
2026-03-28 14:07:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 235f406b-50f8-5b92-9a9b-c7f78ca9e59f with scrape type 2
2026-03-28 14:07:18 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 235f406b-50f8-5b92-9a9b-c7f78ca9e59f with scrape type 2
2026-03-28 14:07:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 235f406b-50f8-5b92-9a9b-c7f78ca9e59f, identifier: ST09%20ARY
2026-03-28 14:07:18 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:07:18 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:07:18 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:07:18 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:07:18 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:07:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:07:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a1fd3bd90>
2026-03-28 14:07:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:07:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:07:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:07:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f055b506-0022-5f0e-a7cd-13f0911779b4/f055b506-0022-5f0e-a7cd-13f0911779b4_image_6.jpg HTTP/1.1" 201 0
2026-03-28 14:07:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FKEZ9481%252F698941415%252F600') HTTP/1.1" 204 0
2026-03-28 14:07:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KEZ9481/698941415/600 saved to cache
2026-03-28 14:07:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item f055b506-0022-5f0e-a7cd-13f0911779b4
2026-03-28 14:07:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KEZ9481/698941324/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/KEZ9481/42810228?sv=2020-08-04&st=2026-03-28T14%3A06%3A56Z&se=2026-03-28T14%3A31%3A56Z&sr=b&sp=r&sig=DDPGn%2BcxbHbdqwyGWf309ifFTIM3Acs6kuQRt8vCf2E%3D)
2026-03-28 14:07:18 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KEZ9481/698941309/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698941309>
2026-03-28 14:07:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 235f406b-50f8-5b92-9a9b-c7f78ca9e59f with identifier: ST09%20ARY
2026-03-28 14:07:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 235f406b-50f8-5b92-9a9b-c7f78ca9e59f with identifier: ST09%20ARY
2026-03-28 14:07:18 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 235f406b-50f8-5b92-9a9b-c7f78ca9e59f with identifier: ST09%20ARY to the API
2026-03-28 14:07:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:07:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:07:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=15&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 18,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=ST09%20ARY-GB',
'category': 'Car',
'color': 'silver',
'currency': 'GBP',
'doors_number': 5,
'engine': '3.0L',
'expiration_date': '2026-03-31T07:00:00Z',
'fuel_type': 'Petrol/Electric',
'id': '235f406b-50f8-5b92-9a9b-c7f78ca9e59f',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': False,
'license_plate': 'ST09 ARY',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=ST09%20ARY&vehicleType=*',
'listing': 'auction',
'location': 'Crawley',
'make': 'LAND ROVER',
'model': 'RANGE ROVER',
'odometer': 14234,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2024-01-01',
'seller_name': None,
'title': 'LAND ROVER RANGE ROVER 3.0 P460E AUTOBIOGRAPHY StationWagon',
'transmission': 'automatic',
'trim': 'P460E AUTOBIOGRAPHY',
'vin': 'SALKA9A47RA243753',
'year': 2024}
2026-03-28 14:07:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27ST09%2520ARY%27 HTTP/1.1" 200 None
2026-03-28 14:07:18 [bca.uk] INFO: Saving data for ST09%20ARY: {'auction_closing_time': 1774940400.0, 'created_time': 1773933687.77835, 'last_price_update_time': 1774706838.898517}
2026-03-28 14:07:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='ST09%2520ARY') HTTP/1.1" 204 0
2026-03-28 14:07:18 [bca.uk] INFO: Found listing with ID: ST18%20RTO
2026-03-28 14:07:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27ST18%2520RTO%27 HTTP/1.1" 200 None
2026-03-28 14:07:18 [bca.uk] INFO: Scrape type for ST18%20RTO: 0
2026-03-28 14:07:18 [bca.uk] INFO: Found listing with ID: SV21%20ZNZ
2026-03-28 14:07:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SV21%2520ZNZ%27 HTTP/1.1" 200 None
2026-03-28 14:07:18 [bca.uk] INFO: Scrape type for SV21%20ZNZ: 0
2026-03-28 14:07:18 [bca.uk] INFO: Found listing with ID: SX22%20GDU
2026-03-28 14:07:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SX22%2520GDU%27 HTTP/1.1" 200 None
2026-03-28 14:07:18 [bca.uk] INFO: Scrape type for SX22%20GDU: 0
2026-03-28 14:07:18 [bca.uk] INFO: Found listing with ID: VX72%20WWK
2026-03-28 14:07:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27VX72%2520WWK%27 HTTP/1.1" 200 None
2026-03-28 14:07:18 [bca.uk] INFO: Scrape type for VX72%20WWK: 0
2026-03-28 14:07:18 [bca.uk] INFO: Found listing with ID: WK70%20HVS
2026-03-28 14:07:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WK70%2520HVS%27 HTTP/1.1" 200 None
2026-03-28 14:07:18 [bca.uk] INFO: Scrape type for WK70%20HVS: 0
2026-03-28 14:07:18 [bca.uk] INFO: Found listing with ID: WU21%20EHW
2026-03-28 14:07:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WU21%2520EHW%27 HTTP/1.1" 200 None
2026-03-28 14:07:19 [bca.uk] INFO: Scrape type for WU21%20EHW: 0
2026-03-28 14:07:19 [bca.uk] INFO: Found listing with ID: WU68%20BGK
2026-03-28 14:07:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WU68%2520BGK%27 HTTP/1.1" 200 None
2026-03-28 14:07:19 [bca.uk] INFO: Scrape type for WU68%20BGK: 0
2026-03-28 14:07:19 [bca.uk] INFO: Found listing with ID: WX22%20ZVD
2026-03-28 14:07:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WX22%2520ZVD%27 HTTP/1.1" 200 None
2026-03-28 14:07:19 [bca.uk] INFO: Scrape type for WX22%20ZVD: 0
2026-03-28 14:07:19 [bca.uk] INFO: Found listing with ID: WX73%20YZA
2026-03-28 14:07:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WX73%2520YZA%27 HTTP/1.1" 200 None
2026-03-28 14:07:19 [bca.uk] INFO: Scrape type for WX73%20YZA: 0
2026-03-28 14:07:19 [bca.uk] INFO: Found listing with ID: YK21%20VRC
2026-03-28 14:07:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YK21%2520VRC%27 HTTP/1.1" 200 None
2026-03-28 14:07:19 [bca.uk] INFO: Scrape type for YK21%20VRC: 0
2026-03-28 14:07:19 [bca.uk] INFO: Found listing with ID: YL70%20NVC
2026-03-28 14:07:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YL70%2520NVC%27 HTTP/1.1" 200 None
2026-03-28 14:07:19 [bca.uk] INFO: Scrape type for YL70%20NVC: 0
2026-03-28 14:07:19 [bca.uk] INFO: Found listing with ID: YN22%20WKM
2026-03-28 14:07:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YN22%2520WKM%27 HTTP/1.1" 200 None
2026-03-28 14:07:19 [bca.uk] INFO: Scrape type for YN22%20WKM: 0
2026-03-28 14:07:19 [bca.uk] INFO: Found listing with ID: YN23%20WUP
2026-03-28 14:07:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YN23%2520WUP%27 HTTP/1.1" 200 None
2026-03-28 14:07:19 [bca.uk] INFO: Scrape type for YN23%20WUP: 0
2026-03-28 14:07:19 [bca.uk] INFO: Found listing with ID: YR22%20XOF
2026-03-28 14:07:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YR22%2520XOF%27 HTTP/1.1" 200 None
2026-03-28 14:07:19 [bca.uk] INFO: Scrape type for YR22%20XOF: 0
2026-03-28 14:07:19 [bca.uk] INFO: Found listing with ID: YR69%20ZVN
2026-03-28 14:07:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YR69%2520ZVN%27 HTTP/1.1" 200 None
2026-03-28 14:07:19 [bca.uk] INFO: Scrape type for YR69%20ZVN: 0
2026-03-28 14:07:19 [bca.uk] INFO: Found listing with ID: AV18%20LLP
2026-03-28 14:07:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27AV18%2520LLP%27 HTTP/1.1" 200 None
2026-03-28 14:07:19 [bca.uk] INFO: Scrape type for AV18%20LLP: 2
2026-03-28 14:07:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2800707b-3de7-51f6-8f13-9bc62dfed068 with identifier: AV18%20LLP
2026-03-28 14:07:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2800707b-3de7-51f6-8f13-9bc62dfed068 with scrape type 2
2026-03-28 14:07:19 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2800707b-3de7-51f6-8f13-9bc62dfed068 with scrape type 2
2026-03-28 14:07:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 2800707b-3de7-51f6-8f13-9bc62dfed068, identifier: AV18%20LLP
2026-03-28 14:07:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SH22GFY/698915564/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/SH22GFY/42809522?sv=2020-08-04&st=2026-03-28T14%3A06%3A58Z&se=2026-03-28T14%3A31%3A58Z&sr=b&sp=r&sig=LF9M3JDhfhAd7nxLqVMWN2qOdCGHrBuIZdqAc9eQvMA%3D)
2026-03-28 14:07:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/T400WRS/698069954/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/T400WRS/42810019?sv=2020-08-04&st=2026-03-28T14%3A06%3A56Z&se=2026-03-28T14%3A31%3A56Z&sr=b&sp=r&sig=kIZj2tqr%2BfocLXmzFxOg%2F2cX7%2FfCCdSGle1KfN6FfvQ%3D)
2026-03-28 14:07:19 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/T400WRS/698069950/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698069950>
2026-03-28 14:07:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YD21LKP/698439628/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YD21LKP/42810029?sv=2020-08-04&st=2026-03-28T14%3A07%3A00Z&se=2026-03-28T14%3A32%3A00Z&sr=b&sp=r&sig=EiPkPHEa%2F3uktliD9Vj4mtSFOMGvF7A9AlPUHHkf2%2B4%3D)
2026-03-28 14:07:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/T400WRS/698069961/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/T400WRS/42810019?sv=2020-08-04&st=2026-03-28T14%3A06%3A56Z&se=2026-03-28T14%3A31%3A56Z&sr=b&sp=r&sig=kIZj2tqr%2BfocLXmzFxOg%2F2cX7%2FfCCdSGle1KfN6FfvQ%3D)
2026-03-28 14:07:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SH22GFY/698915544/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/SH22GFY/42809522?sv=2020-08-04&st=2026-03-28T14%3A06%3A58Z&se=2026-03-28T14%3A31%3A58Z&sr=b&sp=r&sig=LF9M3JDhfhAd7nxLqVMWN2qOdCGHrBuIZdqAc9eQvMA%3D)
2026-03-28 14:07:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 2800707b-3de7-51f6-8f13-9bc62dfed068 with identifier: AV18%20LLP
2026-03-28 14:07:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 2800707b-3de7-51f6-8f13-9bc62dfed068 with identifier: AV18%20LLP
2026-03-28 14:07:19 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 2800707b-3de7-51f6-8f13-9bc62dfed068 with identifier: AV18%20LLP to the API
2026-03-28 14:07:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:07:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:07:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=15&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 125,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=AV18%20LLP-GB',
'category': 'Car',
'color': 'black',
'currency': 'GBP',
'doors_number': 5,
'engine': '2.0L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Diesel',
'id': '2800707b-3de7-51f6-8f13-9bc62dfed068',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'AV18 LLP',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=AV18%20LLP&vehicleType=*',
'listing': 'auction',
'location': 'Livingston',
'make': 'LAND ROVER',
'model': 'R/R EVOQUE',
'odometer': 60012,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-01-01',
'seller_name': None,
'title': 'LAND ROVER R/R EVOQUE 2.0 TD4 180 4WD HSE DYNAMIC Hatchback',
'transmission': 'manual',
'trim': 'TD4 180 4WD HSE DYNAMIC',
'vin': 'SALVA2CN3JH297251',
'year': 2018}
2026-03-28 14:07:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27AV18%2520LLP%27 HTTP/1.1" 200 None
2026-03-28 14:07:19 [bca.uk] INFO: Saving data for AV18%20LLP: {'auction_closing_time': 1774864800.0, 'created_time': 1774523829.589877, 'last_price_update_time': 1774706839.66178}
2026-03-28 14:07:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='AV18%2520LLP') HTTP/1.1" 204 0
2026-03-28 14:07:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:07:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2d6ef090>
2026-03-28 14:07:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:07:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:07:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:07:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f055b506-0022-5f0e-a7cd-13f0911779b4/f055b506-0022-5f0e-a7cd-13f0911779b4_image_5.jpg HTTP/1.1" 201 0
2026-03-28 14:07:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FKEZ9481%252F698941379%252F600') HTTP/1.1" 204 0
2026-03-28 14:07:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KEZ9481/698941379/600 saved to cache
2026-03-28 14:07:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item f055b506-0022-5f0e-a7cd-13f0911779b4
2026-03-28 14:07:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:07:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a3011b9d0>
2026-03-28 14:07:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:07:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:07:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:07:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f055b506-0022-5f0e-a7cd-13f0911779b4/f055b506-0022-5f0e-a7cd-13f0911779b4_image_4.jpg HTTP/1.1" 201 0
2026-03-28 14:07:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FKEZ9481%252F698941361%252F600') HTTP/1.1" 204 0
2026-03-28 14:07:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KEZ9481/698941361/600 saved to cache
2026-03-28 14:07:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item f055b506-0022-5f0e-a7cd-13f0911779b4
2026-03-28 14:07:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:07:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2dda9210>
2026-03-28 14:07:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:07:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:07:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:07:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_95add145-cfdb-56fb-a27d-d877a0432bd6/95add145-cfdb-56fb-a27d-d877a0432bd6_image_3.jpg HTTP/1.1" 201 0
2026-03-28 14:07:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FSH22GFY%252F698915586%252F600') HTTP/1.1" 204 0
2026-03-28 14:07:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SH22GFY/698915586/600 saved to cache
2026-03-28 14:07:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 95add145-cfdb-56fb-a27d-d877a0432bd6
2026-03-28 14:07:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:07:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c742990>
2026-03-28 14:07:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:07:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:07:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:07:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a2c13cca-acdb-56e9-80bf-41e2acf4aed1/a2c13cca-acdb-56e9-80bf-41e2acf4aed1_image_5.jpg HTTP/1.1" 201 0
2026-03-28 14:07:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FT400WRS%252F698069970%252F600') HTTP/1.1" 204 0
2026-03-28 14:07:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/T400WRS/698069970/600 saved to cache
2026-03-28 14:07:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item a2c13cca-acdb-56e9-80bf-41e2acf4aed1
2026-03-28 14:07:20 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:07:20 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:07:20 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:07:20 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:07:20 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:07:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:07:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2d838bd0>
2026-03-28 14:07:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:07:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:07:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:07:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a2c13cca-acdb-56e9-80bf-41e2acf4aed1/a2c13cca-acdb-56e9-80bf-41e2acf4aed1_image_6.jpg HTTP/1.1" 201 0
2026-03-28 14:07:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FT400WRS%252F698069973%252F600') HTTP/1.1" 204 0
2026-03-28 14:07:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/T400WRS/698069973/600 saved to cache
2026-03-28 14:07:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item a2c13cca-acdb-56e9-80bf-41e2acf4aed1
2026-03-28 14:07:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SH22GFY/698915526/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/SH22GFY/42809522?sv=2020-08-04&st=2026-03-28T14%3A06%3A58Z&se=2026-03-28T14%3A31%3A58Z&sr=b&sp=r&sig=LF9M3JDhfhAd7nxLqVMWN2qOdCGHrBuIZdqAc9eQvMA%3D)
2026-03-28 14:07:20 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BP67XDB/698933958/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=BP67XDB-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-28 14:07:20 [bca.uk] INFO: Found listing with ID: RO21%20VFW
2026-03-28 14:07:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27RO21%2520VFW%27 HTTP/1.1" 200 None
2026-03-28 14:07:20 [bca.uk] INFO: Scrape type for RO21%20VFW: 2
2026-03-28 14:07:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a07de800-f0b0-5646-aa6d-6ce891d19b3c with identifier: RO21%20VFW
2026-03-28 14:07:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a07de800-f0b0-5646-aa6d-6ce891d19b3c with scrape type 2
2026-03-28 14:07:20 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a07de800-f0b0-5646-aa6d-6ce891d19b3c with scrape type 2
2026-03-28 14:07:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: a07de800-f0b0-5646-aa6d-6ce891d19b3c, identifier: RO21%20VFW
2026-03-28 14:07:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: a07de800-f0b0-5646-aa6d-6ce891d19b3c with identifier: RO21%20VFW
2026-03-28 14:07:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: a07de800-f0b0-5646-aa6d-6ce891d19b3c with identifier: RO21%20VFW
2026-03-28 14:07:20 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: a07de800-f0b0-5646-aa6d-6ce891d19b3c with identifier: RO21%20VFW to the API
2026-03-28 14:07:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:07:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:07:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=15&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 123,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=RO21%20VFW-GB',
'category': 'Car',
'color': 'grey',
'currency': 'GBP',
'doors_number': 5,
'engine': '2.0L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Diesel',
'id': 'a07de800-f0b0-5646-aa6d-6ce891d19b3c',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'RO21 VFW',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=RO21%20VFW&vehicleType=*',
'listing': 'auction',
'location': 'Livingston',
'make': 'VOLKSWAGEN',
'model': 'GOLF',
'odometer': 59848,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-01-01',
'seller_name': None,
'title': 'VOLKSWAGEN GOLF 2.0 TDI EVO 150 STYLE DSG Hatchback',
'transmission': 'automatic',
'trim': 'TDI EVO 150 STYLE DSG',
'vin': 'WVWZZZCDZMW104563',
'year': 2021}
2026-03-28 14:07:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27RO21%2520VFW%27 HTTP/1.1" 200 None
2026-03-28 14:07:20 [bca.uk] INFO: Saving data for RO21%20VFW: {'auction_closing_time': 1774864800.0, 'created_time': 1773907641.199641, 'last_price_update_time': 1774706840.562107}
2026-03-28 14:07:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='RO21%2520VFW') HTTP/1.1" 204 0
2026-03-28 14:07:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:07:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2dd81f50>
2026-03-28 14:07:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:07:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:07:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:07:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f055b506-0022-5f0e-a7cd-13f0911779b4/f055b506-0022-5f0e-a7cd-13f0911779b4_image_2.jpg HTTP/1.1" 201 0
2026-03-28 14:07:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FKEZ9481%252F698941324%252F600') HTTP/1.1" 204 0
2026-03-28 14:07:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KEZ9481/698941324/600 saved to cache
2026-03-28 14:07:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item f055b506-0022-5f0e-a7cd-13f0911779b4
2026-03-28 14:07:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KEZ9481/698941309/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/KEZ9481/42810228?sv=2020-08-04&st=2026-03-28T14%3A06%3A56Z&se=2026-03-28T14%3A31%3A56Z&sr=b&sp=r&sig=DDPGn%2BcxbHbdqwyGWf309ifFTIM3Acs6kuQRt8vCf2E%3D)
2026-03-28 14:07:20 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BV61MVO/698928622/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698928622>
2026-03-28 14:07:20 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WU19VDC/698045632/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698045632>
2026-03-28 14:07:20 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NL64KGO/698157165/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698157165>
2026-03-28 14:07:20 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KV16LDZ/698296906/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698296906>
2026-03-28 14:07:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YD21LKP/698439624/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YD21LKP/42810029?sv=2020-08-04&st=2026-03-28T14%3A07%3A00Z&se=2026-03-28T14%3A32%3A00Z&sr=b&sp=r&sig=EiPkPHEa%2F3uktliD9Vj4mtSFOMGvF7A9AlPUHHkf2%2B4%3D)
2026-03-28 14:07:20 [bca.uk] INFO: Found listing with ID: SW69%20SCX
2026-03-28 14:07:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SW69%2520SCX%27 HTTP/1.1" 200 None
2026-03-28 14:07:20 [bca.uk] INFO: Scrape type for SW69%20SCX: 0
2026-03-28 14:07:20 [bca.uk] INFO: Found listing with ID: CP17%20DYG
2026-03-28 14:07:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27CP17%2520DYG%27 HTTP/1.1" 200 None
2026-03-28 14:07:20 [bca.uk] INFO: Scrape type for CP17%20DYG: 0
2026-03-28 14:07:20 [bca.uk] INFO: Found listing with ID: EJ17%20HGU
2026-03-28 14:07:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27EJ17%2520HGU%27 HTTP/1.1" 200 None
2026-03-28 14:07:20 [bca.uk] INFO: Scrape type for EJ17%20HGU: 0
2026-03-28 14:07:20 [bca.uk] INFO: Found listing with ID: MT17%20UTS
2026-03-28 14:07:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MT17%2520UTS%27 HTTP/1.1" 200 None
2026-03-28 14:07:20 [bca.uk] INFO: Scrape type for MT17%20UTS: 2
2026-03-28 14:07:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1886f4b7-f60e-5cad-b1be-7d97d95944a9 with identifier: MT17%20UTS
2026-03-28 14:07:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1886f4b7-f60e-5cad-b1be-7d97d95944a9 with scrape type 2
2026-03-28 14:07:20 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1886f4b7-f60e-5cad-b1be-7d97d95944a9 with scrape type 2
2026-03-28 14:07:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 1886f4b7-f60e-5cad-b1be-7d97d95944a9, identifier: MT17%20UTS
2026-03-28 14:07:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 1886f4b7-f60e-5cad-b1be-7d97d95944a9 with identifier: MT17%20UTS
2026-03-28 14:07:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 1886f4b7-f60e-5cad-b1be-7d97d95944a9 with identifier: MT17%20UTS
2026-03-28 14:07:20 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 1886f4b7-f60e-5cad-b1be-7d97d95944a9 with identifier: MT17%20UTS to the API
2026-03-28 14:07:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:07:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:07:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=15&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 200,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=MT17%20UTS-GB',
'category': 'LightCommercialVehicle',
'color': 'white',
'currency': 'GBP',
'doors_number': 2,
'engine': '2.0L',
'expiration_date': '2026-03-31T07:00:00Z',
'fuel_type': 'Diesel',
'id': '1886f4b7-f60e-5cad-b1be-7d97d95944a9',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'MT17 UTS',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=MT17%20UTS&vehicleType=*',
'listing': 'auction',
'location': 'Wolverhampton',
'make': 'FORD',
'model': 'TRANSIT 350 RWD',
'odometer': 152195,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-01-01',
'seller_name': None,
'title': 'FORD TRANSIT 350 RWD 2.0 TDCI 130 LWB RecoveryUnit',
'transmission': 'manual',
'trim': 'TDCI 130 LWB',
'vin': 'WF0DXXTTGDGT04231',
'year': 2017}
2026-03-28 14:07:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MT17%2520UTS%27 HTTP/1.1" 200 None
2026-03-28 14:07:21 [bca.uk] INFO: Saving data for MT17%20UTS: {'auction_closing_time': 1774940400.0, 'created_time': 1773839864.510306, 'last_price_update_time': 1774706841.243973}
2026-03-28 14:07:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='MT17%2520UTS') HTTP/1.1" 204 0
2026-03-28 14:07:21 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/X11BBM/697604011/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=697604011>
2026-03-28 14:07:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/T400WRS/698069950/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/T400WRS/42810019?sv=2020-08-04&st=2026-03-28T14%3A06%3A56Z&se=2026-03-28T14%3A31%3A56Z&sr=b&sp=r&sig=kIZj2tqr%2BfocLXmzFxOg%2F2cX7%2FfCCdSGle1KfN6FfvQ%3D)
2026-03-28 14:07:21 [bca.uk] INFO: Found listing with ID: CX65%20XUD
2026-03-28 14:07:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27CX65%2520XUD%27 HTTP/1.1" 200 None
2026-03-28 14:07:21 [bca.uk] INFO: Scrape type for CX65%20XUD: 0
2026-03-28 14:07:21 [bca.uk] INFO: Found listing with ID: LN68%20FBD
2026-03-28 14:07:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LN68%2520FBD%27 HTTP/1.1" 200 None
2026-03-28 14:07:21 [bca.uk] INFO: Scrape type for LN68%20FBD: 0
2026-03-28 14:07:21 [bca.uk] INFO: Found listing with ID: FV21%20VKU
2026-03-28 14:07:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FV21%2520VKU%27 HTTP/1.1" 200 None
2026-03-28 14:07:21 [bca.uk] INFO: Scrape type for FV21%20VKU: 0
2026-03-28 14:07:21 [bca.uk] INFO: Found listing with ID: MF22%20KJU
2026-03-28 14:07:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MF22%2520KJU%27 HTTP/1.1" 200 None
2026-03-28 14:07:21 [bca.uk] INFO: Scrape type for MF22%20KJU: 0
2026-03-28 14:07:21 [bca.uk] INFO: Found listing with ID: RJ18%20ZHN
2026-03-28 14:07:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27RJ18%2520ZHN%27 HTTP/1.1" 200 None
2026-03-28 14:07:21 [bca.uk] INFO: Scrape type for RJ18%20ZHN: 0
2026-03-28 14:07:21 [bca.uk] INFO: Found listing with ID: BT66%20ZFD
2026-03-28 14:07:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BT66%2520ZFD%27 HTTP/1.1" 200 None
2026-03-28 14:07:21 [bca.uk] INFO: Scrape type for BT66%20ZFD: 0
2026-03-28 14:07:21 [bca.uk] INFO: Found listing with ID: BX20%20FKV
2026-03-28 14:07:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BX20%2520FKV%27 HTTP/1.1" 200 None
2026-03-28 14:07:21 [bca.uk] INFO: Scrape type for BX20%20FKV: 0
2026-03-28 14:07:21 [bca.uk] INFO: Found listing with ID: MT14%20TZF
2026-03-28 14:07:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MT14%2520TZF%27 HTTP/1.1" 200 None
2026-03-28 14:07:21 [bca.uk] INFO: Scrape type for MT14%20TZF: 0
2026-03-28 14:07:21 [bca.uk] INFO: Found listing with ID: SM70%20ZWE
2026-03-28 14:07:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SM70%2520ZWE%27 HTTP/1.1" 200 None
2026-03-28 14:07:21 [bca.uk] INFO: Scrape type for SM70%20ZWE: 0
2026-03-28 14:07:21 [bca.uk] INFO: Found listing with ID: DX68%20VZO
2026-03-28 14:07:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DX68%2520VZO%27 HTTP/1.1" 200 None
2026-03-28 14:07:21 [bca.uk] INFO: Scrape type for DX68%20VZO: 0
2026-03-28 14:07:21 [bca.uk] INFO: Found listing with ID: FE20%20HHJ
2026-03-28 14:07:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FE20%2520HHJ%27 HTTP/1.1" 200 None
2026-03-28 14:07:21 [bca.uk] INFO: Scrape type for FE20%20HHJ: 0
2026-03-28 14:07:21 [bca.uk] INFO: Found listing with ID: MM18%20HRK
2026-03-28 14:07:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MM18%2520HRK%27 HTTP/1.1" 200 None
2026-03-28 14:07:21 [bca.uk] INFO: Scrape type for MM18%20HRK: 2
2026-03-28 14:07:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f8b5e642-6e29-5d87-8919-af61f445b00b with identifier: MM18%20HRK
2026-03-28 14:07:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f8b5e642-6e29-5d87-8919-af61f445b00b with scrape type 2
2026-03-28 14:07:21 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f8b5e642-6e29-5d87-8919-af61f445b00b with scrape type 2
2026-03-28 14:07:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: f8b5e642-6e29-5d87-8919-af61f445b00b, identifier: MM18%20HRK
2026-03-28 14:07:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.bca.co.uk/api/search?q=&pageSize=100&page=16&sort=MostRecentlyAdded> (referer: https://www.bca.co.uk/search) ['zyte-api']
2026-03-28 14:07:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:07:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2d910110>
2026-03-28 14:07:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:07:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:07:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:07:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_95add145-cfdb-56fb-a27d-d877a0432bd6/95add145-cfdb-56fb-a27d-d877a0432bd6_image_2.jpg HTTP/1.1" 201 0
2026-03-28 14:07:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FSH22GFY%252F698915564%252F600') HTTP/1.1" 204 0
2026-03-28 14:07:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SH22GFY/698915564/600 saved to cache
2026-03-28 14:07:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 95add145-cfdb-56fb-a27d-d877a0432bd6
2026-03-28 14:07:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:07:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2da1e950>
2026-03-28 14:07:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:07:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:07:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:07:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a2c13cca-acdb-56e9-80bf-41e2acf4aed1/a2c13cca-acdb-56e9-80bf-41e2acf4aed1_image_2.jpg HTTP/1.1" 201 0
2026-03-28 14:07:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FT400WRS%252F698069954%252F600') HTTP/1.1" 204 0
2026-03-28 14:07:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/T400WRS/698069954/600 saved to cache
2026-03-28 14:07:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item a2c13cca-acdb-56e9-80bf-41e2acf4aed1
2026-03-28 14:07:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:07:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2d890210>
2026-03-28 14:07:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:07:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:07:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:07:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e39beb78-d51f-5fbe-a58d-f26050dd24f6/e39beb78-d51f-5fbe-a58d-f26050dd24f6_image_1.jpg HTTP/1.1" 201 0
2026-03-28 14:07:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FYD21LKP%252F698439628%252F600') HTTP/1.1" 204 0
2026-03-28 14:07:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YD21LKP/698439628/600 saved to cache
2026-03-28 14:07:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item e39beb78-d51f-5fbe-a58d-f26050dd24f6
2026-03-28 14:07:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:07:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c971d90>
2026-03-28 14:07:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:07:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:07:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:07:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a2c13cca-acdb-56e9-80bf-41e2acf4aed1/a2c13cca-acdb-56e9-80bf-41e2acf4aed1_image_4.jpg HTTP/1.1" 201 0
2026-03-28 14:07:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FT400WRS%252F698069961%252F600') HTTP/1.1" 204 0
2026-03-28 14:07:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/T400WRS/698069961/600 saved to cache
2026-03-28 14:07:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item a2c13cca-acdb-56e9-80bf-41e2acf4aed1
2026-03-28 14:07:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:07:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c40d310>
2026-03-28 14:07:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:07:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:07:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:07:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_95add145-cfdb-56fb-a27d-d877a0432bd6/95add145-cfdb-56fb-a27d-d877a0432bd6_image_1.jpg HTTP/1.1" 201 0
2026-03-28 14:07:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FSH22GFY%252F698915544%252F600') HTTP/1.1" 204 0
2026-03-28 14:07:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SH22GFY/698915544/600 saved to cache
2026-03-28 14:07:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 95add145-cfdb-56fb-a27d-d877a0432bd6
2026-03-28 14:07:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:07:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2eb1cad0>
2026-03-28 14:07:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:07:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:07:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:07:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_95add145-cfdb-56fb-a27d-d877a0432bd6/95add145-cfdb-56fb-a27d-d877a0432bd6_image_0.jpg HTTP/1.1" 201 0
2026-03-28 14:07:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FSH22GFY%252F698915526%252F600') HTTP/1.1" 204 0
2026-03-28 14:07:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SH22GFY/698915526/600 saved to cache
2026-03-28 14:07:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 95add145-cfdb-56fb-a27d-d877a0432bd6
2026-03-28 14:07:21 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 95add145-cfdb-56fb-a27d-d877a0432bd6, skipping ID generation
2026-03-28 14:07:21 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 95add145-cfdb-56fb-a27d-d877a0432bd6 sending to next pipeline
2026-03-28 14:07:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 95add145-cfdb-56fb-a27d-d877a0432bd6, identifier: SH22%20GFY
2026-03-28 14:07:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BP67XDB/698933958/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/BP67XDB/42810422?sv=2020-08-04&st=2026-03-28T14%3A03%3A52Z&se=2026-03-28T14%3A28%3A52Z&sr=b&sp=r&sig=Logn8Hbry8lNDBo7BHyP%2FFQM2Uo9ZZUQT4uyTv5b%2Bn0%3D)
2026-03-28 14:07:21 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DF12VWL/698228757/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698228757>
2026-03-28 14:07:21 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WV16UWB/698284438/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698284438>
2026-03-28 14:07:21 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LK64NEJ/698947020/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698947020>
2026-03-28 14:07:21 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CK18AEJ/698910336/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698910336>
2026-03-28 14:07:21 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/DE72KZJ/42810405?sv=2020-08-04&st=2026-03-28T14%3A07%3A20Z&se=2026-03-28T14%3A32%3A20Z&sr=b&sp=r&sig=Rm0NJ3AfMMkhExeMwPLPfRbyOp2UoRTQE0wN25vKQGI%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=DE72%20KZJ-GB>
2026-03-28 14:07:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: f8b5e642-6e29-5d87-8919-af61f445b00b with identifier: MM18%20HRK
2026-03-28 14:07:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: f8b5e642-6e29-5d87-8919-af61f445b00b with identifier: MM18%20HRK
2026-03-28 14:07:22 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: f8b5e642-6e29-5d87-8919-af61f445b00b with identifier: MM18%20HRK to the API
2026-03-28 14:07:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:07:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:07:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=15&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 112,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=MM18%20HRK-GB',
'category': 'LightCommercialVehicle',
'color': 'white',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.6L',
'expiration_date': '2026-04-01T07:00:00Z',
'fuel_type': 'Diesel',
'id': 'f8b5e642-6e29-5d87-8919-af61f445b00b',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'MM18 HRK',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=MM18%20HRK&vehicleType=*',
'listing': 'auction',
'location': 'Paddock Wood',
'make': 'CITROEN',
'model': 'BERLINGO L1',
'odometer': 158063,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-01-01',
'seller_name': None,
'title': 'CITROEN BERLINGO L1 1.6 BLUEHDI 100 850KG ENTERPRISE Van',
'transmission': 'manual',
'trim': 'BLUEHDI 100 850KG ENTERPRISE',
'vin': 'VF77DBHY6JJ707741',
'year': 2018}
2026-03-28 14:07:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MM18%2520HRK%27 HTTP/1.1" 200 None
2026-03-28 14:07:22 [bca.uk] INFO: Saving data for MM18%20HRK: {'auction_closing_time': 1775026800.0, 'created_time': 1774523722.081366, 'last_price_update_time': 1774706842.381236}
2026-03-28 14:07:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='MM18%2520HRK') HTTP/1.1" 204 0
2026-03-28 14:07:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 95add145-cfdb-56fb-a27d-d877a0432bd6 with identifier: SH22%20GFY
2026-03-28 14:07:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 95add145-cfdb-56fb-a27d-d877a0432bd6 with identifier: SH22%20GFY
2026-03-28 14:07:22 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 95add145-cfdb-56fb-a27d-d877a0432bd6 with identifier: SH22%20GFY to the API
2026-03-28 14:07:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:07:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:07:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SH22GFY/698915526/600>
{'auction_title': '',
'c_o_2_emission_value': 117,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_95add145-cfdb-56fb-a27d-d877a0432bd6/95add145-cfdb-56fb-a27d-d877a0432bd6_expert_report_file_c87a3a48-4e80-4ca0-a21d-6a214d01ca79.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=SH22%20GFY-GB',
'category': 'Car',
'color': 'black',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.2L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol',
'id': '95add145-cfdb-56fb-a27d-d877a0432bd6',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'SH22 GFY',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=SH22%20GFY&vehicleType=*',
'listing': 'auction',
'location': 'Manchester',
'make': 'VAUXHALL',
'model': 'CORSA',
'odometer': 26054,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 11,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_95add145-cfdb-56fb-a27d-d877a0432bd6/95add145-cfdb-56fb-a27d-d877a0432bd6_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 42815,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SH22GFY/698915526/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_95add145-cfdb-56fb-a27d-d877a0432bd6/95add145-cfdb-56fb-a27d-d877a0432bd6_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 44615,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SH22GFY/698915544/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_95add145-cfdb-56fb-a27d-d877a0432bd6/95add145-cfdb-56fb-a27d-d877a0432bd6_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 44805,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SH22GFY/698915564/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_95add145-cfdb-56fb-a27d-d877a0432bd6/95add145-cfdb-56fb-a27d-d877a0432bd6_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 45323,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SH22GFY/698915586/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_95add145-cfdb-56fb-a27d-d877a0432bd6/95add145-cfdb-56fb-a27d-d877a0432bd6_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 41710,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SH22GFY/698915611/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_95add145-cfdb-56fb-a27d-d877a0432bd6/95add145-cfdb-56fb-a27d-d877a0432bd6_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 41163,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SH22GFY/698915627/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_95add145-cfdb-56fb-a27d-d877a0432bd6/95add145-cfdb-56fb-a27d-d877a0432bd6_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 85055,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SH22GFY/698915648/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_95add145-cfdb-56fb-a27d-d877a0432bd6/95add145-cfdb-56fb-a27d-d877a0432bd6_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 76111,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SH22GFY/698915673/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_95add145-cfdb-56fb-a27d-d877a0432bd6/95add145-cfdb-56fb-a27d-d877a0432bd6_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 79176,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SH22GFY/698915706/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_95add145-cfdb-56fb-a27d-d877a0432bd6/95add145-cfdb-56fb-a27d-d877a0432bd6_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 68279,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SH22GFY/698915737/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-01-01',
'seller_name': None,
'title': 'VAUXHALL CORSA 1.2 TURBO 100 ELITE ED. Hatchback',
'transmission': 'manual',
'trim': 'TURBO 100 ELITE ED.',
'vin': 'VXKUPHNEKN4232281',
'year': 2022}
2026-03-28 14:07:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SH22%2520GFY%27 HTTP/1.1" 200 None
2026-03-28 14:07:22 [bca.uk] INFO: Saving data for SH22%20GFY: {'created_time': 1774706842.946145, 'last_price_update_time': 1774706842.946156, 'auction_closing_time': 1774864800.0}
2026-03-28 14:07:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='SH22%2520GFY') HTTP/1.1" 204 0
2026-03-28 14:07:22 [bca.uk] INFO: Found listing with ID: DU20%20XWW
2026-03-28 14:07:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DU20%2520XWW%27 HTTP/1.1" 200 None
2026-03-28 14:07:22 [bca.uk] INFO: Scrape type for DU20%20XWW: 0
2026-03-28 14:07:22 [bca.uk] INFO: Found listing with ID: GN70%20OTT
2026-03-28 14:07:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GN70%2520OTT%27 HTTP/1.1" 200 None
2026-03-28 14:07:22 [bca.uk] INFO: Scrape type for GN70%20OTT: 2
2026-03-28 14:07:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e39429a2-3b48-5942-b1d1-7cf77faf21f2 with identifier: GN70%20OTT
2026-03-28 14:07:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e39429a2-3b48-5942-b1d1-7cf77faf21f2 with scrape type 2
2026-03-28 14:07:22 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e39429a2-3b48-5942-b1d1-7cf77faf21f2 with scrape type 2
2026-03-28 14:07:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: e39429a2-3b48-5942-b1d1-7cf77faf21f2, identifier: GN70%20OTT
2026-03-28 14:07:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:07:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c906f50>
2026-03-28 14:07:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:07:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:07:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:07:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f055b506-0022-5f0e-a7cd-13f0911779b4/f055b506-0022-5f0e-a7cd-13f0911779b4_image_1.jpg HTTP/1.1" 201 0
2026-03-28 14:07:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FKEZ9481%252F698941309%252F600') HTTP/1.1" 204 0
2026-03-28 14:07:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KEZ9481/698941309/600 saved to cache
2026-03-28 14:07:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item f055b506-0022-5f0e-a7cd-13f0911779b4
2026-03-28 14:07:23 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: f055b506-0022-5f0e-a7cd-13f0911779b4, skipping ID generation
2026-03-28 14:07:23 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item f055b506-0022-5f0e-a7cd-13f0911779b4 sending to next pipeline
2026-03-28 14:07:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: f055b506-0022-5f0e-a7cd-13f0911779b4, identifier: KEZ%209481
2026-03-28 14:07:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:07:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2ca62750>
2026-03-28 14:07:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:07:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:07:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:07:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e39beb78-d51f-5fbe-a58d-f26050dd24f6/e39beb78-d51f-5fbe-a58d-f26050dd24f6_image_0.jpg HTTP/1.1" 201 0
2026-03-28 14:07:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FYD21LKP%252F698439624%252F600') HTTP/1.1" 204 0
2026-03-28 14:07:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YD21LKP/698439624/600 saved to cache
2026-03-28 14:07:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item e39beb78-d51f-5fbe-a58d-f26050dd24f6
2026-03-28 14:07:23 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: e39beb78-d51f-5fbe-a58d-f26050dd24f6, skipping ID generation
2026-03-28 14:07:23 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item e39beb78-d51f-5fbe-a58d-f26050dd24f6 sending to next pipeline
2026-03-28 14:07:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: e39beb78-d51f-5fbe-a58d-f26050dd24f6, identifier: YD21%20LKP
2026-03-28 14:07:23 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/OY67JPV/698108014/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698108014>
2026-03-28 14:07:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KV16LDZ/698296906/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/KV16LDZ/42797857?sv=2020-08-04&st=2026-03-28T14%3A03%3A49Z&se=2026-03-28T14%3A28%3A49Z&sr=b&sp=r&sig=7pGIWvim4gxli5cifd615Lw7Q0s6ljm9z8msDK3x6Js%3D)
2026-03-28 14:07:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: e39429a2-3b48-5942-b1d1-7cf77faf21f2 with identifier: GN70%20OTT
2026-03-28 14:07:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: e39429a2-3b48-5942-b1d1-7cf77faf21f2 with identifier: GN70%20OTT
2026-03-28 14:07:23 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: e39429a2-3b48-5942-b1d1-7cf77faf21f2 with identifier: GN70%20OTT to the API
2026-03-28 14:07:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:07:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:07:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=15&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 146,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=GN70%20OTT-GB',
'category': 'Car',
'color': 'grey',
'currency': 'GBP',
'doors_number': 5,
'engine': '2.0L',
'expiration_date': '2026-04-03T07:00:00Z',
'fuel_type': 'Petrol',
'id': 'e39429a2-3b48-5942-b1d1-7cf77faf21f2',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'GN70 OTT',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=GN70%20OTT&vehicleType=*',
'listing': 'directbuy',
'location': 'Measham',
'make': 'MAZDA',
'model': 'CX-30',
'odometer': 48330,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 14000,
'price_includes_vat': False,
'registration_date': '2020-01-01',
'seller_name': None,
'title': 'MAZDA CX-30 2.0 SKY-X GT SPORT TECH Hatchback',
'transmission': 'automatic',
'trim': 'SKY-X GT SPORT TECH',
'vin': 'JMZDM6WHA00155380',
'year': 2020}
2026-03-28 14:07:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GN70%2520OTT%27 HTTP/1.1" 200 None
2026-03-28 14:07:23 [bca.uk] INFO: Saving data for GN70%20OTT: {'auction_closing_time': 1775199600.0, 'created_time': 1774523534.56235, 'last_price_update_time': 1774706843.685298}
2026-03-28 14:07:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='GN70%2520OTT') HTTP/1.1" 204 0
2026-03-28 14:07:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: f055b506-0022-5f0e-a7cd-13f0911779b4 with identifier: KEZ%209481
2026-03-28 14:07:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: f055b506-0022-5f0e-a7cd-13f0911779b4 with identifier: KEZ%209481
2026-03-28 14:07:23 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: f055b506-0022-5f0e-a7cd-13f0911779b4 with identifier: KEZ%209481 to the API
2026-03-28 14:07:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:07:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:07:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KEZ9481/698941309/600>
{'auction_title': '',
'c_o_2_emission_value': 140,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f055b506-0022-5f0e-a7cd-13f0911779b4/f055b506-0022-5f0e-a7cd-13f0911779b4_expert_report_file_2bcec5d9-3cef-4aa7-b068-c72ca5f3c66e.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=KEZ%209481-GB',
'category': 'Car',
'color': 'black',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.9L',
'expiration_date': '2026-03-29T10:00:00Z',
'fuel_type': 'Diesel',
'id': 'f055b506-0022-5f0e-a7cd-13f0911779b4',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'KEZ 9481',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=KEZ%209481&vehicleType=*',
'listing': 'auction',
'location': 'Manchester',
'make': 'VOLKSWAGEN',
'model': 'GOLF',
'odometer': 165912,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 11,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f055b506-0022-5f0e-a7cd-13f0911779b4/f055b506-0022-5f0e-a7cd-13f0911779b4_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 42055,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KEZ9481/698941303/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f055b506-0022-5f0e-a7cd-13f0911779b4/f055b506-0022-5f0e-a7cd-13f0911779b4_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 42667,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KEZ9481/698941309/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f055b506-0022-5f0e-a7cd-13f0911779b4/f055b506-0022-5f0e-a7cd-13f0911779b4_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 42480,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KEZ9481/698941324/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f055b506-0022-5f0e-a7cd-13f0911779b4/f055b506-0022-5f0e-a7cd-13f0911779b4_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 43269,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KEZ9481/698941343/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f055b506-0022-5f0e-a7cd-13f0911779b4/f055b506-0022-5f0e-a7cd-13f0911779b4_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 41568,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KEZ9481/698941361/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f055b506-0022-5f0e-a7cd-13f0911779b4/f055b506-0022-5f0e-a7cd-13f0911779b4_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 39930,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KEZ9481/698941379/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f055b506-0022-5f0e-a7cd-13f0911779b4/f055b506-0022-5f0e-a7cd-13f0911779b4_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 108598,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KEZ9481/698941415/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f055b506-0022-5f0e-a7cd-13f0911779b4/f055b506-0022-5f0e-a7cd-13f0911779b4_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 83704,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KEZ9481/698941474/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f055b506-0022-5f0e-a7cd-13f0911779b4/f055b506-0022-5f0e-a7cd-13f0911779b4_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 96256,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KEZ9481/698941524/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f055b506-0022-5f0e-a7cd-13f0911779b4/f055b506-0022-5f0e-a7cd-13f0911779b4_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 92667,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KEZ9481/698941540/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2006-01-01',
'seller_name': None,
'title': 'VOLKSWAGEN GOLF 1.9 TDI SE Hatchback',
'transmission': 'manual',
'trim': 'TDI SE',
'vin': 'WVWZZZ1KZ7W100504',
'year': 2006}
2026-03-28 14:07:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KEZ%25209481%27 HTTP/1.1" 200 None
2026-03-28 14:07:24 [bca.uk] INFO: Saving data for KEZ%209481: {'created_time': 1774706844.096175, 'last_price_update_time': 1774706844.096186, 'auction_closing_time': 1774778400.0}
2026-03-28 14:07:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='KEZ%25209481') HTTP/1.1" 204 0
2026-03-28 14:07:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: e39beb78-d51f-5fbe-a58d-f26050dd24f6 with identifier: YD21%20LKP
2026-03-28 14:07:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: e39beb78-d51f-5fbe-a58d-f26050dd24f6 with identifier: YD21%20LKP
2026-03-28 14:07:24 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: e39beb78-d51f-5fbe-a58d-f26050dd24f6 with identifier: YD21%20LKP to the API
2026-03-28 14:07:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:07:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:07:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YD21LKP/698439624/600>
{'auction_title': '',
'c_o_2_emission_value': 154,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e39beb78-d51f-5fbe-a58d-f26050dd24f6/e39beb78-d51f-5fbe-a58d-f26050dd24f6_expert_report_file_36c2cb97-9c5d-4990-a550-f63692de35d5.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=YD21%20LKP-GB',
'category': 'Car',
'color': 'black',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.5L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol',
'id': 'e39beb78-d51f-5fbe-a58d-f26050dd24f6',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'YD21 LKP',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=YD21%20LKP&vehicleType=*',
'listing': 'auction',
'location': 'Brighouse',
'make': 'SEAT',
'model': 'ATECA',
'odometer': 45133,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 11,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e39beb78-d51f-5fbe-a58d-f26050dd24f6/e39beb78-d51f-5fbe-a58d-f26050dd24f6_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 48971,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YD21LKP/698439624/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e39beb78-d51f-5fbe-a58d-f26050dd24f6/e39beb78-d51f-5fbe-a58d-f26050dd24f6_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 47563,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YD21LKP/698439628/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e39beb78-d51f-5fbe-a58d-f26050dd24f6/e39beb78-d51f-5fbe-a58d-f26050dd24f6_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 43228,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YD21LKP/698439633/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e39beb78-d51f-5fbe-a58d-f26050dd24f6/e39beb78-d51f-5fbe-a58d-f26050dd24f6_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 43338,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YD21LKP/698439635/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e39beb78-d51f-5fbe-a58d-f26050dd24f6/e39beb78-d51f-5fbe-a58d-f26050dd24f6_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 41388,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YD21LKP/698439638/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e39beb78-d51f-5fbe-a58d-f26050dd24f6/e39beb78-d51f-5fbe-a58d-f26050dd24f6_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 41654,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YD21LKP/698439643/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e39beb78-d51f-5fbe-a58d-f26050dd24f6/e39beb78-d51f-5fbe-a58d-f26050dd24f6_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 85749,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YD21LKP/698439650/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e39beb78-d51f-5fbe-a58d-f26050dd24f6/e39beb78-d51f-5fbe-a58d-f26050dd24f6_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 83960,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YD21LKP/698439656/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e39beb78-d51f-5fbe-a58d-f26050dd24f6/e39beb78-d51f-5fbe-a58d-f26050dd24f6_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 85988,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YD21LKP/698439665/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e39beb78-d51f-5fbe-a58d-f26050dd24f6/e39beb78-d51f-5fbe-a58d-f26050dd24f6_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 69933,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YD21LKP/698439675/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-01-01',
'seller_name': None,
'title': 'SEAT ATECA 1.5 TSI EVO 150 SE TECHNOLOGY DSG StationWagon',
'transmission': 'automatic',
'trim': 'TSI EVO 150 SE TECHNOLOGY DSG',
'vin': 'VSSZZZ5FZM6514012',
'year': 2021}
2026-03-28 14:07:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YD21%2520LKP%27 HTTP/1.1" 200 None
2026-03-28 14:07:24 [bca.uk] INFO: Saving data for YD21%20LKP: {'created_time': 1774706844.478092, 'last_price_update_time': 1774706844.478103, 'auction_closing_time': 1774864800.0}
2026-03-28 14:07:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='YD21%2520LKP') HTTP/1.1" 204 0
2026-03-28 14:07:24 [bca.uk] INFO: Found listing with ID: YB19%20EOM
2026-03-28 14:07:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YB19%2520EOM%27 HTTP/1.1" 200 None
2026-03-28 14:07:24 [bca.uk] INFO: Scrape type for YB19%20EOM: 0
2026-03-28 14:07:24 [bca.uk] INFO: Found listing with ID: YG21%20HVH
2026-03-28 14:07:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YG21%2520HVH%27 HTTP/1.1" 200 None
2026-03-28 14:07:24 [bca.uk] INFO: Scrape type for YG21%20HVH: 0
2026-03-28 14:07:24 [bca.uk] INFO: Found listing with ID: BJ22%20OGX
2026-03-28 14:07:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BJ22%2520OGX%27 HTTP/1.1" 200 None
2026-03-28 14:07:24 [bca.uk] INFO: Scrape type for BJ22%20OGX: 0
2026-03-28 14:07:24 [bca.uk] INFO: Found listing with ID: RA19%20XWL
2026-03-28 14:07:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27RA19%2520XWL%27 HTTP/1.1" 200 None
2026-03-28 14:07:24 [bca.uk] INFO: Scrape type for RA19%20XWL: 0
2026-03-28 14:07:24 [bca.uk] INFO: Found listing with ID: SY19%20CEJ
2026-03-28 14:07:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SY19%2520CEJ%27 HTTP/1.1" 200 None
2026-03-28 14:07:24 [bca.uk] INFO: Scrape type for SY19%20CEJ: 0
2026-03-28 14:07:24 [bca.uk] INFO: Found listing with ID: DY64%20YTD
2026-03-28 14:07:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DY64%2520YTD%27 HTTP/1.1" 200 None
2026-03-28 14:07:24 [bca.uk] INFO: Scrape type for DY64%20YTD: 0
2026-03-28 14:07:24 [bca.uk] INFO: Found listing with ID: ML69%20KTJ
2026-03-28 14:07:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27ML69%2520KTJ%27 HTTP/1.1" 200 None
2026-03-28 14:07:24 [bca.uk] INFO: Scrape type for ML69%20KTJ: 0
2026-03-28 14:07:24 [bca.uk] INFO: Found listing with ID: NU21%20PFD
2026-03-28 14:07:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27NU21%2520PFD%27 HTTP/1.1" 200 None
2026-03-28 14:07:24 [bca.uk] INFO: Scrape type for NU21%20PFD: 2
2026-03-28 14:07:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e1d22ef5-3843-5223-b4cc-264a848af5ca with identifier: NU21%20PFD
2026-03-28 14:07:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e1d22ef5-3843-5223-b4cc-264a848af5ca with scrape type 2
2026-03-28 14:07:24 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e1d22ef5-3843-5223-b4cc-264a848af5ca with scrape type 2
2026-03-28 14:07:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: e1d22ef5-3843-5223-b4cc-264a848af5ca, identifier: NU21%20PFD
2026-03-28 14:07:24 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FV17TYW/698768031/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698768031>
2026-03-28 14:07:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WU19VDC/698045632/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/WU19VDC/42792335?sv=2020-08-04&st=2026-03-28T14%3A03%3A50Z&se=2026-03-28T14%3A28%3A50Z&sr=b&sp=r&sig=Mqd3JjFAqa%2F7fy72g8Zcx8u%2F7XgFrycUpKRkPg1JOjA%3D)
2026-03-28 14:07:24 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FY66OTD/698150817/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698150817>
2026-03-28 14:07:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: e1d22ef5-3843-5223-b4cc-264a848af5ca with identifier: NU21%20PFD
2026-03-28 14:07:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: e1d22ef5-3843-5223-b4cc-264a848af5ca with identifier: NU21%20PFD
2026-03-28 14:07:24 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: e1d22ef5-3843-5223-b4cc-264a848af5ca with identifier: NU21%20PFD to the API
2026-03-28 14:07:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:07:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:07:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=15&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 148,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=NU21%20PFD-GB',
'category': 'LightCommercialVehicle',
'color': 'white',
'currency': 'GBP',
'doors_number': 6,
'engine': '1.5L',
'expiration_date': '2026-04-03T07:00:00Z',
'fuel_type': 'Diesel',
'id': 'e1d22ef5-3843-5223-b4cc-264a848af5ca',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'NU21 PFD',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=NU21%20PFD&vehicleType=*',
'listing': 'directbuy',
'location': 'Bridgwater',
'make': 'PEUGEOT',
'model': 'PARTNER',
'odometer': 110377,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 3500,
'price_includes_vat': False,
'registration_date': '2021-01-01',
'seller_name': None,
'title': 'PEUGEOT PARTNER 1.5 B/HDI 100 950 PROF.LONG Van',
'transmission': 'manual',
'trim': 'B/HDI 100 950 PROF.LONG',
'vin': 'VR3EFYHYCMJ598319',
'year': 2021}
2026-03-28 14:07:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27NU21%2520PFD%27 HTTP/1.1" 200 None
2026-03-28 14:07:25 [bca.uk] INFO: Saving data for NU21%20PFD: {'auction_closing_time': 1775199600.0, 'created_time': 1774276880.072916, 'last_price_update_time': 1774706845.053159}
2026-03-28 14:07:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='NU21%2520PFD') HTTP/1.1" 204 0
2026-03-28 14:07:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:07:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2d69fe90>
2026-03-28 14:07:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:07:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:07:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:07:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a2c13cca-acdb-56e9-80bf-41e2acf4aed1/a2c13cca-acdb-56e9-80bf-41e2acf4aed1_image_1.jpg HTTP/1.1" 201 0
2026-03-28 14:07:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FT400WRS%252F698069950%252F600') HTTP/1.1" 204 0
2026-03-28 14:07:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/T400WRS/698069950/600 saved to cache
2026-03-28 14:07:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item a2c13cca-acdb-56e9-80bf-41e2acf4aed1
2026-03-28 14:07:25 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: a2c13cca-acdb-56e9-80bf-41e2acf4aed1, skipping ID generation
2026-03-28 14:07:25 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item a2c13cca-acdb-56e9-80bf-41e2acf4aed1 sending to next pipeline
2026-03-28 14:07:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: a2c13cca-acdb-56e9-80bf-41e2acf4aed1, identifier: T400%20WRS
2026-03-28 14:07:25 [bca.uk] INFO: Total items found: 100
2026-03-28 14:07:25 [bca.uk] INFO: Requesting URL: https://www.bca.co.uk/api/search?q=&pageSize=100&page=17&sort=MostRecentlyAdded
2026-03-28 14:07:25 [bca.uk] INFO: Sending search API request with Bearer token (length=1492)
2026-03-28 14:07:25 [scrapy_zyte_api._params] WARNING: Request <GET https://www.bca.co.uk/api/search?q=&pageSize=100&page=17&sort=MostRecentlyAdded> defines the Zyte API customHttpRequestHeaders parameter, overriding Request.headers. Use Request.headers instead.
2026-03-28 14:07:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:07:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c972ad0>
2026-03-28 14:07:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:07:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:07:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:07:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_090813ec-adc2-5b7f-923f-58bcb47db483/090813ec-adc2-5b7f-923f-58bcb47db483_image_0.jpg HTTP/1.1" 201 0
2026-03-28 14:07:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FBP67XDB%252F698933958%252F600') HTTP/1.1" 204 0
2026-03-28 14:07:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BP67XDB/698933958/600 saved to cache
2026-03-28 14:07:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 090813ec-adc2-5b7f-923f-58bcb47db483
2026-03-28 14:07:25 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 090813ec-adc2-5b7f-923f-58bcb47db483, skipping ID generation
2026-03-28 14:07:25 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 090813ec-adc2-5b7f-923f-58bcb47db483 sending to next pipeline
2026-03-28 14:07:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 090813ec-adc2-5b7f-923f-58bcb47db483, identifier: BP67%20XDB
2026-03-28 14:07:25 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WU19VDC/698045628/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698045628>
2026-03-28 14:07:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/X11BBM/697604011/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/X11BBM/42809514?sv=2020-08-04&st=2026-03-28T14%3A03%3A48Z&se=2026-03-28T14%3A28%3A48Z&sr=b&sp=r&sig=iFv2U%2F%2BmiJcqZ%2BPwwi1Pjq9aw6DZNzQsG5k9GNFr4Nw%3D)
2026-03-28 14:07:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BV61MVO/698928622/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/BV61MVO/42809949?sv=2020-08-04&st=2026-03-28T14%3A03%3A49Z&se=2026-03-28T14%3A28%3A49Z&sr=b&sp=r&sig=PJNKzVVeJy1FKQt32eUXNOOsoTV6pqchYxeSDnPTh7w%3D)
2026-03-28 14:07:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NL64KGO/698157165/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/NL64KGO/42810049?sv=2020-08-04&st=2026-03-28T14%3A03%3A48Z&se=2026-03-28T14%3A28%3A48Z&sr=b&sp=r&sig=GCr8gvM5cBzuZAr6Na7pdcamsQO4tFs2xqxAknQovkg%3D)
2026-03-28 14:07:25 [bca.uk] INFO: Found listing with ID: OV69%20OAL
2026-03-28 14:07:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27OV69%2520OAL%27 HTTP/1.1" 200 None
2026-03-28 14:07:25 [bca.uk] INFO: Scrape type for OV69%20OAL: 0
2026-03-28 14:07:25 [bca.uk] INFO: Found listing with ID: OW17%20RHY
2026-03-28 14:07:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27OW17%2520RHY%27 HTTP/1.1" 200 None
2026-03-28 14:07:25 [bca.uk] INFO: Scrape type for OW17%20RHY: 0
2026-03-28 14:07:25 [bca.uk] INFO: Found listing with ID: WF68%20WGC
2026-03-28 14:07:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WF68%2520WGC%27 HTTP/1.1" 200 None
2026-03-28 14:07:25 [bca.uk] INFO: Scrape type for WF68%20WGC: 2
2026-03-28 14:07:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8b95522a-0961-5bba-8d97-fed09b7023e4 with identifier: WF68%20WGC
2026-03-28 14:07:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8b95522a-0961-5bba-8d97-fed09b7023e4 with scrape type 2
2026-03-28 14:07:25 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8b95522a-0961-5bba-8d97-fed09b7023e4 with scrape type 2
2026-03-28 14:07:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 8b95522a-0961-5bba-8d97-fed09b7023e4, identifier: WF68%20WGC
2026-03-28 14:07:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: a2c13cca-acdb-56e9-80bf-41e2acf4aed1 with identifier: T400%20WRS
2026-03-28 14:07:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: a2c13cca-acdb-56e9-80bf-41e2acf4aed1 with identifier: T400%20WRS
2026-03-28 14:07:25 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: a2c13cca-acdb-56e9-80bf-41e2acf4aed1 with identifier: T400%20WRS to the API
2026-03-28 14:07:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:07:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:07:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/T400WRS/698069950/600>
{'auction_title': '',
'c_o_2_emission_value': 134,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a2c13cca-acdb-56e9-80bf-41e2acf4aed1/a2c13cca-acdb-56e9-80bf-41e2acf4aed1_expert_report_file_abed905b-d731-4403-ac37-a37ca6741086.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=T400%20WRS-GB',
'category': 'Car',
'color': 'red',
'currency': 'GBP',
'doors_number': 5,
'engine': '2.0L',
'expiration_date': '2026-03-29T10:00:00Z',
'fuel_type': 'Diesel',
'id': 'a2c13cca-acdb-56e9-80bf-41e2acf4aed1',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'T400 WRS',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=T400%20WRS&vehicleType=*',
'listing': 'auction',
'location': 'Brighouse',
'make': 'SKODA',
'model': 'KAROQ',
'odometer': 45562,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 11,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a2c13cca-acdb-56e9-80bf-41e2acf4aed1/a2c13cca-acdb-56e9-80bf-41e2acf4aed1_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 51683,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/T400WRS/698069947/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a2c13cca-acdb-56e9-80bf-41e2acf4aed1/a2c13cca-acdb-56e9-80bf-41e2acf4aed1_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 50042,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/T400WRS/698069950/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a2c13cca-acdb-56e9-80bf-41e2acf4aed1/a2c13cca-acdb-56e9-80bf-41e2acf4aed1_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 46578,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/T400WRS/698069954/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a2c13cca-acdb-56e9-80bf-41e2acf4aed1/a2c13cca-acdb-56e9-80bf-41e2acf4aed1_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 46736,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/T400WRS/698069958/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a2c13cca-acdb-56e9-80bf-41e2acf4aed1/a2c13cca-acdb-56e9-80bf-41e2acf4aed1_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 45374,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/T400WRS/698069961/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a2c13cca-acdb-56e9-80bf-41e2acf4aed1/a2c13cca-acdb-56e9-80bf-41e2acf4aed1_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 46255,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/T400WRS/698069970/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a2c13cca-acdb-56e9-80bf-41e2acf4aed1/a2c13cca-acdb-56e9-80bf-41e2acf4aed1_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 89399,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/T400WRS/698069973/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a2c13cca-acdb-56e9-80bf-41e2acf4aed1/a2c13cca-acdb-56e9-80bf-41e2acf4aed1_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 85323,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/T400WRS/698069977/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a2c13cca-acdb-56e9-80bf-41e2acf4aed1/a2c13cca-acdb-56e9-80bf-41e2acf4aed1_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 90213,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/T400WRS/698069983/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a2c13cca-acdb-56e9-80bf-41e2acf4aed1/a2c13cca-acdb-56e9-80bf-41e2acf4aed1_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 84831,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/T400WRS/698069991/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-01-01',
'seller_name': None,
'title': 'SKODA KAROQ 2.0 TDI 150 4X4 SPORTLINE Hatchback',
'transmission': 'manual',
'trim': 'TDI 150 4X4 SPORTLINE',
'vin': 'TMBMJ7NU9K5029103',
'year': 2019}
2026-03-28 14:07:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27T400%2520WRS%27 HTTP/1.1" 200 None
2026-03-28 14:07:25 [bca.uk] INFO: Saving data for T400%20WRS: {'created_time': 1774706845.934753, 'last_price_update_time': 1774706845.934768, 'auction_closing_time': 1774778400.0}
2026-03-28 14:07:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='T400%2520WRS') HTTP/1.1" 204 0
2026-03-28 14:07:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 090813ec-adc2-5b7f-923f-58bcb47db483 with identifier: BP67%20XDB
2026-03-28 14:07:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 090813ec-adc2-5b7f-923f-58bcb47db483 with identifier: BP67%20XDB
2026-03-28 14:07:26 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 090813ec-adc2-5b7f-923f-58bcb47db483 with identifier: BP67%20XDB to the API
2026-03-28 14:07:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:07:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:07:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BP67XDB/698933958/600>
{'auction_title': '',
'c_o_2_emission_value': 104,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_090813ec-adc2-5b7f-923f-58bcb47db483/090813ec-adc2-5b7f-923f-58bcb47db483_expert_report_file_e94e21d5-0e0e-48e8-945e-a5d92b291759.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=BP67%20XDB-GB',
'category': 'Car',
'color': 'grey',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.2L',
'expiration_date': '2026-03-29T10:00:00Z',
'fuel_type': 'Petrol',
'id': '090813ec-adc2-5b7f-923f-58bcb47db483',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'BP67 XDB',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=BP67%20XDB&vehicleType=*',
'listing': 'auction',
'location': 'Birmingham - Perry Barr',
'make': 'CITROEN',
'model': 'C4 CACTUS',
'odometer': 69949,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 11,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_090813ec-adc2-5b7f-923f-58bcb47db483/090813ec-adc2-5b7f-923f-58bcb47db483_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 48428,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BP67XDB/698933958/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_090813ec-adc2-5b7f-923f-58bcb47db483/090813ec-adc2-5b7f-923f-58bcb47db483_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 47599,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BP67XDB/698933971/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_090813ec-adc2-5b7f-923f-58bcb47db483/090813ec-adc2-5b7f-923f-58bcb47db483_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 46365,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BP67XDB/698933985/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_090813ec-adc2-5b7f-923f-58bcb47db483/090813ec-adc2-5b7f-923f-58bcb47db483_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 45849,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BP67XDB/698934010/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_090813ec-adc2-5b7f-923f-58bcb47db483/090813ec-adc2-5b7f-923f-58bcb47db483_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 45259,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BP67XDB/698934023/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_090813ec-adc2-5b7f-923f-58bcb47db483/090813ec-adc2-5b7f-923f-58bcb47db483_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 44017,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BP67XDB/698934036/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_090813ec-adc2-5b7f-923f-58bcb47db483/090813ec-adc2-5b7f-923f-58bcb47db483_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 76107,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BP67XDB/698934061/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_090813ec-adc2-5b7f-923f-58bcb47db483/090813ec-adc2-5b7f-923f-58bcb47db483_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 56617,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BP67XDB/698934081/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_090813ec-adc2-5b7f-923f-58bcb47db483/090813ec-adc2-5b7f-923f-58bcb47db483_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 85436,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BP67XDB/698934110/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_090813ec-adc2-5b7f-923f-58bcb47db483/090813ec-adc2-5b7f-923f-58bcb47db483_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 74672,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BP67XDB/698934128/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-01-01',
'seller_name': None,
'title': 'CITROEN C4 CACTUS 1.2 P/T 82 FLAIR Hatchback',
'transmission': 'manual',
'trim': 'P/T 82 FLAIR',
'vin': 'VF70PHMZBHE557981',
'year': 2018}
2026-03-28 14:07:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BP67%2520XDB%27 HTTP/1.1" 200 None
2026-03-28 14:07:26 [bca.uk] INFO: Saving data for BP67%20XDB: {'created_time': 1774706846.443196, 'last_price_update_time': 1774706846.443209, 'auction_closing_time': 1774778400.0}
2026-03-28 14:07:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='BP67%2520XDB') HTTP/1.1" 204 0
2026-03-28 14:07:26 [scrapy_zyte_api._params] WARNING: Request <GET https://www.bca.co.uk/api/search?q=&pageSize=100&page=17&sort=MostRecentlyAdded> defines the Zyte API customHttpRequestHeaders parameter, overriding Request.headers. Use Request.headers instead.
2026-03-28 14:07:26 [scrapy_zyte_api._params] WARNING: Request <GET https://www.bca.co.uk/api/search?q=&pageSize=100&page=17&sort=MostRecentlyAdded> defines the Zyte API customHttpRequestHeaders parameter, overriding Request.headers. Use Request.headers instead.
2026-03-28 14:07:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 8b95522a-0961-5bba-8d97-fed09b7023e4 with identifier: WF68%20WGC
2026-03-28 14:07:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 8b95522a-0961-5bba-8d97-fed09b7023e4 with identifier: WF68%20WGC
2026-03-28 14:07:26 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 8b95522a-0961-5bba-8d97-fed09b7023e4 with identifier: WF68%20WGC to the API
2026-03-28 14:07:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:07:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:07:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=15&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 218,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=WF68%20WGC-GB',
'category': 'Car',
'color': 'black',
'currency': 'GBP',
'doors_number': 2,
'engine': '3.0L',
'expiration_date': '2026-04-03T07:00:00Z',
'fuel_type': 'Petrol',
'id': '8b95522a-0961-5bba-8d97-fed09b7023e4',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'WF68 WGC',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=WF68%20WGC&vehicleType=*',
'listing': 'directbuy',
'location': 'Birmingham - Perry Barr',
'make': 'MERCEDES-BENZ',
'model': 'C43 AMG',
'odometer': 69503,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 18000,
'price_includes_vat': False,
'registration_date': '2018-01-01',
'seller_name': None,
'title': 'MERCEDES-BENZ C43 AMG 3.0 4MATIC PREMIUM PLUS 9G Convertible',
'transmission': 'manual',
'trim': '4MATIC PREMIUM PLUS 9G',
'vin': 'WDD2054642F828076',
'year': 2018}
2026-03-28 14:07:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WF68%2520WGC%27 HTTP/1.1" 200 None
2026-03-28 14:07:26 [bca.uk] INFO: Saving data for WF68%20WGC: {'auction_closing_time': 1775199600.0, 'created_time': 1774523402.688461, 'last_price_update_time': 1774706846.912652}
2026-03-28 14:07:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='WF68%2520WGC') HTTP/1.1" 204 0
2026-03-28 14:07:26 [bca.uk] INFO: Found listing with ID: KP21%20EYJ
2026-03-28 14:07:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KP21%2520EYJ%27 HTTP/1.1" 200 None
2026-03-28 14:07:26 [bca.uk] INFO: Scrape type for KP21%20EYJ: 0
2026-03-28 14:07:26 [bca.uk] INFO: Found listing with ID: R16%20RRX
2026-03-28 14:07:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27R16%2520RRX%27 HTTP/1.1" 200 None
2026-03-28 14:07:26 [bca.uk] INFO: Scrape type for R16%20RRX: 0
2026-03-28 14:07:26 [bca.uk] INFO: Found listing with ID: YH64%20HNO
2026-03-28 14:07:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YH64%2520HNO%27 HTTP/1.1" 200 None
2026-03-28 14:07:26 [bca.uk] INFO: Scrape type for YH64%20HNO: 0
2026-03-28 14:07:26 [bca.uk] INFO: Found listing with ID: YC25%20ZFZ
2026-03-28 14:07:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YC25%2520ZFZ%27 HTTP/1.1" 200 None
2026-03-28 14:07:26 [bca.uk] INFO: Scrape type for YC25%20ZFZ: 0
2026-03-28 14:07:26 [bca.uk] INFO: Found listing with ID: AF73%20EOV
2026-03-28 14:07:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27AF73%2520EOV%27 HTTP/1.1" 200 None
2026-03-28 14:07:27 [bca.uk] INFO: Scrape type for AF73%20EOV: 0
2026-03-28 14:07:27 [bca.uk] INFO: Found listing with ID: AF73%20FEJ
2026-03-28 14:07:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27AF73%2520FEJ%27 HTTP/1.1" 200 None
2026-03-28 14:07:27 [bca.uk] INFO: Scrape type for AF73%20FEJ: 2
2026-03-28 14:07:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 354448a0-0cfc-570a-9c35-f206e07dd228 with identifier: AF73%20FEJ
2026-03-28 14:07:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 354448a0-0cfc-570a-9c35-f206e07dd228 with scrape type 2
2026-03-28 14:07:27 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 354448a0-0cfc-570a-9c35-f206e07dd228 with scrape type 2
2026-03-28 14:07:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 354448a0-0cfc-570a-9c35-f206e07dd228, identifier: AF73%20FEJ
2026-03-28 14:07:27 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 14:07:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:07:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c9d9f50>
2026-03-28 14:07:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:07:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:07:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:07:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8b90222e-e04a-5b27-ab41-392150aadde5/8b90222e-e04a-5b27-ab41-392150aadde5_image_5.jpg HTTP/1.1" 201 0
2026-03-28 14:07:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FKV16LDZ%252F698296906%252F600') HTTP/1.1" 204 0
2026-03-28 14:07:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KV16LDZ/698296906/600 saved to cache
2026-03-28 14:07:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 8b90222e-e04a-5b27-ab41-392150aadde5
2026-03-28 14:07:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/DE72KZJ/42810405?sv=2020-08-04&st=2026-03-28T14%3A07%3A20Z&se=2026-03-28T14%3A32%3A20Z&sr=b&sp=r&sig=Rm0NJ3AfMMkhExeMwPLPfRbyOp2UoRTQE0wN25vKQGI%3D> (referer: https://www.bca.co.uk/)
2026-03-28 14:07:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LK64NEJ/698947020/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LK64NEJ/42810513?sv=2020-08-04&st=2026-03-28T14%3A03%3A51Z&se=2026-03-28T14%3A28%3A51Z&sr=b&sp=r&sig=dZi6EyBOQ2GoK8knfBZtxM9S6O3yD8ghOm4nMLyaJjo%3D)
2026-03-28 14:07:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CK18AEJ/698910336/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/CK18AEJ/42809519?sv=2020-08-04&st=2026-03-28T14%3A03%3A52Z&se=2026-03-28T14%3A28%3A52Z&sr=b&sp=r&sig=tMAO1WCWalJ7mXIWRlCxzQ1Rx0voh0Hr3%2FaR8xfgZTg%3D)
2026-03-28 14:07:27 [bca.uk] INFO: Found listing with ID: YE67%20OPH
2026-03-28 14:07:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YE67%2520OPH%27 HTTP/1.1" 200 None
2026-03-28 14:07:27 [bca.uk] INFO: Scrape type for YE67%20OPH: 0
2026-03-28 14:07:27 [bca.uk] INFO: Found listing with ID: LL18%20OTM
2026-03-28 14:07:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LL18%2520OTM%27 HTTP/1.1" 200 None
2026-03-28 14:07:27 [bca.uk] INFO: Scrape type for LL18%20OTM: 0
2026-03-28 14:07:27 [bca.uk] INFO: Found listing with ID: LX16%20CNU
2026-03-28 14:07:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LX16%2520CNU%27 HTTP/1.1" 200 None
2026-03-28 14:07:27 [bca.uk] INFO: Scrape type for LX16%20CNU: 2
2026-03-28 14:07:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 917e4925-cc2e-58cc-8815-3da3ed129db3 with identifier: LX16%20CNU
2026-03-28 14:07:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 917e4925-cc2e-58cc-8815-3da3ed129db3 with scrape type 2
2026-03-28 14:07:27 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 917e4925-cc2e-58cc-8815-3da3ed129db3 with scrape type 2
2026-03-28 14:07:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 917e4925-cc2e-58cc-8815-3da3ed129db3, identifier: LX16%20CNU
2026-03-28 14:07:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 354448a0-0cfc-570a-9c35-f206e07dd228 with identifier: AF73%20FEJ
2026-03-28 14:07:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 354448a0-0cfc-570a-9c35-f206e07dd228 with identifier: AF73%20FEJ
2026-03-28 14:07:27 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 354448a0-0cfc-570a-9c35-f206e07dd228 with identifier: AF73%20FEJ to the API
2026-03-28 14:07:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:07:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:07:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=16&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': None,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=AF73%20FEJ-GB',
'category': 'Car',
'color': 'white',
'currency': 'GBP',
'doors_number': 5,
'engine': '0.0L',
'expiration_date': '2026-04-02T23:00:00Z',
'fuel_type': 'Electric',
'id': '354448a0-0cfc-570a-9c35-f206e07dd228',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': False,
'license_plate': 'AF73 FEJ',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=AF73%20FEJ&vehicleType=*',
'listing': 'directbuy',
'location': 'Nottingham',
'make': 'TESLA',
'model': 'MODEL Y',
'odometer': 55094,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 18000,
'price_includes_vat': False,
'registration_date': '2023-01-01',
'seller_name': None,
'title': 'TESLA MODEL Y RWD Hatchback',
'transmission': 'automatic',
'trim': 'RWD',
'vin': 'LRWYHCFS1PC040910',
'year': 2023}
2026-03-28 14:07:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27AF73%2520FEJ%27 HTTP/1.1" 200 None
2026-03-28 14:07:27 [bca.uk] INFO: Saving data for AF73%20FEJ: {'auction_closing_time': 1775170800.0, 'created_time': 1773834927.648711, 'last_price_update_time': 1774706847.698994}
2026-03-28 14:07:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='AF73%2520FEJ') HTTP/1.1" 204 0
2026-03-28 14:07:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WV16UWB/698284438/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/WV16UWB/42797605?sv=2020-08-04&st=2026-03-28T14%3A03%3A48Z&se=2026-03-28T14%3A28%3A48Z&sr=b&sp=r&sig=tZmKWGpA7mZ9Rie4bcnpNzrMU30KCOw%2BfaCUNgMn820%3D)
2026-03-28 14:07:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 917e4925-cc2e-58cc-8815-3da3ed129db3 with identifier: LX16%20CNU
2026-03-28 14:07:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-28 14:07:27 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=orange HTTP/1.1" 200 None
2026-03-28 14:07:28 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-28 14:07:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-28 14:07:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 917e4925-cc2e-58cc-8815-3da3ed129db3 with identifier: LX16%20CNU
2026-03-28 14:07:28 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 917e4925-cc2e-58cc-8815-3da3ed129db3 with identifier: LX16%20CNU to the API
2026-03-28 14:07:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:07:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:07:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=15&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 139,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=LX16%20CNU-GB',
'category': 'Car',
'color': 'orange',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.6L',
'expiration_date': '2026-04-03T07:00:00Z',
'fuel_type': 'Diesel',
'id': '917e4925-cc2e-58cc-8815-3da3ed129db3',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'LX16 CNU',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=LX16%20CNU&vehicleType=*',
'listing': 'directbuy',
'location': 'Blackbushe',
'make': 'NISSAN',
'model': 'X-TRAIL',
'odometer': 59792,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 7000,
'price_includes_vat': False,
'registration_date': '2016-01-01',
'seller_name': None,
'title': 'NISSAN X-TRAIL 1.6 DCI 130 N-TEC (7ST) XTRONIC StationWagon',
'transmission': 'automatic',
'trim': 'DCI 130 N-TEC (7ST) XTRONIC',
'vin': 'JN1JCAT32U0026536',
'year': 2016}
2026-03-28 14:07:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LX16%2520CNU%27 HTTP/1.1" 200 None
2026-03-28 14:07:28 [bca.uk] INFO: Saving data for LX16%20CNU: {'auction_closing_time': 1775199600.0, 'created_time': 1774523506.767027, 'last_price_update_time': 1774706848.665516}
2026-03-28 14:07:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='LX16%2520CNU') HTTP/1.1" 204 0
2026-03-28 14:07:28 [bca.uk] INFO: Found listing with ID: BC74%20HHL
2026-03-28 14:07:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BC74%2520HHL%27 HTTP/1.1" 200 None
2026-03-28 14:07:28 [bca.uk] INFO: Scrape type for BC74%20HHL: 0
2026-03-28 14:07:28 [bca.uk] INFO: Found listing with ID: BG24%20XXM
2026-03-28 14:07:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BG24%2520XXM%27 HTTP/1.1" 200 None
2026-03-28 14:07:28 [bca.uk] INFO: Scrape type for BG24%20XXM: 0
2026-03-28 14:07:28 [bca.uk] INFO: Found listing with ID: BK24%20ZKV
2026-03-28 14:07:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BK24%2520ZKV%27 HTTP/1.1" 200 None
2026-03-28 14:07:28 [bca.uk] INFO: Scrape type for BK24%20ZKV: 0
2026-03-28 14:07:28 [bca.uk] INFO: Found listing with ID: BL73%20ZKG
2026-03-28 14:07:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BL73%2520ZKG%27 HTTP/1.1" 200 None
2026-03-28 14:07:28 [bca.uk] INFO: Scrape type for BL73%20ZKG: 0
2026-03-28 14:07:28 [bca.uk] INFO: Found listing with ID: BP73%20HWG
2026-03-28 14:07:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BP73%2520HWG%27 HTTP/1.1" 200 None
2026-03-28 14:07:28 [bca.uk] INFO: Scrape type for BP73%20HWG: 0
2026-03-28 14:07:28 [bca.uk] INFO: Found listing with ID: BP73%20KDO
2026-03-28 14:07:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BP73%2520KDO%27 HTTP/1.1" 200 None
2026-03-28 14:07:28 [bca.uk] INFO: Scrape type for BP73%20KDO: 0
2026-03-28 14:07:28 [bca.uk] INFO: Found listing with ID: BT23%20XZC
2026-03-28 14:07:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BT23%2520XZC%27 HTTP/1.1" 200 None
2026-03-28 14:07:28 [bca.uk] INFO: Scrape type for BT23%20XZC: 0
2026-03-28 14:07:28 [bca.uk] INFO: Found listing with ID: BW74%20DWK
2026-03-28 14:07:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BW74%2520DWK%27 HTTP/1.1" 200 None
2026-03-28 14:07:28 [bca.uk] INFO: Scrape type for BW74%20DWK: 0
2026-03-28 14:07:28 [bca.uk] INFO: Found listing with ID: CF74%20PHA
2026-03-28 14:07:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27CF74%2520PHA%27 HTTP/1.1" 200 None
2026-03-28 14:07:28 [bca.uk] INFO: Scrape type for CF74%20PHA: 0
2026-03-28 14:07:28 [bca.uk] INFO: Found listing with ID: CF74%20PJJ
2026-03-28 14:07:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27CF74%2520PJJ%27 HTTP/1.1" 200 None
2026-03-28 14:07:28 [bca.uk] INFO: Scrape type for CF74%20PJJ: 0
2026-03-28 14:07:28 [bca.uk] INFO: Found listing with ID: DL73%20LCP
2026-03-28 14:07:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DL73%2520LCP%27 HTTP/1.1" 200 None
2026-03-28 14:07:28 [bca.uk] INFO: Scrape type for DL73%20LCP: 0
2026-03-28 14:07:28 [bca.uk] INFO: Found listing with ID: DL73%20LSZ
2026-03-28 14:07:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DL73%2520LSZ%27 HTTP/1.1" 200 None
2026-03-28 14:07:28 [bca.uk] INFO: Scrape type for DL73%20LSZ: 0
2026-03-28 14:07:28 [bca.uk] INFO: Found listing with ID: DN24%20UWB
2026-03-28 14:07:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DN24%2520UWB%27 HTTP/1.1" 200 None
2026-03-28 14:07:28 [bca.uk] INFO: Scrape type for DN24%20UWB: 0
2026-03-28 14:07:28 [bca.uk] INFO: Found listing with ID: DN70%20KGO
2026-03-28 14:07:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DN70%2520KGO%27 HTTP/1.1" 200 None
2026-03-28 14:07:28 [bca.uk] INFO: Scrape type for DN70%20KGO: 2
2026-03-28 14:07:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 28f5605a-c672-58bf-97b9-6bfbeb67a5c1 with identifier: DN70%20KGO
2026-03-28 14:07:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 28f5605a-c672-58bf-97b9-6bfbeb67a5c1 with scrape type 2
2026-03-28 14:07:28 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 28f5605a-c672-58bf-97b9-6bfbeb67a5c1 with scrape type 2
2026-03-28 14:07:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 28f5605a-c672-58bf-97b9-6bfbeb67a5c1, identifier: DN70%20KGO
2026-03-28 14:07:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DF12VWL/698228757/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/DF12VWL/42797174?sv=2020-08-04&st=2026-03-28T14%3A03%3A51Z&se=2026-03-28T14%3A28%3A51Z&sr=b&sp=r&sig=0mRjBtvz6tka1D82qBQ3%2FRs63GOtrqyuAG7vdnh5S9c%3D)
2026-03-28 14:07:29 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KV16LDZ/698296902/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698296902>
2026-03-28 14:07:29 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BV61MVO/698928598/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698928598>
2026-03-28 14:07:29 [bca.uk] INFO: Found listing with ID: OW17%20PUO
2026-03-28 14:07:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27OW17%2520PUO%27 HTTP/1.1" 200 None
2026-03-28 14:07:29 [bca.uk] INFO: Scrape type for OW17%20PUO: 0
2026-03-28 14:07:29 [bca.uk] INFO: Found listing with ID: RK66%20MLE
2026-03-28 14:07:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27RK66%2520MLE%27 HTTP/1.1" 200 None
2026-03-28 14:07:29 [bca.uk] INFO: Scrape type for RK66%20MLE: 0
2026-03-28 14:07:29 [bca.uk] INFO: Found listing with ID: SC19%20RJJ
2026-03-28 14:07:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SC19%2520RJJ%27 HTTP/1.1" 200 None
2026-03-28 14:07:29 [bca.uk] INFO: Scrape type for SC19%20RJJ: 0
2026-03-28 14:07:29 [bca.uk] INFO: Found listing with ID: FL24%20MXK
2026-03-28 14:07:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FL24%2520MXK%27 HTTP/1.1" 200 None
2026-03-28 14:07:29 [bca.uk] INFO: Scrape type for FL24%20MXK: 0
2026-03-28 14:07:29 [bca.uk] INFO: Found listing with ID: KP21%20EYJ
2026-03-28 14:07:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KP21%2520EYJ%27 HTTP/1.1" 200 None
2026-03-28 14:07:29 [bca.uk] INFO: Scrape type for KP21%20EYJ: 0
2026-03-28 14:07:29 [bca.uk] INFO: Found listing with ID: R16%20RRX
2026-03-28 14:07:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27R16%2520RRX%27 HTTP/1.1" 200 None
2026-03-28 14:07:29 [bca.uk] INFO: Scrape type for R16%20RRX: 0
2026-03-28 14:07:29 [bca.uk] INFO: Found listing with ID: YH64%20HNO
2026-03-28 14:07:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YH64%2520HNO%27 HTTP/1.1" 200 None
2026-03-28 14:07:29 [bca.uk] INFO: Scrape type for YH64%20HNO: 0
2026-03-28 14:07:29 [bca.uk] INFO: Found listing with ID: YC25%20ZFZ
2026-03-28 14:07:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YC25%2520ZFZ%27 HTTP/1.1" 200 None
2026-03-28 14:07:29 [bca.uk] INFO: Scrape type for YC25%20ZFZ: 0
2026-03-28 14:07:29 [bca.uk] INFO: Found listing with ID: AF73%20EOV
2026-03-28 14:07:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27AF73%2520EOV%27 HTTP/1.1" 200 None
2026-03-28 14:07:29 [bca.uk] INFO: Scrape type for AF73%20EOV: 0
2026-03-28 14:07:29 [bca.uk] INFO: Found listing with ID: AF73%20FEJ
2026-03-28 14:07:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27AF73%2520FEJ%27 HTTP/1.1" 200 None
2026-03-28 14:07:29 [bca.uk] INFO: Scrape type for AF73%20FEJ: 0
2026-03-28 14:07:29 [bca.uk] INFO: Found listing with ID: BC74%20HHL
2026-03-28 14:07:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BC74%2520HHL%27 HTTP/1.1" 200 None
2026-03-28 14:07:29 [bca.uk] INFO: Scrape type for BC74%20HHL: 0
2026-03-28 14:07:29 [bca.uk] INFO: Found listing with ID: BG24%20XXM
2026-03-28 14:07:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BG24%2520XXM%27 HTTP/1.1" 200 None
2026-03-28 14:07:29 [bca.uk] INFO: Scrape type for BG24%20XXM: 0
2026-03-28 14:07:29 [bca.uk] INFO: Found listing with ID: BK24%20ZKV
2026-03-28 14:07:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BK24%2520ZKV%27 HTTP/1.1" 200 None
2026-03-28 14:07:29 [bca.uk] INFO: Scrape type for BK24%20ZKV: 0
2026-03-28 14:07:29 [bca.uk] INFO: Found listing with ID: BL73%20ZKG
2026-03-28 14:07:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BL73%2520ZKG%27 HTTP/1.1" 200 None
2026-03-28 14:07:29 [bca.uk] INFO: Scrape type for BL73%20ZKG: 0
2026-03-28 14:07:29 [bca.uk] INFO: Found listing with ID: BP73%20HWG
2026-03-28 14:07:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BP73%2520HWG%27 HTTP/1.1" 200 None
2026-03-28 14:07:29 [bca.uk] INFO: Scrape type for BP73%20HWG: 0
2026-03-28 14:07:29 [bca.uk] INFO: Found listing with ID: BP73%20KDO
2026-03-28 14:07:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BP73%2520KDO%27 HTTP/1.1" 200 None
2026-03-28 14:07:29 [bca.uk] INFO: Scrape type for BP73%20KDO: 0
2026-03-28 14:07:29 [bca.uk] INFO: Found listing with ID: BT23%20XZC
2026-03-28 14:07:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BT23%2520XZC%27 HTTP/1.1" 200 None
2026-03-28 14:07:29 [bca.uk] INFO: Scrape type for BT23%20XZC: 0
2026-03-28 14:07:29 [bca.uk] INFO: Found listing with ID: BW74%20DWK
2026-03-28 14:07:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BW74%2520DWK%27 HTTP/1.1" 200 None
2026-03-28 14:07:29 [bca.uk] INFO: Scrape type for BW74%20DWK: 0
2026-03-28 14:07:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 28f5605a-c672-58bf-97b9-6bfbeb67a5c1 with identifier: DN70%20KGO
2026-03-28 14:07:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 28f5605a-c672-58bf-97b9-6bfbeb67a5c1 with identifier: DN70%20KGO
2026-03-28 14:07:29 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 28f5605a-c672-58bf-97b9-6bfbeb67a5c1 with identifier: DN70%20KGO to the API
2026-03-28 14:07:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:07:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:07:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=16&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 137,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=DN70%20KGO-GB',
'category': 'Car',
'color': 'black',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.5L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Diesel',
'id': '28f5605a-c672-58bf-97b9-6bfbeb67a5c1',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'DN70 KGO',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=DN70%20KGO&vehicleType=*',
'listing': 'auction',
'location': 'Glasgow - East',
'make': 'VAUXHALL',
'model': 'GRANDLAND X',
'odometer': 98729,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-01-01',
'seller_name': None,
'title': 'VAUXHALL GRANDLAND X 1.5 TURBO D 130 BUSINESS ED. Hatchback',
'transmission': 'manual',
'trim': 'TURBO D 130 BUSINESS ED.',
'vin': 'W0VZCYHZ5L6037648',
'year': 2020}
2026-03-28 14:07:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DN70%2520KGO%27 HTTP/1.1" 200 None
2026-03-28 14:07:29 [bca.uk] INFO: Saving data for DN70%20KGO: {'auction_closing_time': 1774864800.0, 'created_time': 1774364293.39261, 'last_price_update_time': 1774706849.681996}
2026-03-28 14:07:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='DN70%2520KGO') HTTP/1.1" 204 0
2026-03-28 14:07:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:07:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c629650>
2026-03-28 14:07:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:07:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:07:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:07:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2c7ab10e-203f-5d5d-b669-d394e3cfab8d/2c7ab10e-203f-5d5d-b669-d394e3cfab8d_image_4.jpg HTTP/1.1" 201 0
2026-03-28 14:07:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FWU19VDC%252F698045632%252F600') HTTP/1.1" 204 0
2026-03-28 14:07:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WU19VDC/698045632/600 saved to cache
2026-03-28 14:07:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 2c7ab10e-203f-5d5d-b669-d394e3cfab8d
2026-03-28 14:07:29 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:07:29 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:07:29 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:07:29 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:07:29 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:07:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:07:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a1fe776d0>
2026-03-28 14:07:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:07:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:07:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:07:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6f52ae88-a710-5999-b75b-294cfedaf6f8/6f52ae88-a710-5999-b75b-294cfedaf6f8_image_7.jpg HTTP/1.1" 201 0
2026-03-28 14:07:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FX11BBM%252F697604011%252F600') HTTP/1.1" 204 0
2026-03-28 14:07:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/X11BBM/697604011/600 saved to cache
2026-03-28 14:07:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 6f52ae88-a710-5999-b75b-294cfedaf6f8
2026-03-28 14:07:29 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:07:29 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:07:29 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:07:29 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:07:29 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:07:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:07:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c62b9d0>
2026-03-28 14:07:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:07:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:07:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:07:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6665ad2b-5db8-5cb5-8575-3440dfdc3f0c/6665ad2b-5db8-5cb5-8575-3440dfdc3f0c_image_6.jpg HTTP/1.1" 201 0
2026-03-28 14:07:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FBV61MVO%252F698928622%252F600') HTTP/1.1" 204 0
2026-03-28 14:07:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BV61MVO/698928622/600 saved to cache
2026-03-28 14:07:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 6665ad2b-5db8-5cb5-8575-3440dfdc3f0c
2026-03-28 14:07:29 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:07:29 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:07:29 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:07:29 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:07:29 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:07:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:07:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c477f10>
2026-03-28 14:07:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:07:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:07:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:07:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0c3c3ab5-91e6-5450-9be7-ee521ca8a766/0c3c3ab5-91e6-5450-9be7-ee521ca8a766_image_7.jpg HTTP/1.1" 201 0
2026-03-28 14:07:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FNL64KGO%252F698157165%252F600') HTTP/1.1" 204 0
2026-03-28 14:07:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NL64KGO/698157165/600 saved to cache
2026-03-28 14:07:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 0c3c3ab5-91e6-5450-9be7-ee521ca8a766
2026-03-28 14:07:30 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NL64KGO/698157151/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698157151>
2026-03-28 14:07:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/OY67JPV/698108014/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/OY67JPV/42810048?sv=2020-08-04&st=2026-03-28T14%3A03%3A48Z&se=2026-03-28T14%3A28%3A48Z&sr=b&sp=r&sig=3IQnxpRCaMGCrWPQZylbi%2BiY%2FkfXKw1FEE36W3dpRwo%3D)
2026-03-28 14:07:30 [bca.uk] INFO: Found listing with ID: DV24%20BZA
2026-03-28 14:07:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DV24%2520BZA%27 HTTP/1.1" 200 None
2026-03-28 14:07:30 [bca.uk] INFO: Scrape type for DV24%20BZA: 0
2026-03-28 14:07:30 [bca.uk] INFO: Found listing with ID: DX71%20AAF
2026-03-28 14:07:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DX71%2520AAF%27 HTTP/1.1" 200 None
2026-03-28 14:07:30 [bca.uk] INFO: Scrape type for DX71%20AAF: 0
2026-03-28 14:07:30 [bca.uk] INFO: Found listing with ID: DY74%20BVW
2026-03-28 14:07:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DY74%2520BVW%27 HTTP/1.1" 200 None
2026-03-28 14:07:30 [bca.uk] INFO: Scrape type for DY74%20BVW: 0
2026-03-28 14:07:30 [bca.uk] INFO: Found listing with ID: FD72%20URU
2026-03-28 14:07:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FD72%2520URU%27 HTTP/1.1" 200 None
2026-03-28 14:07:30 [bca.uk] INFO: Scrape type for FD72%20URU: 0
2026-03-28 14:07:30 [bca.uk] INFO: Found listing with ID: FX19%20KVO
2026-03-28 14:07:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FX19%2520KVO%27 HTTP/1.1" 200 None
2026-03-28 14:07:30 [bca.uk] INFO: Scrape type for FX19%20KVO: 2
2026-03-28 14:07:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 980cdc45-7310-5c08-ae43-41dfed2e8b01 with identifier: FX19%20KVO
2026-03-28 14:07:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 980cdc45-7310-5c08-ae43-41dfed2e8b01 with scrape type 2
2026-03-28 14:07:30 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 980cdc45-7310-5c08-ae43-41dfed2e8b01 with scrape type 2
2026-03-28 14:07:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 980cdc45-7310-5c08-ae43-41dfed2e8b01, identifier: FX19%20KVO
2026-03-28 14:07:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FY66OTD/698150817/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/FY66OTD/42794791?sv=2020-08-04&st=2026-03-28T14%3A03%3A46Z&se=2026-03-28T14%3A28%3A46Z&sr=b&sp=r&sig=nyWr7cManqycrjqVh9Sq0fegCWU0XCSire1eKcJWKLA%3D)
2026-03-28 14:07:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FV17TYW/698768031/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/FV17TYW/42807142?sv=2020-08-04&st=2026-03-28T14%3A03%3A46Z&se=2026-03-28T14%3A28%3A46Z&sr=b&sp=r&sig=3LbtNEGnFqYV4bS0F0%2BmsB%2FgfFSYLdditNDmvy7kudU%3D)
2026-03-28 14:07:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 980cdc45-7310-5c08-ae43-41dfed2e8b01 with identifier: FX19%20KVO
2026-03-28 14:07:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 980cdc45-7310-5c08-ae43-41dfed2e8b01 with identifier: FX19%20KVO
2026-03-28 14:07:30 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 980cdc45-7310-5c08-ae43-41dfed2e8b01 with identifier: FX19%20KVO to the API
2026-03-28 14:07:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:07:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:07:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=16&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 110,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=FX19%20KVO-GB',
'category': 'Car',
'color': 'red',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.0L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol',
'id': '980cdc45-7310-5c08-ae43-41dfed2e8b01',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'FX19 KVO',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=FX19%20KVO&vehicleType=*',
'listing': 'auction',
'location': 'Glasgow - East',
'make': 'HONDA',
'model': 'CIVIC',
'odometer': 43017,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-01-01',
'seller_name': None,
'title': 'HONDA CIVIC 1.0 VTEC TURBO 126 SR Hatchback',
'transmission': 'manual',
'trim': 'VTEC TURBO 126 SR',
'vin': 'SHHFK6760JU010416',
'year': 2019}
2026-03-28 14:07:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FX19%2520KVO%27 HTTP/1.1" 200 None
2026-03-28 14:07:30 [bca.uk] INFO: Saving data for FX19%20KVO: {'auction_closing_time': 1774864800.0, 'created_time': 1773935631.507059, 'last_price_update_time': 1774706850.590217}
2026-03-28 14:07:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='FX19%2520KVO') HTTP/1.1" 204 0
2026-03-28 14:07:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:07:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a1fe74450>
2026-03-28 14:07:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:07:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:07:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:07:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_300e41a8-d251-59f7-802e-bbb7283fa1e6/300e41a8-d251-59f7-802e-bbb7283fa1e6_expert_report_file_570b357e-a902-4760-b19d-b322f261c0e4.pdf HTTP/1.1" 201 0
2026-03-28 14:07:30 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item 300e41a8-d251-59f7-802e-bbb7283fa1e6
2026-03-28 14:07:30 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 300e41a8-d251-59f7-802e-bbb7283fa1e6, skipping ID generation
2026-03-28 14:07:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 300e41a8-d251-59f7-802e-bbb7283fa1e6
2026-03-28 14:07:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DDE72KZJ-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-28 14:07:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=DE72KZJ-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-28 14:07:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:07:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c7ed010>
2026-03-28 14:07:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:07:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:07:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:07:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bb105475-65fd-5601-86d0-a8590c56bf0b/bb105475-65fd-5601-86d0-a8590c56bf0b_image_1.jpg HTTP/1.1" 201 0
2026-03-28 14:07:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLK64NEJ%252F698947020%252F600') HTTP/1.1" 204 0
2026-03-28 14:07:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LK64NEJ/698947020/600 saved to cache
2026-03-28 14:07:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item bb105475-65fd-5601-86d0-a8590c56bf0b
2026-03-28 14:07:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:07:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c84cc10>
2026-03-28 14:07:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:07:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:07:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:07:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_954e7a8e-294d-583e-8576-18c9af402ec0/954e7a8e-294d-583e-8576-18c9af402ec0_image_1.jpg HTTP/1.1" 201 0
2026-03-28 14:07:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FCK18AEJ%252F698910336%252F600') HTTP/1.1" 204 0
2026-03-28 14:07:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CK18AEJ/698910336/600 saved to cache
2026-03-28 14:07:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 954e7a8e-294d-583e-8576-18c9af402ec0
2026-03-28 14:07:30 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:07:30 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:07:30 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:07:30 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:07:30 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:07:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:07:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c6f8810>
2026-03-28 14:07:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:07:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:07:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:07:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_214771ac-26f4-5760-a178-e14681ff06b8/214771ac-26f4-5760-a178-e14681ff06b8_image_7.jpg HTTP/1.1" 201 0
2026-03-28 14:07:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FWV16UWB%252F698284438%252F600') HTTP/1.1" 204 0
2026-03-28 14:07:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WV16UWB/698284438/600 saved to cache
2026-03-28 14:07:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 214771ac-26f4-5760-a178-e14681ff06b8
2026-03-28 14:07:30 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/X11BBM/697604002/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=697604002>
2026-03-28 14:07:30 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WV16UWB/698284431/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698284431>
2026-03-28 14:07:30 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/DG19VCT/42810037?sv=2020-08-04&st=2026-03-28T14%3A07%3A30Z&se=2026-03-28T14%3A32%3A30Z&sr=b&sp=r&sig=lNJupmOisKDrrDy4iKSYnUEsaesieb3TwVNfbpOHZYc%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=DG19%20VCT-GB>
2026-03-28 14:07:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WU19VDC/698045628/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/WU19VDC/42792335?sv=2020-08-04&st=2026-03-28T14%3A03%3A50Z&se=2026-03-28T14%3A28%3A50Z&sr=b&sp=r&sig=Mqd3JjFAqa%2F7fy72g8Zcx8u%2F7XgFrycUpKRkPg1JOjA%3D)
2026-03-28 14:07:30 [bca.uk] INFO: Found listing with ID: GF23%20UCB
2026-03-28 14:07:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GF23%2520UCB%27 HTTP/1.1" 200 None
2026-03-28 14:07:30 [bca.uk] INFO: Scrape type for GF23%20UCB: 0
2026-03-28 14:07:30 [bca.uk] INFO: Found listing with ID: GY24%20CFU
2026-03-28 14:07:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GY24%2520CFU%27 HTTP/1.1" 200 None
2026-03-28 14:07:30 [bca.uk] INFO: Scrape type for GY24%20CFU: 0
2026-03-28 14:07:30 [bca.uk] INFO: Found listing with ID: HK73%20JYE
2026-03-28 14:07:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27HK73%2520JYE%27 HTTP/1.1" 200 None
2026-03-28 14:07:30 [bca.uk] INFO: Scrape type for HK73%20JYE: 0
2026-03-28 14:07:30 [bca.uk] INFO: Found listing with ID: KF73%20CNX
2026-03-28 14:07:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KF73%2520CNX%27 HTTP/1.1" 200 None
2026-03-28 14:07:30 [bca.uk] INFO: Scrape type for KF73%20CNX: 0
2026-03-28 14:07:30 [bca.uk] INFO: Found listing with ID: KJ19%20XCZ
2026-03-28 14:07:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KJ19%2520XCZ%27 HTTP/1.1" 200 None
2026-03-28 14:07:30 [bca.uk] INFO: Scrape type for KJ19%20XCZ: 0
2026-03-28 14:07:30 [bca.uk] INFO: Found listing with ID: KJ23%20NNB
2026-03-28 14:07:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KJ23%2520NNB%27 HTTP/1.1" 200 None
2026-03-28 14:07:30 [bca.uk] INFO: Scrape type for KJ23%20NNB: 0
2026-03-28 14:07:30 [bca.uk] INFO: Found listing with ID: KW24%20FNA
2026-03-28 14:07:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KW24%2520FNA%27 HTTP/1.1" 200 None
2026-03-28 14:07:31 [bca.uk] INFO: Scrape type for KW24%20FNA: 0
2026-03-28 14:07:31 [bca.uk] INFO: Found listing with ID: KY19%20TNM
2026-03-28 14:07:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KY19%2520TNM%27 HTTP/1.1" 200 None
2026-03-28 14:07:31 [bca.uk] INFO: Scrape type for KY19%20TNM: 0
2026-03-28 14:07:31 [bca.uk] INFO: Found listing with ID: LG20%20CFV
2026-03-28 14:07:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LG20%2520CFV%27 HTTP/1.1" 200 None
2026-03-28 14:07:31 [bca.uk] INFO: Scrape type for LG20%20CFV: 0
2026-03-28 14:07:31 [bca.uk] INFO: Found listing with ID: LG24%20ZDK
2026-03-28 14:07:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LG24%2520ZDK%27 HTTP/1.1" 200 None
2026-03-28 14:07:31 [bca.uk] INFO: Scrape type for LG24%20ZDK: 0
2026-03-28 14:07:31 [bca.uk] INFO: Found listing with ID: LL74%20DHM
2026-03-28 14:07:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LL74%2520DHM%27 HTTP/1.1" 200 None
2026-03-28 14:07:31 [bca.uk] INFO: Scrape type for LL74%20DHM: 0
2026-03-28 14:07:31 [bca.uk] INFO: Found listing with ID: LN24%20RKU
2026-03-28 14:07:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LN24%2520RKU%27 HTTP/1.1" 200 None
2026-03-28 14:07:31 [bca.uk] INFO: Scrape type for LN24%20RKU: 0
2026-03-28 14:07:31 [bca.uk] INFO: Found listing with ID: LS24%20EMK
2026-03-28 14:07:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LS24%2520EMK%27 HTTP/1.1" 200 None
2026-03-28 14:07:31 [bca.uk] INFO: Scrape type for LS24%20EMK: 0
2026-03-28 14:07:31 [bca.uk] INFO: Found listing with ID: LS24%20VUX
2026-03-28 14:07:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LS24%2520VUX%27 HTTP/1.1" 200 None
2026-03-28 14:07:31 [bca.uk] INFO: Scrape type for LS24%20VUX: 0
2026-03-28 14:07:31 [bca.uk] INFO: Found listing with ID: MD74%20GXE
2026-03-28 14:07:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MD74%2520GXE%27 HTTP/1.1" 200 None
2026-03-28 14:07:31 [bca.uk] INFO: Scrape type for MD74%20GXE: 0
2026-03-28 14:07:31 [bca.uk] INFO: Found listing with ID: MH24%20ZDS
2026-03-28 14:07:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MH24%2520ZDS%27 HTTP/1.1" 200 None
2026-03-28 14:07:31 [bca.uk] INFO: Scrape type for MH24%20ZDS: 0
2026-03-28 14:07:31 [bca.uk] INFO: Found listing with ID: ML74%20XNN
2026-03-28 14:07:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27ML74%2520XNN%27 HTTP/1.1" 200 None
2026-03-28 14:07:31 [bca.uk] INFO: Scrape type for ML74%20XNN: 0
2026-03-28 14:07:31 [bca.uk] INFO: Found listing with ID: MW23%20BYZ
2026-03-28 14:07:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MW23%2520BYZ%27 HTTP/1.1" 200 None
2026-03-28 14:07:31 [bca.uk] INFO: Scrape type for MW23%20BYZ: 0
2026-03-28 14:07:31 [bca.uk] INFO: Found listing with ID: MW23%20LSZ
2026-03-28 14:07:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MW23%2520LSZ%27 HTTP/1.1" 200 None
2026-03-28 14:07:31 [bca.uk] INFO: Scrape type for MW23%20LSZ: 0
2026-03-28 14:07:31 [bca.uk] INFO: Found listing with ID: OU72%20LYV
2026-03-28 14:07:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27OU72%2520LYV%27 HTTP/1.1" 200 None
2026-03-28 14:07:31 [bca.uk] INFO: Scrape type for OU72%20LYV: 0
2026-03-28 14:07:31 [bca.uk] INFO: Found listing with ID: SA69%20XVY
2026-03-28 14:07:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SA69%2520XVY%27 HTTP/1.1" 200 None
2026-03-28 14:07:31 [bca.uk] INFO: Scrape type for SA69%20XVY: 0
2026-03-28 14:07:31 [bca.uk] INFO: Found listing with ID: SC69%20XMR
2026-03-28 14:07:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SC69%2520XMR%27 HTTP/1.1" 200 None
2026-03-28 14:07:31 [bca.uk] INFO: Scrape type for SC69%20XMR: 0
2026-03-28 14:07:31 [bca.uk] INFO: Found listing with ID: SD73%20CPU
2026-03-28 14:07:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SD73%2520CPU%27 HTTP/1.1" 200 None
2026-03-28 14:07:31 [bca.uk] INFO: Scrape type for SD73%20CPU: 0
2026-03-28 14:07:31 [bca.uk] INFO: Found listing with ID: SG69%20WDL
2026-03-28 14:07:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SG69%2520WDL%27 HTTP/1.1" 200 None
2026-03-28 14:07:31 [bca.uk] INFO: Scrape type for SG69%20WDL: 0
2026-03-28 14:07:31 [bca.uk] INFO: Found listing with ID: SG71%20YGU
2026-03-28 14:07:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SG71%2520YGU%27 HTTP/1.1" 200 None
2026-03-28 14:07:31 [bca.uk] INFO: Scrape type for SG71%20YGU: 0
2026-03-28 14:07:31 [bca.uk] INFO: Found listing with ID: VK24%20NBM
2026-03-28 14:07:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27VK24%2520NBM%27 HTTP/1.1" 200 None
2026-03-28 14:07:31 [bca.uk] INFO: Scrape type for VK24%20NBM: 0
2026-03-28 14:07:31 [bca.uk] INFO: Found listing with ID: WD74%20ECW
2026-03-28 14:07:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WD74%2520ECW%27 HTTP/1.1" 200 None
2026-03-28 14:07:31 [bca.uk] INFO: Scrape type for WD74%20ECW: 2
2026-03-28 14:07:31 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ac8d9e9c-39eb-5240-a262-f61f12f295ff with identifier: WD74%20ECW
2026-03-28 14:07:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ac8d9e9c-39eb-5240-a262-f61f12f295ff with scrape type 2
2026-03-28 14:07:31 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ac8d9e9c-39eb-5240-a262-f61f12f295ff with scrape type 2
2026-03-28 14:07:31 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: ac8d9e9c-39eb-5240-a262-f61f12f295ff, identifier: WD74%20ECW
2026-03-28 14:07:31 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: ac8d9e9c-39eb-5240-a262-f61f12f295ff with identifier: WD74%20ECW
2026-03-28 14:07:31 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: ac8d9e9c-39eb-5240-a262-f61f12f295ff with identifier: WD74%20ECW
2026-03-28 14:07:31 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: ac8d9e9c-39eb-5240-a262-f61f12f295ff with identifier: WD74%20ECW to the API
2026-03-28 14:07:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:07:31 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:07:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=16&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 176,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=WD74%20ECW-GB',
'category': 'Car',
'color': 'grey',
'currency': 'GBP',
'doors_number': 5,
'engine': '2.0L',
'expiration_date': '2026-04-02T23:00:00Z',
'fuel_type': 'Petrol',
'id': 'ac8d9e9c-39eb-5240-a262-f61f12f295ff',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': False,
'license_plate': 'WD74 ECW',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=WD74%20ECW&vehicleType=*',
'listing': 'directbuy',
'location': 'Nottingham',
'make': 'VOLVO',
'model': 'XC60',
'odometer': 21257,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 32700,
'price_includes_vat': False,
'registration_date': '2025-01-01',
'seller_name': None,
'title': 'VOLVO XC60 2.0 B5P AWD PLUS DARK G/T StationWagon',
'transmission': 'automatic',
'trim': 'B5P AWD PLUS DARK G/T',
'vin': 'YV1UZM1V7S1129126',
'year': 2025}
2026-03-28 14:07:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WD74%2520ECW%27 HTTP/1.1" 200 None
2026-03-28 14:07:31 [bca.uk] INFO: Saving data for WD74%20ECW: {'auction_closing_time': 1775170800.0, 'created_time': 1773834973.842887, 'last_price_update_time': 1774706851.902504}
2026-03-28 14:07:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='WD74%2520ECW') HTTP/1.1" 204 0
2026-03-28 14:07:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698947150%27 HTTP/1.1" 200 None
2026-03-28 14:07:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698947150 not downloaded yet
2026-03-28 14:07:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:07:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2ca3df10>
2026-03-28 14:07:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:07:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:07:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:07:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_40991700-d0e5-5255-930d-6ca8fe3c072d/40991700-d0e5-5255-930d-6ca8fe3c072d_image_2.jpg HTTP/1.1" 201 0
2026-03-28 14:07:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FDF12VWL%252F698228757%252F600') HTTP/1.1" 204 0
2026-03-28 14:07:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DF12VWL/698228757/600 saved to cache
2026-03-28 14:07:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 40991700-d0e5-5255-930d-6ca8fe3c072d
2026-03-28 14:07:32 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:07:32 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:07:32 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:07:32 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:07:32 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:07:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:07:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c126cd0>
2026-03-28 14:07:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:07:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:07:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:07:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7708aee7-65e8-597e-aa3d-426819c9c319/7708aee7-65e8-597e-aa3d-426819c9c319_image_8.jpg HTTP/1.1" 201 0
2026-03-28 14:07:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FOY67JPV%252F698108014%252F600') HTTP/1.1" 204 0
2026-03-28 14:07:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/OY67JPV/698108014/600 saved to cache
2026-03-28 14:07:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 7708aee7-65e8-597e-aa3d-426819c9c319
2026-03-28 14:07:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BV61MVO/698928598/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/BV61MVO/42809949?sv=2020-08-04&st=2026-03-28T14%3A03%3A49Z&se=2026-03-28T14%3A28%3A49Z&sr=b&sp=r&sig=PJNKzVVeJy1FKQt32eUXNOOsoTV6pqchYxeSDnPTh7w%3D)
2026-03-28 14:07:32 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LK64NEJ/698947010/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=LK64NEJ-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-28 14:07:32 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/HD12PKZ/42794343?sv=2020-08-04&st=2026-03-28T14%3A07%3A30Z&se=2026-03-28T14%3A32%3A30Z&sr=b&sp=r&sig=YZpH6P9lYVvbxX67%2FUii%2FWyl8Su4sjTpWSDxxHtoHk0%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=HD12%20PKZ-GB>
2026-03-28 14:07:32 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CK18AEJ/698910319/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=CK18AEJ-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-28 14:07:32 [bca.uk] INFO: Found listing with ID: WN74%20JZX
2026-03-28 14:07:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WN74%2520JZX%27 HTTP/1.1" 200 None
2026-03-28 14:07:32 [bca.uk] INFO: Scrape type for WN74%20JZX: 2
2026-03-28 14:07:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: eb0b496f-e28f-55d2-bdef-95b9fb456764 with identifier: WN74%20JZX
2026-03-28 14:07:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item eb0b496f-e28f-55d2-bdef-95b9fb456764 with scrape type 2
2026-03-28 14:07:32 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item eb0b496f-e28f-55d2-bdef-95b9fb456764 with scrape type 2
2026-03-28 14:07:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: eb0b496f-e28f-55d2-bdef-95b9fb456764, identifier: WN74%20JZX
2026-03-28 14:07:32 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:07:32 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:07:32 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:07:32 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:07:32 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:07:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:07:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a1fe3bed0>
2026-03-28 14:07:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:07:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:07:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:07:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_40999011-32af-5ad3-a840-4cb8242ff02a/40999011-32af-5ad3-a840-4cb8242ff02a_image_8.jpg HTTP/1.1" 201 0
2026-03-28 14:07:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FFY66OTD%252F698150817%252F600') HTTP/1.1" 204 0
2026-03-28 14:07:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FY66OTD/698150817/600 saved to cache
2026-03-28 14:07:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 40999011-32af-5ad3-a840-4cb8242ff02a
2026-03-28 14:07:32 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:07:32 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:07:32 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:07:32 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:07:32 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:07:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:07:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c93a390>
2026-03-28 14:07:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:07:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:07:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:07:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d7b30cd7-3fb2-520c-9629-4539584c6e2c/d7b30cd7-3fb2-520c-9629-4539584c6e2c_image_8.jpg HTTP/1.1" 201 0
2026-03-28 14:07:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FFV17TYW%252F698768031%252F600') HTTP/1.1" 204 0
2026-03-28 14:07:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FV17TYW/698768031/600 saved to cache
2026-03-28 14:07:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item d7b30cd7-3fb2-520c-9629-4539584c6e2c
2026-03-28 14:07:32 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DF12VWL/698228752/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698228752>
2026-03-28 14:07:32 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/OY67JPV/698107989/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698107989>
2026-03-28 14:07:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KV16LDZ/698296902/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/KV16LDZ/42797857?sv=2020-08-04&st=2026-03-28T14%3A03%3A49Z&se=2026-03-28T14%3A28%3A49Z&sr=b&sp=r&sig=7pGIWvim4gxli5cifd615Lw7Q0s6ljm9z8msDK3x6Js%3D)
2026-03-28 14:07:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: eb0b496f-e28f-55d2-bdef-95b9fb456764 with identifier: WN74%20JZX
2026-03-28 14:07:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: eb0b496f-e28f-55d2-bdef-95b9fb456764 with identifier: WN74%20JZX
2026-03-28 14:07:32 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: eb0b496f-e28f-55d2-bdef-95b9fb456764 with identifier: WN74%20JZX to the API
2026-03-28 14:07:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:07:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:07:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=16&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 129,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=WN74%20JZX-GB',
'category': 'Car',
'color': 'red',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.5L',
'expiration_date': '2026-04-02T23:00:00Z',
'fuel_type': 'Petrol',
'id': 'eb0b496f-e28f-55d2-bdef-95b9fb456764',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': False,
'license_plate': 'WN74 JZX',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=WN74%20JZX&vehicleType=*',
'listing': 'directbuy',
'location': 'Measham',
'make': 'ALFA ROMEO',
'model': 'TONALE',
'odometer': 10609,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 20100,
'price_includes_vat': False,
'registration_date': '2024-01-01',
'seller_name': None,
'title': 'ALFA ROMEO TONALE 1.5 MHEV SPRINT Hatchback',
'transmission': 'automatic',
'trim': 'MHEV SPRINT',
'vin': 'ZARNASAA8R3089002',
'year': 2024}
2026-03-28 14:07:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WN74%2520JZX%27 HTTP/1.1" 200 None
2026-03-28 14:07:32 [bca.uk] INFO: Saving data for WN74%20JZX: {'auction_closing_time': 1775170800.0, 'created_time': 1773842579.387263, 'last_price_update_time': 1774706852.685217}
2026-03-28 14:07:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='WN74%2520JZX') HTTP/1.1" 204 0
2026-03-28 14:07:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698947164%27 HTTP/1.1" 200 None
2026-03-28 14:07:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698947164 not downloaded yet
2026-03-28 14:07:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NL64KGO/698157151/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/NL64KGO/42810049?sv=2020-08-04&st=2026-03-28T14%3A03%3A48Z&se=2026-03-28T14%3A28%3A48Z&sr=b&sp=r&sig=GCr8gvM5cBzuZAr6Na7pdcamsQO4tFs2xqxAknQovkg%3D)
2026-03-28 14:07:32 [bca.uk] INFO: Found listing with ID: WN74%20OBX
2026-03-28 14:07:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WN74%2520OBX%27 HTTP/1.1" 200 None
2026-03-28 14:07:32 [bca.uk] INFO: Scrape type for WN74%20OBX: 0
2026-03-28 14:07:32 [bca.uk] INFO: Found listing with ID: WR74%20XCX
2026-03-28 14:07:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WR74%2520XCX%27 HTTP/1.1" 200 None
2026-03-28 14:07:32 [bca.uk] INFO: Scrape type for WR74%20XCX: 0
2026-03-28 14:07:32 [bca.uk] INFO: Found listing with ID: YF23%20UOG
2026-03-28 14:07:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YF23%2520UOG%27 HTTP/1.1" 200 None
2026-03-28 14:07:32 [bca.uk] INFO: Scrape type for YF23%20UOG: 0
2026-03-28 14:07:32 [bca.uk] INFO: Found listing with ID: YJ73%20WSK
2026-03-28 14:07:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YJ73%2520WSK%27 HTTP/1.1" 200 None
2026-03-28 14:07:32 [bca.uk] INFO: Scrape type for YJ73%20WSK: 0
2026-03-28 14:07:32 [bca.uk] INFO: Found listing with ID: YJ73%20WUU
2026-03-28 14:07:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YJ73%2520WUU%27 HTTP/1.1" 200 None
2026-03-28 14:07:32 [bca.uk] INFO: Scrape type for YJ73%20WUU: 0
2026-03-28 14:07:32 [bca.uk] INFO: Found listing with ID: YM22%20GWY
2026-03-28 14:07:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YM22%2520GWY%27 HTTP/1.1" 200 None
2026-03-28 14:07:32 [bca.uk] INFO: Scrape type for YM22%20GWY: 0
2026-03-28 14:07:32 [bca.uk] INFO: Found listing with ID: YY73%20UHG
2026-03-28 14:07:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YY73%2520UHG%27 HTTP/1.1" 200 None
2026-03-28 14:07:32 [bca.uk] INFO: Scrape type for YY73%20UHG: 0
2026-03-28 14:07:32 [bca.uk] INFO: Found listing with ID: YY73%20UHP
2026-03-28 14:07:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YY73%2520UHP%27 HTTP/1.1" 200 None
2026-03-28 14:07:32 [bca.uk] INFO: Scrape type for YY73%20UHP: 0
2026-03-28 14:07:32 [bca.uk] INFO: Found listing with ID: YY73%20XEX
2026-03-28 14:07:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YY73%2520XEX%27 HTTP/1.1" 200 None
2026-03-28 14:07:32 [bca.uk] INFO: Scrape type for YY73%20XEX: 0
2026-03-28 14:07:32 [bca.uk] INFO: Found listing with ID: YY73%20XFS
2026-03-28 14:07:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YY73%2520XFS%27 HTTP/1.1" 200 None
2026-03-28 14:07:32 [bca.uk] INFO: Scrape type for YY73%20XFS: 0
2026-03-28 14:07:32 [bca.uk] INFO: Found listing with ID: YY73%20XHE
2026-03-28 14:07:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YY73%2520XHE%27 HTTP/1.1" 200 None
2026-03-28 14:07:32 [bca.uk] INFO: Scrape type for YY73%20XHE: 0
2026-03-28 14:07:32 [bca.uk] INFO: Found listing with ID: EK73%20WBT
2026-03-28 14:07:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27EK73%2520WBT%27 HTTP/1.1" 200 None
2026-03-28 14:07:32 [bca.uk] INFO: Scrape type for EK73%20WBT: 0
2026-03-28 14:07:32 [bca.uk] INFO: Found listing with ID: CV18%20ZGK
2026-03-28 14:07:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27CV18%2520ZGK%27 HTTP/1.1" 200 None
2026-03-28 14:07:32 [bca.uk] INFO: Scrape type for CV18%20ZGK: 2
2026-03-28 14:07:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e5dec426-a5f5-5c60-b2a6-7e67f0aae137 with identifier: CV18%20ZGK
2026-03-28 14:07:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e5dec426-a5f5-5c60-b2a6-7e67f0aae137 with scrape type 2
2026-03-28 14:07:32 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e5dec426-a5f5-5c60-b2a6-7e67f0aae137 with scrape type 2
2026-03-28 14:07:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: e5dec426-a5f5-5c60-b2a6-7e67f0aae137, identifier: CV18%20ZGK
2026-03-28 14:07:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:07:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2d7360d0>
2026-03-28 14:07:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:07:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:07:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:07:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2c7ab10e-203f-5d5d-b669-d394e3cfab8d/2c7ab10e-203f-5d5d-b669-d394e3cfab8d_image_3.jpg HTTP/1.1" 201 0
2026-03-28 14:07:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FWU19VDC%252F698045628%252F600') HTTP/1.1" 204 0
2026-03-28 14:07:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WU19VDC/698045628/600 saved to cache
2026-03-28 14:07:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 2c7ab10e-203f-5d5d-b669-d394e3cfab8d
2026-03-28 14:07:33 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WU19VDC/698045623/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698045623>
2026-03-28 14:07:33 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FY66OTD/698150805/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698150805>
2026-03-28 14:07:33 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FV17TYW/698768016/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698768016>
2026-03-28 14:07:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: e5dec426-a5f5-5c60-b2a6-7e67f0aae137 with identifier: CV18%20ZGK
2026-03-28 14:07:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: e5dec426-a5f5-5c60-b2a6-7e67f0aae137 with identifier: CV18%20ZGK
2026-03-28 14:07:33 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: e5dec426-a5f5-5c60-b2a6-7e67f0aae137 with identifier: CV18%20ZGK to the API
2026-03-28 14:07:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:07:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:07:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=16&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 270,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=CV18%20ZGK-GB',
'category': 'Car',
'color': 'orange',
'currency': 'GBP',
'doors_number': 2,
'engine': '5.0L',
'expiration_date': '2026-04-03T07:00:00Z',
'fuel_type': 'Petrol',
'id': 'e5dec426-a5f5-5c60-b2a6-7e67f0aae137',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'CV18 ZGK',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=CV18%20ZGK&vehicleType=*',
'listing': 'directbuy',
'location': 'Manchester',
'make': 'FORD',
'model': 'MUSTANG',
'odometer': 12592,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 27000,
'price_includes_vat': False,
'registration_date': '2018-01-01',
'seller_name': None,
'title': 'FORD MUSTANG 5.0 V8 GT Coupe',
'transmission': 'automatic',
'trim': 'V8 GT',
'vin': '1FA6P8NF5J5134501',
'year': 2018}
2026-03-28 14:07:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27CV18%2520ZGK%27 HTTP/1.1" 200 None
2026-03-28 14:07:33 [bca.uk] INFO: Saving data for CV18%20ZGK: {'auction_closing_time': 1775199600.0, 'created_time': 1774524532.245251, 'last_price_update_time': 1774706853.435549}
2026-03-28 14:07:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='CV18%2520ZGK') HTTP/1.1" 204 0
2026-03-28 14:07:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698947175%27 HTTP/1.1" 200 None
2026-03-28 14:07:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698947175 not downloaded yet
2026-03-28 14:07:33 [bca.uk] INFO: Found listing with ID: LM63%20VTK
2026-03-28 14:07:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LM63%2520VTK%27 HTTP/1.1" 200 None
2026-03-28 14:07:33 [bca.uk] INFO: Scrape type for LM63%20VTK: 0
2026-03-28 14:07:33 [bca.uk] INFO: Found listing with ID: KP69%20EZC
2026-03-28 14:07:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KP69%2520EZC%27 HTTP/1.1" 200 None
2026-03-28 14:07:33 [bca.uk] INFO: Scrape type for KP69%20EZC: 2
2026-03-28 14:07:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b1ab9821-660c-5151-8ad9-3d77c7355717 with identifier: KP69%20EZC
2026-03-28 14:07:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b1ab9821-660c-5151-8ad9-3d77c7355717 with scrape type 2
2026-03-28 14:07:33 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b1ab9821-660c-5151-8ad9-3d77c7355717 with scrape type 2
2026-03-28 14:07:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: b1ab9821-660c-5151-8ad9-3d77c7355717, identifier: KP69%20EZC
2026-03-28 14:07:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/DG19VCT/42810037?sv=2020-08-04&st=2026-03-28T14%3A07%3A30Z&se=2026-03-28T14%3A32%3A30Z&sr=b&sp=r&sig=lNJupmOisKDrrDy4iKSYnUEsaesieb3TwVNfbpOHZYc%3D> (referer: https://www.bca.co.uk/)
2026-03-28 14:07:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CK18AEJ/698910319/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/CK18AEJ/42809519?sv=2020-08-04&st=2026-03-28T14%3A03%3A52Z&se=2026-03-28T14%3A28%3A52Z&sr=b&sp=r&sig=tMAO1WCWalJ7mXIWRlCxzQ1Rx0voh0Hr3%2FaR8xfgZTg%3D)
2026-03-28 14:07:33 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KV16LDZ/698296899/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698296899>
2026-03-28 14:07:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: b1ab9821-660c-5151-8ad9-3d77c7355717 with identifier: KP69%20EZC
2026-03-28 14:07:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: b1ab9821-660c-5151-8ad9-3d77c7355717 with identifier: KP69%20EZC
2026-03-28 14:07:33 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: b1ab9821-660c-5151-8ad9-3d77c7355717 with identifier: KP69%20EZC to the API
2026-03-28 14:07:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:07:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:07:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=16&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 123,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=KP69%20EZC-GB',
'category': 'Car',
'color': 'grey',
'currency': 'GBP',
'doors_number': 5,
'engine': '2.0L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Diesel',
'id': 'b1ab9821-660c-5151-8ad9-3d77c7355717',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'KP69 EZC',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=KP69%20EZC&vehicleType=*',
'listing': 'auction',
'location': 'Glasgow',
'make': 'VOLKSWAGEN',
'model': 'T-ROC',
'odometer': 82347,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-01-01',
'seller_name': None,
'title': 'VOLKSWAGEN T-ROC 2.0 TDI 150 R LINE DSG Hatchback',
'transmission': 'automatic',
'trim': 'TDI 150 R LINE DSG',
'vin': 'WVGZZZA1ZKV156761',
'year': 2019}
2026-03-28 14:07:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KP69%2520EZC%27 HTTP/1.1" 200 None
2026-03-28 14:07:34 [bca.uk] INFO: Saving data for KP69%20EZC: {'auction_closing_time': 1774864800.0, 'created_time': 1774391478.930838, 'last_price_update_time': 1774706854.099491}
2026-03-28 14:07:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='KP69%2520EZC') HTTP/1.1" 204 0
2026-03-28 14:07:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698947192%27 HTTP/1.1" 200 None
2026-03-28 14:07:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698947192 not downloaded yet
2026-03-28 14:07:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:07:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c130710>
2026-03-28 14:07:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:07:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:07:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:07:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6665ad2b-5db8-5cb5-8575-3440dfdc3f0c/6665ad2b-5db8-5cb5-8575-3440dfdc3f0c_image_5.jpg HTTP/1.1" 201 0
2026-03-28 14:07:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FBV61MVO%252F698928598%252F600') HTTP/1.1" 204 0
2026-03-28 14:07:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BV61MVO/698928598/600 saved to cache
2026-03-28 14:07:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 6665ad2b-5db8-5cb5-8575-3440dfdc3f0c
2026-03-28 14:07:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:07:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c9b3850>
2026-03-28 14:07:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:07:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:07:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:07:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8b90222e-e04a-5b27-ab41-392150aadde5/8b90222e-e04a-5b27-ab41-392150aadde5_image_4.jpg HTTP/1.1" 201 0
2026-03-28 14:07:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FKV16LDZ%252F698296902%252F600') HTTP/1.1" 204 0
2026-03-28 14:07:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KV16LDZ/698296902/600 saved to cache
2026-03-28 14:07:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 8b90222e-e04a-5b27-ab41-392150aadde5
2026-03-28 14:07:34 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:07:34 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:07:34 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:07:34 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:07:34 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:07:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:07:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2d736790>
2026-03-28 14:07:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:07:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:07:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:07:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0c3c3ab5-91e6-5450-9be7-ee521ca8a766/0c3c3ab5-91e6-5450-9be7-ee521ca8a766_image_6.jpg HTTP/1.1" 201 0
2026-03-28 14:07:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FNL64KGO%252F698157151%252F600') HTTP/1.1" 204 0
2026-03-28 14:07:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NL64KGO/698157151/600 saved to cache
2026-03-28 14:07:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 0c3c3ab5-91e6-5450-9be7-ee521ca8a766
2026-03-28 14:07:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LK64NEJ/698947010/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LK64NEJ/42810513?sv=2020-08-04&st=2026-03-28T14%3A03%3A51Z&se=2026-03-28T14%3A28%3A51Z&sr=b&sp=r&sig=dZi6EyBOQ2GoK8knfBZtxM9S6O3yD8ghOm4nMLyaJjo%3D)
2026-03-28 14:07:34 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DE72KZJ/698947132/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=DE72KZJ-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-28 14:07:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/X11BBM/697604002/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/X11BBM/42809514?sv=2020-08-04&st=2026-03-28T14%3A03%3A48Z&se=2026-03-28T14%3A28%3A48Z&sr=b&sp=r&sig=iFv2U%2F%2BmiJcqZ%2BPwwi1Pjq9aw6DZNzQsG5k9GNFr4Nw%3D)
2026-03-28 14:07:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WV16UWB/698284431/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/WV16UWB/42797605?sv=2020-08-04&st=2026-03-28T14%3A03%3A48Z&se=2026-03-28T14%3A28%3A48Z&sr=b&sp=r&sig=tZmKWGpA7mZ9Rie4bcnpNzrMU30KCOw%2BfaCUNgMn820%3D)
2026-03-28 14:07:34 [bca.uk] INFO: Found listing with ID: LM58%20ZKW
2026-03-28 14:07:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LM58%2520ZKW%27 HTTP/1.1" 200 None
2026-03-28 14:07:34 [bca.uk] INFO: Scrape type for LM58%20ZKW: 0
2026-03-28 14:07:34 [bca.uk] INFO: Found listing with ID: ND66%20WXW
2026-03-28 14:07:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27ND66%2520WXW%27 HTTP/1.1" 200 None
2026-03-28 14:07:34 [bca.uk] INFO: Scrape type for ND66%20WXW: 0
2026-03-28 14:07:34 [bca.uk] INFO: Found listing with ID: PE15%20XVX
2026-03-28 14:07:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27PE15%2520XVX%27 HTTP/1.1" 200 None
2026-03-28 14:07:34 [bca.uk] INFO: Scrape type for PE15%20XVX: 0
2026-03-28 14:07:34 [bca.uk] INFO: Found listing with ID: BJ68%20DAO
2026-03-28 14:07:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BJ68%2520DAO%27 HTTP/1.1" 200 None
2026-03-28 14:07:34 [bca.uk] INFO: Scrape type for BJ68%20DAO: 2
2026-03-28 14:07:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c468ea19-6daa-574b-ac9d-4b67ddd2ca4b with identifier: BJ68%20DAO
2026-03-28 14:07:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c468ea19-6daa-574b-ac9d-4b67ddd2ca4b with scrape type 2
2026-03-28 14:07:34 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c468ea19-6daa-574b-ac9d-4b67ddd2ca4b with scrape type 2
2026-03-28 14:07:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: c468ea19-6daa-574b-ac9d-4b67ddd2ca4b, identifier: BJ68%20DAO
2026-03-28 14:07:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: c468ea19-6daa-574b-ac9d-4b67ddd2ca4b with identifier: BJ68%20DAO
2026-03-28 14:07:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: c468ea19-6daa-574b-ac9d-4b67ddd2ca4b with identifier: BJ68%20DAO
2026-03-28 14:07:34 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: c468ea19-6daa-574b-ac9d-4b67ddd2ca4b with identifier: BJ68%20DAO to the API
2026-03-28 14:07:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:07:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:07:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=16&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 179,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=BJ68%20DAO-GB',
'category': 'Car',
'color': 'white',
'currency': 'GBP',
'doors_number': 5,
'engine': '2.0L',
'expiration_date': '2026-04-03T07:00:00Z',
'fuel_type': 'Petrol',
'id': 'c468ea19-6daa-574b-ac9d-4b67ddd2ca4b',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'BJ68 DAO',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=BJ68%20DAO&vehicleType=*',
'listing': 'directbuy',
'location': 'Brighouse',
'make': 'LAND ROVER',
'model': 'R/R VELAR',
'odometer': 23347,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 22400,
'price_includes_vat': False,
'registration_date': '2018-01-01',
'seller_name': None,
'title': 'LAND ROVER R/R VELAR 2.0 P250 R-DYNAMIC HSE StationWagon',
'transmission': 'automatic',
'trim': 'P250 R-DYNAMIC HSE',
'vin': 'SALYA2AX4KA791579',
'year': 2018}
2026-03-28 14:07:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BJ68%2520DAO%27 HTTP/1.1" 200 None
2026-03-28 14:07:34 [bca.uk] INFO: Saving data for BJ68%20DAO: {'auction_closing_time': 1775199600.0, 'created_time': 1773828276.253295, 'last_price_update_time': 1774706854.796076}
2026-03-28 14:07:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='BJ68%2520DAO') HTTP/1.1" 204 0
2026-03-28 14:07:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698947199%27 HTTP/1.1" 200 None
2026-03-28 14:07:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698947199 not downloaded yet
2026-03-28 14:07:34 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DE72KZJ/698947150/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698947150>
2026-03-28 14:07:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DF12VWL/698228752/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/DF12VWL/42797174?sv=2020-08-04&st=2026-03-28T14%3A03%3A51Z&se=2026-03-28T14%3A28%3A51Z&sr=b&sp=r&sig=0mRjBtvz6tka1D82qBQ3%2FRs63GOtrqyuAG7vdnh5S9c%3D)
2026-03-28 14:07:34 [bca.uk] INFO: Found listing with ID: BN70%20UTW
2026-03-28 14:07:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BN70%2520UTW%27 HTTP/1.1" 200 None
2026-03-28 14:07:34 [bca.uk] INFO: Scrape type for BN70%20UTW: 0
2026-03-28 14:07:34 [bca.uk] INFO: Found listing with ID: DF67%20WXX
2026-03-28 14:07:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DF67%2520WXX%27 HTTP/1.1" 200 None
2026-03-28 14:07:34 [bca.uk] INFO: Scrape type for DF67%20WXX: 0
2026-03-28 14:07:34 [bca.uk] INFO: Found listing with ID: EO68%20OSM
2026-03-28 14:07:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27EO68%2520OSM%27 HTTP/1.1" 200 None
2026-03-28 14:07:34 [bca.uk] INFO: Scrape type for EO68%20OSM: 0
2026-03-28 14:07:34 [bca.uk] INFO: Found listing with ID: GM17%20BGK
2026-03-28 14:07:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GM17%2520BGK%27 HTTP/1.1" 200 None
2026-03-28 14:07:34 [bca.uk] INFO: Scrape type for GM17%20BGK: 2
2026-03-28 14:07:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7fd2c5b3-835f-5be9-8e76-17b042b02eee with identifier: GM17%20BGK
2026-03-28 14:07:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7fd2c5b3-835f-5be9-8e76-17b042b02eee with scrape type 2
2026-03-28 14:07:34 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7fd2c5b3-835f-5be9-8e76-17b042b02eee with scrape type 2
2026-03-28 14:07:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 7fd2c5b3-835f-5be9-8e76-17b042b02eee, identifier: GM17%20BGK
2026-03-28 14:07:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/OY67JPV/698107989/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/OY67JPV/42810048?sv=2020-08-04&st=2026-03-28T14%3A03%3A48Z&se=2026-03-28T14%3A28%3A48Z&sr=b&sp=r&sig=3IQnxpRCaMGCrWPQZylbi%2BiY%2FkfXKw1FEE36W3dpRwo%3D)
2026-03-28 14:07:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 7fd2c5b3-835f-5be9-8e76-17b042b02eee with identifier: GM17%20BGK
2026-03-28 14:07:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 7fd2c5b3-835f-5be9-8e76-17b042b02eee with identifier: GM17%20BGK
2026-03-28 14:07:35 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 7fd2c5b3-835f-5be9-8e76-17b042b02eee with identifier: GM17%20BGK to the API
2026-03-28 14:07:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:07:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:07:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=16&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 154,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=GM17%20BGK-GB',
'category': 'Car',
'color': 'silver',
'currency': 'GBP',
'doors_number': 5,
'engine': '2.0L',
'expiration_date': '2026-04-03T07:00:00Z',
'fuel_type': 'Diesel',
'id': '7fd2c5b3-835f-5be9-8e76-17b042b02eee',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'GM17 BGK',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=GM17%20BGK&vehicleType=*',
'listing': 'directbuy',
'location': 'Manchester',
'make': 'LAND ROVER',
'model': 'R/R VELAR',
'odometer': 82955,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 10000,
'price_includes_vat': False,
'registration_date': '2017-01-01',
'seller_name': None,
'title': 'LAND ROVER R/R VELAR 2.0 D240 SE StationWagon',
'transmission': 'automatic',
'trim': 'D240 SE',
'vin': 'SALYA2AN7JA706280',
'year': 2017}
2026-03-28 14:07:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GM17%2520BGK%27 HTTP/1.1" 200 None
2026-03-28 14:07:36 [bca.uk] INFO: Saving data for GM17%20BGK: {'auction_closing_time': 1775199600.0, 'created_time': 1773828084.803175, 'last_price_update_time': 1774706856.464902}
2026-03-28 14:07:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='GM17%2520BGK') HTTP/1.1" 204 0
2026-03-28 14:07:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698947213%27 HTTP/1.1" 200 None
2026-03-28 14:07:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698947213 not downloaded yet
2026-03-28 14:07:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WU19VDC/698045623/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/WU19VDC/42792335?sv=2020-08-04&st=2026-03-28T14%3A03%3A50Z&se=2026-03-28T14%3A28%3A50Z&sr=b&sp=r&sig=Mqd3JjFAqa%2F7fy72g8Zcx8u%2F7XgFrycUpKRkPg1JOjA%3D)
2026-03-28 14:07:36 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BV61MVO/698928578/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698928578>
2026-03-28 14:07:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FY66OTD/698150805/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/FY66OTD/42794791?sv=2020-08-04&st=2026-03-28T14%3A03%3A46Z&se=2026-03-28T14%3A28%3A46Z&sr=b&sp=r&sig=nyWr7cManqycrjqVh9Sq0fegCWU0XCSire1eKcJWKLA%3D)
2026-03-28 14:07:36 [bca.uk] INFO: Found listing with ID: KO67%20BZU
2026-03-28 14:07:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KO67%2520BZU%27 HTTP/1.1" 200 None
2026-03-28 14:07:36 [bca.uk] INFO: Scrape type for KO67%20BZU: 0
2026-03-28 14:07:36 [bca.uk] INFO: Found listing with ID: KS69%20AUH
2026-03-28 14:07:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KS69%2520AUH%27 HTTP/1.1" 200 None
2026-03-28 14:07:36 [bca.uk] INFO: Scrape type for KS69%20AUH: 0
2026-03-28 14:07:36 [bca.uk] INFO: Found listing with ID: LO66%20AAU
2026-03-28 14:07:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LO66%2520AAU%27 HTTP/1.1" 200 None
2026-03-28 14:07:36 [bca.uk] INFO: Scrape type for LO66%20AAU: 2
2026-03-28 14:07:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4cc24894-380d-599e-8cb8-99c6292297d1 with identifier: LO66%20AAU
2026-03-28 14:07:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4cc24894-380d-599e-8cb8-99c6292297d1 with scrape type 2
2026-03-28 14:07:36 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4cc24894-380d-599e-8cb8-99c6292297d1 with scrape type 2
2026-03-28 14:07:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 4cc24894-380d-599e-8cb8-99c6292297d1, identifier: LO66%20AAU
2026-03-28 14:07:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:07:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2d837090>
2026-03-28 14:07:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:07:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:07:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:07:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_82ce45e5-a8c4-552b-855d-b8e5816f3055/82ce45e5-a8c4-552b-855d-b8e5816f3055_expert_report_file_af5c38ea-6b4e-49c2-9422-35293d53e9e8.pdf HTTP/1.1" 201 0
2026-03-28 14:07:36 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item 82ce45e5-a8c4-552b-855d-b8e5816f3055
2026-03-28 14:07:36 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 82ce45e5-a8c4-552b-855d-b8e5816f3055, skipping ID generation
2026-03-28 14:07:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 82ce45e5-a8c4-552b-855d-b8e5816f3055
2026-03-28 14:07:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DDG19VCT-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-28 14:07:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=DG19VCT-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-28 14:07:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:07:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c938d50>
2026-03-28 14:07:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:07:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:07:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:07:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_954e7a8e-294d-583e-8576-18c9af402ec0/954e7a8e-294d-583e-8576-18c9af402ec0_image_0.jpg HTTP/1.1" 201 0
2026-03-28 14:07:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FCK18AEJ%252F698910319%252F600') HTTP/1.1" 204 0
2026-03-28 14:07:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CK18AEJ/698910319/600 saved to cache
2026-03-28 14:07:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 954e7a8e-294d-583e-8576-18c9af402ec0
2026-03-28 14:07:36 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 954e7a8e-294d-583e-8576-18c9af402ec0, skipping ID generation
2026-03-28 14:07:36 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 954e7a8e-294d-583e-8576-18c9af402ec0 sending to next pipeline
2026-03-28 14:07:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 954e7a8e-294d-583e-8576-18c9af402ec0, identifier: CK18%20AEJ
2026-03-28 14:07:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:07:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2ca10290>
2026-03-28 14:07:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:07:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:07:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:07:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bb105475-65fd-5601-86d0-a8590c56bf0b/bb105475-65fd-5601-86d0-a8590c56bf0b_image_0.jpg HTTP/1.1" 201 0
2026-03-28 14:07:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLK64NEJ%252F698947010%252F600') HTTP/1.1" 204 0
2026-03-28 14:07:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LK64NEJ/698947010/600 saved to cache
2026-03-28 14:07:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item bb105475-65fd-5601-86d0-a8590c56bf0b
2026-03-28 14:07:36 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: bb105475-65fd-5601-86d0-a8590c56bf0b, skipping ID generation
2026-03-28 14:07:36 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item bb105475-65fd-5601-86d0-a8590c56bf0b sending to next pipeline
2026-03-28 14:07:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: bb105475-65fd-5601-86d0-a8590c56bf0b, identifier: LK64%20NEJ
2026-03-28 14:07:37 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:07:37 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:07:37 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:07:37 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:07:37 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:07:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:07:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c59bad0>
2026-03-28 14:07:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:07:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:07:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:07:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6f52ae88-a710-5999-b75b-294cfedaf6f8/6f52ae88-a710-5999-b75b-294cfedaf6f8_image_6.jpg HTTP/1.1" 201 0
2026-03-28 14:07:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FX11BBM%252F697604002%252F600') HTTP/1.1" 204 0
2026-03-28 14:07:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/X11BBM/697604002/600 saved to cache
2026-03-28 14:07:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 6f52ae88-a710-5999-b75b-294cfedaf6f8
2026-03-28 14:07:37 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:07:37 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:07:37 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:07:37 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:07:37 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:07:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:07:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c9b85d0>
2026-03-28 14:07:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:07:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:07:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:07:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_214771ac-26f4-5760-a178-e14681ff06b8/214771ac-26f4-5760-a178-e14681ff06b8_image_6.jpg HTTP/1.1" 201 0
2026-03-28 14:07:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FWV16UWB%252F698284431%252F600') HTTP/1.1" 204 0
2026-03-28 14:07:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WV16UWB/698284431/600 saved to cache
2026-03-28 14:07:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 214771ac-26f4-5760-a178-e14681ff06b8
2026-03-28 14:07:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/HD12PKZ/42794343?sv=2020-08-04&st=2026-03-28T14%3A07%3A30Z&se=2026-03-28T14%3A32%3A30Z&sr=b&sp=r&sig=YZpH6P9lYVvbxX67%2FUii%2FWyl8Su4sjTpWSDxxHtoHk0%3D> (referer: https://www.bca.co.uk/)
2026-03-28 14:07:37 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DE72KZJ/698947175/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698947175>
2026-03-28 14:07:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KV16LDZ/698296899/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/KV16LDZ/42797857?sv=2020-08-04&st=2026-03-28T14%3A03%3A49Z&se=2026-03-28T14%3A28%3A49Z&sr=b&sp=r&sig=7pGIWvim4gxli5cifd615Lw7Q0s6ljm9z8msDK3x6Js%3D)
2026-03-28 14:07:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FV17TYW/698768016/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/FV17TYW/42807142?sv=2020-08-04&st=2026-03-28T14%3A03%3A46Z&se=2026-03-28T14%3A28%3A46Z&sr=b&sp=r&sig=3LbtNEGnFqYV4bS0F0%2BmsB%2FgfFSYLdditNDmvy7kudU%3D)
2026-03-28 14:07:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 4cc24894-380d-599e-8cb8-99c6292297d1 with identifier: LO66%20AAU
2026-03-28 14:07:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 4cc24894-380d-599e-8cb8-99c6292297d1 with identifier: LO66%20AAU
2026-03-28 14:07:37 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 4cc24894-380d-599e-8cb8-99c6292297d1 with identifier: LO66%20AAU to the API
2026-03-28 14:07:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:07:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:07:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=16&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 185,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=LO66%20AAU-GB',
'category': 'Car',
'color': 'black',
'currency': 'GBP',
'doors_number': 5,
'engine': '3.0L',
'expiration_date': '2026-04-03T07:00:00Z',
'fuel_type': 'Diesel',
'id': '4cc24894-380d-599e-8cb8-99c6292297d1',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': False,
'license_plate': 'LO66 AAU',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=LO66%20AAU&vehicleType=*',
'listing': 'directbuy',
'location': 'Brighouse',
'make': 'LAND ROVER',
'model': 'R/R SPORT',
'odometer': 112256,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 8800,
'price_includes_vat': False,
'registration_date': '2016-01-01',
'seller_name': None,
'title': 'LAND ROVER R/R SPORT 3.0 SDV6 306 HSE StationWagon',
'transmission': 'manual',
'trim': 'SDV6 306 HSE',
'vin': 'SALWA2KE9GA664788',
'year': 2016}
2026-03-28 14:07:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LO66%2520AAU%27 HTTP/1.1" 200 None
2026-03-28 14:07:37 [bca.uk] INFO: Saving data for LO66%20AAU: {'auction_closing_time': 1775199600.0, 'created_time': 1774436539.44977, 'last_price_update_time': 1774706857.606318}
2026-03-28 14:07:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='LO66%2520AAU') HTTP/1.1" 204 0
2026-03-28 14:07:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698947238%27 HTTP/1.1" 200 None
2026-03-28 14:07:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698947238 not downloaded yet
2026-03-28 14:07:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 954e7a8e-294d-583e-8576-18c9af402ec0 with identifier: CK18%20AEJ
2026-03-28 14:07:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 954e7a8e-294d-583e-8576-18c9af402ec0 with identifier: CK18%20AEJ
2026-03-28 14:07:37 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 954e7a8e-294d-583e-8576-18c9af402ec0 with identifier: CK18%20AEJ to the API
2026-03-28 14:07:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:07:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:07:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CK18AEJ/698910319/600>
{'auction_title': '',
'c_o_2_emission_value': 92,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_954e7a8e-294d-583e-8576-18c9af402ec0/954e7a8e-294d-583e-8576-18c9af402ec0_expert_report_file_05f54dd5-d3ca-45f6-9bfe-102b2b8b5947.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=CK18%20AEJ-GB',
'category': 'Car',
'color': 'blue',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.5L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Diesel',
'id': '954e7a8e-294d-583e-8576-18c9af402ec0',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'CK18 AEJ',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=CK18%20AEJ&vehicleType=*',
'listing': 'auction',
'location': 'Birmingham - Perry Barr',
'make': 'NISSAN',
'model': 'MICRA',
'odometer': 91374,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 11,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_954e7a8e-294d-583e-8576-18c9af402ec0/954e7a8e-294d-583e-8576-18c9af402ec0_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 50807,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CK18AEJ/698910319/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_954e7a8e-294d-583e-8576-18c9af402ec0/954e7a8e-294d-583e-8576-18c9af402ec0_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 50354,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CK18AEJ/698910336/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_954e7a8e-294d-583e-8576-18c9af402ec0/954e7a8e-294d-583e-8576-18c9af402ec0_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 48161,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CK18AEJ/698910355/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_954e7a8e-294d-583e-8576-18c9af402ec0/954e7a8e-294d-583e-8576-18c9af402ec0_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 48164,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CK18AEJ/698910374/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_954e7a8e-294d-583e-8576-18c9af402ec0/954e7a8e-294d-583e-8576-18c9af402ec0_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 47022,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CK18AEJ/698910391/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_954e7a8e-294d-583e-8576-18c9af402ec0/954e7a8e-294d-583e-8576-18c9af402ec0_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 46102,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CK18AEJ/698910404/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_954e7a8e-294d-583e-8576-18c9af402ec0/954e7a8e-294d-583e-8576-18c9af402ec0_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 81763,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CK18AEJ/698910428/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_954e7a8e-294d-583e-8576-18c9af402ec0/954e7a8e-294d-583e-8576-18c9af402ec0_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 78593,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CK18AEJ/698910455/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_954e7a8e-294d-583e-8576-18c9af402ec0/954e7a8e-294d-583e-8576-18c9af402ec0_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 83738,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CK18AEJ/698910480/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_954e7a8e-294d-583e-8576-18c9af402ec0/954e7a8e-294d-583e-8576-18c9af402ec0_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 76018,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CK18AEJ/698910501/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-01-01',
'seller_name': None,
'title': 'NISSAN MICRA 1.5 DCI TEKNA Hatchback',
'transmission': 'manual',
'trim': 'DCI TEKNA',
'vin': 'VNVK1400158861753',
'year': 2018}
2026-03-28 14:07:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27CK18%2520AEJ%27 HTTP/1.1" 200 None
2026-03-28 14:07:38 [bca.uk] INFO: Saving data for CK18%20AEJ: {'created_time': 1774706858.11037, 'last_price_update_time': 1774706858.110381, 'auction_closing_time': 1774864800.0}
2026-03-28 14:07:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='CK18%2520AEJ') HTTP/1.1" 204 0
2026-03-28 14:07:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: bb105475-65fd-5601-86d0-a8590c56bf0b with identifier: LK64%20NEJ
2026-03-28 14:07:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: bb105475-65fd-5601-86d0-a8590c56bf0b with identifier: LK64%20NEJ
2026-03-28 14:07:38 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: bb105475-65fd-5601-86d0-a8590c56bf0b with identifier: LK64%20NEJ to the API
2026-03-28 14:07:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:07:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:07:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LK64NEJ/698947010/600>
{'auction_title': '',
'c_o_2_emission_value': 113,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bb105475-65fd-5601-86d0-a8590c56bf0b/bb105475-65fd-5601-86d0-a8590c56bf0b_expert_report_file_99765518-3803-42d4-8708-f67e9dc2eb77.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=LK64%20NEJ-GB',
'category': 'Car',
'color': 'black',
'currency': 'GBP',
'doors_number': 4,
'engine': '2.1L',
'expiration_date': '2026-03-29T10:00:00Z',
'fuel_type': 'Diesel',
'id': 'bb105475-65fd-5601-86d0-a8590c56bf0b',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'LK64 NEJ',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=LK64%20NEJ&vehicleType=*',
'listing': 'auction',
'location': 'Birmingham - Perry Barr',
'make': 'MERCEDES-BENZ',
'model': 'C220',
'odometer': 175438,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 11,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bb105475-65fd-5601-86d0-a8590c56bf0b/bb105475-65fd-5601-86d0-a8590c56bf0b_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 50095,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LK64NEJ/698947010/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bb105475-65fd-5601-86d0-a8590c56bf0b/bb105475-65fd-5601-86d0-a8590c56bf0b_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 48195,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LK64NEJ/698947020/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bb105475-65fd-5601-86d0-a8590c56bf0b/bb105475-65fd-5601-86d0-a8590c56bf0b_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 46189,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LK64NEJ/698947033/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bb105475-65fd-5601-86d0-a8590c56bf0b/bb105475-65fd-5601-86d0-a8590c56bf0b_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 47032,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LK64NEJ/698947049/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bb105475-65fd-5601-86d0-a8590c56bf0b/bb105475-65fd-5601-86d0-a8590c56bf0b_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 43976,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LK64NEJ/698947067/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bb105475-65fd-5601-86d0-a8590c56bf0b/bb105475-65fd-5601-86d0-a8590c56bf0b_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 43053,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LK64NEJ/698947086/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bb105475-65fd-5601-86d0-a8590c56bf0b/bb105475-65fd-5601-86d0-a8590c56bf0b_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 64687,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LK64NEJ/698947115/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bb105475-65fd-5601-86d0-a8590c56bf0b/bb105475-65fd-5601-86d0-a8590c56bf0b_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 91192,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LK64NEJ/698947141/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bb105475-65fd-5601-86d0-a8590c56bf0b/bb105475-65fd-5601-86d0-a8590c56bf0b_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 98097,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LK64NEJ/698947168/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bb105475-65fd-5601-86d0-a8590c56bf0b/bb105475-65fd-5601-86d0-a8590c56bf0b_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 83166,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LK64NEJ/698947193/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2014-01-01',
'seller_name': None,
'title': 'MERCEDES-BENZ C220 2.1 B/T AMG LINE PREMIUM Saloon',
'transmission': 'manual',
'trim': 'B/T AMG LINE PREMIUM',
'vin': 'WDD2050042R002325',
'year': 2014}
2026-03-28 14:07:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LK64%2520NEJ%27 HTTP/1.1" 200 None
2026-03-28 14:07:38 [bca.uk] INFO: Saving data for LK64%20NEJ: {'created_time': 1774706858.491858, 'last_price_update_time': 1774706858.49187, 'auction_closing_time': 1774778400.0}
2026-03-28 14:07:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='LK64%2520NEJ') HTTP/1.1" 204 0
2026-03-28 14:07:38 [bca.uk] INFO: Found listing with ID: MF71%20ZHD
2026-03-28 14:07:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MF71%2520ZHD%27 HTTP/1.1" 200 None
2026-03-28 14:07:38 [bca.uk] INFO: Scrape type for MF71%20ZHD: 0
2026-03-28 14:07:38 [bca.uk] INFO: Found listing with ID: MW70%20BVB
2026-03-28 14:07:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MW70%2520BVB%27 HTTP/1.1" 200 None
2026-03-28 14:07:38 [bca.uk] INFO: Scrape type for MW70%20BVB: 2
2026-03-28 14:07:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 78745eb2-a4f7-54ee-840c-6c296eb00c5e with identifier: MW70%20BVB
2026-03-28 14:07:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 78745eb2-a4f7-54ee-840c-6c296eb00c5e with scrape type 2
2026-03-28 14:07:38 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 78745eb2-a4f7-54ee-840c-6c296eb00c5e with scrape type 2
2026-03-28 14:07:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 78745eb2-a4f7-54ee-840c-6c296eb00c5e, identifier: MW70%20BVB
2026-03-28 14:07:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698934207%27 HTTP/1.1" 200 None
2026-03-28 14:07:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698934207 not downloaded yet
2026-03-28 14:07:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DE72KZJ/698947132/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/DE72KZJ/42810405?sv=2020-08-04&st=2026-03-28T14%3A07%3A20Z&se=2026-03-28T14%3A32%3A20Z&sr=b&sp=r&sig=Rm0NJ3AfMMkhExeMwPLPfRbyOp2UoRTQE0wN25vKQGI%3D)
2026-03-28 14:07:38 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DE72KZJ/698947164/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698947164>
2026-03-28 14:07:38 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NL64KGO/698157139/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698157139>
2026-03-28 14:07:38 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DE72KZJ/698947192/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698947192>
2026-03-28 14:07:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 78745eb2-a4f7-54ee-840c-6c296eb00c5e with identifier: MW70%20BVB
2026-03-28 14:07:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 78745eb2-a4f7-54ee-840c-6c296eb00c5e with identifier: MW70%20BVB
2026-03-28 14:07:38 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 78745eb2-a4f7-54ee-840c-6c296eb00c5e with identifier: MW70%20BVB to the API
2026-03-28 14:07:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:07:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:07:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=16&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 251,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=MW70%20BVB-GB',
'category': 'Car',
'color': 'black',
'currency': 'GBP',
'doors_number': 5,
'engine': '2.0L',
'expiration_date': '2026-04-03T07:00:00Z',
'fuel_type': 'Petrol',
'id': '78745eb2-a4f7-54ee-840c-6c296eb00c5e',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'MW70 BVB',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=MW70%20BVB&vehicleType=*',
'listing': 'directbuy',
'location': 'Blackbushe',
'make': 'LAND ROVER',
'model': 'R/R SPORT',
'odometer': 30106,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 24000,
'price_includes_vat': False,
'registration_date': '2020-01-01',
'seller_name': None,
'title': 'LAND ROVER R/R SPORT 2.0 P300 HSE (7ST) StationWagon',
'transmission': 'automatic',
'trim': 'P300 HSE (7ST)',
'vin': 'SALWA2AXXMA765952',
'year': 2020}
2026-03-28 14:07:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MW70%2520BVB%27 HTTP/1.1" 200 None
2026-03-28 14:07:39 [bca.uk] INFO: Saving data for MW70%20BVB: {'auction_closing_time': 1775199600.0, 'created_time': 1773828265.997331, 'last_price_update_time': 1774706859.020408}
2026-03-28 14:07:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='MW70%2520BVB') HTTP/1.1" 204 0
2026-03-28 14:07:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698947265%27 HTTP/1.1" 200 None
2026-03-28 14:07:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698947265 not downloaded yet
2026-03-28 14:07:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:07:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a1fe78650>
2026-03-28 14:07:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:07:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:07:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:07:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_40991700-d0e5-5255-930d-6ca8fe3c072d/40991700-d0e5-5255-930d-6ca8fe3c072d_image_1.jpg HTTP/1.1" 201 0
2026-03-28 14:07:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FDF12VWL%252F698228752%252F600') HTTP/1.1" 204 0
2026-03-28 14:07:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DF12VWL/698228752/600 saved to cache
2026-03-28 14:07:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 40991700-d0e5-5255-930d-6ca8fe3c072d
2026-03-28 14:07:39 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:07:39 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:07:39 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:07:39 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:07:39 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:07:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:07:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c9dde90>
2026-03-28 14:07:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:07:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:07:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:07:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7708aee7-65e8-597e-aa3d-426819c9c319/7708aee7-65e8-597e-aa3d-426819c9c319_image_7.jpg HTTP/1.1" 201 0
2026-03-28 14:07:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FOY67JPV%252F698107989%252F600') HTTP/1.1" 204 0
2026-03-28 14:07:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/OY67JPV/698107989/600 saved to cache
2026-03-28 14:07:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 7708aee7-65e8-597e-aa3d-426819c9c319
2026-03-28 14:07:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:07:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a1fe75810>
2026-03-28 14:07:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:07:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:07:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:07:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2c7ab10e-203f-5d5d-b669-d394e3cfab8d/2c7ab10e-203f-5d5d-b669-d394e3cfab8d_image_2.jpg HTTP/1.1" 201 0
2026-03-28 14:07:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FWU19VDC%252F698045623%252F600') HTTP/1.1" 204 0
2026-03-28 14:07:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WU19VDC/698045623/600 saved to cache
2026-03-28 14:07:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 2c7ab10e-203f-5d5d-b669-d394e3cfab8d
2026-03-28 14:07:39 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:07:39 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:07:39 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:07:39 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:07:39 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:07:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:07:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c629550>
2026-03-28 14:07:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:07:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:07:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:07:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_40999011-32af-5ad3-a840-4cb8242ff02a/40999011-32af-5ad3-a840-4cb8242ff02a_image_7.jpg HTTP/1.1" 201 0
2026-03-28 14:07:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FFY66OTD%252F698150805%252F600') HTTP/1.1" 204 0
2026-03-28 14:07:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FY66OTD/698150805/600 saved to cache
2026-03-28 14:07:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 40999011-32af-5ad3-a840-4cb8242ff02a
2026-03-28 14:07:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BV61MVO/698928578/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/BV61MVO/42809949?sv=2020-08-04&st=2026-03-28T14%3A03%3A49Z&se=2026-03-28T14%3A28%3A49Z&sr=b&sp=r&sig=PJNKzVVeJy1FKQt32eUXNOOsoTV6pqchYxeSDnPTh7w%3D)
2026-03-28 14:07:39 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/X11BBM/697603988/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=697603988>
2026-03-28 14:07:39 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WV16UWB/698284425/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698284425>
2026-03-28 14:07:39 [bca.uk] INFO: Found listing with ID: OY17%20KRU
2026-03-28 14:07:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27OY17%2520KRU%27 HTTP/1.1" 200 None
2026-03-28 14:07:39 [bca.uk] INFO: Scrape type for OY17%20KRU: 0
2026-03-28 14:07:39 [bca.uk] INFO: Found listing with ID: OY17%20SPZ
2026-03-28 14:07:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27OY17%2520SPZ%27 HTTP/1.1" 200 None
2026-03-28 14:07:39 [bca.uk] INFO: Scrape type for OY17%20SPZ: 0
2026-03-28 14:07:39 [bca.uk] INFO: Found listing with ID: OY66%20YSS
2026-03-28 14:07:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27OY66%2520YSS%27 HTTP/1.1" 200 None
2026-03-28 14:07:39 [bca.uk] INFO: Scrape type for OY66%20YSS: 0
2026-03-28 14:07:39 [bca.uk] INFO: Found listing with ID: YC68%20MYL
2026-03-28 14:07:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YC68%2520MYL%27 HTTP/1.1" 200 None
2026-03-28 14:07:39 [bca.uk] INFO: Scrape type for YC68%20MYL: 0
2026-03-28 14:07:39 [bca.uk] INFO: Found listing with ID: RO72%20MAE
2026-03-28 14:07:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27RO72%2520MAE%27 HTTP/1.1" 200 None
2026-03-28 14:07:39 [bca.uk] INFO: Scrape type for RO72%20MAE: 0
2026-03-28 14:07:39 [bca.uk] INFO: Found listing with ID: DS65%20OCU
2026-03-28 14:07:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DS65%2520OCU%27 HTTP/1.1" 200 None
2026-03-28 14:07:39 [bca.uk] INFO: Scrape type for DS65%20OCU: 0
2026-03-28 14:07:39 [bca.uk] INFO: Found listing with ID: FE67%20JCX
2026-03-28 14:07:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FE67%2520JCX%27 HTTP/1.1" 200 None
2026-03-28 14:07:39 [bca.uk] INFO: Scrape type for FE67%20JCX: 0
2026-03-28 14:07:39 [bca.uk] INFO: Found listing with ID: HT68%20ERK
2026-03-28 14:07:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27HT68%2520ERK%27 HTTP/1.1" 200 None
2026-03-28 14:07:39 [bca.uk] INFO: Scrape type for HT68%20ERK: 0
2026-03-28 14:07:39 [bca.uk] INFO: Found listing with ID: KU65%20DZH
2026-03-28 14:07:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KU65%2520DZH%27 HTTP/1.1" 200 None
2026-03-28 14:07:39 [bca.uk] INFO: Scrape type for KU65%20DZH: 0
2026-03-28 14:07:39 [bca.uk] INFO: Found listing with ID: SB12%20AFZ
2026-03-28 14:07:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SB12%2520AFZ%27 HTTP/1.1" 200 None
2026-03-28 14:07:39 [bca.uk] INFO: Scrape type for SB12%20AFZ: 0
2026-03-28 14:07:39 [bca.uk] INFO: Found listing with ID: SB64%20HJV
2026-03-28 14:07:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SB64%2520HJV%27 HTTP/1.1" 200 None
2026-03-28 14:07:39 [bca.uk] INFO: Scrape type for SB64%20HJV: 0
2026-03-28 14:07:39 [bca.uk] INFO: Found listing with ID: CJ19%20GAA
2026-03-28 14:07:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27CJ19%2520GAA%27 HTTP/1.1" 200 None
2026-03-28 14:07:39 [bca.uk] INFO: Scrape type for CJ19%20GAA: 0
2026-03-28 14:07:39 [bca.uk] INFO: Found listing with ID: SB19%20OJD
2026-03-28 14:07:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SB19%2520OJD%27 HTTP/1.1" 200 None
2026-03-28 14:07:39 [bca.uk] INFO: Scrape type for SB19%20OJD: 0
2026-03-28 14:07:39 [bca.uk] INFO: Found listing with ID: EK22%20EKC
2026-03-28 14:07:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27EK22%2520EKC%27 HTTP/1.1" 200 None
2026-03-28 14:07:39 [bca.uk] INFO: Scrape type for EK22%20EKC: 0
2026-03-28 14:07:39 [bca.uk] INFO: Found listing with ID: GD69%20YNC
2026-03-28 14:07:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GD69%2520YNC%27 HTTP/1.1" 200 None
2026-03-28 14:07:39 [bca.uk] INFO: Scrape type for GD69%20YNC: 0
2026-03-28 14:07:39 [bca.uk] INFO: Found listing with ID: GSZ%206855
2026-03-28 14:07:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GSZ%25206855%27 HTTP/1.1" 200 None
2026-03-28 14:07:39 [bca.uk] INFO: Scrape type for GSZ%206855: 0
2026-03-28 14:07:39 [bca.uk] INFO: Found listing with ID: LL69%20HKX
2026-03-28 14:07:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LL69%2520HKX%27 HTTP/1.1" 200 None
2026-03-28 14:07:39 [bca.uk] INFO: Scrape type for LL69%20HKX: 0
2026-03-28 14:07:39 [bca.uk] INFO: Found listing with ID: LR72%20YRF
2026-03-28 14:07:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LR72%2520YRF%27 HTTP/1.1" 200 None
2026-03-28 14:07:39 [bca.uk] INFO: Scrape type for LR72%20YRF: 0
2026-03-28 14:07:39 [bca.uk] INFO: Found listing with ID: EF72%20YJG
2026-03-28 14:07:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27EF72%2520YJG%27 HTTP/1.1" 200 None
2026-03-28 14:07:39 [bca.uk] INFO: Scrape type for EF72%20YJG: 0
2026-03-28 14:07:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698934222%27 HTTP/1.1" 200 None
2026-03-28 14:07:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698934222 not downloaded yet
2026-03-28 14:07:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.bca.co.uk/api/search?q=&pageSize=100&page=17&sort=MostRecentlyAdded> (referer: https://www.bca.co.uk/search) ['zyte-api']
2026-03-28 14:07:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DE72KZJ/698947150/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/DE72KZJ/42810405?sv=2020-08-04&st=2026-03-28T14%3A07%3A20Z&se=2026-03-28T14%3A32%3A20Z&sr=b&sp=r&sig=Rm0NJ3AfMMkhExeMwPLPfRbyOp2UoRTQE0wN25vKQGI%3D)
2026-03-28 14:07:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698947286%27 HTTP/1.1" 200 None
2026-03-28 14:07:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698947286 not downloaded yet
2026-03-28 14:07:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:07:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c67f410>
2026-03-28 14:07:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:07:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:07:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:07:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d7dfafc8-5ff1-5ae1-8e11-8b4c127fde8a/d7dfafc8-5ff1-5ae1-8e11-8b4c127fde8a_expert_report_file_b31264a1-b5ef-4c13-8faf-7a7628e0805b.pdf HTTP/1.1" 201 0
2026-03-28 14:07:39 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item d7dfafc8-5ff1-5ae1-8e11-8b4c127fde8a
2026-03-28 14:07:39 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: d7dfafc8-5ff1-5ae1-8e11-8b4c127fde8a, skipping ID generation
2026-03-28 14:07:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item d7dfafc8-5ff1-5ae1-8e11-8b4c127fde8a
2026-03-28 14:07:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DHD12PKZ-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-28 14:07:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=HD12PKZ-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-28 14:07:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:07:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2d8d6210>
2026-03-28 14:07:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:07:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:07:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:07:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8b90222e-e04a-5b27-ab41-392150aadde5/8b90222e-e04a-5b27-ab41-392150aadde5_image_3.jpg HTTP/1.1" 201 0
2026-03-28 14:07:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FKV16LDZ%252F698296899%252F600') HTTP/1.1" 204 0
2026-03-28 14:07:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KV16LDZ/698296899/600 saved to cache
2026-03-28 14:07:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 8b90222e-e04a-5b27-ab41-392150aadde5
2026-03-28 14:07:39 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:07:39 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:07:39 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:07:39 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:07:39 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:07:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:07:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c7991d0>
2026-03-28 14:07:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:07:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:07:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:07:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d7b30cd7-3fb2-520c-9629-4539584c6e2c/d7b30cd7-3fb2-520c-9629-4539584c6e2c_image_7.jpg HTTP/1.1" 201 0
2026-03-28 14:07:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FFV17TYW%252F698768016%252F600') HTTP/1.1" 204 0
2026-03-28 14:07:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FV17TYW/698768016/600 saved to cache
2026-03-28 14:07:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item d7b30cd7-3fb2-520c-9629-4539584c6e2c
2026-03-28 14:07:39 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/KR71ZWG/42809993?sv=2020-08-04&st=2026-03-28T14%3A07%3A39Z&se=2026-03-28T14%3A32%3A39Z&sr=b&sp=r&sig=q0Nwjfh7efHq7efRUVEUOaczVGuVkotTNm5IHVRKC6A%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=KR71%20ZWG-GB>
2026-03-28 14:07:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DE72KZJ/698947175/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/DE72KZJ/42810405?sv=2020-08-04&st=2026-03-28T14%3A07%3A20Z&se=2026-03-28T14%3A32%3A20Z&sr=b&sp=r&sig=Rm0NJ3AfMMkhExeMwPLPfRbyOp2UoRTQE0wN25vKQGI%3D)
2026-03-28 14:07:39 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DE72KZJ/698947199/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698947199>
2026-03-28 14:07:39 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/WD66RGU/42809743?sv=2020-08-04&st=2026-03-28T14%3A07%3A39Z&se=2026-03-28T14%3A32%3A39Z&sr=b&sp=r&sig=eU%2FGhaTr1i0XPFaLo6SDB0gBHhQi%2B9mP%2FEm%2BYcvp8RU%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=WD66%20RGU-GB>
2026-03-28 14:07:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698934237%27 HTTP/1.1" 200 None
2026-03-28 14:07:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698934237 not downloaded yet
2026-03-28 14:07:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:07:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c76e0d0>
2026-03-28 14:07:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:07:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:07:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:07:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_300e41a8-d251-59f7-802e-bbb7283fa1e6/300e41a8-d251-59f7-802e-bbb7283fa1e6_image_0.jpg HTTP/1.1" 201 0
2026-03-28 14:07:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FDE72KZJ%252F698947132%252F600') HTTP/1.1" 204 0
2026-03-28 14:07:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DE72KZJ/698947132/600 saved to cache
2026-03-28 14:07:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 300e41a8-d251-59f7-802e-bbb7283fa1e6
2026-03-28 14:07:39 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/OY67JPV/698107963/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698107963>
2026-03-28 14:07:39 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DE72KZJ/698947213/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698947213>
2026-03-28 14:07:39 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DF12VWL/698228746/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=DF12VWL-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-28 14:07:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698107317%27 HTTP/1.1" 200 None
2026-03-28 14:07:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698107317 not downloaded yet
2026-03-28 14:07:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:07:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c443390>
2026-03-28 14:07:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:07:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:07:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:07:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6665ad2b-5db8-5cb5-8575-3440dfdc3f0c/6665ad2b-5db8-5cb5-8575-3440dfdc3f0c_image_4.jpg HTTP/1.1" 201 0
2026-03-28 14:07:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FBV61MVO%252F698928578%252F600') HTTP/1.1" 204 0
2026-03-28 14:07:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BV61MVO/698928578/600 saved to cache
2026-03-28 14:07:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 6665ad2b-5db8-5cb5-8575-3440dfdc3f0c
2026-03-28 14:07:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DE72KZJ/698947192/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/DE72KZJ/42810405?sv=2020-08-04&st=2026-03-28T14%3A07%3A20Z&se=2026-03-28T14%3A32%3A20Z&sr=b&sp=r&sig=Rm0NJ3AfMMkhExeMwPLPfRbyOp2UoRTQE0wN25vKQGI%3D)
2026-03-28 14:07:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698934252%27 HTTP/1.1" 200 None
2026-03-28 14:07:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698934252 not downloaded yet
2026-03-28 14:07:39 [bca.uk] INFO: Total items found: 100
2026-03-28 14:07:39 [bca.uk] INFO: Requesting URL: https://www.bca.co.uk/api/search?q=&pageSize=100&page=18&sort=MostRecentlyAdded
2026-03-28 14:07:39 [bca.uk] INFO: Sending search API request with Bearer token (length=1492)
2026-03-28 14:07:39 [scrapy_zyte_api._params] WARNING: Request <GET https://www.bca.co.uk/api/search?q=&pageSize=100&page=18&sort=MostRecentlyAdded> defines the Zyte API customHttpRequestHeaders parameter, overriding Request.headers. Use Request.headers instead.
2026-03-28 14:07:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:07:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a1fdb5150>
2026-03-28 14:07:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:07:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:07:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:07:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_300e41a8-d251-59f7-802e-bbb7283fa1e6/300e41a8-d251-59f7-802e-bbb7283fa1e6_image_1.jpg HTTP/1.1" 201 0
2026-03-28 14:07:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FDE72KZJ%252F698947150%252F600') HTTP/1.1" 204 0
2026-03-28 14:07:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DE72KZJ/698947150/600 saved to cache
2026-03-28 14:07:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 300e41a8-d251-59f7-802e-bbb7283fa1e6
2026-03-28 14:07:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NL64KGO/698157139/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/NL64KGO/42810049?sv=2020-08-04&st=2026-03-28T14%3A03%3A48Z&se=2026-03-28T14%3A28%3A48Z&sr=b&sp=r&sig=GCr8gvM5cBzuZAr6Na7pdcamsQO4tFs2xqxAknQovkg%3D)
2026-03-28 14:07:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WV16UWB/698284425/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/WV16UWB/42797605?sv=2020-08-04&st=2026-03-28T14%3A03%3A48Z&se=2026-03-28T14%3A28%3A48Z&sr=b&sp=r&sig=tZmKWGpA7mZ9Rie4bcnpNzrMU30KCOw%2BfaCUNgMn820%3D)
2026-03-28 14:07:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DE72KZJ/698947164/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/DE72KZJ/42810405?sv=2020-08-04&st=2026-03-28T14%3A07%3A20Z&se=2026-03-28T14%3A32%3A20Z&sr=b&sp=r&sig=Rm0NJ3AfMMkhExeMwPLPfRbyOp2UoRTQE0wN25vKQGI%3D)
2026-03-28 14:07:40 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DE72KZJ/698947238/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698947238>
2026-03-28 14:07:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698107334%27 HTTP/1.1" 200 None
2026-03-28 14:07:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698107334 not downloaded yet
2026-03-28 14:07:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/X11BBM/697603988/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/X11BBM/42809514?sv=2020-08-04&st=2026-03-28T14%3A03%3A48Z&se=2026-03-28T14%3A28%3A48Z&sr=b&sp=r&sig=iFv2U%2F%2BmiJcqZ%2BPwwi1Pjq9aw6DZNzQsG5k9GNFr4Nw%3D)
2026-03-28 14:07:40 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DE72KZJ/698947265/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698947265>
2026-03-28 14:07:40 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DG19VCT/698934207/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698934207>
2026-03-28 14:07:40 [scrapy_zyte_api._params] WARNING: Request <GET https://www.bca.co.uk/api/search?q=&pageSize=100&page=18&sort=MostRecentlyAdded> defines the Zyte API customHttpRequestHeaders parameter, overriding Request.headers. Use Request.headers instead.
2026-03-28 14:07:40 [scrapy_zyte_api._params] WARNING: Request <GET https://www.bca.co.uk/api/search?q=&pageSize=100&page=18&sort=MostRecentlyAdded> defines the Zyte API customHttpRequestHeaders parameter, overriding Request.headers. Use Request.headers instead.
2026-03-28 14:07:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698934270%27 HTTP/1.1" 200 None
2026-03-28 14:07:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698934270 not downloaded yet
2026-03-28 14:07:40 [bca.uk] INFO: Found listing with ID: LY16%20SWW
2026-03-28 14:07:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LY16%2520SWW%27 HTTP/1.1" 200 None
2026-03-28 14:07:40 [bca.uk] INFO: Scrape type for LY16%20SWW: 0
2026-03-28 14:07:40 [bca.uk] INFO: Found listing with ID: LT14%20MTK
2026-03-28 14:07:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LT14%2520MTK%27 HTTP/1.1" 200 None
2026-03-28 14:07:40 [bca.uk] INFO: Scrape type for LT14%20MTK: 0
2026-03-28 14:07:40 [bca.uk] INFO: Found listing with ID: MV18%20ZXU
2026-03-28 14:07:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MV18%2520ZXU%27 HTTP/1.1" 200 None
2026-03-28 14:07:40 [bca.uk] INFO: Scrape type for MV18%20ZXU: 0
2026-03-28 14:07:40 [bca.uk] INFO: Found listing with ID: SY24%20KFV
2026-03-28 14:07:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SY24%2520KFV%27 HTTP/1.1" 200 None
2026-03-28 14:07:40 [bca.uk] INFO: Scrape type for SY24%20KFV: 0
2026-03-28 14:07:40 [bca.uk] INFO: Found listing with ID: OE21%20WRR
2026-03-28 14:07:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27OE21%2520WRR%27 HTTP/1.1" 200 None
2026-03-28 14:07:40 [bca.uk] INFO: Scrape type for OE21%20WRR: 0
2026-03-28 14:07:40 [bca.uk] INFO: Found listing with ID: GD19%20SZV
2026-03-28 14:07:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GD19%2520SZV%27 HTTP/1.1" 200 None
2026-03-28 14:07:40 [bca.uk] INFO: Scrape type for GD19%20SZV: 0
2026-03-28 14:07:40 [bca.uk] INFO: Found listing with ID: KV70%20XWE
2026-03-28 14:07:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KV70%2520XWE%27 HTTP/1.1" 200 None
2026-03-28 14:07:40 [bca.uk] INFO: Scrape type for KV70%20XWE: 0
2026-03-28 14:07:40 [bca.uk] INFO: Found listing with ID: PK18%20LLR
2026-03-28 14:07:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27PK18%2520LLR%27 HTTP/1.1" 200 None
2026-03-28 14:07:40 [bca.uk] INFO: Scrape type for PK18%20LLR: 0
2026-03-28 14:07:40 [bca.uk] INFO: Found listing with ID: SA20%20CZR
2026-03-28 14:07:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SA20%2520CZR%27 HTTP/1.1" 200 None
2026-03-28 14:07:40 [bca.uk] INFO: Scrape type for SA20%20CZR: 0
2026-03-28 14:07:40 [bca.uk] INFO: Found listing with ID: SR19%20ZZV
2026-03-28 14:07:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SR19%2520ZZV%27 HTTP/1.1" 200 None
2026-03-28 14:07:40 [bca.uk] INFO: Scrape type for SR19%20ZZV: 0
2026-03-28 14:07:40 [bca.uk] INFO: Found listing with ID: ST69%20RVR
2026-03-28 14:07:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27ST69%2520RVR%27 HTTP/1.1" 200 None
2026-03-28 14:07:40 [bca.uk] INFO: Scrape type for ST69%20RVR: 0
2026-03-28 14:07:40 [bca.uk] INFO: Found listing with ID: HN73%20OYE
2026-03-28 14:07:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27HN73%2520OYE%27 HTTP/1.1" 200 None
2026-03-28 14:07:40 [bca.uk] INFO: Scrape type for HN73%20OYE: 0
2026-03-28 14:07:40 [bca.uk] INFO: Found listing with ID: CV22%20JHX
2026-03-28 14:07:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27CV22%2520JHX%27 HTTP/1.1" 200 None
2026-03-28 14:07:40 [bca.uk] INFO: Scrape type for CV22%20JHX: 0
2026-03-28 14:07:40 [bca.uk] INFO: Found listing with ID: CA20%20HMO
2026-03-28 14:07:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27CA20%2520HMO%27 HTTP/1.1" 200 None
2026-03-28 14:07:40 [bca.uk] INFO: Scrape type for CA20%20HMO: 0
2026-03-28 14:07:40 [bca.uk] INFO: Found listing with ID: D21%20CPN
2026-03-28 14:07:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27D21%2520CPN%27 HTTP/1.1" 200 None
2026-03-28 14:07:40 [bca.uk] INFO: Scrape type for D21%20CPN: 0
2026-03-28 14:07:40 [bca.uk] INFO: Found listing with ID: KR70%20AOW
2026-03-28 14:07:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KR70%2520AOW%27 HTTP/1.1" 200 None
2026-03-28 14:07:40 [bca.uk] INFO: Scrape type for KR70%20AOW: 0
2026-03-28 14:07:40 [bca.uk] INFO: Found listing with ID: LM19%20YBF
2026-03-28 14:07:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LM19%2520YBF%27 HTTP/1.1" 200 None
2026-03-28 14:07:40 [bca.uk] INFO: Scrape type for LM19%20YBF: 0
2026-03-28 14:07:40 [bca.uk] INFO: Found listing with ID: MP19%20XWS
2026-03-28 14:07:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MP19%2520XWS%27 HTTP/1.1" 200 None
2026-03-28 14:07:40 [bca.uk] INFO: Scrape type for MP19%20XWS: 0
2026-03-28 14:07:40 [bca.uk] INFO: Found listing with ID: CK22%20BGY
2026-03-28 14:07:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27CK22%2520BGY%27 HTTP/1.1" 200 None
2026-03-28 14:07:40 [bca.uk] INFO: Scrape type for CK22%20BGY: 0
2026-03-28 14:07:40 [bca.uk] INFO: Found listing with ID: DE64%20WRU
2026-03-28 14:07:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DE64%2520WRU%27 HTTP/1.1" 200 None
2026-03-28 14:07:40 [bca.uk] INFO: Scrape type for DE64%20WRU: 0
2026-03-28 14:07:40 [bca.uk] INFO: Found listing with ID: BM19%20KKC
2026-03-28 14:07:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BM19%2520KKC%27 HTTP/1.1" 200 None
2026-03-28 14:07:40 [bca.uk] INFO: Scrape type for BM19%20KKC: 0
2026-03-28 14:07:40 [bca.uk] INFO: Found listing with ID: CU19%20HWD
2026-03-28 14:07:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27CU19%2520HWD%27 HTTP/1.1" 200 None
2026-03-28 14:07:40 [bca.uk] INFO: Scrape type for CU19%20HWD: 0
2026-03-28 14:07:40 [bca.uk] INFO: Found listing with ID: DA19%20JWL
2026-03-28 14:07:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DA19%2520JWL%27 HTTP/1.1" 200 None
2026-03-28 14:07:40 [bca.uk] INFO: Scrape type for DA19%20JWL: 0
2026-03-28 14:07:40 [bca.uk] INFO: Found listing with ID: WT19%20AXJ
2026-03-28 14:07:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WT19%2520AXJ%27 HTTP/1.1" 200 None
2026-03-28 14:07:40 [bca.uk] INFO: Scrape type for WT19%20AXJ: 0
2026-03-28 14:07:40 [bca.uk] INFO: Found listing with ID: YP20%20XCH
2026-03-28 14:07:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YP20%2520XCH%27 HTTP/1.1" 200 None
2026-03-28 14:07:40 [bca.uk] INFO: Scrape type for YP20%20XCH: 0
2026-03-28 14:07:40 [bca.uk] INFO: Found listing with ID: LM22%20HEV
2026-03-28 14:07:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LM22%2520HEV%27 HTTP/1.1" 200 None
2026-03-28 14:07:40 [bca.uk] INFO: Scrape type for LM22%20HEV: 0
2026-03-28 14:07:40 [bca.uk] INFO: Found listing with ID: FX18%20HGJ
2026-03-28 14:07:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FX18%2520HGJ%27 HTTP/1.1" 200 None
2026-03-28 14:07:40 [bca.uk] INFO: Scrape type for FX18%20HGJ: 0
2026-03-28 14:07:40 [bca.uk] INFO: Found listing with ID: GX10%20TFN
2026-03-28 14:07:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GX10%2520TFN%27 HTTP/1.1" 200 None
2026-03-28 14:07:40 [bca.uk] INFO: Scrape type for GX10%20TFN: 0
2026-03-28 14:07:40 [bca.uk] INFO: Found listing with ID: LR22%20POJ
2026-03-28 14:07:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LR22%2520POJ%27 HTTP/1.1" 200 None
2026-03-28 14:07:40 [bca.uk] INFO: Scrape type for LR22%20POJ: 0
2026-03-28 14:07:40 [bca.uk] INFO: Found listing with ID: MV19%20OZD
2026-03-28 14:07:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MV19%2520OZD%27 HTTP/1.1" 200 None
2026-03-28 14:07:40 [bca.uk] INFO: Scrape type for MV19%20OZD: 0
2026-03-28 14:07:40 [bca.uk] INFO: Found listing with ID: KK18%20NLT
2026-03-28 14:07:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KK18%2520NLT%27 HTTP/1.1" 200 None
2026-03-28 14:07:40 [bca.uk] INFO: Scrape type for KK18%20NLT: 0
2026-03-28 14:07:40 [bca.uk] INFO: Found listing with ID: OY68%20HXZ
2026-03-28 14:07:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27OY68%2520HXZ%27 HTTP/1.1" 200 None
2026-03-28 14:07:40 [bca.uk] INFO: Scrape type for OY68%20HXZ: 0
2026-03-28 14:07:40 [bca.uk] INFO: Found listing with ID: WK18%20TYG
2026-03-28 14:07:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WK18%2520TYG%27 HTTP/1.1" 200 None
2026-03-28 14:07:40 [bca.uk] INFO: Scrape type for WK18%20TYG: 0
2026-03-28 14:07:40 [bca.uk] INFO: Found listing with ID: KL68%20YWS
2026-03-28 14:07:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KL68%2520YWS%27 HTTP/1.1" 200 None
2026-03-28 14:07:40 [bca.uk] INFO: Scrape type for KL68%20YWS: 0
2026-03-28 14:07:40 [bca.uk] INFO: Found listing with ID: PF21%20VOH
2026-03-28 14:07:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27PF21%2520VOH%27 HTTP/1.1" 200 None
2026-03-28 14:07:40 [bca.uk] INFO: Scrape type for PF21%20VOH: 0
2026-03-28 14:07:40 [bca.uk] INFO: Found listing with ID: YT71%20ZPB
2026-03-28 14:07:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YT71%2520ZPB%27 HTTP/1.1" 200 None
2026-03-28 14:07:40 [bca.uk] INFO: Scrape type for YT71%20ZPB: 0
2026-03-28 14:07:40 [bca.uk] INFO: Found listing with ID: SC69%20VLR
2026-03-28 14:07:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SC69%2520VLR%27 HTTP/1.1" 200 None
2026-03-28 14:07:40 [bca.uk] INFO: Scrape type for SC69%20VLR: 0
2026-03-28 14:07:40 [bca.uk] INFO: Found listing with ID: YG70%20JFZ
2026-03-28 14:07:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YG70%2520JFZ%27 HTTP/1.1" 200 None
2026-03-28 14:07:40 [bca.uk] INFO: Scrape type for YG70%20JFZ: 0
2026-03-28 14:07:40 [bca.uk] INFO: Found listing with ID: LL65%20LYY
2026-03-28 14:07:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LL65%2520LYY%27 HTTP/1.1" 200 None
2026-03-28 14:07:40 [bca.uk] INFO: Scrape type for LL65%20LYY: 2
2026-03-28 14:07:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c79fd0dc-987a-5280-8b47-8c2f59c84df6 with identifier: LL65%20LYY
2026-03-28 14:07:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c79fd0dc-987a-5280-8b47-8c2f59c84df6 with scrape type 2
2026-03-28 14:07:40 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c79fd0dc-987a-5280-8b47-8c2f59c84df6 with scrape type 2
2026-03-28 14:07:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: c79fd0dc-987a-5280-8b47-8c2f59c84df6, identifier: LL65%20LYY
2026-03-28 14:07:41 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 14:07:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:07:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c14bbd0>
2026-03-28 14:07:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:07:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:07:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:07:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_300e41a8-d251-59f7-802e-bbb7283fa1e6/300e41a8-d251-59f7-802e-bbb7283fa1e6_image_3.jpg HTTP/1.1" 201 0
2026-03-28 14:07:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FDE72KZJ%252F698947175%252F600') HTTP/1.1" 204 0
2026-03-28 14:07:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DE72KZJ/698947175/600 saved to cache
2026-03-28 14:07:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 300e41a8-d251-59f7-802e-bbb7283fa1e6
2026-03-28 14:07:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698107344%27 HTTP/1.1" 200 None
2026-03-28 14:07:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698107344 not downloaded yet
2026-03-28 14:07:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: c79fd0dc-987a-5280-8b47-8c2f59c84df6 with identifier: LL65%20LYY
2026-03-28 14:07:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: c79fd0dc-987a-5280-8b47-8c2f59c84df6 with identifier: LL65%20LYY
2026-03-28 14:07:41 [scrapy.core.scraper] INFO: Dropped: Dropping expired listing: c79fd0dc-987a-5280-8b47-8c2f59c84df6 with expiration date: 2026-03-28T10:00:00Z
{'auction_title': '',
'c_o_2_emission_value': 182,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=LL65%20LYY-GB',
'category': 'Car',
'color': 'white',
'currency': 'GBP',
'doors_number': 5,
'engine': '3.0L',
'expiration_date': '2026-03-28T10:00:00Z',
'fuel_type': 'Petrol',
'id': 'c79fd0dc-987a-5280-8b47-8c2f59c84df6',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'LL65 LYY',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=LL65%20LYY&vehicleType=*',
'listing': 'auction',
'location': 'Leeds',
'make': 'AUDI',
'model': 'A7 SPORTBACK',
'odometer': 98689,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-01-01',
'seller_name': None,
'title': 'AUDI A7 SPORTBACK 3.0 TFSI 333 QUATTRO BLACK ED.S-T Hatchback',
'transmission': 'automatic',
'trim': 'TFSI 333 QUATTRO BLACK ED.S-T',
'vin': 'WAUZZZ4GXGN068941',
'year': 2015}
2026-03-28 14:07:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LL65%2520LYY%27 HTTP/1.1" 200 None
2026-03-28 14:07:41 [bca.uk] INFO: Saving data for LL65%20LYY: {'auction_closing_time': 1774692000.0, 'created_time': 1773845064.077255, 'last_price_update_time': 1774706861.167696}
2026-03-28 14:07:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='LL65%2520LYY') HTTP/1.1" 204 0
2026-03-28 14:07:41 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DG19VCT/698934194/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=DG19VCT-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-28 14:07:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DE72KZJ/698947199/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/DE72KZJ/42810405?sv=2020-08-04&st=2026-03-28T14%3A07%3A20Z&se=2026-03-28T14%3A32%3A20Z&sr=b&sp=r&sig=Rm0NJ3AfMMkhExeMwPLPfRbyOp2UoRTQE0wN25vKQGI%3D)
2026-03-28 14:07:41 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DG19VCT/698934222/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698934222>
2026-03-28 14:07:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698934297%27 HTTP/1.1" 200 None
2026-03-28 14:07:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698934297 not downloaded yet
2026-03-28 14:07:41 [bca.uk] INFO: Found listing with ID: KX19%20ZFM
2026-03-28 14:07:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KX19%2520ZFM%27 HTTP/1.1" 200 None
2026-03-28 14:07:41 [bca.uk] INFO: Scrape type for KX19%20ZFM: 0
2026-03-28 14:07:41 [bca.uk] INFO: Found listing with ID: DA14%20XSM
2026-03-28 14:07:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DA14%2520XSM%27 HTTP/1.1" 200 None
2026-03-28 14:07:41 [bca.uk] INFO: Scrape type for DA14%20XSM: 0
2026-03-28 14:07:41 [bca.uk] INFO: Found listing with ID: RX73%20ZDN
2026-03-28 14:07:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27RX73%2520ZDN%27 HTTP/1.1" 200 None
2026-03-28 14:07:41 [bca.uk] INFO: Scrape type for RX73%20ZDN: 0
2026-03-28 14:07:41 [bca.uk] INFO: Found listing with ID: GY25%20ONT
2026-03-28 14:07:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GY25%2520ONT%27 HTTP/1.1" 200 None
2026-03-28 14:07:41 [bca.uk] INFO: Scrape type for GY25%20ONT: 0
2026-03-28 14:07:41 [bca.uk] INFO: Found listing with ID: HX69%20ZKF
2026-03-28 14:07:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27HX69%2520ZKF%27 HTTP/1.1" 200 None
2026-03-28 14:07:41 [bca.uk] INFO: Scrape type for HX69%20ZKF: 0
2026-03-28 14:07:41 [bca.uk] INFO: Found listing with ID: DV20%20VXP
2026-03-28 14:07:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DV20%2520VXP%27 HTTP/1.1" 200 None
2026-03-28 14:07:41 [bca.uk] INFO: Scrape type for DV20%20VXP: 0
2026-03-28 14:07:41 [bca.uk] INFO: Found listing with ID: EF69%20NVG
2026-03-28 14:07:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27EF69%2520NVG%27 HTTP/1.1" 200 None
2026-03-28 14:07:41 [bca.uk] INFO: Scrape type for EF69%20NVG: 0
2026-03-28 14:07:41 [bca.uk] INFO: Found listing with ID: GD68%20RFO
2026-03-28 14:07:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GD68%2520RFO%27 HTTP/1.1" 200 None
2026-03-28 14:07:41 [bca.uk] INFO: Scrape type for GD68%20RFO: 0
2026-03-28 14:07:41 [bca.uk] INFO: Found listing with ID: HF18%20LDC
2026-03-28 14:07:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27HF18%2520LDC%27 HTTP/1.1" 200 None
2026-03-28 14:07:41 [bca.uk] INFO: Scrape type for HF18%20LDC: 0
2026-03-28 14:07:41 [bca.uk] INFO: Found listing with ID: HY69%20RKF
2026-03-28 14:07:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27HY69%2520RKF%27 HTTP/1.1" 200 None
2026-03-28 14:07:41 [bca.uk] INFO: Scrape type for HY69%20RKF: 0
2026-03-28 14:07:41 [bca.uk] INFO: Found listing with ID: RV19%20HHT
2026-03-28 14:07:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27RV19%2520HHT%27 HTTP/1.1" 200 None
2026-03-28 14:07:41 [bca.uk] INFO: Scrape type for RV19%20HHT: 0
2026-03-28 14:07:41 [bca.uk] INFO: Found listing with ID: DF21%20FZO
2026-03-28 14:07:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DF21%2520FZO%27 HTTP/1.1" 200 None
2026-03-28 14:07:41 [bca.uk] INFO: Scrape type for DF21%20FZO: 0
2026-03-28 14:07:41 [bca.uk] INFO: Found listing with ID: BU68%20VWW
2026-03-28 14:07:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BU68%2520VWW%27 HTTP/1.1" 200 None
2026-03-28 14:07:41 [bca.uk] INFO: Scrape type for BU68%20VWW: 0
2026-03-28 14:07:41 [bca.uk] INFO: Found listing with ID: BV19%20GVW
2026-03-28 14:07:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BV19%2520GVW%27 HTTP/1.1" 200 None
2026-03-28 14:07:41 [bca.uk] INFO: Scrape type for BV19%20GVW: 0
2026-03-28 14:07:41 [bca.uk] INFO: Found listing with ID: DG22%20CTE
2026-03-28 14:07:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DG22%2520CTE%27 HTTP/1.1" 200 None
2026-03-28 14:07:41 [bca.uk] INFO: Scrape type for DG22%20CTE: 0
2026-03-28 14:07:41 [bca.uk] INFO: Found listing with ID: ML18%20XJB
2026-03-28 14:07:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27ML18%2520XJB%27 HTTP/1.1" 200 None
2026-03-28 14:07:41 [bca.uk] INFO: Scrape type for ML18%20XJB: 0
2026-03-28 14:07:41 [bca.uk] INFO: Found listing with ID: MW69%20HFC
2026-03-28 14:07:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MW69%2520HFC%27 HTTP/1.1" 200 None
2026-03-28 14:07:41 [bca.uk] INFO: Scrape type for MW69%20HFC: 0
2026-03-28 14:07:41 [bca.uk] INFO: Found listing with ID: SA69%20LHZ
2026-03-28 14:07:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SA69%2520LHZ%27 HTTP/1.1" 200 None
2026-03-28 14:07:41 [bca.uk] INFO: Scrape type for SA69%20LHZ: 0
2026-03-28 14:07:41 [bca.uk] INFO: Found listing with ID: VX19%20FEH
2026-03-28 14:07:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27VX19%2520FEH%27 HTTP/1.1" 200 None
2026-03-28 14:07:41 [bca.uk] INFO: Scrape type for VX19%20FEH: 0
2026-03-28 14:07:41 [bca.uk] INFO: Found listing with ID: DE70%20TSU
2026-03-28 14:07:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DE70%2520TSU%27 HTTP/1.1" 200 None
2026-03-28 14:07:41 [bca.uk] INFO: Scrape type for DE70%20TSU: 0
2026-03-28 14:07:41 [bca.uk] INFO: Found listing with ID: SA18%20CFY
2026-03-28 14:07:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SA18%2520CFY%27 HTTP/1.1" 200 None
2026-03-28 14:07:41 [bca.uk] INFO: Scrape type for SA18%20CFY: 0
2026-03-28 14:07:41 [bca.uk] INFO: Found listing with ID: YF71%20WVH
2026-03-28 14:07:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YF71%2520WVH%27 HTTP/1.1" 200 None
2026-03-28 14:07:41 [bca.uk] INFO: Scrape type for YF71%20WVH: 0
2026-03-28 14:07:41 [bca.uk] INFO: Found listing with ID: YL68%20ORJ
2026-03-28 14:07:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YL68%2520ORJ%27 HTTP/1.1" 200 None
2026-03-28 14:07:41 [bca.uk] INFO: Scrape type for YL68%20ORJ: 0
2026-03-28 14:07:41 [bca.uk] INFO: Found listing with ID: YS18%20FWH
2026-03-28 14:07:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YS18%2520FWH%27 HTTP/1.1" 200 None
2026-03-28 14:07:41 [bca.uk] INFO: Scrape type for YS18%20FWH: 0
2026-03-28 14:07:41 [bca.uk] INFO: Found listing with ID: BP69%20OJJ
2026-03-28 14:07:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BP69%2520OJJ%27 HTTP/1.1" 200 None
2026-03-28 14:07:41 [bca.uk] INFO: Scrape type for BP69%20OJJ: 0
2026-03-28 14:07:41 [bca.uk] INFO: Found listing with ID: CK70%20YMM
2026-03-28 14:07:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27CK70%2520YMM%27 HTTP/1.1" 200 None
2026-03-28 14:07:41 [bca.uk] INFO: Scrape type for CK70%20YMM: 0
2026-03-28 14:07:41 [bca.uk] INFO: Found listing with ID: CX20%20KFW
2026-03-28 14:07:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27CX20%2520KFW%27 HTTP/1.1" 200 None
2026-03-28 14:07:41 [bca.uk] INFO: Scrape type for CX20%20KFW: 0
2026-03-28 14:07:41 [bca.uk] INFO: Found listing with ID: KW70%20FHN
2026-03-28 14:07:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KW70%2520FHN%27 HTTP/1.1" 200 None
2026-03-28 14:07:41 [bca.uk] INFO: Scrape type for KW70%20FHN: 0
2026-03-28 14:07:41 [bca.uk] INFO: Found listing with ID: WJ22%20BOV
2026-03-28 14:07:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WJ22%2520BOV%27 HTTP/1.1" 200 None
2026-03-28 14:07:41 [bca.uk] INFO: Scrape type for WJ22%20BOV: 0
2026-03-28 14:07:41 [bca.uk] INFO: Found listing with ID: WN18%20XLF
2026-03-28 14:07:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WN18%2520XLF%27 HTTP/1.1" 200 None
2026-03-28 14:07:41 [bca.uk] INFO: Scrape type for WN18%20XLF: 0
2026-03-28 14:07:41 [bca.uk] INFO: Found listing with ID: KN21%20ZVO
2026-03-28 14:07:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KN21%2520ZVO%27 HTTP/1.1" 200 None
2026-03-28 14:07:41 [bca.uk] INFO: Scrape type for KN21%20ZVO: 0
2026-03-28 14:07:41 [bca.uk] INFO: Found listing with ID: VK69%20CTV
2026-03-28 14:07:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27VK69%2520CTV%27 HTTP/1.1" 200 None
2026-03-28 14:07:42 [bca.uk] INFO: Scrape type for VK69%20CTV: 0
2026-03-28 14:07:42 [bca.uk] INFO: Found listing with ID: EJ22%20VBB
2026-03-28 14:07:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27EJ22%2520VBB%27 HTTP/1.1" 200 None
2026-03-28 14:07:42 [bca.uk] INFO: Scrape type for EJ22%20VBB: 0
2026-03-28 14:07:42 [bca.uk] INFO: Found listing with ID: GP68%20URE
2026-03-28 14:07:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GP68%2520URE%27 HTTP/1.1" 200 None
2026-03-28 14:07:42 [bca.uk] INFO: Scrape type for GP68%20URE: 0
2026-03-28 14:07:42 [bca.uk] INFO: Found listing with ID: KM08%20XXA
2026-03-28 14:07:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KM08%2520XXA%27 HTTP/1.1" 200 None
2026-03-28 14:07:42 [bca.uk] INFO: Scrape type for KM08%20XXA: 0
2026-03-28 14:07:42 [bca.uk] INFO: Found listing with ID: YP66%20YKK
2026-03-28 14:07:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YP66%2520YKK%27 HTTP/1.1" 200 None
2026-03-28 14:07:42 [bca.uk] INFO: Scrape type for YP66%20YKK: 0
2026-03-28 14:07:42 [bca.uk] INFO: Found listing with ID: YC13%20XDV
2026-03-28 14:07:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YC13%2520XDV%27 HTTP/1.1" 200 None
2026-03-28 14:07:42 [bca.uk] INFO: Scrape type for YC13%20XDV: 0
2026-03-28 14:07:42 [bca.uk] INFO: Found listing with ID: EX09%20CTK
2026-03-28 14:07:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27EX09%2520CTK%27 HTTP/1.1" 200 None
2026-03-28 14:07:42 [bca.uk] INFO: Scrape type for EX09%20CTK: 0
2026-03-28 14:07:42 [bca.uk] INFO: Found listing with ID: EX15%20XAZ
2026-03-28 14:07:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27EX15%2520XAZ%27 HTTP/1.1" 200 None
2026-03-28 14:07:42 [bca.uk] INFO: Scrape type for EX15%20XAZ: 0
2026-03-28 14:07:42 [bca.uk] INFO: Found listing with ID: GJ09%20UCB
2026-03-28 14:07:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GJ09%2520UCB%27 HTTP/1.1" 200 None
2026-03-28 14:07:42 [bca.uk] INFO: Scrape type for GJ09%20UCB: 0
2026-03-28 14:07:42 [bca.uk] INFO: Found listing with ID: KP61%20KHZ
2026-03-28 14:07:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KP61%2520KHZ%27 HTTP/1.1" 200 None
2026-03-28 14:07:42 [bca.uk] INFO: Scrape type for KP61%20KHZ: 0
2026-03-28 14:07:42 [bca.uk] INFO: Found listing with ID: KU14%20VPZ
2026-03-28 14:07:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KU14%2520VPZ%27 HTTP/1.1" 200 None
2026-03-28 14:07:42 [bca.uk] INFO: Scrape type for KU14%20VPZ: 0
2026-03-28 14:07:42 [bca.uk] INFO: Found listing with ID: KU62%20UWG
2026-03-28 14:07:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KU62%2520UWG%27 HTTP/1.1" 200 None
2026-03-28 14:07:42 [bca.uk] INFO: Scrape type for KU62%20UWG: 0
2026-03-28 14:07:42 [bca.uk] INFO: Found listing with ID: OY62%20KUU
2026-03-28 14:07:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27OY62%2520KUU%27 HTTP/1.1" 200 None
2026-03-28 14:07:42 [bca.uk] INFO: Scrape type for OY62%20KUU: 0
2026-03-28 14:07:42 [bca.uk] INFO: Found listing with ID: PJ11%20LRU
2026-03-28 14:07:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27PJ11%2520LRU%27 HTTP/1.1" 200 None
2026-03-28 14:07:42 [bca.uk] INFO: Scrape type for PJ11%20LRU: 0
2026-03-28 14:07:42 [bca.uk] INFO: Found listing with ID: ST13%20ZHD
2026-03-28 14:07:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27ST13%2520ZHD%27 HTTP/1.1" 200 None
2026-03-28 14:07:42 [bca.uk] INFO: Scrape type for ST13%20ZHD: 0
2026-03-28 14:07:42 [bca.uk] INFO: Found listing with ID: TT04%20RJB
2026-03-28 14:07:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27TT04%2520RJB%27 HTTP/1.1" 200 None
2026-03-28 14:07:42 [bca.uk] INFO: Scrape type for TT04%20RJB: 0
2026-03-28 14:07:42 [bca.uk] INFO: Found listing with ID: VE63%20BUO
2026-03-28 14:07:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27VE63%2520BUO%27 HTTP/1.1" 200 None
2026-03-28 14:07:42 [bca.uk] INFO: Scrape type for VE63%20BUO: 0
2026-03-28 14:07:42 [bca.uk] INFO: Found listing with ID: AO65%20AOR
2026-03-28 14:07:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27AO65%2520AOR%27 HTTP/1.1" 200 None
2026-03-28 14:07:42 [bca.uk] INFO: Scrape type for AO65%20AOR: 2
2026-03-28 14:07:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8c101d73-63cc-5061-82a8-c4ecc8d3ec9d with identifier: AO65%20AOR
2026-03-28 14:07:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8c101d73-63cc-5061-82a8-c4ecc8d3ec9d with scrape type 2
2026-03-28 14:07:42 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8c101d73-63cc-5061-82a8-c4ecc8d3ec9d with scrape type 2
2026-03-28 14:07:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 8c101d73-63cc-5061-82a8-c4ecc8d3ec9d, identifier: AO65%20AOR
2026-03-28 14:07:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:07:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2d89dd90>
2026-03-28 14:07:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:07:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:07:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:07:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_300e41a8-d251-59f7-802e-bbb7283fa1e6/300e41a8-d251-59f7-802e-bbb7283fa1e6_image_4.jpg HTTP/1.1" 201 0
2026-03-28 14:07:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FDE72KZJ%252F698947192%252F600') HTTP/1.1" 204 0
2026-03-28 14:07:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DE72KZJ/698947192/600 saved to cache
2026-03-28 14:07:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 300e41a8-d251-59f7-802e-bbb7283fa1e6
2026-03-28 14:07:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DF12VWL/698228746/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/DF12VWL/42797174?sv=2020-08-04&st=2026-03-28T14%3A03%3A51Z&se=2026-03-28T14%3A28%3A51Z&sr=b&sp=r&sig=0mRjBtvz6tka1D82qBQ3%2FRs63GOtrqyuAG7vdnh5S9c%3D)
2026-03-28 14:07:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698107360%27 HTTP/1.1" 200 None
2026-03-28 14:07:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698107360 not downloaded yet
2026-03-28 14:07:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 8c101d73-63cc-5061-82a8-c4ecc8d3ec9d with identifier: AO65%20AOR
2026-03-28 14:07:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 8c101d73-63cc-5061-82a8-c4ecc8d3ec9d with identifier: AO65%20AOR
2026-03-28 14:07:42 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 8c101d73-63cc-5061-82a8-c4ecc8d3ec9d with identifier: AO65%20AOR to the API
2026-03-28 14:07:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:07:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:07:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=17&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 98,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=AO65%20AOR-GB',
'category': 'Car',
'color': 'blue',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.4L',
'expiration_date': '2026-03-29T10:00:00Z',
'fuel_type': 'Diesel',
'id': '8c101d73-63cc-5061-82a8-c4ecc8d3ec9d',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'AO65 AOR',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=AO65%20AOR&vehicleType=*',
'listing': 'auction',
'location': 'Thurleigh',
'make': 'KIA',
'model': 'RIO',
'odometer': 149808,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-01-01',
'seller_name': None,
'title': 'KIA RIO 1.4 CRDI 3 Hatchback',
'transmission': 'manual',
'trim': 'CRDI 3',
'vin': 'KNADN514LG6585241',
'year': 2015}
2026-03-28 14:07:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27AO65%2520AOR%27 HTTP/1.1" 200 None
2026-03-28 14:07:43 [bca.uk] INFO: Saving data for AO65%20AOR: {'auction_closing_time': 1774778400.0, 'created_time': 1773960465.767597, 'last_price_update_time': 1774706863.128367}
2026-03-28 14:07:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='AO65%2520AOR') HTTP/1.1" 204 0
2026-03-28 14:07:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:07:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c711150>
2026-03-28 14:07:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:07:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:07:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:07:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0c3c3ab5-91e6-5450-9be7-ee521ca8a766/0c3c3ab5-91e6-5450-9be7-ee521ca8a766_image_5.jpg HTTP/1.1" 201 0
2026-03-28 14:07:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FNL64KGO%252F698157139%252F600') HTTP/1.1" 204 0
2026-03-28 14:07:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NL64KGO/698157139/600 saved to cache
2026-03-28 14:07:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 0c3c3ab5-91e6-5450-9be7-ee521ca8a766
2026-03-28 14:07:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:07:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c6de7d0>
2026-03-28 14:07:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:07:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:07:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:07:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_214771ac-26f4-5760-a178-e14681ff06b8/214771ac-26f4-5760-a178-e14681ff06b8_image_5.jpg HTTP/1.1" 201 0
2026-03-28 14:07:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FWV16UWB%252F698284425%252F600') HTTP/1.1" 204 0
2026-03-28 14:07:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WV16UWB/698284425/600 saved to cache
2026-03-28 14:07:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 214771ac-26f4-5760-a178-e14681ff06b8
2026-03-28 14:07:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:07:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a1fe4c950>
2026-03-28 14:07:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:07:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:07:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:07:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_300e41a8-d251-59f7-802e-bbb7283fa1e6/300e41a8-d251-59f7-802e-bbb7283fa1e6_image_2.jpg HTTP/1.1" 201 0
2026-03-28 14:07:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FDE72KZJ%252F698947164%252F600') HTTP/1.1" 204 0
2026-03-28 14:07:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DE72KZJ/698947164/600 saved to cache
2026-03-28 14:07:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 300e41a8-d251-59f7-802e-bbb7283fa1e6
2026-03-28 14:07:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:07:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2de54f10>
2026-03-28 14:07:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:07:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:07:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:07:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6f52ae88-a710-5999-b75b-294cfedaf6f8/6f52ae88-a710-5999-b75b-294cfedaf6f8_image_5.jpg HTTP/1.1" 201 0
2026-03-28 14:07:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FX11BBM%252F697603988%252F600') HTTP/1.1" 204 0
2026-03-28 14:07:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/X11BBM/697603988/600 saved to cache
2026-03-28 14:07:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 6f52ae88-a710-5999-b75b-294cfedaf6f8
2026-03-28 14:07:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/KR71ZWG/42809993?sv=2020-08-04&st=2026-03-28T14%3A07%3A39Z&se=2026-03-28T14%3A32%3A39Z&sr=b&sp=r&sig=q0Nwjfh7efHq7efRUVEUOaczVGuVkotTNm5IHVRKC6A%3D> (referer: https://www.bca.co.uk/)
2026-03-28 14:07:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DE72KZJ/698947213/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/DE72KZJ/42810405?sv=2020-08-04&st=2026-03-28T14%3A07%3A20Z&se=2026-03-28T14%3A32%3A20Z&sr=b&sp=r&sig=Rm0NJ3AfMMkhExeMwPLPfRbyOp2UoRTQE0wN25vKQGI%3D)
2026-03-28 14:07:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/OY67JPV/698107963/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/OY67JPV/42810048?sv=2020-08-04&st=2026-03-28T14%3A03%3A48Z&se=2026-03-28T14%3A28%3A48Z&sr=b&sp=r&sig=3IQnxpRCaMGCrWPQZylbi%2BiY%2FkfXKw1FEE36W3dpRwo%3D)
2026-03-28 14:07:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698934321%27 HTTP/1.1" 200 None
2026-03-28 14:07:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698934321 not downloaded yet
2026-03-28 14:07:43 [bca.uk] INFO: Found listing with ID: AU61%20VFD
2026-03-28 14:07:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27AU61%2520VFD%27 HTTP/1.1" 200 None
2026-03-28 14:07:43 [bca.uk] INFO: Scrape type for AU61%20VFD: 0
2026-03-28 14:07:43 [bca.uk] INFO: Found listing with ID: AV07%20KPN
2026-03-28 14:07:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27AV07%2520KPN%27 HTTP/1.1" 200 None
2026-03-28 14:07:43 [bca.uk] INFO: Scrape type for AV07%20KPN: 0
2026-03-28 14:07:43 [bca.uk] INFO: Found listing with ID: AV61%20LYA
2026-03-28 14:07:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27AV61%2520LYA%27 HTTP/1.1" 200 None
2026-03-28 14:07:43 [bca.uk] INFO: Scrape type for AV61%20LYA: 0
2026-03-28 14:07:43 [bca.uk] INFO: Found listing with ID: BJ07%20OXE
2026-03-28 14:07:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BJ07%2520OXE%27 HTTP/1.1" 200 None
2026-03-28 14:07:43 [bca.uk] INFO: Scrape type for BJ07%20OXE: 0
2026-03-28 14:07:43 [bca.uk] INFO: Found listing with ID: CX11%20XLL
2026-03-28 14:07:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27CX11%2520XLL%27 HTTP/1.1" 200 None
2026-03-28 14:07:43 [bca.uk] INFO: Scrape type for CX11%20XLL: 0
2026-03-28 14:07:43 [bca.uk] INFO: Found listing with ID: DP11%20NCY
2026-03-28 14:07:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DP11%2520NCY%27 HTTP/1.1" 200 None
2026-03-28 14:07:43 [bca.uk] INFO: Scrape type for DP11%20NCY: 0
2026-03-28 14:07:43 [bca.uk] INFO: Found listing with ID: EU62%20AEF
2026-03-28 14:07:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27EU62%2520AEF%27 HTTP/1.1" 200 None
2026-03-28 14:07:43 [bca.uk] INFO: Scrape type for EU62%20AEF: 0
2026-03-28 14:07:43 [bca.uk] INFO: Found listing with ID: MJ16%20FXK
2026-03-28 14:07:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MJ16%2520FXK%27 HTTP/1.1" 200 None
2026-03-28 14:07:43 [bca.uk] INFO: Scrape type for MJ16%20FXK: 0
2026-03-28 14:07:43 [bca.uk] INFO: Found listing with ID: DY09%20AUK
2026-03-28 14:07:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DY09%2520AUK%27 HTTP/1.1" 200 None
2026-03-28 14:07:43 [bca.uk] INFO: Scrape type for DY09%20AUK: 0
2026-03-28 14:07:43 [bca.uk] INFO: Found listing with ID: SD13%20NWC
2026-03-28 14:07:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SD13%2520NWC%27 HTTP/1.1" 200 None
2026-03-28 14:07:43 [bca.uk] INFO: Scrape type for SD13%20NWC: 0
2026-03-28 14:07:43 [bca.uk] INFO: Found listing with ID: YK62%20XBF
2026-03-28 14:07:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YK62%2520XBF%27 HTTP/1.1" 200 None
2026-03-28 14:07:43 [bca.uk] INFO: Scrape type for YK62%20XBF: 0
2026-03-28 14:07:43 [bca.uk] INFO: Found listing with ID: VN17%20XMU
2026-03-28 14:07:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27VN17%2520XMU%27 HTTP/1.1" 200 None
2026-03-28 14:07:43 [bca.uk] INFO: Scrape type for VN17%20XMU: 2
2026-03-28 14:07:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9c18cdca-d5d0-5915-ac3b-d36940c73bb9 with identifier: VN17%20XMU
2026-03-28 14:07:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9c18cdca-d5d0-5915-ac3b-d36940c73bb9 with scrape type 2
2026-03-28 14:07:43 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9c18cdca-d5d0-5915-ac3b-d36940c73bb9 with scrape type 2
2026-03-28 14:07:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 9c18cdca-d5d0-5915-ac3b-d36940c73bb9, identifier: VN17%20XMU
2026-03-28 14:07:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/WD66RGU/42809743?sv=2020-08-04&st=2026-03-28T14%3A07%3A39Z&se=2026-03-28T14%3A32%3A39Z&sr=b&sp=r&sig=eU%2FGhaTr1i0XPFaLo6SDB0gBHhQi%2B9mP%2FEm%2BYcvp8RU%3D> (referer: https://www.bca.co.uk/)
2026-03-28 14:07:43 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DG19VCT/698934237/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698934237>
2026-03-28 14:07:43 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HD12PKZ/698107317/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698107317>
2026-03-28 14:07:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698107376%27 HTTP/1.1" 200 None
2026-03-28 14:07:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698107376 not downloaded yet
2026-03-28 14:07:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 9c18cdca-d5d0-5915-ac3b-d36940c73bb9 with identifier: VN17%20XMU
2026-03-28 14:07:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 9c18cdca-d5d0-5915-ac3b-d36940c73bb9 with identifier: VN17%20XMU
2026-03-28 14:07:43 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 9c18cdca-d5d0-5915-ac3b-d36940c73bb9 with identifier: VN17%20XMU to the API
2026-03-28 14:07:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:07:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:07:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=17&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 123,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=VN17%20XMU-GB',
'category': 'Car',
'color': 'grey',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.5L',
'expiration_date': '2026-03-29T10:00:00Z',
'fuel_type': 'Petrol',
'id': '9c18cdca-d5d0-5915-ac3b-d36940c73bb9',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'VN17 XMU',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=VN17%20XMU&vehicleType=*',
'listing': 'auction',
'location': 'Thurleigh',
'make': 'BMW',
'model': '2 GRAN TOURER',
'odometer': 119073,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-01-01',
'seller_name': None,
'title': 'BMW 2 GRAN TOURER 1.5 218I T SE MPV',
'transmission': 'manual',
'trim': '218I T SE',
'vin': 'WBA2D320305H47414',
'year': 2017}
2026-03-28 14:07:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27VN17%2520XMU%27 HTTP/1.1" 200 None
2026-03-28 14:07:44 [bca.uk] INFO: Saving data for VN17%20XMU: {'auction_closing_time': 1774778400.0, 'created_time': 1773958056.28463, 'last_price_update_time': 1774706864.100625}
2026-03-28 14:07:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='VN17%2520XMU') HTTP/1.1" 204 0
2026-03-28 14:07:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:07:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c8b7b10>
2026-03-28 14:07:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:07:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:07:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:07:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_300e41a8-d251-59f7-802e-bbb7283fa1e6/300e41a8-d251-59f7-802e-bbb7283fa1e6_image_5.jpg HTTP/1.1" 201 0
2026-03-28 14:07:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FDE72KZJ%252F698947199%252F600') HTTP/1.1" 204 0
2026-03-28 14:07:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DE72KZJ/698947199/600 saved to cache
2026-03-28 14:07:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 300e41a8-d251-59f7-802e-bbb7283fa1e6
2026-03-28 14:07:44 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HD12PKZ/698107304/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=HD12PKZ-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-28 14:07:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DE72KZJ/698947238/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/DE72KZJ/42810405?sv=2020-08-04&st=2026-03-28T14%3A07%3A20Z&se=2026-03-28T14%3A32%3A20Z&sr=b&sp=r&sig=Rm0NJ3AfMMkhExeMwPLPfRbyOp2UoRTQE0wN25vKQGI%3D)
2026-03-28 14:07:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698934346%27 HTTP/1.1" 200 None
2026-03-28 14:07:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698934346 not downloaded yet
2026-03-28 14:07:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698107396%27 HTTP/1.1" 200 None
2026-03-28 14:07:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698107396 not downloaded yet
2026-03-28 14:07:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698934367%27 HTTP/1.1" 200 None
2026-03-28 14:07:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698934367 not downloaded yet
2026-03-28 14:07:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:07:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c0fb810>
2026-03-28 14:07:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:07:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:07:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:07:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_40991700-d0e5-5255-930d-6ca8fe3c072d/40991700-d0e5-5255-930d-6ca8fe3c072d_image_0.jpg HTTP/1.1" 201 0
2026-03-28 14:07:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FDF12VWL%252F698228746%252F600') HTTP/1.1" 204 0
2026-03-28 14:07:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DF12VWL/698228746/600 saved to cache
2026-03-28 14:07:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 40991700-d0e5-5255-930d-6ca8fe3c072d
2026-03-28 14:07:44 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 40991700-d0e5-5255-930d-6ca8fe3c072d, skipping ID generation
2026-03-28 14:07:44 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 40991700-d0e5-5255-930d-6ca8fe3c072d sending to next pipeline
2026-03-28 14:07:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 40991700-d0e5-5255-930d-6ca8fe3c072d, identifier: DF12%20VWL
2026-03-28 14:07:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:07:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c42fc10>
2026-03-28 14:07:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:07:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:07:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:07:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c1e22119-0b44-5e50-aa2c-6734ba2fd45e/c1e22119-0b44-5e50-aa2c-6734ba2fd45e_expert_report_file_9e94038e-c09f-478b-851b-1466604bc0a9.pdf HTTP/1.1" 201 0
2026-03-28 14:07:44 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item c1e22119-0b44-5e50-aa2c-6734ba2fd45e
2026-03-28 14:07:44 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: c1e22119-0b44-5e50-aa2c-6734ba2fd45e, skipping ID generation
2026-03-28 14:07:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item c1e22119-0b44-5e50-aa2c-6734ba2fd45e
2026-03-28 14:07:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DKR71ZWG-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-28 14:07:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=KR71ZWG-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-28 14:07:44 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:07:44 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:07:44 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:07:44 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:07:44 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:07:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:07:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2d780d50>
2026-03-28 14:07:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:07:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:07:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:07:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_300e41a8-d251-59f7-802e-bbb7283fa1e6/300e41a8-d251-59f7-802e-bbb7283fa1e6_image_6.jpg HTTP/1.1" 201 0
2026-03-28 14:07:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FDE72KZJ%252F698947213%252F600') HTTP/1.1" 204 0
2026-03-28 14:07:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DE72KZJ/698947213/600 saved to cache
2026-03-28 14:07:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 300e41a8-d251-59f7-802e-bbb7283fa1e6
2026-03-28 14:07:44 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:07:44 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:07:44 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:07:44 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:07:44 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:07:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:07:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2d780590>
2026-03-28 14:07:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:07:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:07:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:07:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7708aee7-65e8-597e-aa3d-426819c9c319/7708aee7-65e8-597e-aa3d-426819c9c319_image_6.jpg HTTP/1.1" 201 0
2026-03-28 14:07:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FOY67JPV%252F698107963%252F600') HTTP/1.1" 204 0
2026-03-28 14:07:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/OY67JPV/698107963/600 saved to cache
2026-03-28 14:07:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 7708aee7-65e8-597e-aa3d-426819c9c319
2026-03-28 14:07:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:07:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a1fd5a150>
2026-03-28 14:07:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:07:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:07:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:07:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5fc655ed-6705-5d8a-9f72-de0010832a06/5fc655ed-6705-5d8a-9f72-de0010832a06_expert_report_file_ff9d4d81-51b3-4bae-b2c2-dcafd024c863.pdf HTTP/1.1" 201 0
2026-03-28 14:07:44 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item 5fc655ed-6705-5d8a-9f72-de0010832a06
2026-03-28 14:07:44 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 5fc655ed-6705-5d8a-9f72-de0010832a06, skipping ID generation
2026-03-28 14:07:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 5fc655ed-6705-5d8a-9f72-de0010832a06
2026-03-28 14:07:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DWD66RGU-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-28 14:07:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=WD66RGU-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-28 14:07:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DG19VCT/698934222/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/DG19VCT/42810037?sv=2020-08-04&st=2026-03-28T14%3A07%3A30Z&se=2026-03-28T14%3A32%3A30Z&sr=b&sp=r&sig=lNJupmOisKDrrDy4iKSYnUEsaesieb3TwVNfbpOHZYc%3D)
2026-03-28 14:07:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698107417%27 HTTP/1.1" 200 None
2026-03-28 14:07:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698107417 not downloaded yet
2026-03-28 14:07:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 40991700-d0e5-5255-930d-6ca8fe3c072d with identifier: DF12%20VWL
2026-03-28 14:07:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 40991700-d0e5-5255-930d-6ca8fe3c072d with identifier: DF12%20VWL
2026-03-28 14:07:44 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 40991700-d0e5-5255-930d-6ca8fe3c072d with identifier: DF12%20VWL to the API
2026-03-28 14:07:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:07:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:07:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DF12VWL/698228746/600>
{'auction_title': '',
'c_o_2_emission_value': 137,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_40991700-d0e5-5255-930d-6ca8fe3c072d/40991700-d0e5-5255-930d-6ca8fe3c072d_expert_report_file_ed9240c8-23dd-4a11-baad-675cb8e28563.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=DF12%20VWL-GB',
'category': 'Car',
'color': 'white',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.5L',
'expiration_date': '2026-03-29T10:00:00Z',
'fuel_type': 'Diesel',
'id': '40991700-d0e5-5255-930d-6ca8fe3c072d',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'DF12 VWL',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=DF12%20VWL&vehicleType=*',
'listing': 'auction',
'location': 'Bristol',
'make': 'NISSAN',
'model': 'QASHQAI',
'odometer': 89113,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 11,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_40991700-d0e5-5255-930d-6ca8fe3c072d/40991700-d0e5-5255-930d-6ca8fe3c072d_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 44624,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DF12VWL/698228746/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_40991700-d0e5-5255-930d-6ca8fe3c072d/40991700-d0e5-5255-930d-6ca8fe3c072d_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 46230,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DF12VWL/698228752/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_40991700-d0e5-5255-930d-6ca8fe3c072d/40991700-d0e5-5255-930d-6ca8fe3c072d_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 43526,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DF12VWL/698228757/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_40991700-d0e5-5255-930d-6ca8fe3c072d/40991700-d0e5-5255-930d-6ca8fe3c072d_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 44047,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DF12VWL/698228771/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_40991700-d0e5-5255-930d-6ca8fe3c072d/40991700-d0e5-5255-930d-6ca8fe3c072d_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 43665,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DF12VWL/698228782/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_40991700-d0e5-5255-930d-6ca8fe3c072d/40991700-d0e5-5255-930d-6ca8fe3c072d_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 43884,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DF12VWL/698228796/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_40991700-d0e5-5255-930d-6ca8fe3c072d/40991700-d0e5-5255-930d-6ca8fe3c072d_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 90420,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DF12VWL/698228819/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_40991700-d0e5-5255-930d-6ca8fe3c072d/40991700-d0e5-5255-930d-6ca8fe3c072d_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 66378,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DF12VWL/698228838/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_40991700-d0e5-5255-930d-6ca8fe3c072d/40991700-d0e5-5255-930d-6ca8fe3c072d_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 73985,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DF12VWL/698228854/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_40991700-d0e5-5255-930d-6ca8fe3c072d/40991700-d0e5-5255-930d-6ca8fe3c072d_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 85092,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DF12VWL/698228887/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2012-01-01',
'seller_name': None,
'title': 'NISSAN QASHQAI 1.5 DCI 110 N-TEC+ Hatchback',
'transmission': 'manual',
'trim': 'DCI 110 N-TEC+',
'vin': 'SJNFCAJ10U2588868',
'year': 2012}
2026-03-28 14:07:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DF12%2520VWL%27 HTTP/1.1" 200 None
2026-03-28 14:07:44 [bca.uk] INFO: Saving data for DF12%20VWL: {'created_time': 1774706864.991441, 'last_price_update_time': 1774706864.991455, 'auction_closing_time': 1774778400.0}
2026-03-28 14:07:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='DF12%2520VWL') HTTP/1.1" 204 0
2026-03-28 14:07:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DG19VCT/698934207/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/DG19VCT/42810037?sv=2020-08-04&st=2026-03-28T14%3A07%3A30Z&se=2026-03-28T14%3A32%3A30Z&sr=b&sp=r&sig=lNJupmOisKDrrDy4iKSYnUEsaesieb3TwVNfbpOHZYc%3D)
2026-03-28 14:07:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DG19VCT/698934194/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/DG19VCT/42810037?sv=2020-08-04&st=2026-03-28T14%3A07%3A30Z&se=2026-03-28T14%3A32%3A30Z&sr=b&sp=r&sig=lNJupmOisKDrrDy4iKSYnUEsaesieb3TwVNfbpOHZYc%3D)
2026-03-28 14:07:45 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DG19VCT/698934270/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698934270>
2026-03-28 14:07:45 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DE72KZJ/698947286/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698947286>
2026-03-28 14:07:45 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HD12PKZ/698107344/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698107344>
2026-03-28 14:07:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HD12PKZ/698107317/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/HD12PKZ/42794343?sv=2020-08-04&st=2026-03-28T14%3A07%3A30Z&se=2026-03-28T14%3A32%3A30Z&sr=b&sp=r&sig=YZpH6P9lYVvbxX67%2FUii%2FWyl8Su4sjTpWSDxxHtoHk0%3D)
2026-03-28 14:07:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698934234%27 HTTP/1.1" 200 None
2026-03-28 14:07:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698934234 not downloaded yet
2026-03-28 14:07:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698920147%27 HTTP/1.1" 200 None
2026-03-28 14:07:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698920147 not downloaded yet
2026-03-28 14:07:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DE72KZJ/698947265/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/DE72KZJ/42810405?sv=2020-08-04&st=2026-03-28T14%3A07%3A20Z&se=2026-03-28T14%3A32%3A20Z&sr=b&sp=r&sig=Rm0NJ3AfMMkhExeMwPLPfRbyOp2UoRTQE0wN25vKQGI%3D)
2026-03-28 14:07:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698107440%27 HTTP/1.1" 200 None
2026-03-28 14:07:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698107440 not downloaded yet
2026-03-28 14:07:45 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:07:45 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:07:45 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:07:45 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:07:45 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:07:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:07:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c170c10>
2026-03-28 14:07:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:07:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:07:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:07:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_300e41a8-d251-59f7-802e-bbb7283fa1e6/300e41a8-d251-59f7-802e-bbb7283fa1e6_image_7.jpg HTTP/1.1" 201 0
2026-03-28 14:07:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FDE72KZJ%252F698947238%252F600') HTTP/1.1" 204 0
2026-03-28 14:07:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DE72KZJ/698947238/600 saved to cache
2026-03-28 14:07:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 300e41a8-d251-59f7-802e-bbb7283fa1e6
2026-03-28 14:07:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698934251%27 HTTP/1.1" 200 None
2026-03-28 14:07:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698934251 not downloaded yet
2026-03-28 14:07:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698920182%27 HTTP/1.1" 200 None
2026-03-28 14:07:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698920182 not downloaded yet
2026-03-28 14:07:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DG19VCT/698934237/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/DG19VCT/42810037?sv=2020-08-04&st=2026-03-28T14%3A07%3A30Z&se=2026-03-28T14%3A32%3A30Z&sr=b&sp=r&sig=lNJupmOisKDrrDy4iKSYnUEsaesieb3TwVNfbpOHZYc%3D)
2026-03-28 14:07:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698107458%27 HTTP/1.1" 200 None
2026-03-28 14:07:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698107458 not downloaded yet
2026-03-28 14:07:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:07:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2d9f2990>
2026-03-28 14:07:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:07:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:07:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:07:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_82ce45e5-a8c4-552b-855d-b8e5816f3055/82ce45e5-a8c4-552b-855d-b8e5816f3055_image_2.jpg HTTP/1.1" 201 0
2026-03-28 14:07:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FDG19VCT%252F698934222%252F600') HTTP/1.1" 204 0
2026-03-28 14:07:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DG19VCT/698934222/600 saved to cache
2026-03-28 14:07:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 82ce45e5-a8c4-552b-855d-b8e5816f3055
2026-03-28 14:07:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698934262%27 HTTP/1.1" 200 None
2026-03-28 14:07:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698934262 not downloaded yet
2026-03-28 14:07:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698920210%27 HTTP/1.1" 200 None
2026-03-28 14:07:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698920210 not downloaded yet
2026-03-28 14:07:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:07:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2d781410>
2026-03-28 14:07:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:07:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:07:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:07:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_82ce45e5-a8c4-552b-855d-b8e5816f3055/82ce45e5-a8c4-552b-855d-b8e5816f3055_image_1.jpg HTTP/1.1" 201 0
2026-03-28 14:07:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FDG19VCT%252F698934207%252F600') HTTP/1.1" 204 0
2026-03-28 14:07:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DG19VCT/698934207/600 saved to cache
2026-03-28 14:07:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 82ce45e5-a8c4-552b-855d-b8e5816f3055
2026-03-28 14:07:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:07:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2dd827d0>
2026-03-28 14:07:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:07:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:07:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:07:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_82ce45e5-a8c4-552b-855d-b8e5816f3055/82ce45e5-a8c4-552b-855d-b8e5816f3055_image_0.jpg HTTP/1.1" 201 0
2026-03-28 14:07:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FDG19VCT%252F698934194%252F600') HTTP/1.1" 204 0
2026-03-28 14:07:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DG19VCT/698934194/600 saved to cache
2026-03-28 14:07:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 82ce45e5-a8c4-552b-855d-b8e5816f3055
2026-03-28 14:07:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:07:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2dd35290>
2026-03-28 14:07:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:07:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:07:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:07:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d7dfafc8-5ff1-5ae1-8e11-8b4c127fde8a/d7dfafc8-5ff1-5ae1-8e11-8b4c127fde8a_image_1.jpg HTTP/1.1" 201 0
2026-03-28 14:07:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FHD12PKZ%252F698107317%252F600') HTTP/1.1" 204 0
2026-03-28 14:07:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HD12PKZ/698107317/600 saved to cache
2026-03-28 14:07:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item d7dfafc8-5ff1-5ae1-8e11-8b4c127fde8a
2026-03-28 14:07:45 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HD12PKZ/698107396/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698107396>
2026-03-28 14:07:45 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DG19VCT/698934321/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698934321>
2026-03-28 14:07:45 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HD12PKZ/698107334/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698107334>
2026-03-28 14:07:45 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DG19VCT/698934252/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698934252>
2026-03-28 14:07:45 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DG19VCT/698934297/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698934297>
2026-03-28 14:07:45 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HD12PKZ/698107360/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698107360>
2026-03-28 14:07:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HD12PKZ/698107304/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/HD12PKZ/42794343?sv=2020-08-04&st=2026-03-28T14%3A07%3A30Z&se=2026-03-28T14%3A32%3A30Z&sr=b&sp=r&sig=YZpH6P9lYVvbxX67%2FUii%2FWyl8Su4sjTpWSDxxHtoHk0%3D)
2026-03-28 14:07:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HD12PKZ/698107344/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/HD12PKZ/42794343?sv=2020-08-04&st=2026-03-28T14%3A07%3A30Z&se=2026-03-28T14%3A32%3A30Z&sr=b&sp=r&sig=YZpH6P9lYVvbxX67%2FUii%2FWyl8Su4sjTpWSDxxHtoHk0%3D)
2026-03-28 14:07:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698934286%27 HTTP/1.1" 200 None
2026-03-28 14:07:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698934286 not downloaded yet
2026-03-28 14:07:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698920231%27 HTTP/1.1" 200 None
2026-03-28 14:07:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698920231 not downloaded yet
2026-03-28 14:07:45 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:07:45 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:07:45 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:07:45 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:07:45 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:07:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:07:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2d81c110>
2026-03-28 14:07:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:07:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:07:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:07:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_300e41a8-d251-59f7-802e-bbb7283fa1e6/300e41a8-d251-59f7-802e-bbb7283fa1e6_image_8.jpg HTTP/1.1" 201 0
2026-03-28 14:07:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FDE72KZJ%252F698947265%252F600') HTTP/1.1" 204 0
2026-03-28 14:07:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DE72KZJ/698947265/600 saved to cache
2026-03-28 14:07:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 300e41a8-d251-59f7-802e-bbb7283fa1e6
2026-03-28 14:07:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698934300%27 HTTP/1.1" 200 None
2026-03-28 14:07:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698934300 not downloaded yet
2026-03-28 14:07:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698920242%27 HTTP/1.1" 200 None
2026-03-28 14:07:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698920242 not downloaded yet
2026-03-28 14:07:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:07:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2d81e890>
2026-03-28 14:07:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:07:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:07:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:07:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_82ce45e5-a8c4-552b-855d-b8e5816f3055/82ce45e5-a8c4-552b-855d-b8e5816f3055_image_3.jpg HTTP/1.1" 201 0
2026-03-28 14:07:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FDG19VCT%252F698934237%252F600') HTTP/1.1" 204 0
2026-03-28 14:07:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DG19VCT/698934237/600 saved to cache
2026-03-28 14:07:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 82ce45e5-a8c4-552b-855d-b8e5816f3055
2026-03-28 14:07:45 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HD12PKZ/698107440/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698107440>
2026-03-28 14:07:45 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WD66RGU/698920120/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=WD66RGU-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-28 14:07:45 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DG19VCT/698934367/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698934367>
2026-03-28 14:07:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698934322%27 HTTP/1.1" 200 None
2026-03-28 14:07:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698934322 not downloaded yet
2026-03-28 14:07:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698920260%27 HTTP/1.1" 200 None
2026-03-28 14:07:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698920260 not downloaded yet
2026-03-28 14:07:45 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HD12PKZ/698107417/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698107417>
2026-03-28 14:07:45 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KR71ZWG/698934212/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=KR71ZWG-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-28 14:07:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:07:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c73f550>
2026-03-28 14:07:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:07:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:07:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:07:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d7dfafc8-5ff1-5ae1-8e11-8b4c127fde8a/d7dfafc8-5ff1-5ae1-8e11-8b4c127fde8a_image_0.jpg HTTP/1.1" 201 0
2026-03-28 14:07:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FHD12PKZ%252F698107304%252F600') HTTP/1.1" 204 0
2026-03-28 14:07:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HD12PKZ/698107304/600 saved to cache
2026-03-28 14:07:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item d7dfafc8-5ff1-5ae1-8e11-8b4c127fde8a
2026-03-28 14:07:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:07:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c6c9310>
2026-03-28 14:07:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:07:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:07:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:07:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d7dfafc8-5ff1-5ae1-8e11-8b4c127fde8a/d7dfafc8-5ff1-5ae1-8e11-8b4c127fde8a_image_3.jpg HTTP/1.1" 201 0
2026-03-28 14:07:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FHD12PKZ%252F698107344%252F600') HTTP/1.1" 204 0
2026-03-28 14:07:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HD12PKZ/698107344/600 saved to cache
2026-03-28 14:07:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item d7dfafc8-5ff1-5ae1-8e11-8b4c127fde8a
2026-03-28 14:07:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DE72KZJ/698947286/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/DE72KZJ/42810405?sv=2020-08-04&st=2026-03-28T14%3A07%3A20Z&se=2026-03-28T14%3A32%3A20Z&sr=b&sp=r&sig=Rm0NJ3AfMMkhExeMwPLPfRbyOp2UoRTQE0wN25vKQGI%3D)
2026-03-28 14:07:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HD12PKZ/698107360/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/HD12PKZ/42794343?sv=2020-08-04&st=2026-03-28T14%3A07%3A30Z&se=2026-03-28T14%3A32%3A30Z&sr=b&sp=r&sig=YZpH6P9lYVvbxX67%2FUii%2FWyl8Su4sjTpWSDxxHtoHk0%3D)
2026-03-28 14:07:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DG19VCT/698934270/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/DG19VCT/42810037?sv=2020-08-04&st=2026-03-28T14%3A07%3A30Z&se=2026-03-28T14%3A32%3A30Z&sr=b&sp=r&sig=lNJupmOisKDrrDy4iKSYnUEsaesieb3TwVNfbpOHZYc%3D)
2026-03-28 14:07:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698934348%27 HTTP/1.1" 200 None
2026-03-28 14:07:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698934348 not downloaded yet
2026-03-28 14:07:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698920287%27 HTTP/1.1" 200 None
2026-03-28 14:07:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698920287 not downloaded yet
2026-03-28 14:07:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698934368%27 HTTP/1.1" 200 None
2026-03-28 14:07:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698934368 not downloaded yet
2026-03-28 14:07:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698920317%27 HTTP/1.1" 200 None
2026-03-28 14:07:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698920317 not downloaded yet
2026-03-28 14:07:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698934385%27 HTTP/1.1" 200 None
2026-03-28 14:07:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698934385 not downloaded yet
2026-03-28 14:07:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698920354%27 HTTP/1.1" 200 None
2026-03-28 14:07:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698920354 not downloaded yet
2026-03-28 14:07:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HD12PKZ/698107334/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/HD12PKZ/42794343?sv=2020-08-04&st=2026-03-28T14%3A07%3A30Z&se=2026-03-28T14%3A32%3A30Z&sr=b&sp=r&sig=YZpH6P9lYVvbxX67%2FUii%2FWyl8Su4sjTpWSDxxHtoHk0%3D)
2026-03-28 14:07:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HD12PKZ/698107396/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/HD12PKZ/42794343?sv=2020-08-04&st=2026-03-28T14%3A07%3A30Z&se=2026-03-28T14%3A32%3A30Z&sr=b&sp=r&sig=YZpH6P9lYVvbxX67%2FUii%2FWyl8Su4sjTpWSDxxHtoHk0%3D)
2026-03-28 14:07:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DG19VCT/698934297/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/DG19VCT/42810037?sv=2020-08-04&st=2026-03-28T14%3A07%3A30Z&se=2026-03-28T14%3A32%3A30Z&sr=b&sp=r&sig=lNJupmOisKDrrDy4iKSYnUEsaesieb3TwVNfbpOHZYc%3D)
2026-03-28 14:07:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KR71ZWG/698934212/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/KR71ZWG/42809993?sv=2020-08-04&st=2026-03-28T14%3A07%3A39Z&se=2026-03-28T14%3A32%3A39Z&sr=b&sp=r&sig=q0Nwjfh7efHq7efRUVEUOaczVGuVkotTNm5IHVRKC6A%3D)
2026-03-28 14:07:45 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KR71ZWG/698934262/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698934262>
2026-03-28 14:07:45 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WD66RGU/698920210/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698920210>
2026-03-28 14:07:45 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:07:45 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:07:45 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:07:45 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:07:45 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:07:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:07:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2d81fd10>
2026-03-28 14:07:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:07:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:07:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:07:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_300e41a8-d251-59f7-802e-bbb7283fa1e6/300e41a8-d251-59f7-802e-bbb7283fa1e6_image_9.jpg HTTP/1.1" 201 0
2026-03-28 14:07:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FDE72KZJ%252F698947286%252F600') HTTP/1.1" 204 0
2026-03-28 14:07:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DE72KZJ/698947286/600 saved to cache
2026-03-28 14:07:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 300e41a8-d251-59f7-802e-bbb7283fa1e6
2026-03-28 14:07:45 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 300e41a8-d251-59f7-802e-bbb7283fa1e6, skipping ID generation
2026-03-28 14:07:45 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 300e41a8-d251-59f7-802e-bbb7283fa1e6 sending to next pipeline
2026-03-28 14:07:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 300e41a8-d251-59f7-802e-bbb7283fa1e6, identifier: DE72%20KZJ
2026-03-28 14:07:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:07:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2d780d10>
2026-03-28 14:07:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:07:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:07:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:07:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d7dfafc8-5ff1-5ae1-8e11-8b4c127fde8a/d7dfafc8-5ff1-5ae1-8e11-8b4c127fde8a_image_4.jpg HTTP/1.1" 201 0
2026-03-28 14:07:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FHD12PKZ%252F698107360%252F600') HTTP/1.1" 204 0
2026-03-28 14:07:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HD12PKZ/698107360/600 saved to cache
2026-03-28 14:07:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item d7dfafc8-5ff1-5ae1-8e11-8b4c127fde8a
2026-03-28 14:07:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 300e41a8-d251-59f7-802e-bbb7283fa1e6 with identifier: DE72%20KZJ
2026-03-28 14:07:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 300e41a8-d251-59f7-802e-bbb7283fa1e6 with identifier: DE72%20KZJ
2026-03-28 14:07:46 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 300e41a8-d251-59f7-802e-bbb7283fa1e6 with identifier: DE72%20KZJ to the API
2026-03-28 14:07:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:07:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:07:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DE72KZJ/698947286/600>
{'auction_title': '',
'c_o_2_emission_value': 147,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_300e41a8-d251-59f7-802e-bbb7283fa1e6/300e41a8-d251-59f7-802e-bbb7283fa1e6_expert_report_file_570b357e-a902-4760-b19d-b322f261c0e4.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=DE72%20KZJ-GB',
'category': 'Car',
'color': 'black',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.5L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol',
'id': '300e41a8-d251-59f7-802e-bbb7283fa1e6',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'DE72 KZJ',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=DE72%20KZJ&vehicleType=*',
'listing': 'auction',
'location': 'Manchester',
'make': 'AUDI',
'model': 'Q2',
'odometer': 36394,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 11,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_300e41a8-d251-59f7-802e-bbb7283fa1e6/300e41a8-d251-59f7-802e-bbb7283fa1e6_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 45610,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DE72KZJ/698947132/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_300e41a8-d251-59f7-802e-bbb7283fa1e6/300e41a8-d251-59f7-802e-bbb7283fa1e6_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 45797,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DE72KZJ/698947150/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_300e41a8-d251-59f7-802e-bbb7283fa1e6/300e41a8-d251-59f7-802e-bbb7283fa1e6_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 46220,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DE72KZJ/698947164/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_300e41a8-d251-59f7-802e-bbb7283fa1e6/300e41a8-d251-59f7-802e-bbb7283fa1e6_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 47577,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DE72KZJ/698947175/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_300e41a8-d251-59f7-802e-bbb7283fa1e6/300e41a8-d251-59f7-802e-bbb7283fa1e6_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 42867,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DE72KZJ/698947192/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_300e41a8-d251-59f7-802e-bbb7283fa1e6/300e41a8-d251-59f7-802e-bbb7283fa1e6_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 41060,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DE72KZJ/698947199/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_300e41a8-d251-59f7-802e-bbb7283fa1e6/300e41a8-d251-59f7-802e-bbb7283fa1e6_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 95171,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DE72KZJ/698947213/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_300e41a8-d251-59f7-802e-bbb7283fa1e6/300e41a8-d251-59f7-802e-bbb7283fa1e6_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 86593,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DE72KZJ/698947238/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_300e41a8-d251-59f7-802e-bbb7283fa1e6/300e41a8-d251-59f7-802e-bbb7283fa1e6_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 94271,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DE72KZJ/698947265/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_300e41a8-d251-59f7-802e-bbb7283fa1e6/300e41a8-d251-59f7-802e-bbb7283fa1e6_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 93367,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DE72KZJ/698947286/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-01-01',
'seller_name': None,
'title': 'AUDI Q2 1.5 35 TFSI BLACK ED.S-T Hatchback',
'transmission': 'automatic',
'trim': '35 TFSI BLACK ED.S-T',
'vin': 'WAUZZZGA1PA003359',
'year': 2022}
2026-03-28 14:07:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DE72%2520KZJ%27 HTTP/1.1" 200 None
2026-03-28 14:07:46 [bca.uk] INFO: Saving data for DE72%20KZJ: {'created_time': 1774706866.34932, 'last_price_update_time': 1774706866.349334, 'auction_closing_time': 1774864800.0}
2026-03-28 14:07:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='DE72%2520KZJ') HTTP/1.1" 204 0
2026-03-28 14:07:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DG19VCT/698934321/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/DG19VCT/42810037?sv=2020-08-04&st=2026-03-28T14%3A07%3A30Z&se=2026-03-28T14%3A32%3A30Z&sr=b&sp=r&sig=lNJupmOisKDrrDy4iKSYnUEsaesieb3TwVNfbpOHZYc%3D)
2026-03-28 14:07:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DG19VCT/698934252/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/DG19VCT/42810037?sv=2020-08-04&st=2026-03-28T14%3A07%3A30Z&se=2026-03-28T14%3A32%3A30Z&sr=b&sp=r&sig=lNJupmOisKDrrDy4iKSYnUEsaesieb3TwVNfbpOHZYc%3D)
2026-03-28 14:07:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:07:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2d783910>
2026-03-28 14:07:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:07:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:07:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:07:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_82ce45e5-a8c4-552b-855d-b8e5816f3055/82ce45e5-a8c4-552b-855d-b8e5816f3055_image_5.jpg HTTP/1.1" 201 0
2026-03-28 14:07:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FDG19VCT%252F698934270%252F600') HTTP/1.1" 204 0
2026-03-28 14:07:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DG19VCT/698934270/600 saved to cache
2026-03-28 14:07:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 82ce45e5-a8c4-552b-855d-b8e5816f3055
2026-03-28 14:07:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WD66RGU/698920120/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/WD66RGU/42809743?sv=2020-08-04&st=2026-03-28T14%3A07%3A39Z&se=2026-03-28T14%3A32%3A39Z&sr=b&sp=r&sig=eU%2FGhaTr1i0XPFaLo6SDB0gBHhQi%2B9mP%2FEm%2BYcvp8RU%3D)
2026-03-28 14:07:46 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KR71ZWG/698934322/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698934322>
2026-03-28 14:07:46 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WD66RGU/698920260/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698920260>
2026-03-28 14:07:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HD12PKZ/698107440/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/HD12PKZ/42794343?sv=2020-08-04&st=2026-03-28T14%3A07%3A30Z&se=2026-03-28T14%3A32%3A30Z&sr=b&sp=r&sig=YZpH6P9lYVvbxX67%2FUii%2FWyl8Su4sjTpWSDxxHtoHk0%3D)
2026-03-28 14:07:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HD12PKZ/698107417/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/HD12PKZ/42794343?sv=2020-08-04&st=2026-03-28T14%3A07%3A30Z&se=2026-03-28T14%3A32%3A30Z&sr=b&sp=r&sig=YZpH6P9lYVvbxX67%2FUii%2FWyl8Su4sjTpWSDxxHtoHk0%3D)
2026-03-28 14:07:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DG19VCT/698934367/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/DG19VCT/42810037?sv=2020-08-04&st=2026-03-28T14%3A07%3A30Z&se=2026-03-28T14%3A32%3A30Z&sr=b&sp=r&sig=lNJupmOisKDrrDy4iKSYnUEsaesieb3TwVNfbpOHZYc%3D)
2026-03-28 14:07:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:07:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a3063d4d0>
2026-03-28 14:07:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:07:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:07:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:07:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d7dfafc8-5ff1-5ae1-8e11-8b4c127fde8a/d7dfafc8-5ff1-5ae1-8e11-8b4c127fde8a_image_2.jpg HTTP/1.1" 201 0
2026-03-28 14:07:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FHD12PKZ%252F698107334%252F600') HTTP/1.1" 204 0
2026-03-28 14:07:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HD12PKZ/698107334/600 saved to cache
2026-03-28 14:07:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item d7dfafc8-5ff1-5ae1-8e11-8b4c127fde8a
2026-03-28 14:07:46 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:07:46 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:07:46 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:07:46 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:07:46 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:07:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:07:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a1fd5a910>
2026-03-28 14:07:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:07:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:07:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:07:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d7dfafc8-5ff1-5ae1-8e11-8b4c127fde8a/d7dfafc8-5ff1-5ae1-8e11-8b4c127fde8a_image_6.jpg HTTP/1.1" 201 0
2026-03-28 14:07:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FHD12PKZ%252F698107396%252F600') HTTP/1.1" 204 0
2026-03-28 14:07:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HD12PKZ/698107396/600 saved to cache
2026-03-28 14:07:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item d7dfafc8-5ff1-5ae1-8e11-8b4c127fde8a
2026-03-28 14:07:46 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:07:46 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:07:46 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:07:46 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:07:46 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:07:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:07:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c718250>
2026-03-28 14:07:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:07:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:07:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:07:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_82ce45e5-a8c4-552b-855d-b8e5816f3055/82ce45e5-a8c4-552b-855d-b8e5816f3055_image_6.jpg HTTP/1.1" 201 0
2026-03-28 14:07:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FDG19VCT%252F698934297%252F600') HTTP/1.1" 204 0
2026-03-28 14:07:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DG19VCT/698934297/600 saved to cache
2026-03-28 14:07:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 82ce45e5-a8c4-552b-855d-b8e5816f3055
2026-03-28 14:07:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:07:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c4fa350>
2026-03-28 14:07:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:07:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:07:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:07:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c1e22119-0b44-5e50-aa2c-6734ba2fd45e/c1e22119-0b44-5e50-aa2c-6734ba2fd45e_image_0.jpg HTTP/1.1" 201 0
2026-03-28 14:07:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FKR71ZWG%252F698934212%252F600') HTTP/1.1" 204 0
2026-03-28 14:07:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KR71ZWG/698934212/600 saved to cache
2026-03-28 14:07:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item c1e22119-0b44-5e50-aa2c-6734ba2fd45e
2026-03-28 14:07:46 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WD66RGU/698920242/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698920242>
2026-03-28 14:07:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WD66RGU/698920210/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/WD66RGU/42809743?sv=2020-08-04&st=2026-03-28T14%3A07%3A39Z&se=2026-03-28T14%3A32%3A39Z&sr=b&sp=r&sig=eU%2FGhaTr1i0XPFaLo6SDB0gBHhQi%2B9mP%2FEm%2BYcvp8RU%3D)
2026-03-28 14:07:46 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:07:46 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:07:46 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:07:46 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:07:46 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:07:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:07:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2d9f38d0>
2026-03-28 14:07:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:07:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:07:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:07:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_82ce45e5-a8c4-552b-855d-b8e5816f3055/82ce45e5-a8c4-552b-855d-b8e5816f3055_image_7.jpg HTTP/1.1" 201 0
2026-03-28 14:07:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FDG19VCT%252F698934321%252F600') HTTP/1.1" 204 0
2026-03-28 14:07:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DG19VCT/698934321/600 saved to cache
2026-03-28 14:07:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 82ce45e5-a8c4-552b-855d-b8e5816f3055
2026-03-28 14:07:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:07:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2eb26dd0>
2026-03-28 14:07:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:07:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:07:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:07:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_82ce45e5-a8c4-552b-855d-b8e5816f3055/82ce45e5-a8c4-552b-855d-b8e5816f3055_image_4.jpg HTTP/1.1" 201 0
2026-03-28 14:07:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FDG19VCT%252F698934252%252F600') HTTP/1.1" 204 0
2026-03-28 14:07:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DG19VCT/698934252/600 saved to cache
2026-03-28 14:07:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 82ce45e5-a8c4-552b-855d-b8e5816f3055
2026-03-28 14:07:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:07:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c71e090>
2026-03-28 14:07:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:07:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:07:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:07:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5fc655ed-6705-5d8a-9f72-de0010832a06/5fc655ed-6705-5d8a-9f72-de0010832a06_image_0.jpg HTTP/1.1" 201 0
2026-03-28 14:07:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FWD66RGU%252F698920120%252F600') HTTP/1.1" 204 0
2026-03-28 14:07:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WD66RGU/698920120/600 saved to cache
2026-03-28 14:07:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 5fc655ed-6705-5d8a-9f72-de0010832a06
2026-03-28 14:07:46 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:07:46 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:07:46 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:07:46 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:07:46 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:07:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:07:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2d782390>
2026-03-28 14:07:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:07:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:07:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:07:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d7dfafc8-5ff1-5ae1-8e11-8b4c127fde8a/d7dfafc8-5ff1-5ae1-8e11-8b4c127fde8a_image_8.jpg HTTP/1.1" 201 0
2026-03-28 14:07:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FHD12PKZ%252F698107440%252F600') HTTP/1.1" 204 0
2026-03-28 14:07:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HD12PKZ/698107440/600 saved to cache
2026-03-28 14:07:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item d7dfafc8-5ff1-5ae1-8e11-8b4c127fde8a
2026-03-28 14:07:46 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:07:46 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:07:46 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:07:46 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:07:46 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:07:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:07:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c732510>
2026-03-28 14:07:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:07:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:07:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:07:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d7dfafc8-5ff1-5ae1-8e11-8b4c127fde8a/d7dfafc8-5ff1-5ae1-8e11-8b4c127fde8a_image_7.jpg HTTP/1.1" 201 0
2026-03-28 14:07:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FHD12PKZ%252F698107417%252F600') HTTP/1.1" 204 0
2026-03-28 14:07:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HD12PKZ/698107417/600 saved to cache
2026-03-28 14:07:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item d7dfafc8-5ff1-5ae1-8e11-8b4c127fde8a
2026-03-28 14:07:46 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:07:46 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:07:46 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:07:46 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:07:46 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:07:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:07:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2eb267d0>
2026-03-28 14:07:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:07:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:07:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:07:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_82ce45e5-a8c4-552b-855d-b8e5816f3055/82ce45e5-a8c4-552b-855d-b8e5816f3055_image_9.jpg HTTP/1.1" 201 0
2026-03-28 14:07:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FDG19VCT%252F698934367%252F600') HTTP/1.1" 204 0
2026-03-28 14:07:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DG19VCT/698934367/600 saved to cache
2026-03-28 14:07:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 82ce45e5-a8c4-552b-855d-b8e5816f3055
2026-03-28 14:07:46 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KR71ZWG/698934385/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698934385>
2026-03-28 14:07:46 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WD66RGU/698920317/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698920317>
2026-03-28 14:07:46 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WD66RGU/698920287/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698920287>
2026-03-28 14:07:46 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KR71ZWG/698934368/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698934368>
2026-03-28 14:07:46 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WD66RGU/698920354/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698920354>
2026-03-28 14:07:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KR71ZWG/698934262/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/KR71ZWG/42809993?sv=2020-08-04&st=2026-03-28T14%3A07%3A39Z&se=2026-03-28T14%3A32%3A39Z&sr=b&sp=r&sig=q0Nwjfh7efHq7efRUVEUOaczVGuVkotTNm5IHVRKC6A%3D)
2026-03-28 14:07:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:07:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c185b50>
2026-03-28 14:07:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:07:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:07:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:07:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5fc655ed-6705-5d8a-9f72-de0010832a06/5fc655ed-6705-5d8a-9f72-de0010832a06_image_3.jpg HTTP/1.1" 201 0
2026-03-28 14:07:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FWD66RGU%252F698920210%252F600') HTTP/1.1" 204 0
2026-03-28 14:07:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WD66RGU/698920210/600 saved to cache
2026-03-28 14:07:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 5fc655ed-6705-5d8a-9f72-de0010832a06
2026-03-28 14:07:46 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KR71ZWG/698934348/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698934348>
2026-03-28 14:07:46 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KR71ZWG/698934286/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698934286>
2026-03-28 14:07:46 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HD12PKZ/698107458/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698107458>
2026-03-28 14:07:46 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KR71ZWG/698934300/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698934300>
2026-03-28 14:07:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WD66RGU/698920260/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/WD66RGU/42809743?sv=2020-08-04&st=2026-03-28T14%3A07%3A39Z&se=2026-03-28T14%3A32%3A39Z&sr=b&sp=r&sig=eU%2FGhaTr1i0XPFaLo6SDB0gBHhQi%2B9mP%2FEm%2BYcvp8RU%3D)
2026-03-28 14:07:46 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WD66RGU/698920231/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698920231>
2026-03-28 14:07:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KR71ZWG/698934322/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/KR71ZWG/42809993?sv=2020-08-04&st=2026-03-28T14%3A07%3A39Z&se=2026-03-28T14%3A32%3A39Z&sr=b&sp=r&sig=q0Nwjfh7efHq7efRUVEUOaczVGuVkotTNm5IHVRKC6A%3D)
2026-03-28 14:07:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:07:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c691810>
2026-03-28 14:07:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:07:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:07:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:07:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c1e22119-0b44-5e50-aa2c-6734ba2fd45e/c1e22119-0b44-5e50-aa2c-6734ba2fd45e_image_3.jpg HTTP/1.1" 201 0
2026-03-28 14:07:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FKR71ZWG%252F698934262%252F600') HTTP/1.1" 204 0
2026-03-28 14:07:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KR71ZWG/698934262/600 saved to cache
2026-03-28 14:07:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item c1e22119-0b44-5e50-aa2c-6734ba2fd45e
2026-03-28 14:07:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WD66RGU/698920242/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/WD66RGU/42809743?sv=2020-08-04&st=2026-03-28T14%3A07%3A39Z&se=2026-03-28T14%3A32%3A39Z&sr=b&sp=r&sig=eU%2FGhaTr1i0XPFaLo6SDB0gBHhQi%2B9mP%2FEm%2BYcvp8RU%3D)
2026-03-28 14:07:47 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WD66RGU/698920182/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698920182>
2026-03-28 14:07:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KR71ZWG/698934368/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/KR71ZWG/42809993?sv=2020-08-04&st=2026-03-28T14%3A07%3A39Z&se=2026-03-28T14%3A32%3A39Z&sr=b&sp=r&sig=q0Nwjfh7efHq7efRUVEUOaczVGuVkotTNm5IHVRKC6A%3D)
2026-03-28 14:07:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WD66RGU/698920317/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/WD66RGU/42809743?sv=2020-08-04&st=2026-03-28T14%3A07%3A39Z&se=2026-03-28T14%3A32%3A39Z&sr=b&sp=r&sig=eU%2FGhaTr1i0XPFaLo6SDB0gBHhQi%2B9mP%2FEm%2BYcvp8RU%3D)
2026-03-28 14:07:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KR71ZWG/698934385/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/KR71ZWG/42809993?sv=2020-08-04&st=2026-03-28T14%3A07%3A39Z&se=2026-03-28T14%3A32%3A39Z&sr=b&sp=r&sig=q0Nwjfh7efHq7efRUVEUOaczVGuVkotTNm5IHVRKC6A%3D)
2026-03-28 14:07:47 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:07:47 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:07:47 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:07:47 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:07:47 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:07:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:07:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c731650>
2026-03-28 14:07:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:07:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:07:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:07:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5fc655ed-6705-5d8a-9f72-de0010832a06/5fc655ed-6705-5d8a-9f72-de0010832a06_image_6.jpg HTTP/1.1" 201 0
2026-03-28 14:07:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FWD66RGU%252F698920260%252F600') HTTP/1.1" 204 0
2026-03-28 14:07:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WD66RGU/698920260/600 saved to cache
2026-03-28 14:07:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 5fc655ed-6705-5d8a-9f72-de0010832a06
2026-03-28 14:07:47 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KR71ZWG/698934251/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698934251>
2026-03-28 14:07:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WD66RGU/698920354/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/WD66RGU/42809743?sv=2020-08-04&st=2026-03-28T14%3A07%3A39Z&se=2026-03-28T14%3A32%3A39Z&sr=b&sp=r&sig=eU%2FGhaTr1i0XPFaLo6SDB0gBHhQi%2B9mP%2FEm%2BYcvp8RU%3D)
2026-03-28 14:07:47 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:07:47 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:07:47 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:07:47 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:07:47 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:07:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:07:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2ddb1990>
2026-03-28 14:07:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:07:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:07:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:07:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c1e22119-0b44-5e50-aa2c-6734ba2fd45e/c1e22119-0b44-5e50-aa2c-6734ba2fd45e_image_6.jpg HTTP/1.1" 201 0
2026-03-28 14:07:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FKR71ZWG%252F698934322%252F600') HTTP/1.1" 204 0
2026-03-28 14:07:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KR71ZWG/698934322/600 saved to cache
2026-03-28 14:07:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item c1e22119-0b44-5e50-aa2c-6734ba2fd45e
2026-03-28 14:07:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KR71ZWG/698934300/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/KR71ZWG/42809993?sv=2020-08-04&st=2026-03-28T14%3A07%3A39Z&se=2026-03-28T14%3A32%3A39Z&sr=b&sp=r&sig=q0Nwjfh7efHq7efRUVEUOaczVGuVkotTNm5IHVRKC6A%3D)
2026-03-28 14:07:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HD12PKZ/698107458/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/HD12PKZ/42794343?sv=2020-08-04&st=2026-03-28T14%3A07%3A30Z&se=2026-03-28T14%3A32%3A30Z&sr=b&sp=r&sig=YZpH6P9lYVvbxX67%2FUii%2FWyl8Su4sjTpWSDxxHtoHk0%3D)
2026-03-28 14:07:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WD66RGU/698920231/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/WD66RGU/42809743?sv=2020-08-04&st=2026-03-28T14%3A07%3A39Z&se=2026-03-28T14%3A32%3A39Z&sr=b&sp=r&sig=eU%2FGhaTr1i0XPFaLo6SDB0gBHhQi%2B9mP%2FEm%2BYcvp8RU%3D)
2026-03-28 14:07:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.bca.co.uk/api/search?q=&pageSize=100&page=18&sort=MostRecentlyAdded> (referer: https://www.bca.co.uk/search) ['zyte-api']
2026-03-28 14:07:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WD66RGU/698920287/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/WD66RGU/42809743?sv=2020-08-04&st=2026-03-28T14%3A07%3A39Z&se=2026-03-28T14%3A32%3A39Z&sr=b&sp=r&sig=eU%2FGhaTr1i0XPFaLo6SDB0gBHhQi%2B9mP%2FEm%2BYcvp8RU%3D)
2026-03-28 14:07:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KR71ZWG/698934286/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/KR71ZWG/42809993?sv=2020-08-04&st=2026-03-28T14%3A07%3A39Z&se=2026-03-28T14%3A32%3A39Z&sr=b&sp=r&sig=q0Nwjfh7efHq7efRUVEUOaczVGuVkotTNm5IHVRKC6A%3D)
2026-03-28 14:07:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:07:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c95e890>
2026-03-28 14:07:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:07:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:07:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:07:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5fc655ed-6705-5d8a-9f72-de0010832a06/5fc655ed-6705-5d8a-9f72-de0010832a06_image_5.jpg HTTP/1.1" 201 0
2026-03-28 14:07:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FWD66RGU%252F698920242%252F600') HTTP/1.1" 204 0
2026-03-28 14:07:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WD66RGU/698920242/600 saved to cache
2026-03-28 14:07:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 5fc655ed-6705-5d8a-9f72-de0010832a06
2026-03-28 14:07:47 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:07:47 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:07:47 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:07:47 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:07:47 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:07:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:07:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2ca3d290>
2026-03-28 14:07:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:07:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:07:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:07:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c1e22119-0b44-5e50-aa2c-6734ba2fd45e/c1e22119-0b44-5e50-aa2c-6734ba2fd45e_image_8.jpg HTTP/1.1" 201 0
2026-03-28 14:07:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FKR71ZWG%252F698934368%252F600') HTTP/1.1" 204 0
2026-03-28 14:07:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KR71ZWG/698934368/600 saved to cache
2026-03-28 14:07:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item c1e22119-0b44-5e50-aa2c-6734ba2fd45e
2026-03-28 14:07:47 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:07:47 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:07:47 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:07:47 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:07:47 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:07:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:07:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c854490>
2026-03-28 14:07:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:07:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:07:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:07:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5fc655ed-6705-5d8a-9f72-de0010832a06/5fc655ed-6705-5d8a-9f72-de0010832a06_image_8.jpg HTTP/1.1" 201 0
2026-03-28 14:07:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FWD66RGU%252F698920317%252F600') HTTP/1.1" 204 0
2026-03-28 14:07:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WD66RGU/698920317/600 saved to cache
2026-03-28 14:07:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 5fc655ed-6705-5d8a-9f72-de0010832a06
2026-03-28 14:07:47 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:07:47 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:07:47 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:07:47 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:07:47 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:07:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:07:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2d6e75d0>
2026-03-28 14:07:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:07:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:07:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:07:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c1e22119-0b44-5e50-aa2c-6734ba2fd45e/c1e22119-0b44-5e50-aa2c-6734ba2fd45e_image_9.jpg HTTP/1.1" 201 0
2026-03-28 14:07:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FKR71ZWG%252F698934385%252F600') HTTP/1.1" 204 0
2026-03-28 14:07:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KR71ZWG/698934385/600 saved to cache
2026-03-28 14:07:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item c1e22119-0b44-5e50-aa2c-6734ba2fd45e
2026-03-28 14:07:47 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WD66RGU/698920147/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698920147>
2026-03-28 14:07:47 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KR71ZWG/698934234/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698934234>
2026-03-28 14:07:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WD66RGU/698920182/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/WD66RGU/42809743?sv=2020-08-04&st=2026-03-28T14%3A07%3A39Z&se=2026-03-28T14%3A32%3A39Z&sr=b&sp=r&sig=eU%2FGhaTr1i0XPFaLo6SDB0gBHhQi%2B9mP%2FEm%2BYcvp8RU%3D)
2026-03-28 14:07:47 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HD12PKZ/698107376/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698107376>
2026-03-28 14:07:47 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DG19VCT/698934346/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698934346>
2026-03-28 14:07:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KR71ZWG/698934348/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/KR71ZWG/42809993?sv=2020-08-04&st=2026-03-28T14%3A07%3A39Z&se=2026-03-28T14%3A32%3A39Z&sr=b&sp=r&sig=q0Nwjfh7efHq7efRUVEUOaczVGuVkotTNm5IHVRKC6A%3D)
2026-03-28 14:07:47 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:07:47 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:07:47 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:07:47 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:07:47 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:07:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:07:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c855110>
2026-03-28 14:07:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:07:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:07:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:07:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5fc655ed-6705-5d8a-9f72-de0010832a06/5fc655ed-6705-5d8a-9f72-de0010832a06_image_9.jpg HTTP/1.1" 201 0
2026-03-28 14:07:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FWD66RGU%252F698920354%252F600') HTTP/1.1" 204 0
2026-03-28 14:07:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WD66RGU/698920354/600 saved to cache
2026-03-28 14:07:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 5fc655ed-6705-5d8a-9f72-de0010832a06
2026-03-28 14:07:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:07:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2d9076d0>
2026-03-28 14:07:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:07:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:07:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:07:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c1e22119-0b44-5e50-aa2c-6734ba2fd45e/c1e22119-0b44-5e50-aa2c-6734ba2fd45e_image_5.jpg HTTP/1.1" 201 0
2026-03-28 14:07:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FKR71ZWG%252F698934300%252F600') HTTP/1.1" 204 0
2026-03-28 14:07:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KR71ZWG/698934300/600 saved to cache
2026-03-28 14:07:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item c1e22119-0b44-5e50-aa2c-6734ba2fd45e
2026-03-28 14:07:47 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:07:47 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:07:47 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:07:47 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:07:47 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:07:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:07:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c752390>
2026-03-28 14:07:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:07:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:07:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:07:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d7dfafc8-5ff1-5ae1-8e11-8b4c127fde8a/d7dfafc8-5ff1-5ae1-8e11-8b4c127fde8a_image_9.jpg HTTP/1.1" 201 0
2026-03-28 14:07:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FHD12PKZ%252F698107458%252F600') HTTP/1.1" 204 0
2026-03-28 14:07:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HD12PKZ/698107458/600 saved to cache
2026-03-28 14:07:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item d7dfafc8-5ff1-5ae1-8e11-8b4c127fde8a
2026-03-28 14:07:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:07:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c9be7d0>
2026-03-28 14:07:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:07:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:07:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:07:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5fc655ed-6705-5d8a-9f72-de0010832a06/5fc655ed-6705-5d8a-9f72-de0010832a06_image_4.jpg HTTP/1.1" 201 0
2026-03-28 14:07:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FWD66RGU%252F698920231%252F600') HTTP/1.1" 204 0
2026-03-28 14:07:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WD66RGU/698920231/600 saved to cache
2026-03-28 14:07:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 5fc655ed-6705-5d8a-9f72-de0010832a06
2026-03-28 14:07:47 [bca.uk] INFO: Total items found: 100
2026-03-28 14:07:47 [bca.uk] INFO: Requesting URL: https://www.bca.co.uk/api/search?q=&pageSize=100&page=19&sort=MostRecentlyAdded
2026-03-28 14:07:47 [bca.uk] INFO: Sending search API request with Bearer token (length=1492)
2026-03-28 14:07:47 [scrapy_zyte_api._params] WARNING: Request <GET https://www.bca.co.uk/api/search?q=&pageSize=100&page=19&sort=MostRecentlyAdded> defines the Zyte API customHttpRequestHeaders parameter, overriding Request.headers. Use Request.headers instead.
2026-03-28 14:07:47 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:07:47 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:07:47 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:07:47 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:07:47 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:07:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:07:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a1fd38ed0>
2026-03-28 14:07:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:07:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:07:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:07:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5fc655ed-6705-5d8a-9f72-de0010832a06/5fc655ed-6705-5d8a-9f72-de0010832a06_image_7.jpg HTTP/1.1" 201 0
2026-03-28 14:07:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FWD66RGU%252F698920287%252F600') HTTP/1.1" 204 0
2026-03-28 14:07:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WD66RGU/698920287/600 saved to cache
2026-03-28 14:07:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 5fc655ed-6705-5d8a-9f72-de0010832a06
2026-03-28 14:07:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:07:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c1b5210>
2026-03-28 14:07:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:07:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:07:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:07:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c1e22119-0b44-5e50-aa2c-6734ba2fd45e/c1e22119-0b44-5e50-aa2c-6734ba2fd45e_image_4.jpg HTTP/1.1" 201 0
2026-03-28 14:07:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FKR71ZWG%252F698934286%252F600') HTTP/1.1" 204 0
2026-03-28 14:07:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KR71ZWG/698934286/600 saved to cache
2026-03-28 14:07:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item c1e22119-0b44-5e50-aa2c-6734ba2fd45e
2026-03-28 14:07:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KR71ZWG/698934251/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/KR71ZWG/42809993?sv=2020-08-04&st=2026-03-28T14%3A07%3A39Z&se=2026-03-28T14%3A32%3A39Z&sr=b&sp=r&sig=q0Nwjfh7efHq7efRUVEUOaczVGuVkotTNm5IHVRKC6A%3D)
2026-03-28 14:07:47 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FV17TYW/698767998/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698767998>
2026-03-28 14:07:47 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WU19VDC/698045620/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698045620>
2026-03-28 14:07:47 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NL64KGO/698157130/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698157130>
2026-03-28 14:07:47 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KV16LDZ/698296895/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698296895>
2026-03-28 14:07:47 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FY66OTD/698150796/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698150796>
2026-03-28 14:07:47 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BV61MVO/698928556/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698928556>
2026-03-28 14:07:47 [scrapy_zyte_api._params] WARNING: Request <GET https://www.bca.co.uk/api/search?q=&pageSize=100&page=19&sort=MostRecentlyAdded> defines the Zyte API customHttpRequestHeaders parameter, overriding Request.headers. Use Request.headers instead.
2026-03-28 14:07:47 [scrapy_zyte_api._params] WARNING: Request <GET https://www.bca.co.uk/api/search?q=&pageSize=100&page=19&sort=MostRecentlyAdded> defines the Zyte API customHttpRequestHeaders parameter, overriding Request.headers. Use Request.headers instead.
2026-03-28 14:07:47 [bca.uk] INFO: Found listing with ID: EA63%20PVE
2026-03-28 14:07:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27EA63%2520PVE%27 HTTP/1.1" 200 None
2026-03-28 14:07:47 [bca.uk] INFO: Scrape type for EA63%20PVE: 0
2026-03-28 14:07:47 [bca.uk] INFO: Found listing with ID: GL67%20YWJ
2026-03-28 14:07:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GL67%2520YWJ%27 HTTP/1.1" 200 None
2026-03-28 14:07:47 [bca.uk] INFO: Scrape type for GL67%20YWJ: 0
2026-03-28 14:07:47 [bca.uk] INFO: Found listing with ID: IGZ%203878
2026-03-28 14:07:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27IGZ%25203878%27 HTTP/1.1" 200 None
2026-03-28 14:07:47 [bca.uk] INFO: Scrape type for IGZ%203878: 0
2026-03-28 14:07:47 [bca.uk] INFO: Found listing with ID: NK19%20LMM
2026-03-28 14:07:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27NK19%2520LMM%27 HTTP/1.1" 200 None
2026-03-28 14:07:47 [bca.uk] INFO: Scrape type for NK19%20LMM: 0
2026-03-28 14:07:47 [bca.uk] INFO: Found listing with ID: T140%20LPV
2026-03-28 14:07:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27T140%2520LPV%27 HTTP/1.1" 200 None
2026-03-28 14:07:47 [bca.uk] INFO: Scrape type for T140%20LPV: 0
2026-03-28 14:07:47 [bca.uk] INFO: Found listing with ID: YX13%20FTY
2026-03-28 14:07:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YX13%2520FTY%27 HTTP/1.1" 200 None
2026-03-28 14:07:47 [bca.uk] INFO: Scrape type for YX13%20FTY: 0
2026-03-28 14:07:47 [bca.uk] INFO: Found listing with ID: BG61%20YNC
2026-03-28 14:07:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BG61%2520YNC%27 HTTP/1.1" 200 None
2026-03-28 14:07:47 [bca.uk] INFO: Scrape type for BG61%20YNC: 0
2026-03-28 14:07:47 [bca.uk] INFO: Found listing with ID: SL15%20UGO
2026-03-28 14:07:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SL15%2520UGO%27 HTTP/1.1" 200 None
2026-03-28 14:07:47 [bca.uk] INFO: Scrape type for SL15%20UGO: 0
2026-03-28 14:07:47 [bca.uk] INFO: Found listing with ID: LV59%20VRK
2026-03-28 14:07:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LV59%2520VRK%27 HTTP/1.1" 200 None
2026-03-28 14:07:47 [bca.uk] INFO: Scrape type for LV59%20VRK: 0
2026-03-28 14:07:47 [bca.uk] INFO: Found listing with ID: VU63%20XOL
2026-03-28 14:07:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27VU63%2520XOL%27 HTTP/1.1" 200 None
2026-03-28 14:07:47 [bca.uk] INFO: Scrape type for VU63%20XOL: 0
2026-03-28 14:07:47 [bca.uk] INFO: Found listing with ID: YX17%20UZK
2026-03-28 14:07:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YX17%2520UZK%27 HTTP/1.1" 200 None
2026-03-28 14:07:47 [bca.uk] INFO: Scrape type for YX17%20UZK: 0
2026-03-28 14:07:47 [bca.uk] INFO: Found listing with ID: LO17%20BZM
2026-03-28 14:07:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LO17%2520BZM%27 HTTP/1.1" 200 None
2026-03-28 14:07:47 [bca.uk] INFO: Scrape type for LO17%20BZM: 0
2026-03-28 14:07:47 [bca.uk] INFO: Found listing with ID: ND64%20XVK
2026-03-28 14:07:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27ND64%2520XVK%27 HTTP/1.1" 200 None
2026-03-28 14:07:47 [bca.uk] INFO: Scrape type for ND64%20XVK: 0
2026-03-28 14:07:47 [bca.uk] INFO: Found listing with ID: LM05%20PMY
2026-03-28 14:07:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LM05%2520PMY%27 HTTP/1.1" 200 None
2026-03-28 14:07:47 [bca.uk] INFO: Scrape type for LM05%20PMY: 0
2026-03-28 14:07:47 [bca.uk] INFO: Found listing with ID: WN08%20EJO
2026-03-28 14:07:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WN08%2520EJO%27 HTTP/1.1" 200 None
2026-03-28 14:07:47 [bca.uk] INFO: Scrape type for WN08%20EJO: 0
2026-03-28 14:07:47 [bca.uk] INFO: Found listing with ID: LT64%20RFY
2026-03-28 14:07:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LT64%2520RFY%27 HTTP/1.1" 200 None
2026-03-28 14:07:47 [bca.uk] INFO: Scrape type for LT64%20RFY: 0
2026-03-28 14:07:47 [bca.uk] INFO: Found listing with ID: WM18%20TOV
2026-03-28 14:07:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WM18%2520TOV%27 HTTP/1.1" 200 None
2026-03-28 14:07:47 [bca.uk] INFO: Scrape type for WM18%20TOV: 0
2026-03-28 14:07:47 [bca.uk] INFO: Found listing with ID: DL65%20RZM
2026-03-28 14:07:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DL65%2520RZM%27 HTTP/1.1" 200 None
2026-03-28 14:07:48 [bca.uk] INFO: Scrape type for DL65%20RZM: 0
2026-03-28 14:07:48 [bca.uk] INFO: Found listing with ID: AU14%20XMG
2026-03-28 14:07:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27AU14%2520XMG%27 HTTP/1.1" 200 None
2026-03-28 14:07:48 [bca.uk] INFO: Scrape type for AU14%20XMG: 0
2026-03-28 14:07:48 [bca.uk] INFO: Found listing with ID: DY11%20JYC
2026-03-28 14:07:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DY11%2520JYC%27 HTTP/1.1" 200 None
2026-03-28 14:07:48 [bca.uk] INFO: Scrape type for DY11%20JYC: 0
2026-03-28 14:07:48 [bca.uk] INFO: Found listing with ID: NA12%20HKW
2026-03-28 14:07:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27NA12%2520HKW%27 HTTP/1.1" 200 None
2026-03-28 14:07:48 [bca.uk] INFO: Scrape type for NA12%20HKW: 0
2026-03-28 14:07:48 [bca.uk] INFO: Found listing with ID: AK12%20OAP
2026-03-28 14:07:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27AK12%2520OAP%27 HTTP/1.1" 200 None
2026-03-28 14:07:48 [bca.uk] INFO: Scrape type for AK12%20OAP: 0
2026-03-28 14:07:48 [bca.uk] INFO: Found listing with ID: ML21%20PXH
2026-03-28 14:07:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27ML21%2520PXH%27 HTTP/1.1" 200 None
2026-03-28 14:07:48 [bca.uk] INFO: Scrape type for ML21%20PXH: 0
2026-03-28 14:07:48 [bca.uk] INFO: Found listing with ID: BXZ%204666
2026-03-28 14:07:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BXZ%25204666%27 HTTP/1.1" 200 None
2026-03-28 14:07:48 [bca.uk] INFO: Scrape type for BXZ%204666: 0
2026-03-28 14:07:48 [bca.uk] INFO: Found listing with ID: NX63%20LFL
2026-03-28 14:07:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27NX63%2520LFL%27 HTTP/1.1" 200 None
2026-03-28 14:07:48 [bca.uk] INFO: Scrape type for NX63%20LFL: 0
2026-03-28 14:07:48 [bca.uk] INFO: Found listing with ID: YN64%20OSM
2026-03-28 14:07:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YN64%2520OSM%27 HTTP/1.1" 200 None
2026-03-28 14:07:48 [bca.uk] INFO: Scrape type for YN64%20OSM: 0
2026-03-28 14:07:48 [bca.uk] INFO: Found listing with ID: CK64%20JOH
2026-03-28 14:07:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27CK64%2520JOH%27 HTTP/1.1" 200 None
2026-03-28 14:07:48 [bca.uk] INFO: Scrape type for CK64%20JOH: 0
2026-03-28 14:07:48 [bca.uk] INFO: Found listing with ID: DC12%20SEE
2026-03-28 14:07:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DC12%2520SEE%27 HTTP/1.1" 200 None
2026-03-28 14:07:48 [bca.uk] INFO: Scrape type for DC12%20SEE: 0
2026-03-28 14:07:48 [bca.uk] INFO: Found listing with ID: FE59%20XRV
2026-03-28 14:07:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FE59%2520XRV%27 HTTP/1.1" 200 None
2026-03-28 14:07:48 [bca.uk] INFO: Scrape type for FE59%20XRV: 0
2026-03-28 14:07:48 [bca.uk] INFO: Found listing with ID: RA08%20JWP
2026-03-28 14:07:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27RA08%2520JWP%27 HTTP/1.1" 200 None
2026-03-28 14:07:48 [bca.uk] INFO: Scrape type for RA08%20JWP: 0
2026-03-28 14:07:48 [bca.uk] INFO: Found listing with ID: SA06%20UMJ
2026-03-28 14:07:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SA06%2520UMJ%27 HTTP/1.1" 200 None
2026-03-28 14:07:48 [bca.uk] INFO: Scrape type for SA06%20UMJ: 0
2026-03-28 14:07:48 [bca.uk] INFO: Found listing with ID: MW63%20FXS
2026-03-28 14:07:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MW63%2520FXS%27 HTTP/1.1" 200 None
2026-03-28 14:07:48 [bca.uk] INFO: Scrape type for MW63%20FXS: 0
2026-03-28 14:07:48 [bca.uk] INFO: Found listing with ID: YX18%20XUA
2026-03-28 14:07:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YX18%2520XUA%27 HTTP/1.1" 200 None
2026-03-28 14:07:48 [bca.uk] INFO: Scrape type for YX18%20XUA: 0
2026-03-28 14:07:48 [bca.uk] INFO: Found listing with ID: SO14%20FTD
2026-03-28 14:07:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SO14%2520FTD%27 HTTP/1.1" 200 None
2026-03-28 14:07:48 [bca.uk] INFO: Scrape type for SO14%20FTD: 0
2026-03-28 14:07:48 [bca.uk] INFO: Found listing with ID: KN14%20YFH
2026-03-28 14:07:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KN14%2520YFH%27 HTTP/1.1" 200 None
2026-03-28 14:07:48 [bca.uk] INFO: Scrape type for KN14%20YFH: 0
2026-03-28 14:07:48 [bca.uk] INFO: Found listing with ID: SY13%20GYG
2026-03-28 14:07:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SY13%2520GYG%27 HTTP/1.1" 200 None
2026-03-28 14:07:48 [bca.uk] INFO: Scrape type for SY13%20GYG: 0
2026-03-28 14:07:48 [bca.uk] INFO: Found listing with ID: AK64%20WNF
2026-03-28 14:07:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27AK64%2520WNF%27 HTTP/1.1" 200 None
2026-03-28 14:07:48 [bca.uk] INFO: Scrape type for AK64%20WNF: 0
2026-03-28 14:07:48 [bca.uk] INFO: Found listing with ID: MJ66%20YYD
2026-03-28 14:07:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MJ66%2520YYD%27 HTTP/1.1" 200 None
2026-03-28 14:07:48 [bca.uk] INFO: Scrape type for MJ66%20YYD: 0
2026-03-28 14:07:48 [bca.uk] INFO: Found listing with ID: YG59%20LXX
2026-03-28 14:07:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YG59%2520LXX%27 HTTP/1.1" 200 None
2026-03-28 14:07:48 [bca.uk] INFO: Scrape type for YG59%20LXX: 0
2026-03-28 14:07:48 [bca.uk] INFO: Found listing with ID: FT63%20VNN
2026-03-28 14:07:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FT63%2520VNN%27 HTTP/1.1" 200 None
2026-03-28 14:07:48 [bca.uk] INFO: Scrape type for FT63%20VNN: 0
2026-03-28 14:07:48 [bca.uk] INFO: Found listing with ID: HY63%20XBB
2026-03-28 14:07:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27HY63%2520XBB%27 HTTP/1.1" 200 None
2026-03-28 14:07:48 [bca.uk] INFO: Scrape type for HY63%20XBB: 0
2026-03-28 14:07:48 [bca.uk] INFO: Found listing with ID: LV06%20XDN
2026-03-28 14:07:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LV06%2520XDN%27 HTTP/1.1" 200 None
2026-03-28 14:07:48 [bca.uk] INFO: Scrape type for LV06%20XDN: 0
2026-03-28 14:07:48 [bca.uk] INFO: Found listing with ID: VK15%20FJO
2026-03-28 14:07:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27VK15%2520FJO%27 HTTP/1.1" 200 None
2026-03-28 14:07:48 [bca.uk] INFO: Scrape type for VK15%20FJO: 0
2026-03-28 14:07:48 [bca.uk] INFO: Found listing with ID: WX63%20EOP
2026-03-28 14:07:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WX63%2520EOP%27 HTTP/1.1" 200 None
2026-03-28 14:07:48 [bca.uk] INFO: Scrape type for WX63%20EOP: 0
2026-03-28 14:07:48 [bca.uk] INFO: Found listing with ID: MF70%20WBE
2026-03-28 14:07:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MF70%2520WBE%27 HTTP/1.1" 200 None
2026-03-28 14:07:48 [bca.uk] INFO: Scrape type for MF70%20WBE: 0
2026-03-28 14:07:48 [bca.uk] INFO: Found listing with ID: LL67%20VDZ
2026-03-28 14:07:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LL67%2520VDZ%27 HTTP/1.1" 200 None
2026-03-28 14:07:48 [bca.uk] INFO: Scrape type for LL67%20VDZ: 0
2026-03-28 14:07:48 [bca.uk] INFO: Found listing with ID: WU64%20WLK
2026-03-28 14:07:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WU64%2520WLK%27 HTTP/1.1" 200 None
2026-03-28 14:07:48 [bca.uk] INFO: Scrape type for WU64%20WLK: 0
2026-03-28 14:07:48 [bca.uk] INFO: Found listing with ID: WM63%20BYZ
2026-03-28 14:07:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WM63%2520BYZ%27 HTTP/1.1" 200 None
2026-03-28 14:07:48 [bca.uk] INFO: Scrape type for WM63%20BYZ: 0
2026-03-28 14:07:48 [bca.uk] INFO: Found listing with ID: MJ64%20RVZ
2026-03-28 14:07:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MJ64%2520RVZ%27 HTTP/1.1" 200 None
2026-03-28 14:07:48 [bca.uk] INFO: Scrape type for MJ64%20RVZ: 0
2026-03-28 14:07:48 [bca.uk] INFO: Found listing with ID: P19%20KMM
2026-03-28 14:07:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27P19%2520KMM%27 HTTP/1.1" 200 None
2026-03-28 14:07:48 [bca.uk] INFO: Scrape type for P19%20KMM: 0
2026-03-28 14:07:48 [bca.uk] INFO: Found listing with ID: PN62%20MZW
2026-03-28 14:07:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27PN62%2520MZW%27 HTTP/1.1" 200 None
2026-03-28 14:07:48 [bca.uk] INFO: Scrape type for PN62%20MZW: 0
2026-03-28 14:07:48 [bca.uk] INFO: Found listing with ID: WP11%20XBH
2026-03-28 14:07:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WP11%2520XBH%27 HTTP/1.1" 200 None
2026-03-28 14:07:48 [bca.uk] INFO: Scrape type for WP11%20XBH: 0
2026-03-28 14:07:48 [bca.uk] INFO: Found listing with ID: WP59%20FLB
2026-03-28 14:07:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WP59%2520FLB%27 HTTP/1.1" 200 None
2026-03-28 14:07:48 [bca.uk] INFO: Scrape type for WP59%20FLB: 0
2026-03-28 14:07:48 [bca.uk] INFO: Found listing with ID: YJ14%20XFY
2026-03-28 14:07:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YJ14%2520XFY%27 HTTP/1.1" 200 None
2026-03-28 14:07:48 [bca.uk] INFO: Scrape type for YJ14%20XFY: 2
2026-03-28 14:07:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f85b9ee5-11fe-5d79-b648-fd7fc6b3aaef with identifier: YJ14%20XFY
2026-03-28 14:07:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f85b9ee5-11fe-5d79-b648-fd7fc6b3aaef with scrape type 2
2026-03-28 14:07:48 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f85b9ee5-11fe-5d79-b648-fd7fc6b3aaef with scrape type 2
2026-03-28 14:07:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: f85b9ee5-11fe-5d79-b648-fd7fc6b3aaef, identifier: YJ14%20XFY
2026-03-28 14:07:48 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 14:07:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: f85b9ee5-11fe-5d79-b648-fd7fc6b3aaef with identifier: YJ14%20XFY
2026-03-28 14:07:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: f85b9ee5-11fe-5d79-b648-fd7fc6b3aaef with identifier: YJ14%20XFY
2026-03-28 14:07:49 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: f85b9ee5-11fe-5d79-b648-fd7fc6b3aaef with identifier: YJ14%20XFY to the API
2026-03-28 14:07:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:07:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:07:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=18&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 115,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=YJ14%20XFY-GB',
'category': 'Car',
'color': 'blue',
'currency': 'GBP',
'doors_number': 3,
'engine': '2.0L',
'expiration_date': '2026-03-29T10:00:00Z',
'fuel_type': 'Diesel',
'id': 'f85b9ee5-11fe-5d79-b648-fd7fc6b3aaef',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'YJ14 XFY',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=YJ14%20XFY&vehicleType=*',
'listing': 'auction',
'location': 'Bristol',
'make': 'BMW',
'model': '118D',
'odometer': 73073,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2014-01-01',
'seller_name': None,
'title': 'BMW 118D 2.0 SPORT Hatchback',
'transmission': 'manual',
'trim': 'SPORT',
'vin': 'WBA1E12030J793066',
'year': 2014}
2026-03-28 14:07:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YJ14%2520XFY%27 HTTP/1.1" 200 None
2026-03-28 14:07:49 [bca.uk] INFO: Saving data for YJ14%20XFY: {'auction_closing_time': 1774778400.0, 'created_time': 1774523355.834103, 'last_price_update_time': 1774706869.347654}
2026-03-28 14:07:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='YJ14%2520XFY') HTTP/1.1" 204 0
2026-03-28 14:07:49 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/X11BBM/697603979/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=697603979>
2026-03-28 14:07:49 [bca.uk] INFO: Found listing with ID: CE59%20OEW
2026-03-28 14:07:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27CE59%2520OEW%27 HTTP/1.1" 200 None
2026-03-28 14:07:49 [bca.uk] INFO: Scrape type for CE59%20OEW: 0
2026-03-28 14:07:49 [bca.uk] INFO: Found listing with ID: CE63%20AXV
2026-03-28 14:07:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27CE63%2520AXV%27 HTTP/1.1" 200 None
2026-03-28 14:07:49 [bca.uk] INFO: Scrape type for CE63%20AXV: 0
2026-03-28 14:07:49 [bca.uk] INFO: Found listing with ID: EX61%20HKJ
2026-03-28 14:07:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27EX61%2520HKJ%27 HTTP/1.1" 200 None
2026-03-28 14:07:49 [bca.uk] INFO: Scrape type for EX61%20HKJ: 0
2026-03-28 14:07:49 [bca.uk] INFO: Found listing with ID: HG57%20ZGN
2026-03-28 14:07:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27HG57%2520ZGN%27 HTTP/1.1" 200 None
2026-03-28 14:07:49 [bca.uk] INFO: Scrape type for HG57%20ZGN: 0
2026-03-28 14:07:49 [bca.uk] INFO: Found listing with ID: KY16%20LRL
2026-03-28 14:07:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KY16%2520LRL%27 HTTP/1.1" 200 None
2026-03-28 14:07:49 [bca.uk] INFO: Scrape type for KY16%20LRL: 0
2026-03-28 14:07:49 [bca.uk] INFO: Found listing with ID: EO16%20YSH
2026-03-28 14:07:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27EO16%2520YSH%27 HTTP/1.1" 200 None
2026-03-28 14:07:49 [bca.uk] INFO: Scrape type for EO16%20YSH: 0
2026-03-28 14:07:49 [bca.uk] INFO: Found listing with ID: FG19%20CUA
2026-03-28 14:07:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FG19%2520CUA%27 HTTP/1.1" 200 None
2026-03-28 14:07:49 [bca.uk] INFO: Scrape type for FG19%20CUA: 0
2026-03-28 14:07:49 [bca.uk] INFO: Found listing with ID: AY13%20HJN
2026-03-28 14:07:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27AY13%2520HJN%27 HTTP/1.1" 200 None
2026-03-28 14:07:49 [bca.uk] INFO: Scrape type for AY13%20HJN: 0
2026-03-28 14:07:49 [bca.uk] INFO: Found listing with ID: CA62%20GJO
2026-03-28 14:07:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27CA62%2520GJO%27 HTTP/1.1" 200 None
2026-03-28 14:07:49 [bca.uk] INFO: Scrape type for CA62%20GJO: 0
2026-03-28 14:07:49 [bca.uk] INFO: Found listing with ID: SH13%20PNF
2026-03-28 14:07:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SH13%2520PNF%27 HTTP/1.1" 200 None
2026-03-28 14:07:49 [bca.uk] INFO: Scrape type for SH13%20PNF: 0
2026-03-28 14:07:49 [bca.uk] INFO: Found listing with ID: WG65%20NYY
2026-03-28 14:07:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WG65%2520NYY%27 HTTP/1.1" 200 None
2026-03-28 14:07:49 [bca.uk] INFO: Scrape type for WG65%20NYY: 0
2026-03-28 14:07:49 [bca.uk] INFO: Found listing with ID: MF12%20VBY
2026-03-28 14:07:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MF12%2520VBY%27 HTTP/1.1" 200 None
2026-03-28 14:07:49 [bca.uk] INFO: Scrape type for MF12%20VBY: 0
2026-03-28 14:07:49 [bca.uk] INFO: Found listing with ID: GF58%20XOE
2026-03-28 14:07:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GF58%2520XOE%27 HTTP/1.1" 200 None
2026-03-28 14:07:49 [bca.uk] INFO: Scrape type for GF58%20XOE: 0
2026-03-28 14:07:49 [bca.uk] INFO: Found listing with ID: WNZ%201898
2026-03-28 14:07:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WNZ%25201898%27 HTTP/1.1" 200 None
2026-03-28 14:07:49 [bca.uk] INFO: Scrape type for WNZ%201898: 0
2026-03-28 14:07:49 [bca.uk] INFO: Found listing with ID: RA16%20FGU
2026-03-28 14:07:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27RA16%2520FGU%27 HTTP/1.1" 200 None
2026-03-28 14:07:49 [bca.uk] INFO: Scrape type for RA16%20FGU: 0
2026-03-28 14:07:49 [bca.uk] INFO: Found listing with ID: AJ15%20UCW
2026-03-28 14:07:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27AJ15%2520UCW%27 HTTP/1.1" 200 None
2026-03-28 14:07:49 [bca.uk] INFO: Scrape type for AJ15%20UCW: 0
2026-03-28 14:07:49 [bca.uk] INFO: Found listing with ID: GU59%20DWO
2026-03-28 14:07:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GU59%2520DWO%27 HTTP/1.1" 200 None
2026-03-28 14:07:49 [bca.uk] INFO: Scrape type for GU59%20DWO: 0
2026-03-28 14:07:49 [bca.uk] INFO: Found listing with ID: RK11%20VNW
2026-03-28 14:07:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27RK11%2520VNW%27 HTTP/1.1" 200 None
2026-03-28 14:07:49 [bca.uk] INFO: Scrape type for RK11%20VNW: 0
2026-03-28 14:07:49 [bca.uk] INFO: Found listing with ID: SP08%20NVS
2026-03-28 14:07:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SP08%2520NVS%27 HTTP/1.1" 200 None
2026-03-28 14:07:49 [bca.uk] INFO: Scrape type for SP08%20NVS: 0
2026-03-28 14:07:49 [bca.uk] INFO: Found listing with ID: BU11%20RTV
2026-03-28 14:07:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BU11%2520RTV%27 HTTP/1.1" 200 None
2026-03-28 14:07:49 [bca.uk] INFO: Scrape type for BU11%20RTV: 0
2026-03-28 14:07:49 [bca.uk] INFO: Found listing with ID: KR65%20OTY
2026-03-28 14:07:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KR65%2520OTY%27 HTTP/1.1" 200 None
2026-03-28 14:07:49 [bca.uk] INFO: Scrape type for KR65%20OTY: 0
2026-03-28 14:07:49 [bca.uk] INFO: Found listing with ID: RK64%20CYT
2026-03-28 14:07:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27RK64%2520CYT%27 HTTP/1.1" 200 None
2026-03-28 14:07:49 [bca.uk] INFO: Scrape type for RK64%20CYT: 0
2026-03-28 14:07:49 [bca.uk] INFO: Found listing with ID: LN10%20VMY
2026-03-28 14:07:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LN10%2520VMY%27 HTTP/1.1" 200 None
2026-03-28 14:07:49 [bca.uk] INFO: Scrape type for LN10%20VMY: 0
2026-03-28 14:07:49 [bca.uk] INFO: Found listing with ID: DG59%20XEM
2026-03-28 14:07:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DG59%2520XEM%27 HTTP/1.1" 200 None
2026-03-28 14:07:49 [bca.uk] INFO: Scrape type for DG59%20XEM: 0
2026-03-28 14:07:49 [bca.uk] INFO: Found listing with ID: SN65%20YTA
2026-03-28 14:07:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SN65%2520YTA%27 HTTP/1.1" 200 None
2026-03-28 14:07:49 [bca.uk] INFO: Scrape type for SN65%20YTA: 0
2026-03-28 14:07:49 [bca.uk] INFO: Found listing with ID: YJ18%20ZAG
2026-03-28 14:07:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YJ18%2520ZAG%27 HTTP/1.1" 200 None
2026-03-28 14:07:49 [bca.uk] INFO: Scrape type for YJ18%20ZAG: 0
2026-03-28 14:07:49 [bca.uk] INFO: Found listing with ID: CK15%20AEP
2026-03-28 14:07:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27CK15%2520AEP%27 HTTP/1.1" 200 None
2026-03-28 14:07:49 [bca.uk] INFO: Scrape type for CK15%20AEP: 0
2026-03-28 14:07:49 [bca.uk] INFO: Found listing with ID: DA66%20OXP
2026-03-28 14:07:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DA66%2520OXP%27 HTTP/1.1" 200 None
2026-03-28 14:07:49 [bca.uk] INFO: Scrape type for DA66%20OXP: 2
2026-03-28 14:07:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 32fe26a0-c2ca-5b0b-80f2-903fdc9c1704 with identifier: DA66%20OXP
2026-03-28 14:07:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 32fe26a0-c2ca-5b0b-80f2-903fdc9c1704 with scrape type 2
2026-03-28 14:07:49 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 32fe26a0-c2ca-5b0b-80f2-903fdc9c1704 with scrape type 2
2026-03-28 14:07:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 32fe26a0-c2ca-5b0b-80f2-903fdc9c1704, identifier: DA66%20OXP
2026-03-28 14:07:50 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/VO67OHE/42792220?sv=2020-08-04&st=2026-03-28T14%3A07%3A49Z&se=2026-03-28T14%3A32%3A49Z&sr=b&sp=r&sig=hi306iOBJ1MdtnUuCM2GqJ4jJbX%2Bc3I4fiy4m%2FWA7CY%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=VO67%20OHE-GB>
2026-03-28 14:07:50 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/PK68NZT/42809697?sv=2020-08-04&st=2026-03-28T14%3A07%3A49Z&se=2026-03-28T14%3A32%3A49Z&sr=b&sp=r&sig=MlSmp8QnvmrDDMWD0h20OzEr8AtAE1qX43dTRufEQSs%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=PK68%20NZT-GB>
2026-03-28 14:07:50 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WV16UWB/698284418/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698284418>
2026-03-28 14:07:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WD66RGU/698920147/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/WD66RGU/42809743?sv=2020-08-04&st=2026-03-28T14%3A07%3A39Z&se=2026-03-28T14%3A32%3A39Z&sr=b&sp=r&sig=eU%2FGhaTr1i0XPFaLo6SDB0gBHhQi%2B9mP%2FEm%2BYcvp8RU%3D)
2026-03-28 14:07:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KR71ZWG/698934234/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/KR71ZWG/42809993?sv=2020-08-04&st=2026-03-28T14%3A07%3A39Z&se=2026-03-28T14%3A32%3A39Z&sr=b&sp=r&sig=q0Nwjfh7efHq7efRUVEUOaczVGuVkotTNm5IHVRKC6A%3D)
2026-03-28 14:07:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HD12PKZ/698107376/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/HD12PKZ/42794343?sv=2020-08-04&st=2026-03-28T14%3A07%3A30Z&se=2026-03-28T14%3A32%3A30Z&sr=b&sp=r&sig=YZpH6P9lYVvbxX67%2FUii%2FWyl8Su4sjTpWSDxxHtoHk0%3D)
2026-03-28 14:07:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 32fe26a0-c2ca-5b0b-80f2-903fdc9c1704 with identifier: DA66%20OXP
2026-03-28 14:07:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 32fe26a0-c2ca-5b0b-80f2-903fdc9c1704 with identifier: DA66%20OXP
2026-03-28 14:07:50 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 32fe26a0-c2ca-5b0b-80f2-903fdc9c1704 with identifier: DA66%20OXP to the API
2026-03-28 14:07:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:07:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:07:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=18&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 139,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=DA66%20OXP-GB',
'category': 'Car',
'color': 'blue',
'currency': 'GBP',
'doors_number': 5,
'engine': '2.0L',
'expiration_date': '2026-03-29T10:00:00Z',
'fuel_type': 'Diesel',
'id': '32fe26a0-c2ca-5b0b-80f2-903fdc9c1704',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'DA66 OXP',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=DA66%20OXP&vehicleType=*',
'listing': 'auction',
'location': 'Manchester',
'make': 'LAND ROVER',
'model': 'DISCOVERY SPORT',
'odometer': 59108,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-01-01',
'seller_name': None,
'title': 'LAND ROVER DISCOVERY SPORT 2.0 TD4 180 HSE LUXURY StationWagon',
'transmission': 'automatic',
'trim': 'TD4 180 HSE LUXURY',
'vin': 'SALCA2AN1HH661560',
'year': 2017}
2026-03-28 14:07:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DA66%2520OXP%27 HTTP/1.1" 200 None
2026-03-28 14:07:50 [bca.uk] INFO: Saving data for DA66%20OXP: {'auction_closing_time': 1774778400.0, 'created_time': 1774188600.455437, 'last_price_update_time': 1774706870.726418}
2026-03-28 14:07:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='DA66%2520OXP') HTTP/1.1" 204 0
2026-03-28 14:07:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:07:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a1fdb4210>
2026-03-28 14:07:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:07:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:07:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:07:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5fc655ed-6705-5d8a-9f72-de0010832a06/5fc655ed-6705-5d8a-9f72-de0010832a06_image_2.jpg HTTP/1.1" 201 0
2026-03-28 14:07:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FWD66RGU%252F698920182%252F600') HTTP/1.1" 204 0
2026-03-28 14:07:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WD66RGU/698920182/600 saved to cache
2026-03-28 14:07:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 5fc655ed-6705-5d8a-9f72-de0010832a06
2026-03-28 14:07:50 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:07:50 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:07:50 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:07:50 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:07:50 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:07:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:07:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2d833e50>
2026-03-28 14:07:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:07:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:07:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:07:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c1e22119-0b44-5e50-aa2c-6734ba2fd45e/c1e22119-0b44-5e50-aa2c-6734ba2fd45e_image_7.jpg HTTP/1.1" 201 0
2026-03-28 14:07:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FKR71ZWG%252F698934348%252F600') HTTP/1.1" 204 0
2026-03-28 14:07:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KR71ZWG/698934348/600 saved to cache
2026-03-28 14:07:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item c1e22119-0b44-5e50-aa2c-6734ba2fd45e
2026-03-28 14:07:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:07:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c0fa850>
2026-03-28 14:07:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:07:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:07:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:07:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c1e22119-0b44-5e50-aa2c-6734ba2fd45e/c1e22119-0b44-5e50-aa2c-6734ba2fd45e_image_2.jpg HTTP/1.1" 201 0
2026-03-28 14:07:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FKR71ZWG%252F698934251%252F600') HTTP/1.1" 204 0
2026-03-28 14:07:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KR71ZWG/698934251/600 saved to cache
2026-03-28 14:07:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item c1e22119-0b44-5e50-aa2c-6734ba2fd45e
2026-03-28 14:07:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DG19VCT/698934346/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/DG19VCT/42810037?sv=2020-08-04&st=2026-03-28T14%3A07%3A30Z&se=2026-03-28T14%3A32%3A30Z&sr=b&sp=r&sig=lNJupmOisKDrrDy4iKSYnUEsaesieb3TwVNfbpOHZYc%3D)
2026-03-28 14:07:50 [bca.uk] INFO: Found listing with ID: DE14%20WTA
2026-03-28 14:07:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DE14%2520WTA%27 HTTP/1.1" 200 None
2026-03-28 14:07:50 [bca.uk] INFO: Scrape type for DE14%20WTA: 0
2026-03-28 14:07:50 [bca.uk] INFO: Found listing with ID: DV64%20VUB
2026-03-28 14:07:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DV64%2520VUB%27 HTTP/1.1" 200 None
2026-03-28 14:07:50 [bca.uk] INFO: Scrape type for DV64%20VUB: 2
2026-03-28 14:07:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 34af190d-f0fb-5849-8fad-e0b13050d4c9 with identifier: DV64%20VUB
2026-03-28 14:07:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 34af190d-f0fb-5849-8fad-e0b13050d4c9 with scrape type 2
2026-03-28 14:07:50 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 34af190d-f0fb-5849-8fad-e0b13050d4c9 with scrape type 2
2026-03-28 14:07:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 34af190d-f0fb-5849-8fad-e0b13050d4c9, identifier: DV64%20VUB
2026-03-28 14:07:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 34af190d-f0fb-5849-8fad-e0b13050d4c9 with identifier: DV64%20VUB
2026-03-28 14:07:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 34af190d-f0fb-5849-8fad-e0b13050d4c9 with identifier: DV64%20VUB
2026-03-28 14:07:51 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 34af190d-f0fb-5849-8fad-e0b13050d4c9 with identifier: DV64%20VUB to the API
2026-03-28 14:07:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:07:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:07:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=18&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 116,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=DV64%20VUB-GB',
'category': 'Car',
'color': 'black',
'currency': 'GBP',
'doors_number': 5,
'engine': '2.1L',
'expiration_date': '2026-03-29T10:00:00Z',
'fuel_type': 'Diesel',
'id': '34af190d-f0fb-5849-8fad-e0b13050d4c9',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'DV64 VUB',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=DV64%20VUB&vehicleType=*',
'listing': 'auction',
'location': 'Manchester',
'make': 'MERCEDES-BENZ',
'model': 'A200',
'odometer': 70085,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2014-01-01',
'seller_name': None,
'title': 'MERCEDES-BENZ A200 2.1 CDI AMG SPORT Hatchback',
'transmission': 'manual',
'trim': 'CDI AMG SPORT',
'vin': 'WDD1760082V037956',
'year': 2014}
2026-03-28 14:07:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DV64%2520VUB%27 HTTP/1.1" 200 None
2026-03-28 14:07:51 [bca.uk] INFO: Saving data for DV64%20VUB: {'auction_closing_time': 1774778400.0, 'created_time': 1774524384.797414, 'last_price_update_time': 1774706871.475019}
2026-03-28 14:07:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='DV64%2520VUB') HTTP/1.1" 204 0
2026-03-28 14:07:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NL64KGO/698157130/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/NL64KGO/42810049?sv=2020-08-04&st=2026-03-28T14%3A03%3A48Z&se=2026-03-28T14%3A28%3A48Z&sr=b&sp=r&sig=GCr8gvM5cBzuZAr6Na7pdcamsQO4tFs2xqxAknQovkg%3D)
2026-03-28 14:07:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KV16LDZ/698296895/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/KV16LDZ/42797857?sv=2020-08-04&st=2026-03-28T14%3A03%3A49Z&se=2026-03-28T14%3A28%3A49Z&sr=b&sp=r&sig=7pGIWvim4gxli5cifd615Lw7Q0s6ljm9z8msDK3x6Js%3D)
2026-03-28 14:07:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BV61MVO/698928556/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/BV61MVO/42809949?sv=2020-08-04&st=2026-03-28T14%3A03%3A49Z&se=2026-03-28T14%3A28%3A49Z&sr=b&sp=r&sig=PJNKzVVeJy1FKQt32eUXNOOsoTV6pqchYxeSDnPTh7w%3D)
2026-03-28 14:07:51 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/OY67JPV/698107940/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698107940>
2026-03-28 14:07:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WU19VDC/698045620/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/WU19VDC/42792335?sv=2020-08-04&st=2026-03-28T14%3A03%3A50Z&se=2026-03-28T14%3A28%3A50Z&sr=b&sp=r&sig=Mqd3JjFAqa%2F7fy72g8Zcx8u%2F7XgFrycUpKRkPg1JOjA%3D)
2026-03-28 14:07:51 [bca.uk] INFO: Found listing with ID: GV65%20GPK
2026-03-28 14:07:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GV65%2520GPK%27 HTTP/1.1" 200 None
2026-03-28 14:07:51 [bca.uk] INFO: Scrape type for GV65%20GPK: 0
2026-03-28 14:07:51 [bca.uk] INFO: Found listing with ID: KS65%20YFC
2026-03-28 14:07:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KS65%2520YFC%27 HTTP/1.1" 200 None
2026-03-28 14:07:51 [bca.uk] INFO: Scrape type for KS65%20YFC: 0
2026-03-28 14:07:51 [bca.uk] INFO: Found listing with ID: MJ18%20MZG
2026-03-28 14:07:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MJ18%2520MZG%27 HTTP/1.1" 200 None
2026-03-28 14:07:51 [bca.uk] INFO: Scrape type for MJ18%20MZG: 2
2026-03-28 14:07:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 94302c6b-31c7-5223-9f3b-57a2a5df8b07 with identifier: MJ18%20MZG
2026-03-28 14:07:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 94302c6b-31c7-5223-9f3b-57a2a5df8b07 with scrape type 2
2026-03-28 14:07:51 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 94302c6b-31c7-5223-9f3b-57a2a5df8b07 with scrape type 2
2026-03-28 14:07:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 94302c6b-31c7-5223-9f3b-57a2a5df8b07, identifier: MJ18%20MZG
2026-03-28 14:07:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FY66OTD/698150796/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/FY66OTD/42794791?sv=2020-08-04&st=2026-03-28T14%3A03%3A46Z&se=2026-03-28T14%3A28%3A46Z&sr=b&sp=r&sig=nyWr7cManqycrjqVh9Sq0fegCWU0XCSire1eKcJWKLA%3D)
2026-03-28 14:07:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FV17TYW/698767998/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/FV17TYW/42807142?sv=2020-08-04&st=2026-03-28T14%3A03%3A46Z&se=2026-03-28T14%3A28%3A46Z&sr=b&sp=r&sig=3LbtNEGnFqYV4bS0F0%2BmsB%2FgfFSYLdditNDmvy7kudU%3D)
2026-03-28 14:07:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 94302c6b-31c7-5223-9f3b-57a2a5df8b07 with identifier: MJ18%20MZG
2026-03-28 14:07:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 94302c6b-31c7-5223-9f3b-57a2a5df8b07 with identifier: MJ18%20MZG
2026-03-28 14:07:51 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 94302c6b-31c7-5223-9f3b-57a2a5df8b07 with identifier: MJ18%20MZG to the API
2026-03-28 14:07:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:07:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:07:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=18&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 117,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=MJ18%20MZG-GB',
'category': 'Car',
'color': 'blue',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.0L',
'expiration_date': '2026-03-29T10:00:00Z',
'fuel_type': 'Petrol',
'id': '94302c6b-31c7-5223-9f3b-57a2a5df8b07',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'MJ18 MZG',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=MJ18%20MZG&vehicleType=*',
'listing': 'auction',
'location': 'Manchester',
'make': 'DACIA',
'model': 'SANDERO',
'odometer': 79220,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-01-01',
'seller_name': None,
'title': 'DACIA SANDERO 1.0 SCE AMBIANCE Hatchback',
'transmission': 'manual',
'trim': 'SCE AMBIANCE',
'vin': 'UU15SDMC560239915',
'year': 2018}
2026-03-28 14:07:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MJ18%2520MZG%27 HTTP/1.1" 200 None
2026-03-28 14:07:51 [bca.uk] INFO: Saving data for MJ18%20MZG: {'auction_closing_time': 1774778400.0, 'created_time': 1774425889.550395, 'last_price_update_time': 1774706871.998451}
2026-03-28 14:07:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='MJ18%2520MZG') HTTP/1.1" 204 0
2026-03-28 14:07:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WV16UWB/698284418/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/WV16UWB/42797605?sv=2020-08-04&st=2026-03-28T14%3A03%3A48Z&se=2026-03-28T14%3A28%3A48Z&sr=b&sp=r&sig=tZmKWGpA7mZ9Rie4bcnpNzrMU30KCOw%2BfaCUNgMn820%3D)
2026-03-28 14:07:52 [bca.uk] INFO: Found listing with ID: MT67%20CGG
2026-03-28 14:07:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MT67%2520CGG%27 HTTP/1.1" 200 None
2026-03-28 14:07:52 [bca.uk] INFO: Scrape type for MT67%20CGG: 2
2026-03-28 14:07:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 693a6cd5-de7e-5864-bddb-95f8520a410c with identifier: MT67%20CGG
2026-03-28 14:07:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 693a6cd5-de7e-5864-bddb-95f8520a410c with scrape type 2
2026-03-28 14:07:52 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 693a6cd5-de7e-5864-bddb-95f8520a410c with scrape type 2
2026-03-28 14:07:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 693a6cd5-de7e-5864-bddb-95f8520a410c, identifier: MT67%20CGG
2026-03-28 14:07:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:07:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c799190>
2026-03-28 14:07:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:07:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:07:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:07:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5fc655ed-6705-5d8a-9f72-de0010832a06/5fc655ed-6705-5d8a-9f72-de0010832a06_image_1.jpg HTTP/1.1" 201 0
2026-03-28 14:07:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FWD66RGU%252F698920147%252F600') HTTP/1.1" 204 0
2026-03-28 14:07:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WD66RGU/698920147/600 saved to cache
2026-03-28 14:07:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 5fc655ed-6705-5d8a-9f72-de0010832a06
2026-03-28 14:07:52 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 5fc655ed-6705-5d8a-9f72-de0010832a06, skipping ID generation
2026-03-28 14:07:52 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 5fc655ed-6705-5d8a-9f72-de0010832a06 sending to next pipeline
2026-03-28 14:07:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 5fc655ed-6705-5d8a-9f72-de0010832a06, identifier: WD66%20RGU
2026-03-28 14:07:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:07:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a1fd90bd0>
2026-03-28 14:07:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:07:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:07:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:07:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c1e22119-0b44-5e50-aa2c-6734ba2fd45e/c1e22119-0b44-5e50-aa2c-6734ba2fd45e_image_1.jpg HTTP/1.1" 201 0
2026-03-28 14:07:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FKR71ZWG%252F698934234%252F600') HTTP/1.1" 204 0
2026-03-28 14:07:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KR71ZWG/698934234/600 saved to cache
2026-03-28 14:07:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item c1e22119-0b44-5e50-aa2c-6734ba2fd45e
2026-03-28 14:07:52 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: c1e22119-0b44-5e50-aa2c-6734ba2fd45e, skipping ID generation
2026-03-28 14:07:52 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item c1e22119-0b44-5e50-aa2c-6734ba2fd45e sending to next pipeline
2026-03-28 14:07:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: c1e22119-0b44-5e50-aa2c-6734ba2fd45e, identifier: KR71%20ZWG
2026-03-28 14:07:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:07:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c972890>
2026-03-28 14:07:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:07:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:07:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:07:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d7dfafc8-5ff1-5ae1-8e11-8b4c127fde8a/d7dfafc8-5ff1-5ae1-8e11-8b4c127fde8a_image_5.jpg HTTP/1.1" 201 0
2026-03-28 14:07:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FHD12PKZ%252F698107376%252F600') HTTP/1.1" 204 0
2026-03-28 14:07:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HD12PKZ/698107376/600 saved to cache
2026-03-28 14:07:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item d7dfafc8-5ff1-5ae1-8e11-8b4c127fde8a
2026-03-28 14:07:52 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: d7dfafc8-5ff1-5ae1-8e11-8b4c127fde8a, skipping ID generation
2026-03-28 14:07:52 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item d7dfafc8-5ff1-5ae1-8e11-8b4c127fde8a sending to next pipeline
2026-03-28 14:07:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: d7dfafc8-5ff1-5ae1-8e11-8b4c127fde8a, identifier: HD12%20PKZ
2026-03-28 14:07:52 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:07:52 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:07:52 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:07:52 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:07:52 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:07:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:07:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c84ff10>
2026-03-28 14:07:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:07:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:07:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:07:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_82ce45e5-a8c4-552b-855d-b8e5816f3055/82ce45e5-a8c4-552b-855d-b8e5816f3055_image_8.jpg HTTP/1.1" 201 0
2026-03-28 14:07:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FDG19VCT%252F698934346%252F600') HTTP/1.1" 204 0
2026-03-28 14:07:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DG19VCT/698934346/600 saved to cache
2026-03-28 14:07:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 82ce45e5-a8c4-552b-855d-b8e5816f3055
2026-03-28 14:07:52 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 82ce45e5-a8c4-552b-855d-b8e5816f3055, skipping ID generation
2026-03-28 14:07:52 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 82ce45e5-a8c4-552b-855d-b8e5816f3055 sending to next pipeline
2026-03-28 14:07:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 82ce45e5-a8c4-552b-855d-b8e5816f3055, identifier: DG19%20VCT
2026-03-28 14:07:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/X11BBM/697603979/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/X11BBM/42809514?sv=2020-08-04&st=2026-03-28T14%3A03%3A48Z&se=2026-03-28T14%3A28%3A48Z&sr=b&sp=r&sig=iFv2U%2F%2BmiJcqZ%2BPwwi1Pjq9aw6DZNzQsG5k9GNFr4Nw%3D)
2026-03-28 14:07:52 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FV17TYW/698767980/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698767980>
2026-03-28 14:07:52 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FY66OTD/698150784/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698150784>
2026-03-28 14:07:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 693a6cd5-de7e-5864-bddb-95f8520a410c with identifier: MT67%20CGG
2026-03-28 14:07:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 693a6cd5-de7e-5864-bddb-95f8520a410c with identifier: MT67%20CGG
2026-03-28 14:07:52 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 693a6cd5-de7e-5864-bddb-95f8520a410c with identifier: MT67%20CGG to the API
2026-03-28 14:07:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:07:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:07:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=18&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 122,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=MT67%20CGG-GB',
'category': 'Car',
'color': 'silver',
'currency': 'GBP',
'doors_number': 5,
'engine': '2.0L',
'expiration_date': '2026-03-29T10:00:00Z',
'fuel_type': 'Diesel',
'id': '693a6cd5-de7e-5864-bddb-95f8520a410c',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'MT67 CGG',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=MT67%20CGG&vehicleType=*',
'listing': 'auction',
'location': 'Manchester',
'make': 'FORD',
'model': 'KUGA',
'odometer': 90032,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-01-01',
'seller_name': None,
'title': 'FORD KUGA 2.0 TDCI 150 2WD TITANIUM StationWagon',
'transmission': 'manual',
'trim': 'TDCI 150 2WD TITANIUM',
'vin': 'WF0AXXWPMAHG68374',
'year': 2017}
2026-03-28 14:07:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MT67%2520CGG%27 HTTP/1.1" 200 None
2026-03-28 14:07:53 [bca.uk] INFO: Saving data for MT67%20CGG: {'auction_closing_time': 1774778400.0, 'created_time': 1774188526.931401, 'last_price_update_time': 1774706873.062176}
2026-03-28 14:07:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='MT67%2520CGG') HTTP/1.1" 204 0
2026-03-28 14:07:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 5fc655ed-6705-5d8a-9f72-de0010832a06 with identifier: WD66%20RGU
2026-03-28 14:07:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 5fc655ed-6705-5d8a-9f72-de0010832a06 with identifier: WD66%20RGU
2026-03-28 14:07:53 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 5fc655ed-6705-5d8a-9f72-de0010832a06 with identifier: WD66%20RGU to the API
2026-03-28 14:07:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:07:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:07:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WD66RGU/698920147/600>
{'auction_title': '',
'c_o_2_emission_value': 139,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5fc655ed-6705-5d8a-9f72-de0010832a06/5fc655ed-6705-5d8a-9f72-de0010832a06_expert_report_file_ff9d4d81-51b3-4bae-b2c2-dcafd024c863.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=WD66%20RGU-GB',
'category': 'Car',
'color': 'brown',
'currency': 'GBP',
'doors_number': 5,
'engine': '2.0L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Diesel',
'id': '5fc655ed-6705-5d8a-9f72-de0010832a06',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'WD66 RGU',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=WD66%20RGU&vehicleType=*',
'listing': 'auction',
'location': 'Bridgwater',
'make': 'SEAT',
'model': 'ALHAMBRA',
'odometer': 93098,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 11,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5fc655ed-6705-5d8a-9f72-de0010832a06/5fc655ed-6705-5d8a-9f72-de0010832a06_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 53193,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WD66RGU/698920120/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5fc655ed-6705-5d8a-9f72-de0010832a06/5fc655ed-6705-5d8a-9f72-de0010832a06_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 53753,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WD66RGU/698920147/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5fc655ed-6705-5d8a-9f72-de0010832a06/5fc655ed-6705-5d8a-9f72-de0010832a06_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 50753,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WD66RGU/698920182/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5fc655ed-6705-5d8a-9f72-de0010832a06/5fc655ed-6705-5d8a-9f72-de0010832a06_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 50692,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WD66RGU/698920210/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5fc655ed-6705-5d8a-9f72-de0010832a06/5fc655ed-6705-5d8a-9f72-de0010832a06_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 47880,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WD66RGU/698920231/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5fc655ed-6705-5d8a-9f72-de0010832a06/5fc655ed-6705-5d8a-9f72-de0010832a06_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 47368,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WD66RGU/698920242/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5fc655ed-6705-5d8a-9f72-de0010832a06/5fc655ed-6705-5d8a-9f72-de0010832a06_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 88985,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WD66RGU/698920260/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5fc655ed-6705-5d8a-9f72-de0010832a06/5fc655ed-6705-5d8a-9f72-de0010832a06_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 85587,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WD66RGU/698920287/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5fc655ed-6705-5d8a-9f72-de0010832a06/5fc655ed-6705-5d8a-9f72-de0010832a06_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 92259,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WD66RGU/698920317/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5fc655ed-6705-5d8a-9f72-de0010832a06/5fc655ed-6705-5d8a-9f72-de0010832a06_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 81444,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WD66RGU/698920354/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-01-01',
'seller_name': None,
'title': 'SEAT ALHAMBRA 2.0 TDI CR 184 SE LUX DSG MPV',
'transmission': 'automatic',
'trim': 'TDI CR 184 SE LUX DSG',
'vin': 'VSSZZZ7NZHV717106',
'year': 2017}
2026-03-28 14:07:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WD66%2520RGU%27 HTTP/1.1" 200 None
2026-03-28 14:07:53 [bca.uk] INFO: Saving data for WD66%20RGU: {'created_time': 1774706873.487971, 'last_price_update_time': 1774706873.487984, 'auction_closing_time': 1774864800.0}
2026-03-28 14:07:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='WD66%2520RGU') HTTP/1.1" 204 0
2026-03-28 14:07:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: c1e22119-0b44-5e50-aa2c-6734ba2fd45e with identifier: KR71%20ZWG
2026-03-28 14:07:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: c1e22119-0b44-5e50-aa2c-6734ba2fd45e with identifier: KR71%20ZWG
2026-03-28 14:07:53 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: c1e22119-0b44-5e50-aa2c-6734ba2fd45e with identifier: KR71%20ZWG to the API
2026-03-28 14:07:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:07:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:07:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KR71ZWG/698934234/600>
{'auction_title': '',
'c_o_2_emission_value': 248,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c1e22119-0b44-5e50-aa2c-6734ba2fd45e/c1e22119-0b44-5e50-aa2c-6734ba2fd45e_expert_report_file_9e94038e-c09f-478b-851b-1466604bc0a9.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=KR71%20ZWG-GB',
'category': 'Car',
'color': 'white',
'currency': 'GBP',
'doors_number': 2,
'engine': '5.0L',
'expiration_date': '2026-03-31T10:00:00Z',
'fuel_type': 'Petrol',
'id': 'c1e22119-0b44-5e50-aa2c-6734ba2fd45e',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'KR71 ZWG',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=KR71%20ZWG&vehicleType=*',
'listing': 'auction',
'location': 'Manchester',
'make': 'JAGUAR',
'model': 'F-TYPE',
'odometer': 28863,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 11,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c1e22119-0b44-5e50-aa2c-6734ba2fd45e/c1e22119-0b44-5e50-aa2c-6734ba2fd45e_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 41708,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KR71ZWG/698934212/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c1e22119-0b44-5e50-aa2c-6734ba2fd45e/c1e22119-0b44-5e50-aa2c-6734ba2fd45e_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 41770,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KR71ZWG/698934234/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c1e22119-0b44-5e50-aa2c-6734ba2fd45e/c1e22119-0b44-5e50-aa2c-6734ba2fd45e_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 41980,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KR71ZWG/698934251/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c1e22119-0b44-5e50-aa2c-6734ba2fd45e/c1e22119-0b44-5e50-aa2c-6734ba2fd45e_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 42681,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KR71ZWG/698934262/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c1e22119-0b44-5e50-aa2c-6734ba2fd45e/c1e22119-0b44-5e50-aa2c-6734ba2fd45e_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 40447,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KR71ZWG/698934286/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c1e22119-0b44-5e50-aa2c-6734ba2fd45e/c1e22119-0b44-5e50-aa2c-6734ba2fd45e_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 40333,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KR71ZWG/698934300/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c1e22119-0b44-5e50-aa2c-6734ba2fd45e/c1e22119-0b44-5e50-aa2c-6734ba2fd45e_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 72412,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KR71ZWG/698934322/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c1e22119-0b44-5e50-aa2c-6734ba2fd45e/c1e22119-0b44-5e50-aa2c-6734ba2fd45e_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 79701,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KR71ZWG/698934348/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c1e22119-0b44-5e50-aa2c-6734ba2fd45e/c1e22119-0b44-5e50-aa2c-6734ba2fd45e_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 90795,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KR71ZWG/698934368/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c1e22119-0b44-5e50-aa2c-6734ba2fd45e/c1e22119-0b44-5e50-aa2c-6734ba2fd45e_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 74316,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KR71ZWG/698934385/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-01-01',
'seller_name': None,
'title': 'JAGUAR F-TYPE 5.0 P450 V8 S/C AWD R-DYNAMIC Coupe',
'transmission': 'automatic',
'trim': 'P450 V8 S/C AWD R-DYNAMIC',
'vin': 'SAJDA1AE4NCK77952',
'year': 2021}
2026-03-28 14:07:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KR71%2520ZWG%27 HTTP/1.1" 200 None
2026-03-28 14:07:53 [bca.uk] INFO: Saving data for KR71%20ZWG: {'created_time': 1774706873.886823, 'last_price_update_time': 1774706873.886834, 'auction_closing_time': 1774951200.0}
2026-03-28 14:07:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='KR71%2520ZWG') HTTP/1.1" 204 0
2026-03-28 14:07:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: d7dfafc8-5ff1-5ae1-8e11-8b4c127fde8a with identifier: HD12%20PKZ
2026-03-28 14:07:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: d7dfafc8-5ff1-5ae1-8e11-8b4c127fde8a with identifier: HD12%20PKZ
2026-03-28 14:07:54 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: d7dfafc8-5ff1-5ae1-8e11-8b4c127fde8a with identifier: HD12%20PKZ to the API
2026-03-28 14:07:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:07:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:07:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HD12PKZ/698107376/600>
{'auction_title': '',
'c_o_2_emission_value': 129,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d7dfafc8-5ff1-5ae1-8e11-8b4c127fde8a/d7dfafc8-5ff1-5ae1-8e11-8b4c127fde8a_expert_report_file_b31264a1-b5ef-4c13-8faf-7a7628e0805b.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=HD12%20PKZ-GB',
'category': 'Car',
'color': 'grey',
'currency': 'GBP',
'doors_number': 4,
'engine': '2.0L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Diesel',
'id': 'd7dfafc8-5ff1-5ae1-8e11-8b4c127fde8a',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'HD12 PKZ',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=HD12%20PKZ&vehicleType=*',
'listing': 'auction',
'location': 'Bridgwater',
'make': 'BMW',
'model': '520D',
'odometer': 86086,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 11,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d7dfafc8-5ff1-5ae1-8e11-8b4c127fde8a/d7dfafc8-5ff1-5ae1-8e11-8b4c127fde8a_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 53647,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HD12PKZ/698107304/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d7dfafc8-5ff1-5ae1-8e11-8b4c127fde8a/d7dfafc8-5ff1-5ae1-8e11-8b4c127fde8a_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 53180,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HD12PKZ/698107317/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d7dfafc8-5ff1-5ae1-8e11-8b4c127fde8a/d7dfafc8-5ff1-5ae1-8e11-8b4c127fde8a_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 50270,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HD12PKZ/698107334/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d7dfafc8-5ff1-5ae1-8e11-8b4c127fde8a/d7dfafc8-5ff1-5ae1-8e11-8b4c127fde8a_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 50292,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HD12PKZ/698107344/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d7dfafc8-5ff1-5ae1-8e11-8b4c127fde8a/d7dfafc8-5ff1-5ae1-8e11-8b4c127fde8a_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 45050,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HD12PKZ/698107360/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d7dfafc8-5ff1-5ae1-8e11-8b4c127fde8a/d7dfafc8-5ff1-5ae1-8e11-8b4c127fde8a_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 45203,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HD12PKZ/698107376/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d7dfafc8-5ff1-5ae1-8e11-8b4c127fde8a/d7dfafc8-5ff1-5ae1-8e11-8b4c127fde8a_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 83804,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HD12PKZ/698107396/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d7dfafc8-5ff1-5ae1-8e11-8b4c127fde8a/d7dfafc8-5ff1-5ae1-8e11-8b4c127fde8a_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 88009,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HD12PKZ/698107417/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d7dfafc8-5ff1-5ae1-8e11-8b4c127fde8a/d7dfafc8-5ff1-5ae1-8e11-8b4c127fde8a_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 99950,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HD12PKZ/698107440/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d7dfafc8-5ff1-5ae1-8e11-8b4c127fde8a/d7dfafc8-5ff1-5ae1-8e11-8b4c127fde8a_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 81610,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HD12PKZ/698107458/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2012-01-01',
'seller_name': None,
'title': 'BMW 520D 2.0 M SPORT STEP S/S Saloon',
'transmission': 'manual',
'trim': 'M SPORT STEP S/S',
'vin': 'WBAFW12020C842958',
'year': 2012}
2026-03-28 14:07:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27HD12%2520PKZ%27 HTTP/1.1" 200 None
2026-03-28 14:07:54 [bca.uk] INFO: Saving data for HD12%20PKZ: {'created_time': 1774706874.329359, 'last_price_update_time': 1774706874.329373, 'auction_closing_time': 1774864800.0}
2026-03-28 14:07:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='HD12%2520PKZ') HTTP/1.1" 204 0
2026-03-28 14:07:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 82ce45e5-a8c4-552b-855d-b8e5816f3055 with identifier: DG19%20VCT
2026-03-28 14:07:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 82ce45e5-a8c4-552b-855d-b8e5816f3055 with identifier: DG19%20VCT
2026-03-28 14:07:54 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 82ce45e5-a8c4-552b-855d-b8e5816f3055 with identifier: DG19%20VCT to the API
2026-03-28 14:07:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:07:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:07:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DG19VCT/698934346/600>
{'auction_title': '',
'c_o_2_emission_value': 120,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_82ce45e5-a8c4-552b-855d-b8e5816f3055/82ce45e5-a8c4-552b-855d-b8e5816f3055_expert_report_file_af5c38ea-6b4e-49c2-9422-35293d53e9e8.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=DG19%20VCT-GB',
'category': 'Car',
'color': 'white',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.2L',
'expiration_date': '2026-03-29T10:00:00Z',
'fuel_type': 'Petrol',
'id': '82ce45e5-a8c4-552b-855d-b8e5816f3055',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'DG19 VCT',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=DG19%20VCT&vehicleType=*',
'listing': 'auction',
'location': 'Manchester',
'make': 'VAUXHALL',
'model': 'GRANDLAND X',
'odometer': 37729,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 11,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_82ce45e5-a8c4-552b-855d-b8e5816f3055/82ce45e5-a8c4-552b-855d-b8e5816f3055_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 44340,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DG19VCT/698934194/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_82ce45e5-a8c4-552b-855d-b8e5816f3055/82ce45e5-a8c4-552b-855d-b8e5816f3055_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 43427,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DG19VCT/698934207/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_82ce45e5-a8c4-552b-855d-b8e5816f3055/82ce45e5-a8c4-552b-855d-b8e5816f3055_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 41177,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DG19VCT/698934222/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_82ce45e5-a8c4-552b-855d-b8e5816f3055/82ce45e5-a8c4-552b-855d-b8e5816f3055_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 43225,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DG19VCT/698934237/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_82ce45e5-a8c4-552b-855d-b8e5816f3055/82ce45e5-a8c4-552b-855d-b8e5816f3055_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 44353,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DG19VCT/698934252/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_82ce45e5-a8c4-552b-855d-b8e5816f3055/82ce45e5-a8c4-552b-855d-b8e5816f3055_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 40826,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DG19VCT/698934270/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_82ce45e5-a8c4-552b-855d-b8e5816f3055/82ce45e5-a8c4-552b-855d-b8e5816f3055_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 67377,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DG19VCT/698934297/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_82ce45e5-a8c4-552b-855d-b8e5816f3055/82ce45e5-a8c4-552b-855d-b8e5816f3055_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 73360,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DG19VCT/698934321/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_82ce45e5-a8c4-552b-855d-b8e5816f3055/82ce45e5-a8c4-552b-855d-b8e5816f3055_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 82476,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DG19VCT/698934346/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_82ce45e5-a8c4-552b-855d-b8e5816f3055/82ce45e5-a8c4-552b-855d-b8e5816f3055_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 85591,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DG19VCT/698934367/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-01-01',
'seller_name': None,
'title': 'VAUXHALL GRANDLAND X 1.2 T 130 SE Hatchback',
'transmission': 'manual',
'trim': 'T 130 SE',
'vin': 'W0VZRHNS4KS068563',
'year': 2019}
2026-03-28 14:07:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DG19%2520VCT%27 HTTP/1.1" 200 None
2026-03-28 14:07:54 [bca.uk] INFO: Saving data for DG19%20VCT: {'created_time': 1774706874.728671, 'last_price_update_time': 1774706874.728685, 'auction_closing_time': 1774778400.0}
2026-03-28 14:07:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='DG19%2520VCT') HTTP/1.1" 204 0
2026-03-28 14:07:54 [bca.uk] INFO: Found listing with ID: NL64%20YGU
2026-03-28 14:07:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27NL64%2520YGU%27 HTTP/1.1" 200 None
2026-03-28 14:07:54 [bca.uk] INFO: Scrape type for NL64%20YGU: 0
2026-03-28 14:07:54 [bca.uk] INFO: Found listing with ID: PN15%20XLB
2026-03-28 14:07:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27PN15%2520XLB%27 HTTP/1.1" 200 None
2026-03-28 14:07:54 [bca.uk] INFO: Scrape type for PN15%20XLB: 0
2026-03-28 14:07:54 [bca.uk] INFO: Found listing with ID: PX64%20PPV
2026-03-28 14:07:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27PX64%2520PPV%27 HTTP/1.1" 200 None
2026-03-28 14:07:54 [bca.uk] INFO: Scrape type for PX64%20PPV: 0
2026-03-28 14:07:54 [bca.uk] INFO: Found listing with ID: RV64%20NSO
2026-03-28 14:07:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27RV64%2520NSO%27 HTTP/1.1" 200 None
2026-03-28 14:07:54 [bca.uk] INFO: Scrape type for RV64%20NSO: 0
2026-03-28 14:07:54 [bca.uk] INFO: Found listing with ID: CP64%20LLR
2026-03-28 14:07:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27CP64%2520LLR%27 HTTP/1.1" 200 None
2026-03-28 14:07:54 [bca.uk] INFO: Scrape type for CP64%20LLR: 0
2026-03-28 14:07:54 [bca.uk] INFO: Found listing with ID: SY15%20WZH
2026-03-28 14:07:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SY15%2520WZH%27 HTTP/1.1" 200 None
2026-03-28 14:07:54 [bca.uk] INFO: Scrape type for SY15%20WZH: 0
2026-03-28 14:07:54 [bca.uk] INFO: Found listing with ID: AF68%20SVE
2026-03-28 14:07:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27AF68%2520SVE%27 HTTP/1.1" 200 None
2026-03-28 14:07:54 [bca.uk] INFO: Scrape type for AF68%20SVE: 0
2026-03-28 14:07:54 [bca.uk] INFO: Found listing with ID: MV65%20OCE
2026-03-28 14:07:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MV65%2520OCE%27 HTTP/1.1" 200 None
2026-03-28 14:07:54 [bca.uk] INFO: Scrape type for MV65%20OCE: 0
2026-03-28 14:07:54 [bca.uk] INFO: Found listing with ID: PO13%20XES
2026-03-28 14:07:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27PO13%2520XES%27 HTTP/1.1" 200 None
2026-03-28 14:07:54 [bca.uk] INFO: Scrape type for PO13%20XES: 0
2026-03-28 14:07:54 [bca.uk] INFO: Found listing with ID: PX08%20FZF
2026-03-28 14:07:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27PX08%2520FZF%27 HTTP/1.1" 200 None
2026-03-28 14:07:54 [bca.uk] INFO: Scrape type for PX08%20FZF: 0
2026-03-28 14:07:54 [bca.uk] INFO: Found listing with ID: RJ67%20ZGP
2026-03-28 14:07:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27RJ67%2520ZGP%27 HTTP/1.1" 200 None
2026-03-28 14:07:54 [bca.uk] INFO: Scrape type for RJ67%20ZGP: 0
2026-03-28 14:07:54 [bca.uk] INFO: Found listing with ID: SM11%20YYC
2026-03-28 14:07:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SM11%2520YYC%27 HTTP/1.1" 200 None
2026-03-28 14:07:54 [bca.uk] INFO: Scrape type for SM11%20YYC: 0
2026-03-28 14:07:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:07:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c972ad0>
2026-03-28 14:07:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:07:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:07:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:07:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0c3c3ab5-91e6-5450-9be7-ee521ca8a766/0c3c3ab5-91e6-5450-9be7-ee521ca8a766_image_4.jpg HTTP/1.1" 201 0
2026-03-28 14:07:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FNL64KGO%252F698157130%252F600') HTTP/1.1" 204 0
2026-03-28 14:07:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NL64KGO/698157130/600 saved to cache
2026-03-28 14:07:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 0c3c3ab5-91e6-5450-9be7-ee521ca8a766
2026-03-28 14:07:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:07:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a1fe4d790>
2026-03-28 14:07:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:07:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:07:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:07:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8b90222e-e04a-5b27-ab41-392150aadde5/8b90222e-e04a-5b27-ab41-392150aadde5_image_2.jpg HTTP/1.1" 201 0
2026-03-28 14:07:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FKV16LDZ%252F698296895%252F600') HTTP/1.1" 204 0
2026-03-28 14:07:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KV16LDZ/698296895/600 saved to cache
2026-03-28 14:07:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 8b90222e-e04a-5b27-ab41-392150aadde5
2026-03-28 14:07:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:07:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2d905490>
2026-03-28 14:07:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:07:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:07:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:07:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6665ad2b-5db8-5cb5-8575-3440dfdc3f0c/6665ad2b-5db8-5cb5-8575-3440dfdc3f0c_image_3.jpg HTTP/1.1" 201 0
2026-03-28 14:07:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FBV61MVO%252F698928556%252F600') HTTP/1.1" 204 0
2026-03-28 14:07:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BV61MVO/698928556/600 saved to cache
2026-03-28 14:07:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 6665ad2b-5db8-5cb5-8575-3440dfdc3f0c
2026-03-28 14:07:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:07:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c4d2710>
2026-03-28 14:07:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:07:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:07:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:07:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2c7ab10e-203f-5d5d-b669-d394e3cfab8d/2c7ab10e-203f-5d5d-b669-d394e3cfab8d_image_1.jpg HTTP/1.1" 201 0
2026-03-28 14:07:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FWU19VDC%252F698045620%252F600') HTTP/1.1" 204 0
2026-03-28 14:07:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WU19VDC/698045620/600 saved to cache
2026-03-28 14:07:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 2c7ab10e-203f-5d5d-b669-d394e3cfab8d
2026-03-28 14:07:55 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:07:55 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:07:55 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:07:55 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:07:55 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:07:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:07:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c945910>
2026-03-28 14:07:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:07:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:07:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:07:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_40999011-32af-5ad3-a840-4cb8242ff02a/40999011-32af-5ad3-a840-4cb8242ff02a_image_6.jpg HTTP/1.1" 201 0
2026-03-28 14:07:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FFY66OTD%252F698150796%252F600') HTTP/1.1" 204 0
2026-03-28 14:07:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FY66OTD/698150796/600 saved to cache
2026-03-28 14:07:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 40999011-32af-5ad3-a840-4cb8242ff02a
2026-03-28 14:07:55 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:07:55 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:07:55 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:07:55 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:07:55 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:07:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:07:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a1fe38b90>
2026-03-28 14:07:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:07:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:07:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:07:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d7b30cd7-3fb2-520c-9629-4539584c6e2c/d7b30cd7-3fb2-520c-9629-4539584c6e2c_image_6.jpg HTTP/1.1" 201 0
2026-03-28 14:07:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FFV17TYW%252F698767998%252F600') HTTP/1.1" 204 0
2026-03-28 14:07:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FV17TYW/698767998/600 saved to cache
2026-03-28 14:07:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item d7b30cd7-3fb2-520c-9629-4539584c6e2c
2026-03-28 14:07:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/PK68NZT/42809697?sv=2020-08-04&st=2026-03-28T14%3A07%3A49Z&se=2026-03-28T14%3A32%3A49Z&sr=b&sp=r&sig=MlSmp8QnvmrDDMWD0h20OzEr8AtAE1qX43dTRufEQSs%3D> (referer: https://www.bca.co.uk/)
2026-03-28 14:07:55 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DA21SOU/697888046/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=697888046>
2026-03-28 14:07:55 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LN68RBY/698920336/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698920336>
2026-03-28 14:07:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/OY67JPV/698107940/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/OY67JPV/42810048?sv=2020-08-04&st=2026-03-28T14%3A03%3A48Z&se=2026-03-28T14%3A28%3A48Z&sr=b&sp=r&sig=3IQnxpRCaMGCrWPQZylbi%2BiY%2FkfXKw1FEE36W3dpRwo%3D)
2026-03-28 14:07:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/VO67OHE/42792220?sv=2020-08-04&st=2026-03-28T14%3A07%3A49Z&se=2026-03-28T14%3A32%3A49Z&sr=b&sp=r&sig=hi306iOBJ1MdtnUuCM2GqJ4jJbX%2Bc3I4fiy4m%2FWA7CY%3D> (referer: https://www.bca.co.uk/)
2026-03-28 14:07:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:07:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c13c290>
2026-03-28 14:07:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:07:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:07:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:07:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_214771ac-26f4-5760-a178-e14681ff06b8/214771ac-26f4-5760-a178-e14681ff06b8_image_4.jpg HTTP/1.1" 201 0
2026-03-28 14:07:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FWV16UWB%252F698284418%252F600') HTTP/1.1" 204 0
2026-03-28 14:07:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WV16UWB/698284418/600 saved to cache
2026-03-28 14:07:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 214771ac-26f4-5760-a178-e14681ff06b8
2026-03-28 14:07:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:07:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c446950>
2026-03-28 14:07:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:07:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:07:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:07:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6f52ae88-a710-5999-b75b-294cfedaf6f8/6f52ae88-a710-5999-b75b-294cfedaf6f8_image_4.jpg HTTP/1.1" 201 0
2026-03-28 14:07:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FX11BBM%252F697603979%252F600') HTTP/1.1" 204 0
2026-03-28 14:07:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/X11BBM/697603979/600 saved to cache
2026-03-28 14:07:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 6f52ae88-a710-5999-b75b-294cfedaf6f8
2026-03-28 14:07:55 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WU19VDC/698045618/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=WU19VDC-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-28 14:07:55 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KU19CFH/697551274/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=697551274>
2026-03-28 14:07:55 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KV16LDZ/698296888/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698296888>
2026-03-28 14:07:55 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NL64KGO/698157119/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698157119>
2026-03-28 14:07:55 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BV61MVO/698928533/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698928533>
2026-03-28 14:07:55 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WV16UWB/698284415/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698284415>
2026-03-28 14:07:55 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/X11BBM/697603974/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=697603974>
2026-03-28 14:07:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FY66OTD/698150784/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/FY66OTD/42794791?sv=2020-08-04&st=2026-03-28T14%3A03%3A46Z&se=2026-03-28T14%3A28%3A46Z&sr=b&sp=r&sig=nyWr7cManqycrjqVh9Sq0fegCWU0XCSire1eKcJWKLA%3D)
2026-03-28 14:07:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FV17TYW/698767980/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/FV17TYW/42807142?sv=2020-08-04&st=2026-03-28T14%3A03%3A46Z&se=2026-03-28T14%3A28%3A46Z&sr=b&sp=r&sig=3LbtNEGnFqYV4bS0F0%2BmsB%2FgfFSYLdditNDmvy7kudU%3D)
2026-03-28 14:07:55 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/MV18VBD/42809599?sv=2020-08-04&st=2026-03-28T14%3A07%3A55Z&se=2026-03-28T14%3A32%3A55Z&sr=b&sp=r&sig=qrwyo516FqCfQ9rzYuw%2F1kiWtelF6cPMOtHn%2FkvWNFc%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=MV18%20VBD-GB>
2026-03-28 14:07:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:07:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a1fec44d0>
2026-03-28 14:07:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:07:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:07:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:07:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_418ba9d9-1978-54c6-a2d3-b78329217655/418ba9d9-1978-54c6-a2d3-b78329217655_expert_report_file_79379637-9cf3-4075-bead-b590f70c10a8.pdf HTTP/1.1" 201 0
2026-03-28 14:07:55 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item 418ba9d9-1978-54c6-a2d3-b78329217655
2026-03-28 14:07:55 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 418ba9d9-1978-54c6-a2d3-b78329217655, skipping ID generation
2026-03-28 14:07:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 418ba9d9-1978-54c6-a2d3-b78329217655
2026-03-28 14:07:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DPK68NZT-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-28 14:07:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=PK68NZT-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-28 14:07:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:07:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c973010>
2026-03-28 14:07:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:07:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:07:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:07:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7708aee7-65e8-597e-aa3d-426819c9c319/7708aee7-65e8-597e-aa3d-426819c9c319_image_5.jpg HTTP/1.1" 201 0
2026-03-28 14:07:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FOY67JPV%252F698107940%252F600') HTTP/1.1" 204 0
2026-03-28 14:07:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/OY67JPV/698107940/600 saved to cache
2026-03-28 14:07:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 7708aee7-65e8-597e-aa3d-426819c9c319
2026-03-28 14:07:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LN68RBY/698920336/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LN68RBY/42809684?sv=2020-08-04&st=2026-03-28T14%3A03%3A42Z&se=2026-03-28T14%3A28%3A42Z&sr=b&sp=r&sig=aIYqAxiZsHZDOcTozI0zzgpiaCRiEseqbYSKBZyhWQ4%3D)
2026-03-28 14:07:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.bca.co.uk/api/search?q=&pageSize=100&page=19&sort=MostRecentlyAdded> (referer: https://www.bca.co.uk/search) ['zyte-api']
2026-03-28 14:07:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698929119%27 HTTP/1.1" 200 None
2026-03-28 14:07:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698929119 not downloaded yet
2026-03-28 14:07:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:07:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a1fe8ce10>
2026-03-28 14:07:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:07:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:07:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:07:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_eaf9d23b-faf9-5201-9f92-ea95460928e4/eaf9d23b-faf9-5201-9f92-ea95460928e4_expert_report_file_31a3455e-5be8-47ae-95cc-5772bbfb62d7.pdf HTTP/1.1" 201 0
2026-03-28 14:07:55 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item eaf9d23b-faf9-5201-9f92-ea95460928e4
2026-03-28 14:07:55 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: eaf9d23b-faf9-5201-9f92-ea95460928e4, skipping ID generation
2026-03-28 14:07:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item eaf9d23b-faf9-5201-9f92-ea95460928e4
2026-03-28 14:07:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DVO67OHE-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-28 14:07:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=VO67OHE-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-28 14:07:55 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FY66OTD/698150775/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698150775>
2026-03-28 14:07:55 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/OY67JPV/698107923/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698107923>
2026-03-28 14:07:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698929134%27 HTTP/1.1" 200 None
2026-03-28 14:07:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698929134 not downloaded yet
2026-03-28 14:07:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D697995560%27 HTTP/1.1" 200 None
2026-03-28 14:07:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=697995560 not downloaded yet
2026-03-28 14:07:55 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FV17TYW/698767973/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698767973>
2026-03-28 14:07:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:07:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2dd84410>
2026-03-28 14:07:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:07:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:07:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:07:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_40999011-32af-5ad3-a840-4cb8242ff02a/40999011-32af-5ad3-a840-4cb8242ff02a_image_5.jpg HTTP/1.1" 201 0
2026-03-28 14:07:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FFY66OTD%252F698150784%252F600') HTTP/1.1" 204 0
2026-03-28 14:07:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FY66OTD/698150784/600 saved to cache
2026-03-28 14:07:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 40999011-32af-5ad3-a840-4cb8242ff02a
2026-03-28 14:07:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:07:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2ca58a10>
2026-03-28 14:07:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:07:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:07:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:07:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d7b30cd7-3fb2-520c-9629-4539584c6e2c/d7b30cd7-3fb2-520c-9629-4539584c6e2c_image_5.jpg HTTP/1.1" 201 0
2026-03-28 14:07:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FFV17TYW%252F698767980%252F600') HTTP/1.1" 204 0
2026-03-28 14:07:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FV17TYW/698767980/600 saved to cache
2026-03-28 14:07:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item d7b30cd7-3fb2-520c-9629-4539584c6e2c
2026-03-28 14:07:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WU19VDC/698045618/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/WU19VDC/42792335?sv=2020-08-04&st=2026-03-28T14%3A03%3A50Z&se=2026-03-28T14%3A28%3A50Z&sr=b&sp=r&sig=Mqd3JjFAqa%2F7fy72g8Zcx8u%2F7XgFrycUpKRkPg1JOjA%3D)
2026-03-28 14:07:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KV16LDZ/698296888/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/KV16LDZ/42797857?sv=2020-08-04&st=2026-03-28T14%3A03%3A49Z&se=2026-03-28T14%3A28%3A49Z&sr=b&sp=r&sig=7pGIWvim4gxli5cifd615Lw7Q0s6ljm9z8msDK3x6Js%3D)
2026-03-28 14:07:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698929143%27 HTTP/1.1" 200 None
2026-03-28 14:07:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698929143 not downloaded yet
2026-03-28 14:07:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D697995563%27 HTTP/1.1" 200 None
2026-03-28 14:07:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=697995563 not downloaded yet
2026-03-28 14:07:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KU19CFH/697551274/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/KU19CFH/42809756?sv=2020-08-04&st=2026-03-28T14%3A03%3A45Z&se=2026-03-28T14%3A28%3A45Z&sr=b&sp=r&sig=1G7eR4FaPr%2BtRdJKW3arikyQmOCuk26xvavIORXr6y8%3D)
2026-03-28 14:07:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DA21SOU/697888046/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/DA21SOU/42810340?sv=2020-08-04&st=2026-03-28T14%3A03%3A42Z&se=2026-03-28T14%3A28%3A42Z&sr=b&sp=r&sig=6%2F4a%2BWc9n6QD4YiOi5mt3dZkPnMZj%2Bfh7208k4Rd3hI%3D)
2026-03-28 14:07:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698929168%27 HTTP/1.1" 200 None
2026-03-28 14:07:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698929168 not downloaded yet
2026-03-28 14:07:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D697995566%27 HTTP/1.1" 200 None
2026-03-28 14:07:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=697995566 not downloaded yet
2026-03-28 14:07:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/MV18VBD/42809599?sv=2020-08-04&st=2026-03-28T14%3A07%3A55Z&se=2026-03-28T14%3A32%3A55Z&sr=b&sp=r&sig=qrwyo516FqCfQ9rzYuw%2F1kiWtelF6cPMOtHn%2FkvWNFc%3D> (referer: https://www.bca.co.uk/)
2026-03-28 14:07:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WV16UWB/698284415/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/WV16UWB/42797605?sv=2020-08-04&st=2026-03-28T14%3A03%3A48Z&se=2026-03-28T14%3A28%3A48Z&sr=b&sp=r&sig=tZmKWGpA7mZ9Rie4bcnpNzrMU30KCOw%2BfaCUNgMn820%3D)
2026-03-28 14:07:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BV61MVO/698928533/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/BV61MVO/42809949?sv=2020-08-04&st=2026-03-28T14%3A03%3A49Z&se=2026-03-28T14%3A28%3A49Z&sr=b&sp=r&sig=PJNKzVVeJy1FKQt32eUXNOOsoTV6pqchYxeSDnPTh7w%3D)
2026-03-28 14:07:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698929184%27 HTTP/1.1" 200 None
2026-03-28 14:07:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698929184 not downloaded yet
2026-03-28 14:07:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D697995574%27 HTTP/1.1" 200 None
2026-03-28 14:07:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=697995574 not downloaded yet
2026-03-28 14:07:55 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:07:55 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:07:55 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:07:55 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:07:55 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:07:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:07:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c858550>
2026-03-28 14:07:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:07:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:07:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:07:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_04fa14f2-714c-5033-a1fe-bd0c784e7d7e/04fa14f2-714c-5033-a1fe-bd0c784e7d7e_image_9.jpg HTTP/1.1" 201 0
2026-03-28 14:07:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLN68RBY%252F698920336%252F600') HTTP/1.1" 204 0
2026-03-28 14:07:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LN68RBY/698920336/600 saved to cache
2026-03-28 14:07:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 04fa14f2-714c-5033-a1fe-bd0c784e7d7e
2026-03-28 14:07:55 [bca.uk] INFO: Total items found: 100
2026-03-28 14:07:55 [bca.uk] INFO: Requesting URL: https://www.bca.co.uk/api/search?q=&pageSize=100&page=20&sort=MostRecentlyAdded
2026-03-28 14:07:55 [bca.uk] INFO: Sending search API request with Bearer token (length=1492)
2026-03-28 14:07:55 [scrapy_zyte_api._params] WARNING: Request <GET https://www.bca.co.uk/api/search?q=&pageSize=100&page=20&sort=MostRecentlyAdded> defines the Zyte API customHttpRequestHeaders parameter, overriding Request.headers. Use Request.headers instead.
2026-03-28 14:07:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/X11BBM/697603974/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/X11BBM/42809514?sv=2020-08-04&st=2026-03-28T14%3A03%3A48Z&se=2026-03-28T14%3A28%3A48Z&sr=b&sp=r&sig=iFv2U%2F%2BmiJcqZ%2BPwwi1Pjq9aw6DZNzQsG5k9GNFr4Nw%3D)
2026-03-28 14:07:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NL64KGO/698157119/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/NL64KGO/42810049?sv=2020-08-04&st=2026-03-28T14%3A03%3A48Z&se=2026-03-28T14%3A28%3A48Z&sr=b&sp=r&sig=GCr8gvM5cBzuZAr6Na7pdcamsQO4tFs2xqxAknQovkg%3D)
2026-03-28 14:07:55 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DA21SOU/697888030/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=697888030>
2026-03-28 14:07:55 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PK68NZT/698929090/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=PK68NZT-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-28 14:07:55 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LN68RBY/698920315/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698920315>
2026-03-28 14:07:55 [scrapy_zyte_api._params] WARNING: Request <GET https://www.bca.co.uk/api/search?q=&pageSize=100&page=20&sort=MostRecentlyAdded> defines the Zyte API customHttpRequestHeaders parameter, overriding Request.headers. Use Request.headers instead.
2026-03-28 14:07:55 [scrapy_zyte_api._params] WARNING: Request <GET https://www.bca.co.uk/api/search?q=&pageSize=100&page=20&sort=MostRecentlyAdded> defines the Zyte API customHttpRequestHeaders parameter, overriding Request.headers. Use Request.headers instead.
2026-03-28 14:07:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698929219%27 HTTP/1.1" 200 None
2026-03-28 14:07:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698929219 not downloaded yet
2026-03-28 14:07:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D697995577%27 HTTP/1.1" 200 None
2026-03-28 14:07:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=697995577 not downloaded yet
2026-03-28 14:07:55 [bca.uk] INFO: Found listing with ID: WF09%20WWO
2026-03-28 14:07:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WF09%2520WWO%27 HTTP/1.1" 200 None
2026-03-28 14:07:55 [bca.uk] INFO: Scrape type for WF09%20WWO: 0
2026-03-28 14:07:55 [bca.uk] INFO: Found listing with ID: YD15%20FET
2026-03-28 14:07:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YD15%2520FET%27 HTTP/1.1" 200 None
2026-03-28 14:07:55 [bca.uk] INFO: Scrape type for YD15%20FET: 0
2026-03-28 14:07:55 [bca.uk] INFO: Found listing with ID: YJ63%20EVM
2026-03-28 14:07:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YJ63%2520EVM%27 HTTP/1.1" 200 None
2026-03-28 14:07:55 [bca.uk] INFO: Scrape type for YJ63%20EVM: 0
2026-03-28 14:07:55 [bca.uk] INFO: Found listing with ID: YN08%20UVD
2026-03-28 14:07:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YN08%2520UVD%27 HTTP/1.1" 200 None
2026-03-28 14:07:55 [bca.uk] INFO: Scrape type for YN08%20UVD: 0
2026-03-28 14:07:55 [bca.uk] INFO: Found listing with ID: YR60%20HSF
2026-03-28 14:07:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YR60%2520HSF%27 HTTP/1.1" 200 None
2026-03-28 14:07:56 [bca.uk] INFO: Scrape type for YR60%20HSF: 0
2026-03-28 14:07:56 [bca.uk] INFO: Found listing with ID: ET10%20FWV
2026-03-28 14:07:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27ET10%2520FWV%27 HTTP/1.1" 200 None
2026-03-28 14:07:56 [bca.uk] INFO: Scrape type for ET10%20FWV: 0
2026-03-28 14:07:56 [bca.uk] INFO: Found listing with ID: FFZ%202461
2026-03-28 14:07:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FFZ%25202461%27 HTTP/1.1" 200 None
2026-03-28 14:07:56 [bca.uk] INFO: Scrape type for FFZ%202461: 0
2026-03-28 14:07:56 [bca.uk] INFO: Found listing with ID: GD10%20BNJ
2026-03-28 14:07:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GD10%2520BNJ%27 HTTP/1.1" 200 None
2026-03-28 14:07:56 [bca.uk] INFO: Scrape type for GD10%20BNJ: 0
2026-03-28 14:07:56 [bca.uk] INFO: Found listing with ID: J222%20SOB
2026-03-28 14:07:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27J222%2520SOB%27 HTTP/1.1" 200 None
2026-03-28 14:07:56 [bca.uk] INFO: Scrape type for J222%20SOB: 0
2026-03-28 14:07:56 [bca.uk] INFO: Found listing with ID: LK08%20VLX
2026-03-28 14:07:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LK08%2520VLX%27 HTTP/1.1" 200 None
2026-03-28 14:07:56 [bca.uk] INFO: Scrape type for LK08%20VLX: 0
2026-03-28 14:07:56 [bca.uk] INFO: Found listing with ID: ML10%20HFR
2026-03-28 14:07:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27ML10%2520HFR%27 HTTP/1.1" 200 None
2026-03-28 14:07:56 [bca.uk] INFO: Scrape type for ML10%20HFR: 0
2026-03-28 14:07:56 [bca.uk] INFO: Found listing with ID: NA52%20HNU
2026-03-28 14:07:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27NA52%2520HNU%27 HTTP/1.1" 200 None
2026-03-28 14:07:56 [bca.uk] INFO: Scrape type for NA52%20HNU: 0
2026-03-28 14:07:56 [bca.uk] INFO: Found listing with ID: NU62%20FVV
2026-03-28 14:07:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27NU62%2520FVV%27 HTTP/1.1" 200 None
2026-03-28 14:07:56 [bca.uk] INFO: Scrape type for NU62%20FVV: 0
2026-03-28 14:07:56 [bca.uk] INFO: Found listing with ID: AP14%20DLE
2026-03-28 14:07:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27AP14%2520DLE%27 HTTP/1.1" 200 None
2026-03-28 14:07:56 [bca.uk] INFO: Scrape type for AP14%20DLE: 0
2026-03-28 14:07:56 [bca.uk] INFO: Found listing with ID: BG61%20XGP
2026-03-28 14:07:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BG61%2520XGP%27 HTTP/1.1" 200 None
2026-03-28 14:07:56 [bca.uk] INFO: Scrape type for BG61%20XGP: 0
2026-03-28 14:07:56 [bca.uk] INFO: Found listing with ID: BV07%20PTY
2026-03-28 14:07:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BV07%2520PTY%27 HTTP/1.1" 200 None
2026-03-28 14:07:56 [bca.uk] INFO: Scrape type for BV07%20PTY: 0
2026-03-28 14:07:56 [bca.uk] INFO: Found listing with ID: DA59%20ZDF
2026-03-28 14:07:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DA59%2520ZDF%27 HTTP/1.1" 200 None
2026-03-28 14:07:56 [bca.uk] INFO: Scrape type for DA59%20ZDF: 0
2026-03-28 14:07:56 [bca.uk] INFO: Found listing with ID: DN62%20BXP
2026-03-28 14:07:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DN62%2520BXP%27 HTTP/1.1" 200 None
2026-03-28 14:07:56 [bca.uk] INFO: Scrape type for DN62%20BXP: 0
2026-03-28 14:07:56 [bca.uk] INFO: Found listing with ID: DU11%20ZKX
2026-03-28 14:07:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DU11%2520ZKX%27 HTTP/1.1" 200 None
2026-03-28 14:07:56 [bca.uk] INFO: Scrape type for DU11%20ZKX: 0
2026-03-28 14:07:56 [bca.uk] INFO: Found listing with ID: EA63%20XHB
2026-03-28 14:07:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27EA63%2520XHB%27 HTTP/1.1" 200 None
2026-03-28 14:07:56 [bca.uk] INFO: Scrape type for EA63%20XHB: 0
2026-03-28 14:07:56 [bca.uk] INFO: Found listing with ID: EJ09%20JZU
2026-03-28 14:07:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27EJ09%2520JZU%27 HTTP/1.1" 200 None
2026-03-28 14:07:56 [bca.uk] INFO: Scrape type for EJ09%20JZU: 0
2026-03-28 14:07:56 [bca.uk] INFO: Found listing with ID: EJ11%20WXD
2026-03-28 14:07:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27EJ11%2520WXD%27 HTTP/1.1" 200 None
2026-03-28 14:07:56 [bca.uk] INFO: Scrape type for EJ11%20WXD: 0
2026-03-28 14:07:56 [bca.uk] INFO: Found listing with ID: AE08%20JGR
2026-03-28 14:07:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27AE08%2520JGR%27 HTTP/1.1" 200 None
2026-03-28 14:07:56 [bca.uk] INFO: Scrape type for AE08%20JGR: 0
2026-03-28 14:07:56 [bca.uk] INFO: Found listing with ID: AF63%20VLZ
2026-03-28 14:07:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27AF63%2520VLZ%27 HTTP/1.1" 200 None
2026-03-28 14:07:56 [bca.uk] INFO: Scrape type for AF63%20VLZ: 0
2026-03-28 14:07:56 [bca.uk] INFO: Found listing with ID: AJ59%20YCC
2026-03-28 14:07:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27AJ59%2520YCC%27 HTTP/1.1" 200 None
2026-03-28 14:07:56 [bca.uk] INFO: Scrape type for AJ59%20YCC: 0
2026-03-28 14:07:56 [bca.uk] INFO: Found listing with ID: EF69%20FGP
2026-03-28 14:07:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27EF69%2520FGP%27 HTTP/1.1" 200 None
2026-03-28 14:07:56 [bca.uk] INFO: Scrape type for EF69%20FGP: 0
2026-03-28 14:07:56 [bca.uk] INFO: Found listing with ID: KS71%20LRF
2026-03-28 14:07:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KS71%2520LRF%27 HTTP/1.1" 200 None
2026-03-28 14:07:56 [bca.uk] INFO: Scrape type for KS71%20LRF: 0
2026-03-28 14:07:56 [bca.uk] INFO: Found listing with ID: MV22%20UCS
2026-03-28 14:07:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MV22%2520UCS%27 HTTP/1.1" 200 None
2026-03-28 14:07:56 [bca.uk] INFO: Scrape type for MV22%20UCS: 0
2026-03-28 14:07:56 [bca.uk] INFO: Found listing with ID: VK73%20CAE
2026-03-28 14:07:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27VK73%2520CAE%27 HTTP/1.1" 200 None
2026-03-28 14:07:56 [bca.uk] INFO: Scrape type for VK73%20CAE: 2
2026-03-28 14:07:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0cfcf4e9-8c27-54d6-ad5a-2867621306ba with identifier: VK73%20CAE
2026-03-28 14:07:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0cfcf4e9-8c27-54d6-ad5a-2867621306ba with scrape type 2
2026-03-28 14:07:56 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0cfcf4e9-8c27-54d6-ad5a-2867621306ba with scrape type 2
2026-03-28 14:07:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 0cfcf4e9-8c27-54d6-ad5a-2867621306ba, identifier: VK73%20CAE
2026-03-28 14:07:56 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 14:07:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 0cfcf4e9-8c27-54d6-ad5a-2867621306ba with identifier: VK73%20CAE
2026-03-28 14:07:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 0cfcf4e9-8c27-54d6-ad5a-2867621306ba with identifier: VK73%20CAE
2026-03-28 14:07:56 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 0cfcf4e9-8c27-54d6-ad5a-2867621306ba with identifier: VK73%20CAE to the API
2026-03-28 14:07:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:07:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:07:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=19&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 19,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=VK73%20CAE-GB',
'category': 'Car',
'color': 'white',
'currency': 'GBP',
'doors_number': 5,
'engine': '3.0L',
'expiration_date': '2026-03-30T07:00:00Z',
'fuel_type': 'Petrol/Electric',
'id': '0cfcf4e9-8c27-54d6-ad5a-2867621306ba',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': False,
'license_plate': 'VK73 CAE',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=VK73%20CAE&vehicleType=*',
'listing': 'auction',
'location': 'Birmingham - Perry Barr',
'make': 'LAND ROVER',
'model': 'R/R SPORT',
'odometer': 35152,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2023-01-01',
'seller_name': None,
'title': 'LAND ROVER R/R SPORT 3.0 P440E AUTOBIOGRAPHY StationWagon',
'transmission': 'automatic',
'trim': 'P440E AUTOBIOGRAPHY',
'vin': 'SAL1A2A42PA156813',
'year': 2023}
2026-03-28 14:07:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27VK73%2520CAE%27 HTTP/1.1" 200 None
2026-03-28 14:07:57 [bca.uk] INFO: Saving data for VK73%20CAE: {'auction_closing_time': 1774854000.0, 'created_time': 1774437787.259083, 'last_price_update_time': 1774706877.120621}
2026-03-28 14:07:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='VK73%2520CAE') HTTP/1.1" 204 0
2026-03-28 14:07:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/OY67JPV/698107923/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/OY67JPV/42810048?sv=2020-08-04&st=2026-03-28T14%3A03%3A48Z&se=2026-03-28T14%3A28%3A48Z&sr=b&sp=r&sig=3IQnxpRCaMGCrWPQZylbi%2BiY%2FkfXKw1FEE36W3dpRwo%3D)
2026-03-28 14:07:57 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KU19CFH/697551259/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=697551259>
2026-03-28 14:07:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FV17TYW/698767973/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/FV17TYW/42807142?sv=2020-08-04&st=2026-03-28T14%3A03%3A46Z&se=2026-03-28T14%3A28%3A46Z&sr=b&sp=r&sig=3LbtNEGnFqYV4bS0F0%2BmsB%2FgfFSYLdditNDmvy7kudU%3D)
2026-03-28 14:07:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698929250%27 HTTP/1.1" 200 None
2026-03-28 14:07:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698929250 not downloaded yet
2026-03-28 14:07:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D697995587%27 HTTP/1.1" 200 None
2026-03-28 14:07:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=697995587 not downloaded yet
2026-03-28 14:07:57 [bca.uk] INFO: Found listing with ID: NA14%20MLY
2026-03-28 14:07:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27NA14%2520MLY%27 HTTP/1.1" 200 None
2026-03-28 14:07:57 [bca.uk] INFO: Scrape type for NA14%20MLY: 0
2026-03-28 14:07:57 [bca.uk] INFO: Found listing with ID: DV12%20NKX
2026-03-28 14:07:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DV12%2520NKX%27 HTTP/1.1" 200 None
2026-03-28 14:07:57 [bca.uk] INFO: Scrape type for DV12%20NKX: 0
2026-03-28 14:07:57 [bca.uk] INFO: Found listing with ID: YE13%20TGX
2026-03-28 14:07:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YE13%2520TGX%27 HTTP/1.1" 200 None
2026-03-28 14:07:57 [bca.uk] INFO: Scrape type for YE13%20TGX: 0
2026-03-28 14:07:57 [bca.uk] INFO: Found listing with ID: KX63%20VRW
2026-03-28 14:07:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KX63%2520VRW%27 HTTP/1.1" 200 None
2026-03-28 14:07:57 [bca.uk] INFO: Scrape type for KX63%20VRW: 0
2026-03-28 14:07:57 [bca.uk] INFO: Found listing with ID: WU56%20JVV
2026-03-28 14:07:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WU56%2520JVV%27 HTTP/1.1" 200 None
2026-03-28 14:07:57 [bca.uk] INFO: Scrape type for WU56%20JVV: 0
2026-03-28 14:07:57 [bca.uk] INFO: Found listing with ID: MW14%20VSG
2026-03-28 14:07:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MW14%2520VSG%27 HTTP/1.1" 200 None
2026-03-28 14:07:57 [bca.uk] INFO: Scrape type for MW14%20VSG: 0
2026-03-28 14:07:57 [bca.uk] INFO: Found listing with ID: YG63%20XMA
2026-03-28 14:07:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YG63%2520XMA%27 HTTP/1.1" 200 None
2026-03-28 14:07:57 [bca.uk] INFO: Scrape type for YG63%20XMA: 0
2026-03-28 14:07:57 [bca.uk] INFO: Found listing with ID: WM64%20MZY
2026-03-28 14:07:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WM64%2520MZY%27 HTTP/1.1" 200 None
2026-03-28 14:07:57 [bca.uk] INFO: Scrape type for WM64%20MZY: 0
2026-03-28 14:07:57 [bca.uk] INFO: Found listing with ID: PK67%20WXJ
2026-03-28 14:07:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27PK67%2520WXJ%27 HTTP/1.1" 200 None
2026-03-28 14:07:57 [bca.uk] INFO: Scrape type for PK67%20WXJ: 0
2026-03-28 14:07:57 [bca.uk] INFO: Found listing with ID: BG68%20USB
2026-03-28 14:07:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BG68%2520USB%27 HTTP/1.1" 200 None
2026-03-28 14:07:57 [bca.uk] INFO: Scrape type for BG68%20USB: 0
2026-03-28 14:07:57 [bca.uk] INFO: Found listing with ID: CF22%20XZJ
2026-03-28 14:07:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27CF22%2520XZJ%27 HTTP/1.1" 200 None
2026-03-28 14:07:57 [bca.uk] INFO: Scrape type for CF22%20XZJ: 0
2026-03-28 14:07:57 [bca.uk] INFO: Found listing with ID: YF64%20HNX
2026-03-28 14:07:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YF64%2520HNX%27 HTTP/1.1" 200 None
2026-03-28 14:07:57 [bca.uk] INFO: Scrape type for YF64%20HNX: 0
2026-03-28 14:07:57 [bca.uk] INFO: Found listing with ID: MK20%20NXW
2026-03-28 14:07:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MK20%2520NXW%27 HTTP/1.1" 200 None
2026-03-28 14:07:57 [bca.uk] INFO: Scrape type for MK20%20NXW: 0
2026-03-28 14:07:57 [bca.uk] INFO: Found listing with ID: ND15%20ZTH
2026-03-28 14:07:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27ND15%2520ZTH%27 HTTP/1.1" 200 None
2026-03-28 14:07:57 [bca.uk] INFO: Scrape type for ND15%20ZTH: 0
2026-03-28 14:07:57 [bca.uk] INFO: Found listing with ID: BF65%20MXK
2026-03-28 14:07:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BF65%2520MXK%27 HTTP/1.1" 200 None
2026-03-28 14:07:57 [bca.uk] INFO: Scrape type for BF65%20MXK: 0
2026-03-28 14:07:57 [bca.uk] INFO: Found listing with ID: CJ21%20DMF
2026-03-28 14:07:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27CJ21%2520DMF%27 HTTP/1.1" 200 None
2026-03-28 14:07:57 [bca.uk] INFO: Scrape type for CJ21%20DMF: 0
2026-03-28 14:07:57 [bca.uk] INFO: Found listing with ID: CX17%20HLC
2026-03-28 14:07:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27CX17%2520HLC%27 HTTP/1.1" 200 None
2026-03-28 14:07:57 [bca.uk] INFO: Scrape type for CX17%20HLC: 0
2026-03-28 14:07:57 [bca.uk] INFO: Found listing with ID: CU67%20WRO
2026-03-28 14:07:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27CU67%2520WRO%27 HTTP/1.1" 200 None
2026-03-28 14:07:57 [bca.uk] INFO: Scrape type for CU67%20WRO: 0
2026-03-28 14:07:57 [bca.uk] INFO: Found listing with ID: NU20%20BYM
2026-03-28 14:07:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27NU20%2520BYM%27 HTTP/1.1" 200 None
2026-03-28 14:07:57 [bca.uk] INFO: Scrape type for NU20%20BYM: 0
2026-03-28 14:07:57 [bca.uk] INFO: Found listing with ID: SE23%20USB
2026-03-28 14:07:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SE23%2520USB%27 HTTP/1.1" 200 None
2026-03-28 14:07:57 [bca.uk] INFO: Scrape type for SE23%20USB: 0
2026-03-28 14:07:57 [bca.uk] INFO: Found listing with ID: CX19%20CMZ
2026-03-28 14:07:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27CX19%2520CMZ%27 HTTP/1.1" 200 None
2026-03-28 14:07:57 [bca.uk] INFO: Scrape type for CX19%20CMZ: 0
2026-03-28 14:07:57 [bca.uk] INFO: Found listing with ID: SJ19%20TZN
2026-03-28 14:07:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SJ19%2520TZN%27 HTTP/1.1" 200 None
2026-03-28 14:07:57 [bca.uk] INFO: Scrape type for SJ19%20TZN: 0
2026-03-28 14:07:57 [bca.uk] INFO: Found listing with ID: HX07%20WBO
2026-03-28 14:07:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27HX07%2520WBO%27 HTTP/1.1" 200 None
2026-03-28 14:07:57 [bca.uk] INFO: Scrape type for HX07%20WBO: 0
2026-03-28 14:07:57 [bca.uk] INFO: Found listing with ID: YT69%20XRC
2026-03-28 14:07:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YT69%2520XRC%27 HTTP/1.1" 200 None
2026-03-28 14:07:57 [bca.uk] INFO: Scrape type for YT69%20XRC: 0
2026-03-28 14:07:57 [bca.uk] INFO: Found listing with ID: SV63%20OHA
2026-03-28 14:07:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SV63%2520OHA%27 HTTP/1.1" 200 None
2026-03-28 14:07:57 [bca.uk] INFO: Scrape type for SV63%20OHA: 0
2026-03-28 14:07:57 [bca.uk] INFO: Found listing with ID: WN11%20LZE
2026-03-28 14:07:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WN11%2520LZE%27 HTTP/1.1" 200 None
2026-03-28 14:07:57 [bca.uk] INFO: Scrape type for WN11%20LZE: 0
2026-03-28 14:07:57 [bca.uk] INFO: Found listing with ID: WF08%20GUH
2026-03-28 14:07:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WF08%2520GUH%27 HTTP/1.1" 200 None
2026-03-28 14:07:57 [bca.uk] INFO: Scrape type for WF08%20GUH: 0
2026-03-28 14:07:57 [bca.uk] INFO: Found listing with ID: PE15%20VEP
2026-03-28 14:07:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27PE15%2520VEP%27 HTTP/1.1" 200 None
2026-03-28 14:07:57 [bca.uk] INFO: Scrape type for PE15%20VEP: 0
2026-03-28 14:07:57 [bca.uk] INFO: Found listing with ID: BF68%20XZH
2026-03-28 14:07:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BF68%2520XZH%27 HTTP/1.1" 200 None
2026-03-28 14:07:57 [bca.uk] INFO: Scrape type for BF68%20XZH: 0
2026-03-28 14:07:57 [bca.uk] INFO: Found listing with ID: WH19%20KYM
2026-03-28 14:07:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WH19%2520KYM%27 HTTP/1.1" 200 None
2026-03-28 14:07:57 [bca.uk] INFO: Scrape type for WH19%20KYM: 0
2026-03-28 14:07:57 [bca.uk] INFO: Found listing with ID: KV65%20KKF
2026-03-28 14:07:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KV65%2520KKF%27 HTTP/1.1" 200 None
2026-03-28 14:07:57 [bca.uk] INFO: Scrape type for KV65%20KKF: 0
2026-03-28 14:07:57 [bca.uk] INFO: Found listing with ID: BD61%20LZS
2026-03-28 14:07:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BD61%2520LZS%27 HTTP/1.1" 200 None
2026-03-28 14:07:57 [bca.uk] INFO: Scrape type for BD61%20LZS: 0
2026-03-28 14:07:57 [bca.uk] INFO: Found listing with ID: GK70%20LKL
2026-03-28 14:07:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GK70%2520LKL%27 HTTP/1.1" 200 None
2026-03-28 14:07:57 [bca.uk] INFO: Scrape type for GK70%20LKL: 0
2026-03-28 14:07:57 [bca.uk] INFO: Found listing with ID: MF15%20LOA
2026-03-28 14:07:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MF15%2520LOA%27 HTTP/1.1" 200 None
2026-03-28 14:07:57 [bca.uk] INFO: Scrape type for MF15%20LOA: 0
2026-03-28 14:07:57 [bca.uk] INFO: Found listing with ID: SB67%20ZDO
2026-03-28 14:07:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SB67%2520ZDO%27 HTTP/1.1" 200 None
2026-03-28 14:07:57 [bca.uk] INFO: Scrape type for SB67%20ZDO: 0
2026-03-28 14:07:57 [bca.uk] INFO: Found listing with ID: YB23%20NJU
2026-03-28 14:07:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YB23%2520NJU%27 HTTP/1.1" 200 None
2026-03-28 14:07:57 [bca.uk] INFO: Scrape type for YB23%20NJU: 0
2026-03-28 14:07:57 [bca.uk] INFO: Found listing with ID: VA18%20JZP
2026-03-28 14:07:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27VA18%2520JZP%27 HTTP/1.1" 200 None
2026-03-28 14:07:57 [bca.uk] INFO: Scrape type for VA18%20JZP: 0
2026-03-28 14:07:57 [bca.uk] INFO: Found listing with ID: PF65%20MKM
2026-03-28 14:07:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27PF65%2520MKM%27 HTTP/1.1" 200 None
2026-03-28 14:07:57 [bca.uk] INFO: Scrape type for PF65%20MKM: 0
2026-03-28 14:07:57 [bca.uk] INFO: Found listing with ID: SY68%20MYK
2026-03-28 14:07:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SY68%2520MYK%27 HTTP/1.1" 200 None
2026-03-28 14:07:57 [bca.uk] INFO: Scrape type for SY68%20MYK: 0
2026-03-28 14:07:57 [bca.uk] INFO: Found listing with ID: YB15%20YCN
2026-03-28 14:07:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YB15%2520YCN%27 HTTP/1.1" 200 None
2026-03-28 14:07:57 [bca.uk] INFO: Scrape type for YB15%20YCN: 0
2026-03-28 14:07:57 [bca.uk] INFO: Found listing with ID: YP70%20OYG
2026-03-28 14:07:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YP70%2520OYG%27 HTTP/1.1" 200 None
2026-03-28 14:07:58 [bca.uk] INFO: Scrape type for YP70%20OYG: 0
2026-03-28 14:07:58 [bca.uk] INFO: Found listing with ID: P12%20TBE
2026-03-28 14:07:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27P12%2520TBE%27 HTTP/1.1" 200 None
2026-03-28 14:07:58 [bca.uk] INFO: Scrape type for P12%20TBE: 0
2026-03-28 14:07:58 [bca.uk] INFO: Found listing with ID: SA72%20DPN
2026-03-28 14:07:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SA72%2520DPN%27 HTTP/1.1" 200 None
2026-03-28 14:07:58 [bca.uk] INFO: Scrape type for SA72%20DPN: 0
2026-03-28 14:07:58 [bca.uk] INFO: Found listing with ID: BD64%20SVN
2026-03-28 14:07:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BD64%2520SVN%27 HTTP/1.1" 200 None
2026-03-28 14:07:58 [bca.uk] INFO: Scrape type for BD64%20SVN: 0
2026-03-28 14:07:58 [bca.uk] INFO: Found listing with ID: SG16%20XEM
2026-03-28 14:07:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SG16%2520XEM%27 HTTP/1.1" 200 None
2026-03-28 14:07:58 [bca.uk] INFO: Scrape type for SG16%20XEM: 0
2026-03-28 14:07:58 [bca.uk] INFO: Found listing with ID: BX64%20YVD
2026-03-28 14:07:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BX64%2520YVD%27 HTTP/1.1" 200 None
2026-03-28 14:07:58 [bca.uk] INFO: Scrape type for BX64%20YVD: 0
2026-03-28 14:07:58 [bca.uk] INFO: Found listing with ID: EO60%20XFZ
2026-03-28 14:07:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27EO60%2520XFZ%27 HTTP/1.1" 200 None
2026-03-28 14:07:58 [bca.uk] INFO: Scrape type for EO60%20XFZ: 0
2026-03-28 14:07:58 [bca.uk] INFO: Found listing with ID: DS65%20VAY
2026-03-28 14:07:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DS65%2520VAY%27 HTTP/1.1" 200 None
2026-03-28 14:07:58 [bca.uk] INFO: Scrape type for DS65%20VAY: 0
2026-03-28 14:07:58 [bca.uk] INFO: Found listing with ID: YA72%20EKD
2026-03-28 14:07:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YA72%2520EKD%27 HTTP/1.1" 200 None
2026-03-28 14:07:58 [bca.uk] INFO: Scrape type for YA72%20EKD: 0
2026-03-28 14:07:58 [bca.uk] INFO: Found listing with ID: SG17%20XAA
2026-03-28 14:07:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SG17%2520XAA%27 HTTP/1.1" 200 None
2026-03-28 14:07:58 [bca.uk] INFO: Scrape type for SG17%20XAA: 0
2026-03-28 14:07:58 [bca.uk] INFO: Found listing with ID: WA16%20TJO
2026-03-28 14:07:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WA16%2520TJO%27 HTTP/1.1" 200 None
2026-03-28 14:07:58 [bca.uk] INFO: Scrape type for WA16%20TJO: 0
2026-03-28 14:07:58 [bca.uk] INFO: Found listing with ID: EK13%20NDL
2026-03-28 14:07:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27EK13%2520NDL%27 HTTP/1.1" 200 None
2026-03-28 14:07:58 [bca.uk] INFO: Scrape type for EK13%20NDL: 0
2026-03-28 14:07:58 [bca.uk] INFO: Found listing with ID: AY66%20EOR
2026-03-28 14:07:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27AY66%2520EOR%27 HTTP/1.1" 200 None
2026-03-28 14:07:58 [bca.uk] INFO: Scrape type for AY66%20EOR: 0
2026-03-28 14:07:58 [bca.uk] INFO: Found listing with ID: FL70%20WDY
2026-03-28 14:07:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FL70%2520WDY%27 HTTP/1.1" 200 None
2026-03-28 14:07:58 [bca.uk] INFO: Scrape type for FL70%20WDY: 0
2026-03-28 14:07:58 [bca.uk] INFO: Found listing with ID: HK71%20UCC
2026-03-28 14:07:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27HK71%2520UCC%27 HTTP/1.1" 200 None
2026-03-28 14:07:58 [bca.uk] INFO: Scrape type for HK71%20UCC: 0
2026-03-28 14:07:58 [bca.uk] INFO: Found listing with ID: HN67%20XHO
2026-03-28 14:07:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27HN67%2520XHO%27 HTTP/1.1" 200 None
2026-03-28 14:07:58 [bca.uk] INFO: Scrape type for HN67%20XHO: 0
2026-03-28 14:07:58 [bca.uk] INFO: Found listing with ID: HK22%20RGO
2026-03-28 14:07:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27HK22%2520RGO%27 HTTP/1.1" 200 None
2026-03-28 14:07:58 [bca.uk] INFO: Scrape type for HK22%20RGO: 0
2026-03-28 14:07:58 [bca.uk] INFO: Found listing with ID: DS67%20KWK
2026-03-28 14:07:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DS67%2520KWK%27 HTTP/1.1" 200 None
2026-03-28 14:07:58 [bca.uk] INFO: Scrape type for DS67%20KWK: 0
2026-03-28 14:07:58 [bca.uk] INFO: Found listing with ID: CX15%20ULU
2026-03-28 14:07:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27CX15%2520ULU%27 HTTP/1.1" 200 None
2026-03-28 14:07:58 [bca.uk] INFO: Scrape type for CX15%20ULU: 0
2026-03-28 14:07:58 [bca.uk] INFO: Found listing with ID: RO14%20MMV
2026-03-28 14:07:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27RO14%2520MMV%27 HTTP/1.1" 200 None
2026-03-28 14:07:58 [bca.uk] INFO: Scrape type for RO14%20MMV: 0
2026-03-28 14:07:58 [bca.uk] INFO: Found listing with ID: MA13%20FHH
2026-03-28 14:07:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MA13%2520FHH%27 HTTP/1.1" 200 None
2026-03-28 14:07:58 [bca.uk] INFO: Scrape type for MA13%20FHH: 0
2026-03-28 14:07:58 [bca.uk] INFO: Found listing with ID: MK17%20JHJ
2026-03-28 14:07:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MK17%2520JHJ%27 HTTP/1.1" 200 None
2026-03-28 14:07:58 [bca.uk] INFO: Scrape type for MK17%20JHJ: 0
2026-03-28 14:07:58 [bca.uk] INFO: Found listing with ID: SG16%20EAC
2026-03-28 14:07:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SG16%2520EAC%27 HTTP/1.1" 200 None
2026-03-28 14:07:58 [bca.uk] INFO: Scrape type for SG16%20EAC: 0
2026-03-28 14:07:58 [bca.uk] INFO: Found listing with ID: YS65%20LZV
2026-03-28 14:07:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YS65%2520LZV%27 HTTP/1.1" 200 None
2026-03-28 14:07:58 [bca.uk] INFO: Scrape type for YS65%20LZV: 0
2026-03-28 14:07:58 [bca.uk] INFO: Found listing with ID: KO18%20CWM
2026-03-28 14:07:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KO18%2520CWM%27 HTTP/1.1" 200 None
2026-03-28 14:07:58 [bca.uk] INFO: Scrape type for KO18%20CWM: 0
2026-03-28 14:07:58 [bca.uk] INFO: Found listing with ID: KP61%20JVR
2026-03-28 14:07:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KP61%2520JVR%27 HTTP/1.1" 200 None
2026-03-28 14:07:58 [bca.uk] INFO: Scrape type for KP61%20JVR: 0
2026-03-28 14:07:58 [bca.uk] INFO: Found listing with ID: WK15%20WKR
2026-03-28 14:07:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WK15%2520WKR%27 HTTP/1.1" 200 None
2026-03-28 14:07:58 [bca.uk] INFO: Scrape type for WK15%20WKR: 2
2026-03-28 14:07:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ac89f782-61e2-577f-95e2-1478629915d5 with identifier: WK15%20WKR
2026-03-28 14:07:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ac89f782-61e2-577f-95e2-1478629915d5 with scrape type 2
2026-03-28 14:07:58 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ac89f782-61e2-577f-95e2-1478629915d5 with scrape type 2
2026-03-28 14:07:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: ac89f782-61e2-577f-95e2-1478629915d5, identifier: WK15%20WKR
2026-03-28 14:07:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:07:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c4625d0>
2026-03-28 14:07:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:07:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:07:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:07:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2c7ab10e-203f-5d5d-b669-d394e3cfab8d/2c7ab10e-203f-5d5d-b669-d394e3cfab8d_image_0.jpg HTTP/1.1" 201 0
2026-03-28 14:07:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FWU19VDC%252F698045618%252F600') HTTP/1.1" 204 0
2026-03-28 14:07:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WU19VDC/698045618/600 saved to cache
2026-03-28 14:07:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 2c7ab10e-203f-5d5d-b669-d394e3cfab8d
2026-03-28 14:07:58 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 2c7ab10e-203f-5d5d-b669-d394e3cfab8d, skipping ID generation
2026-03-28 14:07:58 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 2c7ab10e-203f-5d5d-b669-d394e3cfab8d sending to next pipeline
2026-03-28 14:07:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 2c7ab10e-203f-5d5d-b669-d394e3cfab8d, identifier: WU19%20VDC
2026-03-28 14:07:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:07:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2dd1f550>
2026-03-28 14:07:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:07:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:07:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:07:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8b90222e-e04a-5b27-ab41-392150aadde5/8b90222e-e04a-5b27-ab41-392150aadde5_image_1.jpg HTTP/1.1" 201 0
2026-03-28 14:07:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FKV16LDZ%252F698296888%252F600') HTTP/1.1" 204 0
2026-03-28 14:07:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KV16LDZ/698296888/600 saved to cache
2026-03-28 14:07:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 8b90222e-e04a-5b27-ab41-392150aadde5
2026-03-28 14:07:58 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 8b90222e-e04a-5b27-ab41-392150aadde5, skipping ID generation
2026-03-28 14:07:58 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 8b90222e-e04a-5b27-ab41-392150aadde5 sending to next pipeline
2026-03-28 14:07:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 8b90222e-e04a-5b27-ab41-392150aadde5, identifier: KV16%20LDZ
2026-03-28 14:07:58 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:07:58 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:07:58 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:07:58 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:07:58 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:07:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:07:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2dd86350>
2026-03-28 14:07:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:07:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:07:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:07:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b6d51688-b23c-5016-a794-ddfbf11c9378/b6d51688-b23c-5016-a794-ddfbf11c9378_image_9.jpg HTTP/1.1" 201 0
2026-03-28 14:07:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FKU19CFH%252F697551274%252F600') HTTP/1.1" 204 0
2026-03-28 14:07:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KU19CFH/697551274/600 saved to cache
2026-03-28 14:07:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item b6d51688-b23c-5016-a794-ddfbf11c9378
2026-03-28 14:07:59 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:07:59 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:07:59 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:07:59 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:07:59 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:07:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:07:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c1b4bd0>
2026-03-28 14:07:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:07:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:07:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:07:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1534762c-5952-5a28-84f7-7b27016558ac/1534762c-5952-5a28-84f7-7b27016558ac_image_9.jpg HTTP/1.1" 201 0
2026-03-28 14:07:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FDA21SOU%252F697888046%252F600') HTTP/1.1" 204 0
2026-03-28 14:07:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DA21SOU/697888046/600 saved to cache
2026-03-28 14:07:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 1534762c-5952-5a28-84f7-7b27016558ac
2026-03-28 14:07:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:07:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a1fe36590>
2026-03-28 14:07:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:07:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:07:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:07:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1c35ef13-b24b-57bb-8a15-809839352176/1c35ef13-b24b-57bb-8a15-809839352176_expert_report_file_787a84cd-cf29-4d27-9cbb-136b529f7f01.pdf HTTP/1.1" 201 0
2026-03-28 14:07:59 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item 1c35ef13-b24b-57bb-8a15-809839352176
2026-03-28 14:07:59 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 1c35ef13-b24b-57bb-8a15-809839352176, skipping ID generation
2026-03-28 14:07:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 1c35ef13-b24b-57bb-8a15-809839352176
2026-03-28 14:07:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DMV18VBD-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-28 14:07:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=MV18VBD-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-28 14:07:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:07:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2ca61e10>
2026-03-28 14:07:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:07:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:07:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:07:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_214771ac-26f4-5760-a178-e14681ff06b8/214771ac-26f4-5760-a178-e14681ff06b8_image_3.jpg HTTP/1.1" 201 0
2026-03-28 14:07:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FWV16UWB%252F698284415%252F600') HTTP/1.1" 204 0
2026-03-28 14:07:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WV16UWB/698284415/600 saved to cache
2026-03-28 14:07:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 214771ac-26f4-5760-a178-e14681ff06b8
2026-03-28 14:07:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:07:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c943990>
2026-03-28 14:07:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:07:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:07:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:07:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6665ad2b-5db8-5cb5-8575-3440dfdc3f0c/6665ad2b-5db8-5cb5-8575-3440dfdc3f0c_image_2.jpg HTTP/1.1" 201 0
2026-03-28 14:07:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FBV61MVO%252F698928533%252F600') HTTP/1.1" 204 0
2026-03-28 14:07:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BV61MVO/698928533/600 saved to cache
2026-03-28 14:07:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 6665ad2b-5db8-5cb5-8575-3440dfdc3f0c
2026-03-28 14:07:59 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VO67OHE/697995560/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=697995560>
2026-03-28 14:07:59 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PK68NZT/698929134/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698929134>
2026-03-28 14:07:59 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PK68NZT/698929119/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698929119>
2026-03-28 14:07:59 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VO67OHE/697995552/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=VO67OHE-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-28 14:07:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FY66OTD/698150775/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/FY66OTD/42794791?sv=2020-08-04&st=2026-03-28T14%3A03%3A46Z&se=2026-03-28T14%3A28%3A46Z&sr=b&sp=r&sig=nyWr7cManqycrjqVh9Sq0fegCWU0XCSire1eKcJWKLA%3D)
2026-03-28 14:07:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: ac89f782-61e2-577f-95e2-1478629915d5 with identifier: WK15%20WKR
2026-03-28 14:07:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: ac89f782-61e2-577f-95e2-1478629915d5 with identifier: WK15%20WKR
2026-03-28 14:07:59 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: ac89f782-61e2-577f-95e2-1478629915d5 with identifier: WK15%20WKR to the API
2026-03-28 14:07:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:07:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:07:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=19&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 95,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=WK15%20WKR-GB',
'category': 'LightCommercialVehicle',
'color': 'blue',
'currency': 'GBP',
'doors_number': 3,
'engine': '1.6L',
'expiration_date': '2026-04-02T10:00:00Z',
'fuel_type': 'Diesel',
'id': 'ac89f782-61e2-577f-95e2-1478629915d5',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'WK15 WKR',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=WK15%20WKR&vehicleType=*',
'listing': 'auction',
'location': 'Bristol',
'make': 'FORD',
'model': 'FIESTA',
'odometer': 113476,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-01-01',
'seller_name': None,
'title': 'FORD FIESTA 1.6 TDCI SPORT Van',
'transmission': 'manual',
'trim': 'TDCI SPORT',
'vin': 'WF0RXXGAKRFC83726',
'year': 2015}
2026-03-28 14:07:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WK15%2520WKR%27 HTTP/1.1" 200 None
2026-03-28 14:07:59 [bca.uk] INFO: Saving data for WK15%20WKR: {'auction_closing_time': 1775124000.0, 'created_time': 1774523264.479455, 'last_price_update_time': 1774706879.517056}
2026-03-28 14:07:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='WK15%2520WKR') HTTP/1.1" 204 0
2026-03-28 14:07:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 2c7ab10e-203f-5d5d-b669-d394e3cfab8d with identifier: WU19%20VDC
2026-03-28 14:07:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 2c7ab10e-203f-5d5d-b669-d394e3cfab8d with identifier: WU19%20VDC
2026-03-28 14:07:59 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 2c7ab10e-203f-5d5d-b669-d394e3cfab8d with identifier: WU19%20VDC to the API
2026-03-28 14:07:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:07:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:08:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WU19VDC/698045618/600>
{'auction_title': '',
'c_o_2_emission_value': 112,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2c7ab10e-203f-5d5d-b669-d394e3cfab8d/2c7ab10e-203f-5d5d-b669-d394e3cfab8d_expert_report_file_7d2e52a7-4f47-4a52-a682-03c5c5f73255.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=WU19%20VDC-GB',
'category': 'Car',
'color': 'grey',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.5L',
'expiration_date': '2026-03-29T10:00:00Z',
'fuel_type': 'Petrol',
'id': '2c7ab10e-203f-5d5d-b669-d394e3cfab8d',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'WU19 VDC',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=WU19%20VDC&vehicleType=*',
'listing': 'auction',
'location': 'Bristol',
'make': 'SKODA',
'model': 'OCTAVIA',
'odometer': 130145,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 11,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2c7ab10e-203f-5d5d-b669-d394e3cfab8d/2c7ab10e-203f-5d5d-b669-d394e3cfab8d_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 46210,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WU19VDC/698045618/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2c7ab10e-203f-5d5d-b669-d394e3cfab8d/2c7ab10e-203f-5d5d-b669-d394e3cfab8d_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 47034,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WU19VDC/698045620/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2c7ab10e-203f-5d5d-b669-d394e3cfab8d/2c7ab10e-203f-5d5d-b669-d394e3cfab8d_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 42268,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WU19VDC/698045623/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2c7ab10e-203f-5d5d-b669-d394e3cfab8d/2c7ab10e-203f-5d5d-b669-d394e3cfab8d_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 43813,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WU19VDC/698045628/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2c7ab10e-203f-5d5d-b669-d394e3cfab8d/2c7ab10e-203f-5d5d-b669-d394e3cfab8d_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 42621,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WU19VDC/698045632/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2c7ab10e-203f-5d5d-b669-d394e3cfab8d/2c7ab10e-203f-5d5d-b669-d394e3cfab8d_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 43101,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WU19VDC/698045637/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2c7ab10e-203f-5d5d-b669-d394e3cfab8d/2c7ab10e-203f-5d5d-b669-d394e3cfab8d_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 79013,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WU19VDC/698045644/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2c7ab10e-203f-5d5d-b669-d394e3cfab8d/2c7ab10e-203f-5d5d-b669-d394e3cfab8d_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 71772,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WU19VDC/698045650/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2c7ab10e-203f-5d5d-b669-d394e3cfab8d/2c7ab10e-203f-5d5d-b669-d394e3cfab8d_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 77448,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WU19VDC/698045655/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2c7ab10e-203f-5d5d-b669-d394e3cfab8d/2c7ab10e-203f-5d5d-b669-d394e3cfab8d_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 79431,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WU19VDC/698045660/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-01-01',
'seller_name': None,
'title': 'SKODA OCTAVIA 1.5 TSI 150 SE Hatchback',
'transmission': 'manual',
'trim': 'TSI 150 SE',
'vin': 'TMBBR7NE7K0158186',
'year': 2019}
2026-03-28 14:08:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WU19%2520VDC%27 HTTP/1.1" 200 None
2026-03-28 14:08:00 [bca.uk] INFO: Saving data for WU19%20VDC: {'created_time': 1774706880.107877, 'last_price_update_time': 1774706880.107887, 'auction_closing_time': 1774778400.0}
2026-03-28 14:08:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='WU19%2520VDC') HTTP/1.1" 204 0
2026-03-28 14:08:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 8b90222e-e04a-5b27-ab41-392150aadde5 with identifier: KV16%20LDZ
2026-03-28 14:08:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 8b90222e-e04a-5b27-ab41-392150aadde5 with identifier: KV16%20LDZ
2026-03-28 14:08:00 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 8b90222e-e04a-5b27-ab41-392150aadde5 with identifier: KV16%20LDZ to the API
2026-03-28 14:08:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:08:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:08:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KV16LDZ/698296888/600>
{'auction_title': '',
'c_o_2_emission_value': 139,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8b90222e-e04a-5b27-ab41-392150aadde5/8b90222e-e04a-5b27-ab41-392150aadde5_expert_report_file_46e3b6a7-961a-4e52-9723-9317477d3672.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=KV16%20LDZ-GB',
'category': 'Car',
'color': 'green',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.6L',
'expiration_date': '2026-03-29T10:00:00Z',
'fuel_type': 'Diesel',
'id': '8b90222e-e04a-5b27-ab41-392150aadde5',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'KV16 LDZ',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=KV16%20LDZ&vehicleType=*',
'listing': 'auction',
'location': 'Bristol',
'make': 'NISSAN',
'model': 'X-TRAIL',
'odometer': 133347,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 11,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8b90222e-e04a-5b27-ab41-392150aadde5/8b90222e-e04a-5b27-ab41-392150aadde5_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 48279,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KV16LDZ/698296885/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8b90222e-e04a-5b27-ab41-392150aadde5/8b90222e-e04a-5b27-ab41-392150aadde5_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 48443,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KV16LDZ/698296888/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8b90222e-e04a-5b27-ab41-392150aadde5/8b90222e-e04a-5b27-ab41-392150aadde5_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 44390,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KV16LDZ/698296895/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8b90222e-e04a-5b27-ab41-392150aadde5/8b90222e-e04a-5b27-ab41-392150aadde5_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 45617,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KV16LDZ/698296899/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8b90222e-e04a-5b27-ab41-392150aadde5/8b90222e-e04a-5b27-ab41-392150aadde5_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 44750,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KV16LDZ/698296902/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8b90222e-e04a-5b27-ab41-392150aadde5/8b90222e-e04a-5b27-ab41-392150aadde5_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 43312,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KV16LDZ/698296906/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8b90222e-e04a-5b27-ab41-392150aadde5/8b90222e-e04a-5b27-ab41-392150aadde5_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 97308,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KV16LDZ/698296913/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8b90222e-e04a-5b27-ab41-392150aadde5/8b90222e-e04a-5b27-ab41-392150aadde5_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 88365,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KV16LDZ/698296918/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8b90222e-e04a-5b27-ab41-392150aadde5/8b90222e-e04a-5b27-ab41-392150aadde5_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 87314,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KV16LDZ/698296923/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8b90222e-e04a-5b27-ab41-392150aadde5/8b90222e-e04a-5b27-ab41-392150aadde5_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 87632,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KV16LDZ/698296928/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-01-01',
'seller_name': None,
'title': 'NISSAN X-TRAIL 1.6 DCI 130 TEKNA (7ST) XTRONIC StationWagon',
'transmission': 'automatic',
'trim': 'DCI 130 TEKNA (7ST) XTRONIC',
'vin': 'JN1JCAT32U0023480',
'year': 2016}
2026-03-28 14:08:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KV16%2520LDZ%27 HTTP/1.1" 200 None
2026-03-28 14:08:00 [bca.uk] INFO: Saving data for KV16%20LDZ: {'created_time': 1774706880.484852, 'last_price_update_time': 1774706880.484863, 'auction_closing_time': 1774778400.0}
2026-03-28 14:08:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='KV16%2520LDZ') HTTP/1.1" 204 0
2026-03-28 14:08:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698929284%27 HTTP/1.1" 200 None
2026-03-28 14:08:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698929284 not downloaded yet
2026-03-28 14:08:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D697995601%27 HTTP/1.1" 200 None
2026-03-28 14:08:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=697995601 not downloaded yet
2026-03-28 14:08:00 [bca.uk] INFO: Found listing with ID: WX60%20CFO
2026-03-28 14:08:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WX60%2520CFO%27 HTTP/1.1" 200 None
2026-03-28 14:08:00 [bca.uk] INFO: Scrape type for WX60%20CFO: 0
2026-03-28 14:08:00 [bca.uk] INFO: Found listing with ID: VK66%20PZX
2026-03-28 14:08:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27VK66%2520PZX%27 HTTP/1.1" 200 None
2026-03-28 14:08:00 [bca.uk] INFO: Scrape type for VK66%20PZX: 0
2026-03-28 14:08:00 [bca.uk] INFO: Found listing with ID: SJ64%20WFB
2026-03-28 14:08:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SJ64%2520WFB%27 HTTP/1.1" 200 None
2026-03-28 14:08:00 [bca.uk] INFO: Scrape type for SJ64%20WFB: 0
2026-03-28 14:08:00 [bca.uk] INFO: Found listing with ID: WN62%20OGT
2026-03-28 14:08:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WN62%2520OGT%27 HTTP/1.1" 200 None
2026-03-28 14:08:00 [bca.uk] INFO: Scrape type for WN62%20OGT: 0
2026-03-28 14:08:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698920384%27 HTTP/1.1" 200 None
2026-03-28 14:08:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698920384 not downloaded yet
2026-03-28 14:08:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:08:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2de08990>
2026-03-28 14:08:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:08:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:08:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:08:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6f52ae88-a710-5999-b75b-294cfedaf6f8/6f52ae88-a710-5999-b75b-294cfedaf6f8_image_3.jpg HTTP/1.1" 201 0
2026-03-28 14:08:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FX11BBM%252F697603974%252F600') HTTP/1.1" 204 0
2026-03-28 14:08:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/X11BBM/697603974/600 saved to cache
2026-03-28 14:08:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 6f52ae88-a710-5999-b75b-294cfedaf6f8
2026-03-28 14:08:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:08:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c19b410>
2026-03-28 14:08:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:08:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:08:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:08:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0c3c3ab5-91e6-5450-9be7-ee521ca8a766/0c3c3ab5-91e6-5450-9be7-ee521ca8a766_image_3.jpg HTTP/1.1" 201 0
2026-03-28 14:08:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FNL64KGO%252F698157119%252F600') HTTP/1.1" 204 0
2026-03-28 14:08:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NL64KGO/698157119/600 saved to cache
2026-03-28 14:08:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 0c3c3ab5-91e6-5450-9be7-ee521ca8a766
2026-03-28 14:08:00 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VO67OHE/697995566/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=697995566>
2026-03-28 14:08:00 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VO67OHE/697995563/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=697995563>
2026-03-28 14:08:00 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PK68NZT/698929168/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698929168>
2026-03-28 14:08:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698929306%27 HTTP/1.1" 200 None
2026-03-28 14:08:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698929306 not downloaded yet
2026-03-28 14:08:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D697995612%27 HTTP/1.1" 200 None
2026-03-28 14:08:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=697995612 not downloaded yet
2026-03-28 14:08:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698920391%27 HTTP/1.1" 200 None
2026-03-28 14:08:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698920391 not downloaded yet
2026-03-28 14:08:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:08:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c823c50>
2026-03-28 14:08:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:08:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:08:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:08:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7708aee7-65e8-597e-aa3d-426819c9c319/7708aee7-65e8-597e-aa3d-426819c9c319_image_4.jpg HTTP/1.1" 201 0
2026-03-28 14:08:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FOY67JPV%252F698107923%252F600') HTTP/1.1" 204 0
2026-03-28 14:08:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/OY67JPV/698107923/600 saved to cache
2026-03-28 14:08:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 7708aee7-65e8-597e-aa3d-426819c9c319
2026-03-28 14:08:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:08:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2ca880d0>
2026-03-28 14:08:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:08:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:08:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:08:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d7b30cd7-3fb2-520c-9629-4539584c6e2c/d7b30cd7-3fb2-520c-9629-4539584c6e2c_image_4.jpg HTTP/1.1" 201 0
2026-03-28 14:08:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FFV17TYW%252F698767973%252F600') HTTP/1.1" 204 0
2026-03-28 14:08:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FV17TYW/698767973/600 saved to cache
2026-03-28 14:08:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item d7b30cd7-3fb2-520c-9629-4539584c6e2c
2026-03-28 14:08:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:08:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a1fe3f2d0>
2026-03-28 14:08:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:08:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:08:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:08:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_40999011-32af-5ad3-a840-4cb8242ff02a/40999011-32af-5ad3-a840-4cb8242ff02a_image_4.jpg HTTP/1.1" 201 0
2026-03-28 14:08:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FFY66OTD%252F698150775%252F600') HTTP/1.1" 204 0
2026-03-28 14:08:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FY66OTD/698150775/600 saved to cache
2026-03-28 14:08:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 40999011-32af-5ad3-a840-4cb8242ff02a
2026-03-28 14:08:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PK68NZT/698929090/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/PK68NZT/42809697?sv=2020-08-04&st=2026-03-28T14%3A07%3A49Z&se=2026-03-28T14%3A32%3A49Z&sr=b&sp=r&sig=MlSmp8QnvmrDDMWD0h20OzEr8AtAE1qX43dTRufEQSs%3D)
2026-03-28 14:08:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VO67OHE/697995552/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/VO67OHE/42792220?sv=2020-08-04&st=2026-03-28T14%3A07%3A49Z&se=2026-03-28T14%3A32%3A49Z&sr=b&sp=r&sig=hi306iOBJ1MdtnUuCM2GqJ4jJbX%2Bc3I4fiy4m%2FWA7CY%3D)
2026-03-28 14:08:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D697995623%27 HTTP/1.1" 200 None
2026-03-28 14:08:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=697995623 not downloaded yet
2026-03-28 14:08:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698920396%27 HTTP/1.1" 200 None
2026-03-28 14:08:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698920396 not downloaded yet
2026-03-28 14:08:00 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VO67OHE/697995574/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=697995574>
2026-03-28 14:08:00 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PK68NZT/698929219/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698929219>
2026-03-28 14:08:00 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VO67OHE/697995577/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=697995577>
2026-03-28 14:08:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LN68RBY/698920315/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LN68RBY/42809684?sv=2020-08-04&st=2026-03-28T14%3A03%3A42Z&se=2026-03-28T14%3A28%3A42Z&sr=b&sp=r&sig=aIYqAxiZsHZDOcTozI0zzgpiaCRiEseqbYSKBZyhWQ4%3D)
2026-03-28 14:08:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KU19CFH/697551259/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/KU19CFH/42809756?sv=2020-08-04&st=2026-03-28T14%3A03%3A45Z&se=2026-03-28T14%3A28%3A45Z&sr=b&sp=r&sig=1G7eR4FaPr%2BtRdJKW3arikyQmOCuk26xvavIORXr6y8%3D)
2026-03-28 14:08:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DA21SOU/697888030/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/DA21SOU/42810340?sv=2020-08-04&st=2026-03-28T14%3A03%3A42Z&se=2026-03-28T14%3A28%3A42Z&sr=b&sp=r&sig=6%2F4a%2BWc9n6QD4YiOi5mt3dZkPnMZj%2Bfh7208k4Rd3hI%3D)
2026-03-28 14:08:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698920400%27 HTTP/1.1" 200 None
2026-03-28 14:08:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698920400 not downloaded yet
2026-03-28 14:08:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698920404%27 HTTP/1.1" 200 None
2026-03-28 14:08:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698920404 not downloaded yet
2026-03-28 14:08:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698920410%27 HTTP/1.1" 200 None
2026-03-28 14:08:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698920410 not downloaded yet
2026-03-28 14:08:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698920415%27 HTTP/1.1" 200 None
2026-03-28 14:08:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698920415 not downloaded yet
2026-03-28 14:08:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VO67OHE/697995563/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/VO67OHE/42792220?sv=2020-08-04&st=2026-03-28T14%3A07%3A49Z&se=2026-03-28T14%3A32%3A49Z&sr=b&sp=r&sig=hi306iOBJ1MdtnUuCM2GqJ4jJbX%2Bc3I4fiy4m%2FWA7CY%3D)
2026-03-28 14:08:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698920423%27 HTTP/1.1" 200 None
2026-03-28 14:08:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698920423 not downloaded yet
2026-03-28 14:08:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:08:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2deaa210>
2026-03-28 14:08:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:08:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:08:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:08:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_418ba9d9-1978-54c6-a2d3-b78329217655/418ba9d9-1978-54c6-a2d3-b78329217655_image_0.jpg HTTP/1.1" 201 0
2026-03-28 14:08:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FPK68NZT%252F698929090%252F600') HTTP/1.1" 204 0
2026-03-28 14:08:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PK68NZT/698929090/600 saved to cache
2026-03-28 14:08:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 418ba9d9-1978-54c6-a2d3-b78329217655
2026-03-28 14:08:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:08:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a3008ce90>
2026-03-28 14:08:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:08:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:08:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:08:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_eaf9d23b-faf9-5201-9f92-ea95460928e4/eaf9d23b-faf9-5201-9f92-ea95460928e4_image_0.jpg HTTP/1.1" 201 0
2026-03-28 14:08:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FVO67OHE%252F697995552%252F600') HTTP/1.1" 204 0
2026-03-28 14:08:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VO67OHE/697995552/600 saved to cache
2026-03-28 14:08:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item eaf9d23b-faf9-5201-9f92-ea95460928e4
2026-03-28 14:08:01 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MV18VBD/698920391/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698920391>
2026-03-28 14:08:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PK68NZT/698929119/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/PK68NZT/42809697?sv=2020-08-04&st=2026-03-28T14%3A07%3A49Z&se=2026-03-28T14%3A32%3A49Z&sr=b&sp=r&sig=MlSmp8QnvmrDDMWD0h20OzEr8AtAE1qX43dTRufEQSs%3D)
2026-03-28 14:08:01 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MV18VBD/698920371/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=MV18VBD-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-28 14:08:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PK68NZT/698929134/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/PK68NZT/42809697?sv=2020-08-04&st=2026-03-28T14%3A07%3A49Z&se=2026-03-28T14%3A32%3A49Z&sr=b&sp=r&sig=MlSmp8QnvmrDDMWD0h20OzEr8AtAE1qX43dTRufEQSs%3D)
2026-03-28 14:08:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PK68NZT/698929168/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/PK68NZT/42809697?sv=2020-08-04&st=2026-03-28T14%3A07%3A49Z&se=2026-03-28T14%3A32%3A49Z&sr=b&sp=r&sig=MlSmp8QnvmrDDMWD0h20OzEr8AtAE1qX43dTRufEQSs%3D)
2026-03-28 14:08:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698920430%27 HTTP/1.1" 200 None
2026-03-28 14:08:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698920430 not downloaded yet
2026-03-28 14:08:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VO67OHE/697995560/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/VO67OHE/42792220?sv=2020-08-04&st=2026-03-28T14%3A07%3A49Z&se=2026-03-28T14%3A32%3A49Z&sr=b&sp=r&sig=hi306iOBJ1MdtnUuCM2GqJ4jJbX%2Bc3I4fiy4m%2FWA7CY%3D)
2026-03-28 14:08:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VO67OHE/697995566/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/VO67OHE/42792220?sv=2020-08-04&st=2026-03-28T14%3A07%3A49Z&se=2026-03-28T14%3A32%3A49Z&sr=b&sp=r&sig=hi306iOBJ1MdtnUuCM2GqJ4jJbX%2Bc3I4fiy4m%2FWA7CY%3D)
2026-03-28 14:08:01 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VO67OHE/697995612/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=697995612>
2026-03-28 14:08:01 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MV18VBD/698920415/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698920415>
2026-03-28 14:08:01 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PK68NZT/698929306/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698929306>
2026-03-28 14:08:01 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MV18VBD/698920384/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698920384>
2026-03-28 14:08:01 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VO67OHE/697995601/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=697995601>
2026-03-28 14:08:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VO67OHE/697995574/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/VO67OHE/42792220?sv=2020-08-04&st=2026-03-28T14%3A07%3A49Z&se=2026-03-28T14%3A32%3A49Z&sr=b&sp=r&sig=hi306iOBJ1MdtnUuCM2GqJ4jJbX%2Bc3I4fiy4m%2FWA7CY%3D)
2026-03-28 14:08:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VO67OHE/697995577/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/VO67OHE/42792220?sv=2020-08-04&st=2026-03-28T14%3A07%3A49Z&se=2026-03-28T14%3A32%3A49Z&sr=b&sp=r&sig=hi306iOBJ1MdtnUuCM2GqJ4jJbX%2Bc3I4fiy4m%2FWA7CY%3D)
2026-03-28 14:08:01 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:08:01 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:08:01 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:08:01 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:08:01 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:08:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:08:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2dea90d0>
2026-03-28 14:08:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:08:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:08:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:08:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_04fa14f2-714c-5033-a1fe-bd0c784e7d7e/04fa14f2-714c-5033-a1fe-bd0c784e7d7e_image_8.jpg HTTP/1.1" 201 0
2026-03-28 14:08:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLN68RBY%252F698920315%252F600') HTTP/1.1" 204 0
2026-03-28 14:08:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LN68RBY/698920315/600 saved to cache
2026-03-28 14:08:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 04fa14f2-714c-5033-a1fe-bd0c784e7d7e
2026-03-28 14:08:01 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:08:01 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:08:01 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:08:01 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:08:01 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:08:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:08:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c588750>
2026-03-28 14:08:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:08:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:08:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:08:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b6d51688-b23c-5016-a794-ddfbf11c9378/b6d51688-b23c-5016-a794-ddfbf11c9378_image_8.jpg HTTP/1.1" 201 0
2026-03-28 14:08:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FKU19CFH%252F697551259%252F600') HTTP/1.1" 204 0
2026-03-28 14:08:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KU19CFH/697551259/600 saved to cache
2026-03-28 14:08:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item b6d51688-b23c-5016-a794-ddfbf11c9378
2026-03-28 14:08:01 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:08:01 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:08:01 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:08:01 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:08:01 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:08:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:08:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c769cd0>
2026-03-28 14:08:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:08:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:08:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:08:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1534762c-5952-5a28-84f7-7b27016558ac/1534762c-5952-5a28-84f7-7b27016558ac_image_8.jpg HTTP/1.1" 201 0
2026-03-28 14:08:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FDA21SOU%252F697888030%252F600') HTTP/1.1" 204 0
2026-03-28 14:08:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DA21SOU/697888030/600 saved to cache
2026-03-28 14:08:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 1534762c-5952-5a28-84f7-7b27016558ac
2026-03-28 14:08:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:08:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2ca1e950>
2026-03-28 14:08:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:08:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:08:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:08:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_eaf9d23b-faf9-5201-9f92-ea95460928e4/eaf9d23b-faf9-5201-9f92-ea95460928e4_image_2.jpg HTTP/1.1" 201 0
2026-03-28 14:08:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FVO67OHE%252F697995563%252F600') HTTP/1.1" 204 0
2026-03-28 14:08:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VO67OHE/697995563/600 saved to cache
2026-03-28 14:08:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item eaf9d23b-faf9-5201-9f92-ea95460928e4
2026-03-28 14:08:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PK68NZT/698929219/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/PK68NZT/42809697?sv=2020-08-04&st=2026-03-28T14%3A07%3A49Z&se=2026-03-28T14%3A32%3A49Z&sr=b&sp=r&sig=MlSmp8QnvmrDDMWD0h20OzEr8AtAE1qX43dTRufEQSs%3D)
2026-03-28 14:08:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:08:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2ca0fc50>
2026-03-28 14:08:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:08:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:08:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:08:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_418ba9d9-1978-54c6-a2d3-b78329217655/418ba9d9-1978-54c6-a2d3-b78329217655_image_1.jpg HTTP/1.1" 201 0
2026-03-28 14:08:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FPK68NZT%252F698929119%252F600') HTTP/1.1" 204 0
2026-03-28 14:08:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PK68NZT/698929119/600 saved to cache
2026-03-28 14:08:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 418ba9d9-1978-54c6-a2d3-b78329217655
2026-03-28 14:08:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:08:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2d736910>
2026-03-28 14:08:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:08:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:08:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:08:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_418ba9d9-1978-54c6-a2d3-b78329217655/418ba9d9-1978-54c6-a2d3-b78329217655_image_2.jpg HTTP/1.1" 201 0
2026-03-28 14:08:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FPK68NZT%252F698929134%252F600') HTTP/1.1" 204 0
2026-03-28 14:08:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PK68NZT/698929134/600 saved to cache
2026-03-28 14:08:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 418ba9d9-1978-54c6-a2d3-b78329217655
2026-03-28 14:08:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:08:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c73c950>
2026-03-28 14:08:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:08:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:08:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:08:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_418ba9d9-1978-54c6-a2d3-b78329217655/418ba9d9-1978-54c6-a2d3-b78329217655_image_4.jpg HTTP/1.1" 201 0
2026-03-28 14:08:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FPK68NZT%252F698929168%252F600') HTTP/1.1" 204 0
2026-03-28 14:08:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PK68NZT/698929168/600 saved to cache
2026-03-28 14:08:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 418ba9d9-1978-54c6-a2d3-b78329217655
2026-03-28 14:08:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:08:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c9ed410>
2026-03-28 14:08:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:08:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:08:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:08:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_eaf9d23b-faf9-5201-9f92-ea95460928e4/eaf9d23b-faf9-5201-9f92-ea95460928e4_image_1.jpg HTTP/1.1" 201 0
2026-03-28 14:08:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FVO67OHE%252F697995560%252F600') HTTP/1.1" 204 0
2026-03-28 14:08:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VO67OHE/697995560/600 saved to cache
2026-03-28 14:08:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item eaf9d23b-faf9-5201-9f92-ea95460928e4
2026-03-28 14:08:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:08:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c5f1510>
2026-03-28 14:08:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:08:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:08:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:08:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_eaf9d23b-faf9-5201-9f92-ea95460928e4/eaf9d23b-faf9-5201-9f92-ea95460928e4_image_3.jpg HTTP/1.1" 201 0
2026-03-28 14:08:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FVO67OHE%252F697995566%252F600') HTTP/1.1" 204 0
2026-03-28 14:08:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VO67OHE/697995566/600 saved to cache
2026-03-28 14:08:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item eaf9d23b-faf9-5201-9f92-ea95460928e4
2026-03-28 14:08:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MV18VBD/698920371/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/MV18VBD/42809599?sv=2020-08-04&st=2026-03-28T14%3A07%3A55Z&se=2026-03-28T14%3A32%3A55Z&sr=b&sp=r&sig=qrwyo516FqCfQ9rzYuw%2F1kiWtelF6cPMOtHn%2FkvWNFc%3D)
2026-03-28 14:08:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MV18VBD/698920391/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/MV18VBD/42809599?sv=2020-08-04&st=2026-03-28T14%3A07%3A55Z&se=2026-03-28T14%3A32%3A55Z&sr=b&sp=r&sig=qrwyo516FqCfQ9rzYuw%2F1kiWtelF6cPMOtHn%2FkvWNFc%3D)
2026-03-28 14:08:01 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MV18VBD/698920404/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698920404>
2026-03-28 14:08:01 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MV18VBD/698920400/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698920400>
2026-03-28 14:08:01 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MV18VBD/698920423/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698920423>
2026-03-28 14:08:01 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MV18VBD/698920410/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698920410>
2026-03-28 14:08:01 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MV18VBD/698920396/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698920396>
2026-03-28 14:08:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:08:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a1fe80310>
2026-03-28 14:08:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:08:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:08:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:08:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_eaf9d23b-faf9-5201-9f92-ea95460928e4/eaf9d23b-faf9-5201-9f92-ea95460928e4_image_4.jpg HTTP/1.1" 201 0
2026-03-28 14:08:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FVO67OHE%252F697995574%252F600') HTTP/1.1" 204 0
2026-03-28 14:08:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VO67OHE/697995574/600 saved to cache
2026-03-28 14:08:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item eaf9d23b-faf9-5201-9f92-ea95460928e4
2026-03-28 14:08:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:08:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c606cd0>
2026-03-28 14:08:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:08:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:08:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:08:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_eaf9d23b-faf9-5201-9f92-ea95460928e4/eaf9d23b-faf9-5201-9f92-ea95460928e4_image_5.jpg HTTP/1.1" 201 0
2026-03-28 14:08:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FVO67OHE%252F697995577%252F600') HTTP/1.1" 204 0
2026-03-28 14:08:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VO67OHE/697995577/600 saved to cache
2026-03-28 14:08:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item eaf9d23b-faf9-5201-9f92-ea95460928e4
2026-03-28 14:08:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VO67OHE/697995601/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/VO67OHE/42792220?sv=2020-08-04&st=2026-03-28T14%3A07%3A49Z&se=2026-03-28T14%3A32%3A49Z&sr=b&sp=r&sig=hi306iOBJ1MdtnUuCM2GqJ4jJbX%2Bc3I4fiy4m%2FWA7CY%3D)
2026-03-28 14:08:01 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:08:01 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:08:01 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:08:01 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:08:01 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:08:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:08:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c9a1d10>
2026-03-28 14:08:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:08:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:08:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:08:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_418ba9d9-1978-54c6-a2d3-b78329217655/418ba9d9-1978-54c6-a2d3-b78329217655_image_6.jpg HTTP/1.1" 201 0
2026-03-28 14:08:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FPK68NZT%252F698929219%252F600') HTTP/1.1" 204 0
2026-03-28 14:08:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PK68NZT/698929219/600 saved to cache
2026-03-28 14:08:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 418ba9d9-1978-54c6-a2d3-b78329217655
2026-03-28 14:08:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:08:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2eb26dd0>
2026-03-28 14:08:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:08:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:08:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:08:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1c35ef13-b24b-57bb-8a15-809839352176/1c35ef13-b24b-57bb-8a15-809839352176_image_0.jpg HTTP/1.1" 201 0
2026-03-28 14:08:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FMV18VBD%252F698920371%252F600') HTTP/1.1" 204 0
2026-03-28 14:08:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MV18VBD/698920371/600 saved to cache
2026-03-28 14:08:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 1c35ef13-b24b-57bb-8a15-809839352176
2026-03-28 14:08:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:08:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c71a090>
2026-03-28 14:08:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:08:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:08:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:08:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1c35ef13-b24b-57bb-8a15-809839352176/1c35ef13-b24b-57bb-8a15-809839352176_image_2.jpg HTTP/1.1" 201 0
2026-03-28 14:08:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FMV18VBD%252F698920391%252F600') HTTP/1.1" 204 0
2026-03-28 14:08:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MV18VBD/698920391/600 saved to cache
2026-03-28 14:08:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 1c35ef13-b24b-57bb-8a15-809839352176
2026-03-28 14:08:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MV18VBD/698920384/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/MV18VBD/42809599?sv=2020-08-04&st=2026-03-28T14%3A07%3A55Z&se=2026-03-28T14%3A32%3A55Z&sr=b&sp=r&sig=qrwyo516FqCfQ9rzYuw%2F1kiWtelF6cPMOtHn%2FkvWNFc%3D)
2026-03-28 14:08:01 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VO67OHE/697995623/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=697995623>
2026-03-28 14:08:01 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MV18VBD/698920430/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698920430>
2026-03-28 14:08:01 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PK68NZT/698929284/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698929284>
2026-03-28 14:08:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MV18VBD/698920396/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/MV18VBD/42809599?sv=2020-08-04&st=2026-03-28T14%3A07%3A55Z&se=2026-03-28T14%3A32%3A55Z&sr=b&sp=r&sig=qrwyo516FqCfQ9rzYuw%2F1kiWtelF6cPMOtHn%2FkvWNFc%3D)
2026-03-28 14:08:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VO67OHE/697995612/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/VO67OHE/42792220?sv=2020-08-04&st=2026-03-28T14%3A07%3A49Z&se=2026-03-28T14%3A32%3A49Z&sr=b&sp=r&sig=hi306iOBJ1MdtnUuCM2GqJ4jJbX%2Bc3I4fiy4m%2FWA7CY%3D)
2026-03-28 14:08:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MV18VBD/698920415/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/MV18VBD/42809599?sv=2020-08-04&st=2026-03-28T14%3A07%3A55Z&se=2026-03-28T14%3A32%3A55Z&sr=b&sp=r&sig=qrwyo516FqCfQ9rzYuw%2F1kiWtelF6cPMOtHn%2FkvWNFc%3D)
2026-03-28 14:08:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PK68NZT/698929306/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/PK68NZT/42809697?sv=2020-08-04&st=2026-03-28T14%3A07%3A49Z&se=2026-03-28T14%3A32%3A49Z&sr=b&sp=r&sig=MlSmp8QnvmrDDMWD0h20OzEr8AtAE1qX43dTRufEQSs%3D)
2026-03-28 14:08:01 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:08:01 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:08:01 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:08:01 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:08:01 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:08:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:08:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c11a250>
2026-03-28 14:08:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:08:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:08:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:08:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_eaf9d23b-faf9-5201-9f92-ea95460928e4/eaf9d23b-faf9-5201-9f92-ea95460928e4_image_7.jpg HTTP/1.1" 201 0
2026-03-28 14:08:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FVO67OHE%252F697995601%252F600') HTTP/1.1" 204 0
2026-03-28 14:08:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VO67OHE/697995601/600 saved to cache
2026-03-28 14:08:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item eaf9d23b-faf9-5201-9f92-ea95460928e4
2026-03-28 14:08:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MV18VBD/698920400/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/MV18VBD/42809599?sv=2020-08-04&st=2026-03-28T14%3A07%3A55Z&se=2026-03-28T14%3A32%3A55Z&sr=b&sp=r&sig=qrwyo516FqCfQ9rzYuw%2F1kiWtelF6cPMOtHn%2FkvWNFc%3D)
2026-03-28 14:08:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MV18VBD/698920404/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/MV18VBD/42809599?sv=2020-08-04&st=2026-03-28T14%3A07%3A55Z&se=2026-03-28T14%3A32%3A55Z&sr=b&sp=r&sig=qrwyo516FqCfQ9rzYuw%2F1kiWtelF6cPMOtHn%2FkvWNFc%3D)
2026-03-28 14:08:02 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VO67OHE/697995587/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=697995587>
2026-03-28 14:08:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MV18VBD/698920423/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/MV18VBD/42809599?sv=2020-08-04&st=2026-03-28T14%3A07%3A55Z&se=2026-03-28T14%3A32%3A55Z&sr=b&sp=r&sig=qrwyo516FqCfQ9rzYuw%2F1kiWtelF6cPMOtHn%2FkvWNFc%3D)
2026-03-28 14:08:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MV18VBD/698920410/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/MV18VBD/42809599?sv=2020-08-04&st=2026-03-28T14%3A07%3A55Z&se=2026-03-28T14%3A32%3A55Z&sr=b&sp=r&sig=qrwyo516FqCfQ9rzYuw%2F1kiWtelF6cPMOtHn%2FkvWNFc%3D)
2026-03-28 14:08:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:08:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a1ffb1910>
2026-03-28 14:08:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:08:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:08:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:08:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1c35ef13-b24b-57bb-8a15-809839352176/1c35ef13-b24b-57bb-8a15-809839352176_image_1.jpg HTTP/1.1" 201 0
2026-03-28 14:08:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FMV18VBD%252F698920384%252F600') HTTP/1.1" 204 0
2026-03-28 14:08:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MV18VBD/698920384/600 saved to cache
2026-03-28 14:08:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 1c35ef13-b24b-57bb-8a15-809839352176
2026-03-28 14:08:02 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PK68NZT/698929184/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698929184>
2026-03-28 14:08:02 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PK68NZT/698929250/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698929250>
2026-03-28 14:08:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PK68NZT/698929284/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/PK68NZT/42809697?sv=2020-08-04&st=2026-03-28T14%3A07%3A49Z&se=2026-03-28T14%3A32%3A49Z&sr=b&sp=r&sig=MlSmp8QnvmrDDMWD0h20OzEr8AtAE1qX43dTRufEQSs%3D)
2026-03-28 14:08:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VO67OHE/697995623/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/VO67OHE/42792220?sv=2020-08-04&st=2026-03-28T14%3A07%3A49Z&se=2026-03-28T14%3A32%3A49Z&sr=b&sp=r&sig=hi306iOBJ1MdtnUuCM2GqJ4jJbX%2Bc3I4fiy4m%2FWA7CY%3D)
2026-03-28 14:08:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:08:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c9f74d0>
2026-03-28 14:08:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:08:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:08:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:08:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1c35ef13-b24b-57bb-8a15-809839352176/1c35ef13-b24b-57bb-8a15-809839352176_image_3.jpg HTTP/1.1" 201 0
2026-03-28 14:08:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FMV18VBD%252F698920396%252F600') HTTP/1.1" 204 0
2026-03-28 14:08:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MV18VBD/698920396/600 saved to cache
2026-03-28 14:08:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 1c35ef13-b24b-57bb-8a15-809839352176
2026-03-28 14:08:02 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:08:02 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:08:02 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:08:02 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:08:02 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:08:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:08:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a304b8bd0>
2026-03-28 14:08:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:08:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:08:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:08:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_eaf9d23b-faf9-5201-9f92-ea95460928e4/eaf9d23b-faf9-5201-9f92-ea95460928e4_image_8.jpg HTTP/1.1" 201 0
2026-03-28 14:08:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FVO67OHE%252F697995612%252F600') HTTP/1.1" 204 0
2026-03-28 14:08:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VO67OHE/697995612/600 saved to cache
2026-03-28 14:08:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item eaf9d23b-faf9-5201-9f92-ea95460928e4
2026-03-28 14:08:02 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:08:02 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:08:02 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:08:02 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:08:02 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:08:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:08:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c6b61d0>
2026-03-28 14:08:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:08:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:08:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:08:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1c35ef13-b24b-57bb-8a15-809839352176/1c35ef13-b24b-57bb-8a15-809839352176_image_7.jpg HTTP/1.1" 201 0
2026-03-28 14:08:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FMV18VBD%252F698920415%252F600') HTTP/1.1" 204 0
2026-03-28 14:08:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MV18VBD/698920415/600 saved to cache
2026-03-28 14:08:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 1c35ef13-b24b-57bb-8a15-809839352176
2026-03-28 14:08:02 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:08:02 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:08:02 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:08:02 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:08:02 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:08:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:08:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c7320d0>
2026-03-28 14:08:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:08:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:08:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:08:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_418ba9d9-1978-54c6-a2d3-b78329217655/418ba9d9-1978-54c6-a2d3-b78329217655_image_9.jpg HTTP/1.1" 201 0
2026-03-28 14:08:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FPK68NZT%252F698929306%252F600') HTTP/1.1" 204 0
2026-03-28 14:08:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PK68NZT/698929306/600 saved to cache
2026-03-28 14:08:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 418ba9d9-1978-54c6-a2d3-b78329217655
2026-03-28 14:08:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MV18VBD/698920430/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/MV18VBD/42809599?sv=2020-08-04&st=2026-03-28T14%3A07%3A55Z&se=2026-03-28T14%3A32%3A55Z&sr=b&sp=r&sig=qrwyo516FqCfQ9rzYuw%2F1kiWtelF6cPMOtHn%2FkvWNFc%3D)
2026-03-28 14:08:02 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NL64KGO/698157107/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698157107>
2026-03-28 14:08:02 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PK68NZT/698929143/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698929143>
2026-03-28 14:08:02 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BV61MVO/698928503/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698928503>
2026-03-28 14:08:02 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/X11BBM/697603972/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=697603972>
2026-03-28 14:08:02 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WV16UWB/698284411/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698284411>
2026-03-28 14:08:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:08:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c6b5fd0>
2026-03-28 14:08:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:08:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:08:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:08:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1c35ef13-b24b-57bb-8a15-809839352176/1c35ef13-b24b-57bb-8a15-809839352176_image_4.jpg HTTP/1.1" 201 0
2026-03-28 14:08:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FMV18VBD%252F698920400%252F600') HTTP/1.1" 204 0
2026-03-28 14:08:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MV18VBD/698920400/600 saved to cache
2026-03-28 14:08:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 1c35ef13-b24b-57bb-8a15-809839352176
2026-03-28 14:08:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:08:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c43c6d0>
2026-03-28 14:08:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:08:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:08:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:08:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1c35ef13-b24b-57bb-8a15-809839352176/1c35ef13-b24b-57bb-8a15-809839352176_image_5.jpg HTTP/1.1" 201 0
2026-03-28 14:08:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FMV18VBD%252F698920404%252F600') HTTP/1.1" 204 0
2026-03-28 14:08:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MV18VBD/698920404/600 saved to cache
2026-03-28 14:08:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 1c35ef13-b24b-57bb-8a15-809839352176
2026-03-28 14:08:02 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:08:02 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:08:02 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:08:02 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:08:02 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:08:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:08:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a1fe37c50>
2026-03-28 14:08:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:08:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:08:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:08:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1c35ef13-b24b-57bb-8a15-809839352176/1c35ef13-b24b-57bb-8a15-809839352176_image_8.jpg HTTP/1.1" 201 0
2026-03-28 14:08:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FMV18VBD%252F698920423%252F600') HTTP/1.1" 204 0
2026-03-28 14:08:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MV18VBD/698920423/600 saved to cache
2026-03-28 14:08:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 1c35ef13-b24b-57bb-8a15-809839352176
2026-03-28 14:08:02 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:08:02 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:08:02 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:08:02 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:08:02 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:08:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:08:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a1fe34090>
2026-03-28 14:08:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:08:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:08:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:08:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1c35ef13-b24b-57bb-8a15-809839352176/1c35ef13-b24b-57bb-8a15-809839352176_image_6.jpg HTTP/1.1" 201 0
2026-03-28 14:08:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FMV18VBD%252F698920410%252F600') HTTP/1.1" 204 0
2026-03-28 14:08:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MV18VBD/698920410/600 saved to cache
2026-03-28 14:08:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 1c35ef13-b24b-57bb-8a15-809839352176
2026-03-28 14:08:02 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:08:02 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:08:02 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:08:02 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:08:02 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:08:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:08:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c9fa610>
2026-03-28 14:08:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:08:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:08:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:08:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_418ba9d9-1978-54c6-a2d3-b78329217655/418ba9d9-1978-54c6-a2d3-b78329217655_image_8.jpg HTTP/1.1" 201 0
2026-03-28 14:08:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FPK68NZT%252F698929284%252F600') HTTP/1.1" 204 0
2026-03-28 14:08:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PK68NZT/698929284/600 saved to cache
2026-03-28 14:08:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 418ba9d9-1978-54c6-a2d3-b78329217655
2026-03-28 14:08:02 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:08:02 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:08:02 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:08:02 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:08:02 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:08:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:08:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2deb2d90>
2026-03-28 14:08:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:08:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:08:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:08:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_eaf9d23b-faf9-5201-9f92-ea95460928e4/eaf9d23b-faf9-5201-9f92-ea95460928e4_image_9.jpg HTTP/1.1" 201 0
2026-03-28 14:08:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FVO67OHE%252F697995623%252F600') HTTP/1.1" 204 0
2026-03-28 14:08:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VO67OHE/697995623/600 saved to cache
2026-03-28 14:08:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item eaf9d23b-faf9-5201-9f92-ea95460928e4
2026-03-28 14:08:02 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/WP63USZ/42807824?sv=2020-08-04&st=2026-03-28T14%3A08%3A02Z&se=2026-03-28T14%3A33%3A02Z&sr=b&sp=r&sig=5J8P%2B%2BDbXuvBahjgaBANg4jjcUvdaSd%2B3YMnV6APqM0%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=WP63%20USZ-GB>
2026-03-28 14:08:02 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FV17TYW/698767959/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698767959>
2026-03-28 14:08:02 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FY66OTD/698150768/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698150768>
2026-03-28 14:08:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PK68NZT/698929184/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/PK68NZT/42809697?sv=2020-08-04&st=2026-03-28T14%3A07%3A49Z&se=2026-03-28T14%3A32%3A49Z&sr=b&sp=r&sig=MlSmp8QnvmrDDMWD0h20OzEr8AtAE1qX43dTRufEQSs%3D)
2026-03-28 14:08:02 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/WD19GOC/42806738?sv=2020-08-04&st=2026-03-28T14%3A08%3A02Z&se=2026-03-28T14%3A33%3A02Z&sr=b&sp=r&sig=T9osZMHtKGs6rKBj%2B14p7cPT3e2arLHsziTS%2BIeeX6Q%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=WD19%20GOC-GB>
2026-03-28 14:08:02 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/OY67JPV/698107909/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698107909>
2026-03-28 14:08:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PK68NZT/698929250/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/PK68NZT/42809697?sv=2020-08-04&st=2026-03-28T14%3A07%3A49Z&se=2026-03-28T14%3A32%3A49Z&sr=b&sp=r&sig=MlSmp8QnvmrDDMWD0h20OzEr8AtAE1qX43dTRufEQSs%3D)
2026-03-28 14:08:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VO67OHE/697995587/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/VO67OHE/42792220?sv=2020-08-04&st=2026-03-28T14%3A07%3A49Z&se=2026-03-28T14%3A32%3A49Z&sr=b&sp=r&sig=hi306iOBJ1MdtnUuCM2GqJ4jJbX%2Bc3I4fiy4m%2FWA7CY%3D)
2026-03-28 14:08:02 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:08:02 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:08:02 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:08:02 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:08:02 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:08:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:08:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c9997d0>
2026-03-28 14:08:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:08:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:08:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:08:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1c35ef13-b24b-57bb-8a15-809839352176/1c35ef13-b24b-57bb-8a15-809839352176_image_9.jpg HTTP/1.1" 201 0
2026-03-28 14:08:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FMV18VBD%252F698920430%252F600') HTTP/1.1" 204 0
2026-03-28 14:08:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MV18VBD/698920430/600 saved to cache
2026-03-28 14:08:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 1c35ef13-b24b-57bb-8a15-809839352176
2026-03-28 14:08:02 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 1c35ef13-b24b-57bb-8a15-809839352176, skipping ID generation
2026-03-28 14:08:02 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 1c35ef13-b24b-57bb-8a15-809839352176 sending to next pipeline
2026-03-28 14:08:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 1c35ef13-b24b-57bb-8a15-809839352176, identifier: MV18%20VBD
2026-03-28 14:08:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 1c35ef13-b24b-57bb-8a15-809839352176 with identifier: MV18%20VBD
2026-03-28 14:08:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 1c35ef13-b24b-57bb-8a15-809839352176 with identifier: MV18%20VBD
2026-03-28 14:08:03 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 1c35ef13-b24b-57bb-8a15-809839352176 with identifier: MV18%20VBD to the API
2026-03-28 14:08:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:08:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:08:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MV18VBD/698920430/600>
{'auction_title': '',
'c_o_2_emission_value': 109,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1c35ef13-b24b-57bb-8a15-809839352176/1c35ef13-b24b-57bb-8a15-809839352176_expert_report_file_787a84cd-cf29-4d27-9cbb-136b529f7f01.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=MV18%20VBD-GB',
'category': 'Car',
'color': 'grey',
'currency': 'GBP',
'doors_number': 4,
'engine': '2.1L',
'expiration_date': '2026-03-29T10:00:00Z',
'fuel_type': 'Diesel',
'id': '1c35ef13-b24b-57bb-8a15-809839352176',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'MV18 VBD',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=MV18%20VBD&vehicleType=*',
'listing': 'auction',
'location': 'Manchester',
'make': 'MERCEDES-BENZ',
'model': 'C220 D',
'odometer': 53330,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 11,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1c35ef13-b24b-57bb-8a15-809839352176/1c35ef13-b24b-57bb-8a15-809839352176_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 45192,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MV18VBD/698920371/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1c35ef13-b24b-57bb-8a15-809839352176/1c35ef13-b24b-57bb-8a15-809839352176_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 44360,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MV18VBD/698920384/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1c35ef13-b24b-57bb-8a15-809839352176/1c35ef13-b24b-57bb-8a15-809839352176_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 44773,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MV18VBD/698920391/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1c35ef13-b24b-57bb-8a15-809839352176/1c35ef13-b24b-57bb-8a15-809839352176_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 45596,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MV18VBD/698920396/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1c35ef13-b24b-57bb-8a15-809839352176/1c35ef13-b24b-57bb-8a15-809839352176_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 42930,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MV18VBD/698920400/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1c35ef13-b24b-57bb-8a15-809839352176/1c35ef13-b24b-57bb-8a15-809839352176_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 40976,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MV18VBD/698920404/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1c35ef13-b24b-57bb-8a15-809839352176/1c35ef13-b24b-57bb-8a15-809839352176_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 98959,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MV18VBD/698920410/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1c35ef13-b24b-57bb-8a15-809839352176/1c35ef13-b24b-57bb-8a15-809839352176_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 81900,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MV18VBD/698920415/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1c35ef13-b24b-57bb-8a15-809839352176/1c35ef13-b24b-57bb-8a15-809839352176_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 91099,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MV18VBD/698920423/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1c35ef13-b24b-57bb-8a15-809839352176/1c35ef13-b24b-57bb-8a15-809839352176_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 89532,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MV18VBD/698920430/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-01-01',
'seller_name': None,
'title': 'MERCEDES-BENZ C220 D 2.1 SPORT PREMIUM 9G Saloon',
'transmission': 'manual',
'trim': 'SPORT PREMIUM 9G',
'vin': 'WDD2050042R333611',
'year': 2018}
2026-03-28 14:08:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MV18%2520VBD%27 HTTP/1.1" 200 None
2026-03-28 14:08:03 [bca.uk] INFO: Saving data for MV18%20VBD: {'created_time': 1774706883.912065, 'last_price_update_time': 1774706883.91208, 'auction_closing_time': 1774778400.0}
2026-03-28 14:08:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='MV18%2520VBD') HTTP/1.1" 204 0
2026-03-28 14:08:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WV16UWB/698284411/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/WV16UWB/42797605?sv=2020-08-04&st=2026-03-28T14%3A03%3A48Z&se=2026-03-28T14%3A28%3A48Z&sr=b&sp=r&sig=tZmKWGpA7mZ9Rie4bcnpNzrMU30KCOw%2BfaCUNgMn820%3D)
2026-03-28 14:08:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/X11BBM/697603972/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/X11BBM/42809514?sv=2020-08-04&st=2026-03-28T14%3A03%3A48Z&se=2026-03-28T14%3A28%3A48Z&sr=b&sp=r&sig=iFv2U%2F%2BmiJcqZ%2BPwwi1Pjq9aw6DZNzQsG5k9GNFr4Nw%3D)
2026-03-28 14:08:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NL64KGO/698157107/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/NL64KGO/42810049?sv=2020-08-04&st=2026-03-28T14%3A03%3A48Z&se=2026-03-28T14%3A28%3A48Z&sr=b&sp=r&sig=GCr8gvM5cBzuZAr6Na7pdcamsQO4tFs2xqxAknQovkg%3D)
2026-03-28 14:08:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BV61MVO/698928503/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/BV61MVO/42809949?sv=2020-08-04&st=2026-03-28T14%3A03%3A49Z&se=2026-03-28T14%3A28%3A49Z&sr=b&sp=r&sig=PJNKzVVeJy1FKQt32eUXNOOsoTV6pqchYxeSDnPTh7w%3D)
2026-03-28 14:08:03 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LN68RBY/698920295/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698920295>
2026-03-28 14:08:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PK68NZT/698929143/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/PK68NZT/42809697?sv=2020-08-04&st=2026-03-28T14%3A07%3A49Z&se=2026-03-28T14%3A32%3A49Z&sr=b&sp=r&sig=MlSmp8QnvmrDDMWD0h20OzEr8AtAE1qX43dTRufEQSs%3D)
2026-03-28 14:08:03 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DA21SOU/697888020/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=697888020>
2026-03-28 14:08:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/OY67JPV/698107909/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/OY67JPV/42810048?sv=2020-08-04&st=2026-03-28T14%3A03%3A48Z&se=2026-03-28T14%3A28%3A48Z&sr=b&sp=r&sig=3IQnxpRCaMGCrWPQZylbi%2BiY%2FkfXKw1FEE36W3dpRwo%3D)
2026-03-28 14:08:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:08:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c6dd890>
2026-03-28 14:08:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:08:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:08:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:08:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_418ba9d9-1978-54c6-a2d3-b78329217655/418ba9d9-1978-54c6-a2d3-b78329217655_image_5.jpg HTTP/1.1" 201 0
2026-03-28 14:08:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FPK68NZT%252F698929184%252F600') HTTP/1.1" 204 0
2026-03-28 14:08:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PK68NZT/698929184/600 saved to cache
2026-03-28 14:08:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 418ba9d9-1978-54c6-a2d3-b78329217655
2026-03-28 14:08:03 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:08:03 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:08:03 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:08:03 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:08:03 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:08:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:08:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c76db10>
2026-03-28 14:08:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:08:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:08:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:08:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_418ba9d9-1978-54c6-a2d3-b78329217655/418ba9d9-1978-54c6-a2d3-b78329217655_image_7.jpg HTTP/1.1" 201 0
2026-03-28 14:08:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FPK68NZT%252F698929250%252F600') HTTP/1.1" 204 0
2026-03-28 14:08:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PK68NZT/698929250/600 saved to cache
2026-03-28 14:08:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 418ba9d9-1978-54c6-a2d3-b78329217655
2026-03-28 14:08:04 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:08:04 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:08:04 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:08:04 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:08:04 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:08:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:08:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2dbc1790>
2026-03-28 14:08:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:08:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:08:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:08:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_eaf9d23b-faf9-5201-9f92-ea95460928e4/eaf9d23b-faf9-5201-9f92-ea95460928e4_image_6.jpg HTTP/1.1" 201 0
2026-03-28 14:08:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FVO67OHE%252F697995587%252F600') HTTP/1.1" 204 0
2026-03-28 14:08:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VO67OHE/697995587/600 saved to cache
2026-03-28 14:08:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item eaf9d23b-faf9-5201-9f92-ea95460928e4
2026-03-28 14:08:04 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: eaf9d23b-faf9-5201-9f92-ea95460928e4, skipping ID generation
2026-03-28 14:08:04 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item eaf9d23b-faf9-5201-9f92-ea95460928e4 sending to next pipeline
2026-03-28 14:08:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: eaf9d23b-faf9-5201-9f92-ea95460928e4, identifier: VO67%20OHE
2026-03-28 14:08:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: eaf9d23b-faf9-5201-9f92-ea95460928e4 with identifier: VO67%20OHE
2026-03-28 14:08:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: eaf9d23b-faf9-5201-9f92-ea95460928e4 with identifier: VO67%20OHE
2026-03-28 14:08:04 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: eaf9d23b-faf9-5201-9f92-ea95460928e4 with identifier: VO67%20OHE to the API
2026-03-28 14:08:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:08:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:08:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VO67OHE/697995587/600>
{'auction_title': '',
'c_o_2_emission_value': 139,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_eaf9d23b-faf9-5201-9f92-ea95460928e4/eaf9d23b-faf9-5201-9f92-ea95460928e4_expert_report_file_31a3455e-5be8-47ae-95cc-5772bbfb62d7.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=VO67%20OHE-GB',
'category': 'Car',
'color': 'white',
'currency': 'GBP',
'doors_number': 5,
'engine': '2.0L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Diesel',
'id': 'eaf9d23b-faf9-5201-9f92-ea95460928e4',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'VO67 OHE',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=VO67%20OHE&vehicleType=*',
'listing': 'auction',
'location': 'Bridgwater',
'make': 'LAND ROVER',
'model': 'DISCOVERY SPORT',
'odometer': 65871,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 11,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_eaf9d23b-faf9-5201-9f92-ea95460928e4/eaf9d23b-faf9-5201-9f92-ea95460928e4_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 50417,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VO67OHE/697995552/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_eaf9d23b-faf9-5201-9f92-ea95460928e4/eaf9d23b-faf9-5201-9f92-ea95460928e4_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 50601,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VO67OHE/697995560/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_eaf9d23b-faf9-5201-9f92-ea95460928e4/eaf9d23b-faf9-5201-9f92-ea95460928e4_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 47178,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VO67OHE/697995563/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_eaf9d23b-faf9-5201-9f92-ea95460928e4/eaf9d23b-faf9-5201-9f92-ea95460928e4_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 46841,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VO67OHE/697995566/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_eaf9d23b-faf9-5201-9f92-ea95460928e4/eaf9d23b-faf9-5201-9f92-ea95460928e4_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 44241,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VO67OHE/697995574/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_eaf9d23b-faf9-5201-9f92-ea95460928e4/eaf9d23b-faf9-5201-9f92-ea95460928e4_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 43914,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VO67OHE/697995577/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_eaf9d23b-faf9-5201-9f92-ea95460928e4/eaf9d23b-faf9-5201-9f92-ea95460928e4_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 90080,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VO67OHE/697995587/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_eaf9d23b-faf9-5201-9f92-ea95460928e4/eaf9d23b-faf9-5201-9f92-ea95460928e4_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 71816,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VO67OHE/697995601/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_eaf9d23b-faf9-5201-9f92-ea95460928e4/eaf9d23b-faf9-5201-9f92-ea95460928e4_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 84484,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VO67OHE/697995612/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_eaf9d23b-faf9-5201-9f92-ea95460928e4/eaf9d23b-faf9-5201-9f92-ea95460928e4_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 67524,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VO67OHE/697995623/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-01-01',
'seller_name': None,
'title': 'LAND ROVER DISCOVERY SPORT 2.0 TD4 180 HSE BLACK StationWagon',
'transmission': 'automatic',
'trim': 'TD4 180 HSE BLACK',
'vin': 'SALCA2AN6JH726439',
'year': 2017}
2026-03-28 14:08:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27VO67%2520OHE%27 HTTP/1.1" 200 None
2026-03-28 14:08:04 [bca.uk] INFO: Saving data for VO67%20OHE: {'created_time': 1774706884.592234, 'last_price_update_time': 1774706884.592244, 'auction_closing_time': 1774864800.0}
2026-03-28 14:08:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='VO67%2520OHE') HTTP/1.1" 204 0
2026-03-28 14:08:04 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/X11BBM/697603970/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=697603970>
2026-03-28 14:08:04 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KU19CFH/697551238/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=697551238>
2026-03-28 14:08:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FV17TYW/698767959/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/FV17TYW/42807142?sv=2020-08-04&st=2026-03-28T14%3A03%3A46Z&se=2026-03-28T14%3A28%3A46Z&sr=b&sp=r&sig=3LbtNEGnFqYV4bS0F0%2BmsB%2FgfFSYLdditNDmvy7kudU%3D)
2026-03-28 14:08:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FY66OTD/698150768/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/FY66OTD/42794791?sv=2020-08-04&st=2026-03-28T14%3A03%3A46Z&se=2026-03-28T14%3A28%3A46Z&sr=b&sp=r&sig=nyWr7cManqycrjqVh9Sq0fegCWU0XCSire1eKcJWKLA%3D)
2026-03-28 14:08:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.bca.co.uk/api/search?q=&pageSize=100&page=20&sort=MostRecentlyAdded> (referer: https://www.bca.co.uk/search) ['zyte-api']
2026-03-28 14:08:04 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WV16UWB/698284408/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698284408>
2026-03-28 14:08:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:08:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c1872d0>
2026-03-28 14:08:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:08:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:08:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:08:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_214771ac-26f4-5760-a178-e14681ff06b8/214771ac-26f4-5760-a178-e14681ff06b8_image_2.jpg HTTP/1.1" 201 0
2026-03-28 14:08:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FWV16UWB%252F698284411%252F600') HTTP/1.1" 204 0
2026-03-28 14:08:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WV16UWB/698284411/600 saved to cache
2026-03-28 14:08:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 214771ac-26f4-5760-a178-e14681ff06b8
2026-03-28 14:08:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:08:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2deb3f90>
2026-03-28 14:08:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:08:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:08:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:08:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6f52ae88-a710-5999-b75b-294cfedaf6f8/6f52ae88-a710-5999-b75b-294cfedaf6f8_image_2.jpg HTTP/1.1" 201 0
2026-03-28 14:08:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FX11BBM%252F697603972%252F600') HTTP/1.1" 204 0
2026-03-28 14:08:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/X11BBM/697603972/600 saved to cache
2026-03-28 14:08:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 6f52ae88-a710-5999-b75b-294cfedaf6f8
2026-03-28 14:08:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:08:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c9b4950>
2026-03-28 14:08:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:08:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:08:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:08:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0c3c3ab5-91e6-5450-9be7-ee521ca8a766/0c3c3ab5-91e6-5450-9be7-ee521ca8a766_image_2.jpg HTTP/1.1" 201 0
2026-03-28 14:08:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FNL64KGO%252F698157107%252F600') HTTP/1.1" 204 0
2026-03-28 14:08:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NL64KGO/698157107/600 saved to cache
2026-03-28 14:08:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 0c3c3ab5-91e6-5450-9be7-ee521ca8a766
2026-03-28 14:08:04 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 0c3c3ab5-91e6-5450-9be7-ee521ca8a766, skipping ID generation
2026-03-28 14:08:04 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 0c3c3ab5-91e6-5450-9be7-ee521ca8a766 sending to next pipeline
2026-03-28 14:08:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 0c3c3ab5-91e6-5450-9be7-ee521ca8a766, identifier: NL64%20KGO
2026-03-28 14:08:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:08:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c99a690>
2026-03-28 14:08:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:08:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:08:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:08:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6665ad2b-5db8-5cb5-8575-3440dfdc3f0c/6665ad2b-5db8-5cb5-8575-3440dfdc3f0c_image_1.jpg HTTP/1.1" 201 0
2026-03-28 14:08:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FBV61MVO%252F698928503%252F600') HTTP/1.1" 204 0
2026-03-28 14:08:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BV61MVO/698928503/600 saved to cache
2026-03-28 14:08:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 6665ad2b-5db8-5cb5-8575-3440dfdc3f0c
2026-03-28 14:08:04 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 6665ad2b-5db8-5cb5-8575-3440dfdc3f0c, skipping ID generation
2026-03-28 14:08:04 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 6665ad2b-5db8-5cb5-8575-3440dfdc3f0c sending to next pipeline
2026-03-28 14:08:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 6665ad2b-5db8-5cb5-8575-3440dfdc3f0c, identifier: BV61%20MVO
2026-03-28 14:08:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:08:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2d99f810>
2026-03-28 14:08:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:08:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:08:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:08:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_418ba9d9-1978-54c6-a2d3-b78329217655/418ba9d9-1978-54c6-a2d3-b78329217655_image_3.jpg HTTP/1.1" 201 0
2026-03-28 14:08:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FPK68NZT%252F698929143%252F600') HTTP/1.1" 204 0
2026-03-28 14:08:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PK68NZT/698929143/600 saved to cache
2026-03-28 14:08:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 418ba9d9-1978-54c6-a2d3-b78329217655
2026-03-28 14:08:05 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 418ba9d9-1978-54c6-a2d3-b78329217655, skipping ID generation
2026-03-28 14:08:05 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 418ba9d9-1978-54c6-a2d3-b78329217655 sending to next pipeline
2026-03-28 14:08:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 418ba9d9-1978-54c6-a2d3-b78329217655, identifier: PK68%20NZT
2026-03-28 14:08:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:08:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c3fd390>
2026-03-28 14:08:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:08:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:08:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:08:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7708aee7-65e8-597e-aa3d-426819c9c319/7708aee7-65e8-597e-aa3d-426819c9c319_image_3.jpg HTTP/1.1" 201 0
2026-03-28 14:08:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FOY67JPV%252F698107909%252F600') HTTP/1.1" 204 0
2026-03-28 14:08:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/OY67JPV/698107909/600 saved to cache
2026-03-28 14:08:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 7708aee7-65e8-597e-aa3d-426819c9c319
2026-03-28 14:08:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/WD19GOC/42806738?sv=2020-08-04&st=2026-03-28T14%3A08%3A02Z&se=2026-03-28T14%3A33%3A02Z&sr=b&sp=r&sig=T9osZMHtKGs6rKBj%2B14p7cPT3e2arLHsziTS%2BIeeX6Q%3D> (referer: https://www.bca.co.uk/)
2026-03-28 14:08:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LN68RBY/698920295/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LN68RBY/42809684?sv=2020-08-04&st=2026-03-28T14%3A03%3A42Z&se=2026-03-28T14%3A28%3A42Z&sr=b&sp=r&sig=aIYqAxiZsHZDOcTozI0zzgpiaCRiEseqbYSKBZyhWQ4%3D)
2026-03-28 14:08:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 0c3c3ab5-91e6-5450-9be7-ee521ca8a766 with identifier: NL64%20KGO
2026-03-28 14:08:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 0c3c3ab5-91e6-5450-9be7-ee521ca8a766 with identifier: NL64%20KGO
2026-03-28 14:08:05 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 0c3c3ab5-91e6-5450-9be7-ee521ca8a766 with identifier: NL64%20KGO to the API
2026-03-28 14:08:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:08:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:08:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NL64KGO/698157107/600>
{'auction_title': '',
'c_o_2_emission_value': 120,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0c3c3ab5-91e6-5450-9be7-ee521ca8a766/0c3c3ab5-91e6-5450-9be7-ee521ca8a766_expert_report_file_586396e7-a461-450b-a201-0611bd7a5cc5.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=NL64%20KGO-GB',
'category': 'Car',
'color': 'blue',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.2L',
'expiration_date': '2026-03-29T10:00:00Z',
'fuel_type': 'Petrol',
'id': '0c3c3ab5-91e6-5450-9be7-ee521ca8a766',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'NL64 KGO',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=NL64%20KGO&vehicleType=*',
'listing': 'auction',
'location': 'Bristol',
'make': 'FORD',
'model': 'FIESTA',
'odometer': 55096,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 11,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0c3c3ab5-91e6-5450-9be7-ee521ca8a766/0c3c3ab5-91e6-5450-9be7-ee521ca8a766_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 48051,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NL64KGO/698157087/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0c3c3ab5-91e6-5450-9be7-ee521ca8a766/0c3c3ab5-91e6-5450-9be7-ee521ca8a766_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 48680,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NL64KGO/698157097/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0c3c3ab5-91e6-5450-9be7-ee521ca8a766/0c3c3ab5-91e6-5450-9be7-ee521ca8a766_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 44387,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NL64KGO/698157107/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0c3c3ab5-91e6-5450-9be7-ee521ca8a766/0c3c3ab5-91e6-5450-9be7-ee521ca8a766_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 45385,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NL64KGO/698157119/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0c3c3ab5-91e6-5450-9be7-ee521ca8a766/0c3c3ab5-91e6-5450-9be7-ee521ca8a766_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 45419,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NL64KGO/698157130/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0c3c3ab5-91e6-5450-9be7-ee521ca8a766/0c3c3ab5-91e6-5450-9be7-ee521ca8a766_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 44943,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NL64KGO/698157139/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0c3c3ab5-91e6-5450-9be7-ee521ca8a766/0c3c3ab5-91e6-5450-9be7-ee521ca8a766_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 97572,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NL64KGO/698157151/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0c3c3ab5-91e6-5450-9be7-ee521ca8a766/0c3c3ab5-91e6-5450-9be7-ee521ca8a766_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 90066,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NL64KGO/698157165/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0c3c3ab5-91e6-5450-9be7-ee521ca8a766/0c3c3ab5-91e6-5450-9be7-ee521ca8a766_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 102088,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NL64KGO/698157181/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0c3c3ab5-91e6-5450-9be7-ee521ca8a766/0c3c3ab5-91e6-5450-9be7-ee521ca8a766_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 96282,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NL64KGO/698157200/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2014-01-01',
'seller_name': None,
'title': 'FORD FIESTA 1.2 82 ZETEC Hatchback',
'transmission': 'manual',
'trim': '82 ZETEC',
'vin': 'WF0DXXGAKDEB64420',
'year': 2014}
2026-03-28 14:08:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27NL64%2520KGO%27 HTTP/1.1" 200 None
2026-03-28 14:08:05 [bca.uk] INFO: Saving data for NL64%20KGO: {'created_time': 1774706885.575253, 'last_price_update_time': 1774706885.575266, 'auction_closing_time': 1774778400.0}
2026-03-28 14:08:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='NL64%2520KGO') HTTP/1.1" 204 0
2026-03-28 14:08:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 6665ad2b-5db8-5cb5-8575-3440dfdc3f0c with identifier: BV61%20MVO
2026-03-28 14:08:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 6665ad2b-5db8-5cb5-8575-3440dfdc3f0c with identifier: BV61%20MVO
2026-03-28 14:08:05 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 6665ad2b-5db8-5cb5-8575-3440dfdc3f0c with identifier: BV61%20MVO to the API
2026-03-28 14:08:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:08:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:08:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BV61MVO/698928503/600>
{'auction_title': '',
'c_o_2_emission_value': 184,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6665ad2b-5db8-5cb5-8575-3440dfdc3f0c/6665ad2b-5db8-5cb5-8575-3440dfdc3f0c_expert_report_file_83f500f5-a9b6-4942-a35a-b2dcb55f4940.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=BV61%20MVO-GB',
'category': 'Car',
'color': 'silver',
'currency': 'GBP',
'doors_number': 2,
'engine': '2.0L',
'expiration_date': '2026-03-31T10:00:00Z',
'fuel_type': 'Petrol',
'id': '6665ad2b-5db8-5cb5-8575-3440dfdc3f0c',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'BV61 MVO',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=BV61%20MVO&vehicleType=*',
'listing': 'auction',
'location': 'Blackbushe',
'make': 'AUDI',
'model': 'TTS',
'odometer': 76577,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 11,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6665ad2b-5db8-5cb5-8575-3440dfdc3f0c/6665ad2b-5db8-5cb5-8575-3440dfdc3f0c_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 52840,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BV61MVO/698928485/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6665ad2b-5db8-5cb5-8575-3440dfdc3f0c/6665ad2b-5db8-5cb5-8575-3440dfdc3f0c_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 50372,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BV61MVO/698928503/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6665ad2b-5db8-5cb5-8575-3440dfdc3f0c/6665ad2b-5db8-5cb5-8575-3440dfdc3f0c_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 49272,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BV61MVO/698928533/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6665ad2b-5db8-5cb5-8575-3440dfdc3f0c/6665ad2b-5db8-5cb5-8575-3440dfdc3f0c_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 51620,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BV61MVO/698928556/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6665ad2b-5db8-5cb5-8575-3440dfdc3f0c/6665ad2b-5db8-5cb5-8575-3440dfdc3f0c_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 53639,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BV61MVO/698928578/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6665ad2b-5db8-5cb5-8575-3440dfdc3f0c/6665ad2b-5db8-5cb5-8575-3440dfdc3f0c_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 50522,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BV61MVO/698928598/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6665ad2b-5db8-5cb5-8575-3440dfdc3f0c/6665ad2b-5db8-5cb5-8575-3440dfdc3f0c_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 97601,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BV61MVO/698928622/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6665ad2b-5db8-5cb5-8575-3440dfdc3f0c/6665ad2b-5db8-5cb5-8575-3440dfdc3f0c_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 55751,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BV61MVO/698928652/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6665ad2b-5db8-5cb5-8575-3440dfdc3f0c/6665ad2b-5db8-5cb5-8575-3440dfdc3f0c_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 90931,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BV61MVO/698928679/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6665ad2b-5db8-5cb5-8575-3440dfdc3f0c/6665ad2b-5db8-5cb5-8575-3440dfdc3f0c_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 86674,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BV61MVO/698928702/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2011-01-01',
'seller_name': None,
'title': 'AUDI TTS 2.0 TFSI QUATTRO BLACK ED. Coupe',
'transmission': 'manual',
'trim': 'TFSI QUATTRO BLACK ED.',
'vin': 'TRUZZZ8J8B1024466',
'year': 2011}
2026-03-28 14:08:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BV61%2520MVO%27 HTTP/1.1" 200 None
2026-03-28 14:08:05 [bca.uk] INFO: Saving data for BV61%20MVO: {'created_time': 1774706885.959188, 'last_price_update_time': 1774706885.959203, 'auction_closing_time': 1774951200.0}
2026-03-28 14:08:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='BV61%2520MVO') HTTP/1.1" 204 0
2026-03-28 14:08:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 418ba9d9-1978-54c6-a2d3-b78329217655 with identifier: PK68%20NZT
2026-03-28 14:08:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 418ba9d9-1978-54c6-a2d3-b78329217655 with identifier: PK68%20NZT
2026-03-28 14:08:06 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 418ba9d9-1978-54c6-a2d3-b78329217655 with identifier: PK68%20NZT to the API
2026-03-28 14:08:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:08:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:08:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PK68NZT/698929143/600>
{'auction_title': '',
'c_o_2_emission_value': 108,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_418ba9d9-1978-54c6-a2d3-b78329217655/418ba9d9-1978-54c6-a2d3-b78329217655_expert_report_file_79379637-9cf3-4075-bead-b590f70c10a8.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=PK68%20NZT-GB',
'category': 'Car',
'color': 'blue',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.5L',
'expiration_date': '2026-03-29T10:00:00Z',
'fuel_type': 'Diesel',
'id': '418ba9d9-1978-54c6-a2d3-b78329217655',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'PK68 NZT',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=PK68%20NZT&vehicleType=*',
'listing': 'auction',
'location': 'Manchester',
'make': 'PEUGEOT',
'model': '3008',
'odometer': 56326,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 11,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_418ba9d9-1978-54c6-a2d3-b78329217655/418ba9d9-1978-54c6-a2d3-b78329217655_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 47689,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PK68NZT/698929090/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_418ba9d9-1978-54c6-a2d3-b78329217655/418ba9d9-1978-54c6-a2d3-b78329217655_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 47815,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PK68NZT/698929119/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_418ba9d9-1978-54c6-a2d3-b78329217655/418ba9d9-1978-54c6-a2d3-b78329217655_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 45426,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PK68NZT/698929134/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_418ba9d9-1978-54c6-a2d3-b78329217655/418ba9d9-1978-54c6-a2d3-b78329217655_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 45785,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PK68NZT/698929143/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_418ba9d9-1978-54c6-a2d3-b78329217655/418ba9d9-1978-54c6-a2d3-b78329217655_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 44794,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PK68NZT/698929168/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_418ba9d9-1978-54c6-a2d3-b78329217655/418ba9d9-1978-54c6-a2d3-b78329217655_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 42423,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PK68NZT/698929184/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_418ba9d9-1978-54c6-a2d3-b78329217655/418ba9d9-1978-54c6-a2d3-b78329217655_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 93618,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PK68NZT/698929219/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_418ba9d9-1978-54c6-a2d3-b78329217655/418ba9d9-1978-54c6-a2d3-b78329217655_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 89029,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PK68NZT/698929250/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_418ba9d9-1978-54c6-a2d3-b78329217655/418ba9d9-1978-54c6-a2d3-b78329217655_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 102128,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PK68NZT/698929284/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_418ba9d9-1978-54c6-a2d3-b78329217655/418ba9d9-1978-54c6-a2d3-b78329217655_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 72530,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PK68NZT/698929306/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-01-01',
'seller_name': None,
'title': 'PEUGEOT 3008 1.5 BLUEHDI 130 ALLURE EAT8 Hatchback',
'transmission': 'automatic',
'trim': 'BLUEHDI 130 ALLURE EAT8',
'vin': 'VF3MCYHZRJS389711',
'year': 2018}
2026-03-28 14:08:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27PK68%2520NZT%27 HTTP/1.1" 200 None
2026-03-28 14:08:06 [bca.uk] INFO: Saving data for PK68%20NZT: {'created_time': 1774706886.355664, 'last_price_update_time': 1774706886.355677, 'auction_closing_time': 1774778400.0}
2026-03-28 14:08:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='PK68%2520NZT') HTTP/1.1" 204 0
2026-03-28 14:08:06 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/OY67JPV/698107893/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698107893>
2026-03-28 14:08:06 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FY66OTD/698150760/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698150760>
2026-03-28 14:08:06 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/TFZ8294/42809548?sv=2020-08-04&st=2026-03-28T14%3A08%3A05Z&se=2026-03-28T14%3A33%3A05Z&sr=b&sp=r&sig=ErLZlBqdyCWgCZpWR0ce5C0%2FBbCxi3QUVQkCi%2FMXrM0%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=TFZ%208294-GB>
2026-03-28 14:08:06 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/WB19OHW/42808333?sv=2020-08-04&st=2026-03-28T14%3A08%3A05Z&se=2026-03-28T14%3A33%3A05Z&sr=b&sp=r&sig=1tPrGuzNeNTywf9es7t2uJatudSyGSBqwxwUQUNO5j8%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=WB19%20OHW-GB>
2026-03-28 14:08:06 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FV17TYW/698767940/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698767940>
2026-03-28 14:08:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/WP63USZ/42807824?sv=2020-08-04&st=2026-03-28T14%3A08%3A02Z&se=2026-03-28T14%3A33%3A02Z&sr=b&sp=r&sig=5J8P%2B%2BDbXuvBahjgaBANg4jjcUvdaSd%2B3YMnV6APqM0%3D> (referer: https://www.bca.co.uk/)
2026-03-28 14:08:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:08:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c769810>
2026-03-28 14:08:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:08:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:08:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:08:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d7b30cd7-3fb2-520c-9629-4539584c6e2c/d7b30cd7-3fb2-520c-9629-4539584c6e2c_image_3.jpg HTTP/1.1" 201 0
2026-03-28 14:08:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FFV17TYW%252F698767959%252F600') HTTP/1.1" 204 0
2026-03-28 14:08:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FV17TYW/698767959/600 saved to cache
2026-03-28 14:08:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item d7b30cd7-3fb2-520c-9629-4539584c6e2c
2026-03-28 14:08:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:08:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c8da110>
2026-03-28 14:08:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:08:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:08:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:08:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_40999011-32af-5ad3-a840-4cb8242ff02a/40999011-32af-5ad3-a840-4cb8242ff02a_image_3.jpg HTTP/1.1" 201 0
2026-03-28 14:08:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FFY66OTD%252F698150768%252F600') HTTP/1.1" 204 0
2026-03-28 14:08:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FY66OTD/698150768/600 saved to cache
2026-03-28 14:08:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 40999011-32af-5ad3-a840-4cb8242ff02a
2026-03-28 14:08:06 [bca.uk] INFO: Total items found: 100
2026-03-28 14:08:06 [bca.uk] INFO: Requesting URL: https://www.bca.co.uk/api/search?q=&pageSize=100&page=21&sort=MostRecentlyAdded
2026-03-28 14:08:06 [bca.uk] INFO: Sending search API request with Bearer token (length=1492)
2026-03-28 14:08:06 [scrapy_zyte_api._params] WARNING: Request <GET https://www.bca.co.uk/api/search?q=&pageSize=100&page=21&sort=MostRecentlyAdded> defines the Zyte API customHttpRequestHeaders parameter, overriding Request.headers. Use Request.headers instead.
2026-03-28 14:08:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:08:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2ca2d710>
2026-03-28 14:08:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:08:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:08:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:08:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a1043301-1d6c-5ef5-8043-fba38100bdea/a1043301-1d6c-5ef5-8043-fba38100bdea_expert_report_file_59be0a70-e0be-4a0d-8fc7-3cb8d4de4c98.pdf HTTP/1.1" 201 0
2026-03-28 14:08:06 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item a1043301-1d6c-5ef5-8043-fba38100bdea
2026-03-28 14:08:06 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: a1043301-1d6c-5ef5-8043-fba38100bdea, skipping ID generation
2026-03-28 14:08:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item a1043301-1d6c-5ef5-8043-fba38100bdea
2026-03-28 14:08:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DWD19GOC-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-28 14:08:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=WD19GOC-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-28 14:08:06 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:08:06 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:08:06 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:08:06 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:08:06 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:08:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:08:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2d9859d0>
2026-03-28 14:08:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:08:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:08:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:08:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_04fa14f2-714c-5033-a1fe-bd0c784e7d7e/04fa14f2-714c-5033-a1fe-bd0c784e7d7e_image_7.jpg HTTP/1.1" 201 0
2026-03-28 14:08:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLN68RBY%252F698920295%252F600') HTTP/1.1" 204 0
2026-03-28 14:08:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LN68RBY/698920295/600 saved to cache
2026-03-28 14:08:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 04fa14f2-714c-5033-a1fe-bd0c784e7d7e
2026-03-28 14:08:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WV16UWB/698284408/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/WV16UWB/42797605?sv=2020-08-04&st=2026-03-28T14%3A03%3A48Z&se=2026-03-28T14%3A28%3A48Z&sr=b&sp=r&sig=tZmKWGpA7mZ9Rie4bcnpNzrMU30KCOw%2BfaCUNgMn820%3D)
2026-03-28 14:08:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/X11BBM/697603970/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/X11BBM/42809514?sv=2020-08-04&st=2026-03-28T14%3A03%3A48Z&se=2026-03-28T14%3A28%3A48Z&sr=b&sp=r&sig=iFv2U%2F%2BmiJcqZ%2BPwwi1Pjq9aw6DZNzQsG5k9GNFr4Nw%3D)
2026-03-28 14:08:06 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LN68RBY/698920267/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698920267>
2026-03-28 14:08:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KU19CFH/697551238/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/KU19CFH/42809756?sv=2020-08-04&st=2026-03-28T14%3A03%3A45Z&se=2026-03-28T14%3A28%3A45Z&sr=b&sp=r&sig=1G7eR4FaPr%2BtRdJKW3arikyQmOCuk26xvavIORXr6y8%3D)
2026-03-28 14:08:06 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KU19CFH/697551217/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=697551217>
2026-03-28 14:08:06 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DA21SOU/697888006/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=697888006>
2026-03-28 14:08:06 [scrapy_zyte_api._params] WARNING: Request <GET https://www.bca.co.uk/api/search?q=&pageSize=100&page=21&sort=MostRecentlyAdded> defines the Zyte API customHttpRequestHeaders parameter, overriding Request.headers. Use Request.headers instead.
2026-03-28 14:08:06 [scrapy_zyte_api._params] WARNING: Request <GET https://www.bca.co.uk/api/search?q=&pageSize=100&page=21&sort=MostRecentlyAdded> defines the Zyte API customHttpRequestHeaders parameter, overriding Request.headers. Use Request.headers instead.
2026-03-28 14:08:06 [bca.uk] INFO: Found listing with ID: HF66%20XPD
2026-03-28 14:08:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27HF66%2520XPD%27 HTTP/1.1" 200 None
2026-03-28 14:08:06 [bca.uk] INFO: Scrape type for HF66%20XPD: 0
2026-03-28 14:08:06 [bca.uk] INFO: Found listing with ID: NA68%20PNX
2026-03-28 14:08:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27NA68%2520PNX%27 HTTP/1.1" 200 None
2026-03-28 14:08:06 [bca.uk] INFO: Scrape type for NA68%20PNX: 0
2026-03-28 14:08:06 [bca.uk] INFO: Found listing with ID: SH66%20VEY
2026-03-28 14:08:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SH66%2520VEY%27 HTTP/1.1" 200 None
2026-03-28 14:08:06 [bca.uk] INFO: Scrape type for SH66%20VEY: 0
2026-03-28 14:08:06 [bca.uk] INFO: Found listing with ID: SA67%20LLK
2026-03-28 14:08:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SA67%2520LLK%27 HTTP/1.1" 200 None
2026-03-28 14:08:06 [bca.uk] INFO: Scrape type for SA67%20LLK: 0
2026-03-28 14:08:06 [bca.uk] INFO: Found listing with ID: OE62%20XHT
2026-03-28 14:08:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27OE62%2520XHT%27 HTTP/1.1" 200 None
2026-03-28 14:08:06 [bca.uk] INFO: Scrape type for OE62%20XHT: 0
2026-03-28 14:08:06 [bca.uk] INFO: Found listing with ID: BP74%20GVC
2026-03-28 14:08:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BP74%2520GVC%27 HTTP/1.1" 200 None
2026-03-28 14:08:06 [bca.uk] INFO: Scrape type for BP74%20GVC: 0
2026-03-28 14:08:06 [bca.uk] INFO: Found listing with ID: M5%20OPK
2026-03-28 14:08:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27M5%2520OPK%27 HTTP/1.1" 200 None
2026-03-28 14:08:06 [bca.uk] INFO: Scrape type for M5%20OPK: 0
2026-03-28 14:08:06 [bca.uk] INFO: Found listing with ID: YB14%20PZY
2026-03-28 14:08:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YB14%2520PZY%27 HTTP/1.1" 200 None
2026-03-28 14:08:06 [bca.uk] INFO: Scrape type for YB14%20PZY: 0
2026-03-28 14:08:06 [bca.uk] INFO: Found listing with ID: YT15%20HZM
2026-03-28 14:08:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YT15%2520HZM%27 HTTP/1.1" 200 None
2026-03-28 14:08:06 [bca.uk] INFO: Scrape type for YT15%20HZM: 0
2026-03-28 14:08:06 [bca.uk] INFO: Found listing with ID: SB17%20NPK
2026-03-28 14:08:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SB17%2520NPK%27 HTTP/1.1" 200 None
2026-03-28 14:08:06 [bca.uk] INFO: Scrape type for SB17%20NPK: 0
2026-03-28 14:08:06 [bca.uk] INFO: Found listing with ID: OX73%20BFE
2026-03-28 14:08:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27OX73%2520BFE%27 HTTP/1.1" 200 None
2026-03-28 14:08:06 [bca.uk] INFO: Scrape type for OX73%20BFE: 0
2026-03-28 14:08:06 [bca.uk] INFO: Found listing with ID: EY13%20FZE
2026-03-28 14:08:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27EY13%2520FZE%27 HTTP/1.1" 200 None
2026-03-28 14:08:06 [bca.uk] INFO: Scrape type for EY13%20FZE: 0
2026-03-28 14:08:06 [bca.uk] INFO: Found listing with ID: BC73%20NTT
2026-03-28 14:08:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BC73%2520NTT%27 HTTP/1.1" 200 None
2026-03-28 14:08:06 [bca.uk] INFO: Scrape type for BC73%20NTT: 0
2026-03-28 14:08:06 [bca.uk] INFO: Found listing with ID: VK21%20GPO
2026-03-28 14:08:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27VK21%2520GPO%27 HTTP/1.1" 200 None
2026-03-28 14:08:06 [bca.uk] INFO: Scrape type for VK21%20GPO: 0
2026-03-28 14:08:06 [bca.uk] INFO: Found listing with ID: PK65%20OBP
2026-03-28 14:08:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27PK65%2520OBP%27 HTTP/1.1" 200 None
2026-03-28 14:08:07 [bca.uk] INFO: Scrape type for PK65%20OBP: 0
2026-03-28 14:08:07 [bca.uk] INFO: Found listing with ID: AY66%20ZNA
2026-03-28 14:08:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27AY66%2520ZNA%27 HTTP/1.1" 200 None
2026-03-28 14:08:07 [bca.uk] INFO: Scrape type for AY66%20ZNA: 0
2026-03-28 14:08:07 [bca.uk] INFO: Found listing with ID: NA07%20HJZ
2026-03-28 14:08:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27NA07%2520HJZ%27 HTTP/1.1" 200 None
2026-03-28 14:08:07 [bca.uk] INFO: Scrape type for NA07%20HJZ: 0
2026-03-28 14:08:07 [bca.uk] INFO: Found listing with ID: RV18%20HSL
2026-03-28 14:08:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27RV18%2520HSL%27 HTTP/1.1" 200 None
2026-03-28 14:08:07 [bca.uk] INFO: Scrape type for RV18%20HSL: 0
2026-03-28 14:08:07 [bca.uk] INFO: Found listing with ID: YR70%20UMF
2026-03-28 14:08:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YR70%2520UMF%27 HTTP/1.1" 200 None
2026-03-28 14:08:07 [bca.uk] INFO: Scrape type for YR70%20UMF: 0
2026-03-28 14:08:07 [bca.uk] INFO: Found listing with ID: FJ18%20XJY
2026-03-28 14:08:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FJ18%2520XJY%27 HTTP/1.1" 200 None
2026-03-28 14:08:07 [bca.uk] INFO: Scrape type for FJ18%20XJY: 0
2026-03-28 14:08:07 [bca.uk] INFO: Found listing with ID: RA15%20GLF
2026-03-28 14:08:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27RA15%2520GLF%27 HTTP/1.1" 200 None
2026-03-28 14:08:07 [bca.uk] INFO: Scrape type for RA15%20GLF: 0
2026-03-28 14:08:07 [bca.uk] INFO: Found listing with ID: VN62%20UNY
2026-03-28 14:08:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27VN62%2520UNY%27 HTTP/1.1" 200 None
2026-03-28 14:08:07 [bca.uk] INFO: Scrape type for VN62%20UNY: 0
2026-03-28 14:08:07 [bca.uk] INFO: Found listing with ID: FSZ%204071
2026-03-28 14:08:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FSZ%25204071%27 HTTP/1.1" 200 None
2026-03-28 14:08:07 [bca.uk] INFO: Scrape type for FSZ%204071: 0
2026-03-28 14:08:07 [bca.uk] INFO: Found listing with ID: DP24%20AKN
2026-03-28 14:08:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DP24%2520AKN%27 HTTP/1.1" 200 None
2026-03-28 14:08:07 [bca.uk] INFO: Scrape type for DP24%20AKN: 0
2026-03-28 14:08:07 [bca.uk] INFO: Found listing with ID: MM22%20HGF
2026-03-28 14:08:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MM22%2520HGF%27 HTTP/1.1" 200 None
2026-03-28 14:08:07 [bca.uk] INFO: Scrape type for MM22%20HGF: 0
2026-03-28 14:08:07 [bca.uk] INFO: Found listing with ID: OY67%20EZZ
2026-03-28 14:08:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27OY67%2520EZZ%27 HTTP/1.1" 200 None
2026-03-28 14:08:07 [bca.uk] INFO: Scrape type for OY67%20EZZ: 0
2026-03-28 14:08:07 [bca.uk] INFO: Found listing with ID: AO63%20VPL
2026-03-28 14:08:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27AO63%2520VPL%27 HTTP/1.1" 200 None
2026-03-28 14:08:07 [bca.uk] INFO: Scrape type for AO63%20VPL: 0
2026-03-28 14:08:07 [bca.uk] INFO: Found listing with ID: SJ19%20FLS
2026-03-28 14:08:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SJ19%2520FLS%27 HTTP/1.1" 200 None
2026-03-28 14:08:07 [bca.uk] INFO: Scrape type for SJ19%20FLS: 0
2026-03-28 14:08:07 [bca.uk] INFO: Found listing with ID: SM73%20DNX
2026-03-28 14:08:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SM73%2520DNX%27 HTTP/1.1" 200 None
2026-03-28 14:08:07 [bca.uk] INFO: Scrape type for SM73%20DNX: 0
2026-03-28 14:08:07 [bca.uk] INFO: Found listing with ID: EA23%20YLO
2026-03-28 14:08:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27EA23%2520YLO%27 HTTP/1.1" 200 None
2026-03-28 14:08:07 [bca.uk] INFO: Scrape type for EA23%20YLO: 0
2026-03-28 14:08:07 [bca.uk] INFO: Found listing with ID: KU63%20WEA
2026-03-28 14:08:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KU63%2520WEA%27 HTTP/1.1" 200 None
2026-03-28 14:08:07 [bca.uk] INFO: Scrape type for KU63%20WEA: 0
2026-03-28 14:08:07 [bca.uk] INFO: Found listing with ID: WP69%20UHB
2026-03-28 14:08:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WP69%2520UHB%27 HTTP/1.1" 200 None
2026-03-28 14:08:07 [bca.uk] INFO: Scrape type for WP69%20UHB: 0
2026-03-28 14:08:07 [bca.uk] INFO: Found listing with ID: YS69%20ZKF
2026-03-28 14:08:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YS69%2520ZKF%27 HTTP/1.1" 200 None
2026-03-28 14:08:07 [bca.uk] INFO: Scrape type for YS69%20ZKF: 0
2026-03-28 14:08:07 [bca.uk] INFO: Found listing with ID: YM71%20FSP
2026-03-28 14:08:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YM71%2520FSP%27 HTTP/1.1" 200 None
2026-03-28 14:08:07 [bca.uk] INFO: Scrape type for YM71%20FSP: 0
2026-03-28 14:08:07 [bca.uk] INFO: Found listing with ID: YS16%20DMO
2026-03-28 14:08:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YS16%2520DMO%27 HTTP/1.1" 200 None
2026-03-28 14:08:07 [bca.uk] INFO: Scrape type for YS16%20DMO: 0
2026-03-28 14:08:07 [bca.uk] INFO: Found listing with ID: DN13%20XYJ
2026-03-28 14:08:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DN13%2520XYJ%27 HTTP/1.1" 200 None
2026-03-28 14:08:07 [bca.uk] INFO: Scrape type for DN13%20XYJ: 0
2026-03-28 14:08:07 [bca.uk] INFO: Found listing with ID: GK24%20HMF
2026-03-28 14:08:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GK24%2520HMF%27 HTTP/1.1" 200 None
2026-03-28 14:08:07 [bca.uk] INFO: Scrape type for GK24%20HMF: 0
2026-03-28 14:08:07 [bca.uk] INFO: Found listing with ID: WN22%20TKD
2026-03-28 14:08:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WN22%2520TKD%27 HTTP/1.1" 200 None
2026-03-28 14:08:07 [bca.uk] INFO: Scrape type for WN22%20TKD: 0
2026-03-28 14:08:07 [bca.uk] INFO: Found listing with ID: LO23%20GPU
2026-03-28 14:08:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LO23%2520GPU%27 HTTP/1.1" 200 None
2026-03-28 14:08:07 [bca.uk] INFO: Scrape type for LO23%20GPU: 0
2026-03-28 14:08:07 [bca.uk] INFO: Found listing with ID: YP68%20XHL
2026-03-28 14:08:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YP68%2520XHL%27 HTTP/1.1" 200 None
2026-03-28 14:08:07 [bca.uk] INFO: Scrape type for YP68%20XHL: 0
2026-03-28 14:08:07 [bca.uk] INFO: Found listing with ID: YA23%20TZR
2026-03-28 14:08:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YA23%2520TZR%27 HTTP/1.1" 200 None
2026-03-28 14:08:07 [bca.uk] INFO: Scrape type for YA23%20TZR: 0
2026-03-28 14:08:07 [bca.uk] INFO: Found listing with ID: VN18%20WGJ
2026-03-28 14:08:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27VN18%2520WGJ%27 HTTP/1.1" 200 None
2026-03-28 14:08:07 [bca.uk] INFO: Scrape type for VN18%20WGJ: 2
2026-03-28 14:08:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d4cb05e3-81bc-5617-a6a2-b4b161b65bc1 with identifier: VN18%20WGJ
2026-03-28 14:08:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d4cb05e3-81bc-5617-a6a2-b4b161b65bc1 with scrape type 2
2026-03-28 14:08:07 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d4cb05e3-81bc-5617-a6a2-b4b161b65bc1 with scrape type 2
2026-03-28 14:08:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: d4cb05e3-81bc-5617-a6a2-b4b161b65bc1, identifier: VN18%20WGJ
2026-03-28 14:08:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698733420%27 HTTP/1.1" 200 None
2026-03-28 14:08:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698733420 not downloaded yet
2026-03-28 14:08:07 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 14:08:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DA21SOU/697888020/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/DA21SOU/42810340?sv=2020-08-04&st=2026-03-28T14%3A03%3A42Z&se=2026-03-28T14%3A28%3A42Z&sr=b&sp=r&sig=6%2F4a%2BWc9n6QD4YiOi5mt3dZkPnMZj%2Bfh7208k4Rd3hI%3D)
2026-03-28 14:08:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: d4cb05e3-81bc-5617-a6a2-b4b161b65bc1 with identifier: VN18%20WGJ
2026-03-28 14:08:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: d4cb05e3-81bc-5617-a6a2-b4b161b65bc1 with identifier: VN18%20WGJ
2026-03-28 14:08:07 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: d4cb05e3-81bc-5617-a6a2-b4b161b65bc1 with identifier: VN18%20WGJ to the API
2026-03-28 14:08:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:08:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:08:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=20&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 101,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=VN18%20WGJ-GB',
'category': 'Car',
'color': 'red',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.0L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol',
'id': 'd4cb05e3-81bc-5617-a6a2-b4b161b65bc1',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'VN18 WGJ',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=VN18%20WGJ&vehicleType=*',
'listing': 'auction',
'location': 'Birmingham - Perry Barr',
'make': 'SKODA',
'model': 'FABIA',
'odometer': 51740,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-01-01',
'seller_name': None,
'title': 'SKODA FABIA 1.0 TSI 95 COLOUR EDITION Hatchback',
'transmission': 'manual',
'trim': 'TSI 95 COLOUR EDITION',
'vin': 'TMBFP6NJ5JZ180194',
'year': 2018}
2026-03-28 14:08:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27VN18%2520WGJ%27 HTTP/1.1" 200 None
2026-03-28 14:08:07 [bca.uk] INFO: Saving data for VN18%20WGJ: {'auction_closing_time': 1774864800.0, 'created_time': 1774436638.298307, 'last_price_update_time': 1774706887.994718}
2026-03-28 14:08:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='VN18%2520WGJ') HTTP/1.1" 204 0
2026-03-28 14:08:08 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/NY11BJE/42808365?sv=2020-08-04&st=2026-03-28T14%3A08%3A06Z&se=2026-03-28T14%3A33%3A06Z&sr=b&sp=r&sig=BnHSFQIYk3fEUhH4zxeRM80fwfd2ygxBi8EnHswGMU8%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=NY11%20BJE-GB>
2026-03-28 14:08:08 [bca.uk] INFO: Found listing with ID: BN16%20YCC
2026-03-28 14:08:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BN16%2520YCC%27 HTTP/1.1" 200 None
2026-03-28 14:08:08 [bca.uk] INFO: Scrape type for BN16%20YCC: 0
2026-03-28 14:08:08 [bca.uk] INFO: Found listing with ID: EF15%20ECY
2026-03-28 14:08:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27EF15%2520ECY%27 HTTP/1.1" 200 None
2026-03-28 14:08:08 [bca.uk] INFO: Scrape type for EF15%20ECY: 0
2026-03-28 14:08:08 [bca.uk] INFO: Found listing with ID: BV64%20HHP
2026-03-28 14:08:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BV64%2520HHP%27 HTTP/1.1" 200 None
2026-03-28 14:08:08 [bca.uk] INFO: Scrape type for BV64%20HHP: 0
2026-03-28 14:08:08 [bca.uk] INFO: Found listing with ID: WP22%20CZC
2026-03-28 14:08:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WP22%2520CZC%27 HTTP/1.1" 200 None
2026-03-28 14:08:08 [bca.uk] INFO: Scrape type for WP22%20CZC: 0
2026-03-28 14:08:08 [bca.uk] INFO: Found listing with ID: YH21%20NLM
2026-03-28 14:08:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YH21%2520NLM%27 HTTP/1.1" 200 None
2026-03-28 14:08:08 [bca.uk] INFO: Scrape type for YH21%20NLM: 0
2026-03-28 14:08:08 [bca.uk] INFO: Found listing with ID: CE69%20XSY
2026-03-28 14:08:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27CE69%2520XSY%27 HTTP/1.1" 200 None
2026-03-28 14:08:08 [bca.uk] INFO: Scrape type for CE69%20XSY: 0
2026-03-28 14:08:08 [bca.uk] INFO: Found listing with ID: FL68%20XDW
2026-03-28 14:08:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FL68%2520XDW%27 HTTP/1.1" 200 None
2026-03-28 14:08:08 [bca.uk] INFO: Scrape type for FL68%20XDW: 2
2026-03-28 14:08:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 40309fa2-9094-503f-8b4a-447e76160edf with identifier: FL68%20XDW
2026-03-28 14:08:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 40309fa2-9094-503f-8b4a-447e76160edf with scrape type 2
2026-03-28 14:08:08 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 40309fa2-9094-503f-8b4a-447e76160edf with scrape type 2
2026-03-28 14:08:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 40309fa2-9094-503f-8b4a-447e76160edf, identifier: FL68%20XDW
2026-03-28 14:08:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698733444%27 HTTP/1.1" 200 None
2026-03-28 14:08:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698733444 not downloaded yet
2026-03-28 14:08:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FV17TYW/698767940/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/FV17TYW/42807142?sv=2020-08-04&st=2026-03-28T14%3A03%3A46Z&se=2026-03-28T14%3A28%3A46Z&sr=b&sp=r&sig=3LbtNEGnFqYV4bS0F0%2BmsB%2FgfFSYLdditNDmvy7kudU%3D)
2026-03-28 14:08:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FY66OTD/698150760/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/FY66OTD/42794791?sv=2020-08-04&st=2026-03-28T14%3A03%3A46Z&se=2026-03-28T14%3A28%3A46Z&sr=b&sp=r&sig=nyWr7cManqycrjqVh9Sq0fegCWU0XCSire1eKcJWKLA%3D)
2026-03-28 14:08:08 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/OY67JPV/698107879/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698107879>
2026-03-28 14:08:08 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/RE68RYC/42807274?sv=2020-08-04&st=2026-03-28T14%3A08%3A07Z&se=2026-03-28T14%3A33%3A07Z&sr=b&sp=r&sig=2T9BQlp2w4jq0TOnJ2XRxIlj1g8XZKwhz0v6utga2zA%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=RE68%20RYC-GB>
2026-03-28 14:08:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 40309fa2-9094-503f-8b4a-447e76160edf with identifier: FL68%20XDW
2026-03-28 14:08:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 40309fa2-9094-503f-8b4a-447e76160edf with identifier: FL68%20XDW
2026-03-28 14:08:08 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 40309fa2-9094-503f-8b4a-447e76160edf with identifier: FL68%20XDW to the API
2026-03-28 14:08:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:08:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:08:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=20&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 110,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=FL68%20XDW-GB',
'category': 'Car',
'color': 'white',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.5L',
'expiration_date': '2026-03-29T10:00:00Z',
'fuel_type': 'Diesel',
'id': '40309fa2-9094-503f-8b4a-447e76160edf',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'FL68 XDW',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=FL68%20XDW&vehicleType=*',
'listing': 'auction',
'location': 'Walsall',
'make': 'NISSAN',
'model': 'QASHQAI',
'odometer': 56184,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-01-01',
'seller_name': None,
'title': 'NISSAN QASHQAI 1.5 DCI 115 TEKNA Hatchback',
'transmission': 'manual',
'trim': 'DCI 115 TEKNA',
'vin': 'SJNFAAJ11U2456355',
'year': 2018}
2026-03-28 14:08:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FL68%2520XDW%27 HTTP/1.1" 200 None
2026-03-28 14:08:08 [bca.uk] INFO: Saving data for FL68%20XDW: {'auction_closing_time': 1774778400.0, 'created_time': 1774523216.287621, 'last_price_update_time': 1774706888.696717}
2026-03-28 14:08:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='FL68%2520XDW') HTTP/1.1" 204 0
2026-03-28 14:08:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:08:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c922c10>
2026-03-28 14:08:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:08:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:08:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:08:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_49f7b40c-fae2-5164-be3f-ce9eb1a2514d/49f7b40c-fae2-5164-be3f-ce9eb1a2514d_expert_report_file_24fb677c-472b-4ecf-8679-dac585523ba0.pdf HTTP/1.1" 201 0
2026-03-28 14:08:08 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item 49f7b40c-fae2-5164-be3f-ce9eb1a2514d
2026-03-28 14:08:08 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 49f7b40c-fae2-5164-be3f-ce9eb1a2514d, skipping ID generation
2026-03-28 14:08:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 49f7b40c-fae2-5164-be3f-ce9eb1a2514d
2026-03-28 14:08:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DWP63USZ-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-28 14:08:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=WP63USZ-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-28 14:08:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:08:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a1ff529d0>
2026-03-28 14:08:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:08:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:08:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:08:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_214771ac-26f4-5760-a178-e14681ff06b8/214771ac-26f4-5760-a178-e14681ff06b8_image_1.jpg HTTP/1.1" 201 0
2026-03-28 14:08:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FWV16UWB%252F698284408%252F600') HTTP/1.1" 204 0
2026-03-28 14:08:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WV16UWB/698284408/600 saved to cache
2026-03-28 14:08:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 214771ac-26f4-5760-a178-e14681ff06b8
2026-03-28 14:08:08 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 214771ac-26f4-5760-a178-e14681ff06b8, skipping ID generation
2026-03-28 14:08:08 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 214771ac-26f4-5760-a178-e14681ff06b8 sending to next pipeline
2026-03-28 14:08:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 214771ac-26f4-5760-a178-e14681ff06b8, identifier: WV16%20UWB
2026-03-28 14:08:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:08:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c4184d0>
2026-03-28 14:08:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:08:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:08:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:08:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6f52ae88-a710-5999-b75b-294cfedaf6f8/6f52ae88-a710-5999-b75b-294cfedaf6f8_image_1.jpg HTTP/1.1" 201 0
2026-03-28 14:08:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FX11BBM%252F697603970%252F600') HTTP/1.1" 204 0
2026-03-28 14:08:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/X11BBM/697603970/600 saved to cache
2026-03-28 14:08:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 6f52ae88-a710-5999-b75b-294cfedaf6f8
2026-03-28 14:08:08 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 6f52ae88-a710-5999-b75b-294cfedaf6f8, skipping ID generation
2026-03-28 14:08:08 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 6f52ae88-a710-5999-b75b-294cfedaf6f8 sending to next pipeline
2026-03-28 14:08:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 6f52ae88-a710-5999-b75b-294cfedaf6f8, identifier: X11%20BBM
2026-03-28 14:08:09 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:08:09 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:08:09 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:08:09 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:08:09 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:08:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:08:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a1ff53e90>
2026-03-28 14:08:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:08:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:08:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:08:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b6d51688-b23c-5016-a794-ddfbf11c9378/b6d51688-b23c-5016-a794-ddfbf11c9378_image_7.jpg HTTP/1.1" 201 0
2026-03-28 14:08:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FKU19CFH%252F697551238%252F600') HTTP/1.1" 204 0
2026-03-28 14:08:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KU19CFH/697551238/600 saved to cache
2026-03-28 14:08:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item b6d51688-b23c-5016-a794-ddfbf11c9378
2026-03-28 14:08:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/OY67JPV/698107893/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/OY67JPV/42810048?sv=2020-08-04&st=2026-03-28T14%3A03%3A48Z&se=2026-03-28T14%3A28%3A48Z&sr=b&sp=r&sig=3IQnxpRCaMGCrWPQZylbi%2BiY%2FkfXKw1FEE36W3dpRwo%3D)
2026-03-28 14:08:09 [bca.uk] INFO: Found listing with ID: AO62%20OXD
2026-03-28 14:08:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27AO62%2520OXD%27 HTTP/1.1" 200 None
2026-03-28 14:08:09 [bca.uk] INFO: Scrape type for AO62%20OXD: 0
2026-03-28 14:08:09 [bca.uk] INFO: Found listing with ID: PX56%20GKL
2026-03-28 14:08:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27PX56%2520GKL%27 HTTP/1.1" 200 None
2026-03-28 14:08:09 [bca.uk] INFO: Scrape type for PX56%20GKL: 0
2026-03-28 14:08:09 [bca.uk] INFO: Found listing with ID: MD19%20WYP
2026-03-28 14:08:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MD19%2520WYP%27 HTTP/1.1" 200 None
2026-03-28 14:08:09 [bca.uk] INFO: Scrape type for MD19%20WYP: 0
2026-03-28 14:08:09 [bca.uk] INFO: Found listing with ID: KE73%20AZL
2026-03-28 14:08:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KE73%2520AZL%27 HTTP/1.1" 200 None
2026-03-28 14:08:09 [bca.uk] INFO: Scrape type for KE73%20AZL: 0
2026-03-28 14:08:09 [bca.uk] INFO: Found listing with ID: LM72%20ZKZ
2026-03-28 14:08:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LM72%2520ZKZ%27 HTTP/1.1" 200 None
2026-03-28 14:08:09 [bca.uk] INFO: Scrape type for LM72%20ZKZ: 0
2026-03-28 14:08:09 [bca.uk] INFO: Found listing with ID: VO24%20OZH
2026-03-28 14:08:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27VO24%2520OZH%27 HTTP/1.1" 200 None
2026-03-28 14:08:09 [bca.uk] INFO: Scrape type for VO24%20OZH: 0
2026-03-28 14:08:09 [bca.uk] INFO: Found listing with ID: DK14%20KWN
2026-03-28 14:08:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DK14%2520KWN%27 HTTP/1.1" 200 None
2026-03-28 14:08:09 [bca.uk] INFO: Scrape type for DK14%20KWN: 0
2026-03-28 14:08:09 [bca.uk] INFO: Found listing with ID: LR23%20ZDW
2026-03-28 14:08:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LR23%2520ZDW%27 HTTP/1.1" 200 None
2026-03-28 14:08:09 [bca.uk] INFO: Scrape type for LR23%20ZDW: 0
2026-03-28 14:08:09 [bca.uk] INFO: Found listing with ID: GV74%20XLD
2026-03-28 14:08:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GV74%2520XLD%27 HTTP/1.1" 200 None
2026-03-28 14:08:09 [bca.uk] INFO: Scrape type for GV74%20XLD: 0
2026-03-28 14:08:09 [bca.uk] INFO: Found listing with ID: LM74%20XOF
2026-03-28 14:08:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LM74%2520XOF%27 HTTP/1.1" 200 None
2026-03-28 14:08:09 [bca.uk] INFO: Scrape type for LM74%20XOF: 0
2026-03-28 14:08:09 [bca.uk] INFO: Found listing with ID: LP72%20VEW
2026-03-28 14:08:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LP72%2520VEW%27 HTTP/1.1" 200 None
2026-03-28 14:08:09 [bca.uk] INFO: Scrape type for LP72%20VEW: 0
2026-03-28 14:08:09 [bca.uk] INFO: Found listing with ID: MD24%20WCJ
2026-03-28 14:08:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MD24%2520WCJ%27 HTTP/1.1" 200 None
2026-03-28 14:08:09 [bca.uk] INFO: Scrape type for MD24%20WCJ: 0
2026-03-28 14:08:09 [bca.uk] INFO: Found listing with ID: BC74%20HAX
2026-03-28 14:08:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BC74%2520HAX%27 HTTP/1.1" 200 None
2026-03-28 14:08:09 [bca.uk] INFO: Scrape type for BC74%20HAX: 0
2026-03-28 14:08:09 [bca.uk] INFO: Found listing with ID: EO23%20LML
2026-03-28 14:08:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27EO23%2520LML%27 HTTP/1.1" 200 None
2026-03-28 14:08:09 [bca.uk] INFO: Scrape type for EO23%20LML: 0
2026-03-28 14:08:09 [bca.uk] INFO: Found listing with ID: EU16%20VPP
2026-03-28 14:08:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27EU16%2520VPP%27 HTTP/1.1" 200 None
2026-03-28 14:08:09 [bca.uk] INFO: Scrape type for EU16%20VPP: 0
2026-03-28 14:08:09 [bca.uk] INFO: Found listing with ID: EO74%20OPL
2026-03-28 14:08:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27EO74%2520OPL%27 HTTP/1.1" 200 None
2026-03-28 14:08:09 [bca.uk] INFO: Scrape type for EO74%20OPL: 0
2026-03-28 14:08:09 [bca.uk] INFO: Found listing with ID: DA15%20KME
2026-03-28 14:08:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DA15%2520KME%27 HTTP/1.1" 200 None
2026-03-28 14:08:09 [bca.uk] INFO: Scrape type for DA15%20KME: 0
2026-03-28 14:08:09 [bca.uk] INFO: Found listing with ID: DN17%20OTR
2026-03-28 14:08:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DN17%2520OTR%27 HTTP/1.1" 200 None
2026-03-28 14:08:09 [bca.uk] INFO: Scrape type for DN17%20OTR: 0
2026-03-28 14:08:09 [bca.uk] INFO: Found listing with ID: LL23%20KPF
2026-03-28 14:08:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LL23%2520KPF%27 HTTP/1.1" 200 None
2026-03-28 14:08:09 [bca.uk] INFO: Scrape type for LL23%20KPF: 0
2026-03-28 14:08:09 [bca.uk] INFO: Found listing with ID: Y863%20PSL
2026-03-28 14:08:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27Y863%2520PSL%27 HTTP/1.1" 200 None
2026-03-28 14:08:09 [bca.uk] INFO: Scrape type for Y863%20PSL: 0
2026-03-28 14:08:09 [bca.uk] INFO: Found listing with ID: FY72%20ATU
2026-03-28 14:08:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FY72%2520ATU%27 HTTP/1.1" 200 None
2026-03-28 14:08:09 [bca.uk] INFO: Scrape type for FY72%20ATU: 0
2026-03-28 14:08:09 [bca.uk] INFO: Found listing with ID: SR19%20KRE
2026-03-28 14:08:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SR19%2520KRE%27 HTTP/1.1" 200 None
2026-03-28 14:08:09 [bca.uk] INFO: Scrape type for SR19%20KRE: 2
2026-03-28 14:08:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 18ba6a1b-20e2-50f0-8eba-15e0acddf5aa with identifier: SR19%20KRE
2026-03-28 14:08:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 18ba6a1b-20e2-50f0-8eba-15e0acddf5aa with scrape type 2
2026-03-28 14:08:09 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 18ba6a1b-20e2-50f0-8eba-15e0acddf5aa with scrape type 2
2026-03-28 14:08:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 18ba6a1b-20e2-50f0-8eba-15e0acddf5aa, identifier: SR19%20KRE
2026-03-28 14:08:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698733455%27 HTTP/1.1" 200 None
2026-03-28 14:08:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698733455 not downloaded yet
2026-03-28 14:08:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 214771ac-26f4-5760-a178-e14681ff06b8 with identifier: WV16%20UWB
2026-03-28 14:08:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 214771ac-26f4-5760-a178-e14681ff06b8 with identifier: WV16%20UWB
2026-03-28 14:08:09 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 214771ac-26f4-5760-a178-e14681ff06b8 with identifier: WV16%20UWB to the API
2026-03-28 14:08:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:08:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:08:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WV16UWB/698284408/600>
{'auction_title': '',
'c_o_2_emission_value': 144,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_214771ac-26f4-5760-a178-e14681ff06b8/214771ac-26f4-5760-a178-e14681ff06b8_expert_report_file_46291f46-c5c7-491f-bf46-f0004f8cb173.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=WV16%20UWB-GB',
'category': 'Car',
'color': 'grey',
'currency': 'GBP',
'doors_number': 5,
'engine': '2.2L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Diesel',
'id': '214771ac-26f4-5760-a178-e14681ff06b8',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'WV16 UWB',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=WV16%20UWB&vehicleType=*',
'listing': 'auction',
'location': 'Bristol',
'make': 'MAZDA',
'model': 'CX-5',
'odometer': 80111,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 11,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_214771ac-26f4-5760-a178-e14681ff06b8/214771ac-26f4-5760-a178-e14681ff06b8_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 45686,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WV16UWB/698284405/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_214771ac-26f4-5760-a178-e14681ff06b8/214771ac-26f4-5760-a178-e14681ff06b8_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 46236,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WV16UWB/698284408/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_214771ac-26f4-5760-a178-e14681ff06b8/214771ac-26f4-5760-a178-e14681ff06b8_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 42613,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WV16UWB/698284411/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_214771ac-26f4-5760-a178-e14681ff06b8/214771ac-26f4-5760-a178-e14681ff06b8_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 42930,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WV16UWB/698284415/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_214771ac-26f4-5760-a178-e14681ff06b8/214771ac-26f4-5760-a178-e14681ff06b8_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 42281,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WV16UWB/698284418/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_214771ac-26f4-5760-a178-e14681ff06b8/214771ac-26f4-5760-a178-e14681ff06b8_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 41618,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WV16UWB/698284425/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_214771ac-26f4-5760-a178-e14681ff06b8/214771ac-26f4-5760-a178-e14681ff06b8_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 85548,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WV16UWB/698284431/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_214771ac-26f4-5760-a178-e14681ff06b8/214771ac-26f4-5760-a178-e14681ff06b8_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 80442,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WV16UWB/698284438/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_214771ac-26f4-5760-a178-e14681ff06b8/214771ac-26f4-5760-a178-e14681ff06b8_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 88093,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WV16UWB/698284443/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_214771ac-26f4-5760-a178-e14681ff06b8/214771ac-26f4-5760-a178-e14681ff06b8_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 79537,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WV16UWB/698284450/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-01-01',
'seller_name': None,
'title': 'MAZDA CX-5 2.2 D 175 SPORT AWD StationWagon',
'transmission': 'automatic',
'trim': 'D 175 SPORT AWD',
'vin': 'JMZKEN92800473039',
'year': 2016}
2026-03-28 14:08:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WV16%2520UWB%27 HTTP/1.1" 200 None
2026-03-28 14:08:09 [bca.uk] INFO: Saving data for WV16%20UWB: {'created_time': 1774706889.936626, 'last_price_update_time': 1774706889.93664, 'auction_closing_time': 1774864800.0}
2026-03-28 14:08:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='WV16%2520UWB') HTTP/1.1" 204 0
2026-03-28 14:08:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 6f52ae88-a710-5999-b75b-294cfedaf6f8 with identifier: X11%20BBM
2026-03-28 14:08:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 6f52ae88-a710-5999-b75b-294cfedaf6f8 with identifier: X11%20BBM
2026-03-28 14:08:10 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 6f52ae88-a710-5999-b75b-294cfedaf6f8 with identifier: X11%20BBM to the API
2026-03-28 14:08:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:08:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:08:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/X11BBM/697603970/600>
{'auction_title': '',
'c_o_2_emission_value': 366,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6f52ae88-a710-5999-b75b-294cfedaf6f8/6f52ae88-a710-5999-b75b-294cfedaf6f8_expert_report_file_7d14c044-ed09-4d03-9489-38732ad92b03.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=X11%20BBM-GB',
'category': 'Car',
'color': 'blue',
'currency': 'GBP',
'doors_number': 2,
'engine': '5.0L',
'expiration_date': '2026-03-31T10:00:00Z',
'fuel_type': 'Petrol',
'id': '6f52ae88-a710-5999-b75b-294cfedaf6f8',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'X11 BBM',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=X11%20BBM&vehicleType=*',
'listing': 'auction',
'location': 'Bristol',
'make': 'BMW',
'model': 'M6',
'odometer': 53312,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 12,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6f52ae88-a710-5999-b75b-294cfedaf6f8/6f52ae88-a710-5999-b75b-294cfedaf6f8_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 46390,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/X11BBM/697603967/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6f52ae88-a710-5999-b75b-294cfedaf6f8/6f52ae88-a710-5999-b75b-294cfedaf6f8_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 46284,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/X11BBM/697603970/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6f52ae88-a710-5999-b75b-294cfedaf6f8/6f52ae88-a710-5999-b75b-294cfedaf6f8_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 43608,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/X11BBM/697603972/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6f52ae88-a710-5999-b75b-294cfedaf6f8/6f52ae88-a710-5999-b75b-294cfedaf6f8_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 44507,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/X11BBM/697603974/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6f52ae88-a710-5999-b75b-294cfedaf6f8/6f52ae88-a710-5999-b75b-294cfedaf6f8_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 41725,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/X11BBM/697603979/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6f52ae88-a710-5999-b75b-294cfedaf6f8/6f52ae88-a710-5999-b75b-294cfedaf6f8_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 43697,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/X11BBM/697603988/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6f52ae88-a710-5999-b75b-294cfedaf6f8/6f52ae88-a710-5999-b75b-294cfedaf6f8_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 85225,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/X11BBM/697604002/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6f52ae88-a710-5999-b75b-294cfedaf6f8/6f52ae88-a710-5999-b75b-294cfedaf6f8_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 66852,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/X11BBM/697604011/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6f52ae88-a710-5999-b75b-294cfedaf6f8/6f52ae88-a710-5999-b75b-294cfedaf6f8_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 87276,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/X11BBM/697604017/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6f52ae88-a710-5999-b75b-294cfedaf6f8/6f52ae88-a710-5999-b75b-294cfedaf6f8_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 76238,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/X11BBM/697604024/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2007-01-01',
'seller_name': None,
'title': 'BMW M6 5.0 SMG Convertible',
'transmission': 'automatic',
'trim': 'SMG',
'vin': 'WBSEK920X0B392225',
'year': 2007}
2026-03-28 14:08:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27X11%2520BBM%27 HTTP/1.1" 200 None
2026-03-28 14:08:10 [bca.uk] INFO: Saving data for X11%20BBM: {'created_time': 1774706890.450479, 'last_price_update_time': 1774706890.450491, 'auction_closing_time': 1774951200.0}
2026-03-28 14:08:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='X11%2520BBM') HTTP/1.1" 204 0
2026-03-28 14:08:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 18ba6a1b-20e2-50f0-8eba-15e0acddf5aa with identifier: SR19%20KRE
2026-03-28 14:08:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 18ba6a1b-20e2-50f0-8eba-15e0acddf5aa with identifier: SR19%20KRE
2026-03-28 14:08:10 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 18ba6a1b-20e2-50f0-8eba-15e0acddf5aa with identifier: SR19%20KRE to the API
2026-03-28 14:08:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:08:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:08:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=20&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 123,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=SR19%20KRE-GB',
'category': 'Car',
'color': 'black',
'currency': 'GBP',
'doors_number': 5,
'engine': '2.0L',
'expiration_date': '2026-04-06T10:00:00Z',
'fuel_type': 'Diesel',
'id': '18ba6a1b-20e2-50f0-8eba-15e0acddf5aa',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'SR19 KRE',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=SR19%20KRE&vehicleType=*',
'listing': 'auction',
'location': 'Walsall',
'make': 'BMW',
'model': 'X2',
'odometer': 74418,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-01-01',
'seller_name': None,
'title': 'BMW X2 2.0 XDRIVE 18D M SPORT X STEP Hatchback',
'transmission': 'automatic',
'trim': 'XDRIVE 18D M SPORT X STEP',
'vin': 'WBAYK720005N01795',
'year': 2019}
2026-03-28 14:08:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SR19%2520KRE%27 HTTP/1.1" 200 None
2026-03-28 14:08:10 [bca.uk] INFO: Saving data for SR19%20KRE: {'auction_closing_time': 1775469600.0, 'created_time': 1774610675.430018, 'last_price_update_time': 1774706890.823265}
2026-03-28 14:08:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='SR19%2520KRE') HTTP/1.1" 204 0
2026-03-28 14:08:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698814293%27 HTTP/1.1" 200 None
2026-03-28 14:08:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698814293 not downloaded yet
2026-03-28 14:08:10 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:08:10 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:08:10 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:08:10 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:08:10 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:08:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:08:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2d906010>
2026-03-28 14:08:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:08:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:08:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:08:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1534762c-5952-5a28-84f7-7b27016558ac/1534762c-5952-5a28-84f7-7b27016558ac_image_7.jpg HTTP/1.1" 201 0
2026-03-28 14:08:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FDA21SOU%252F697888020%252F600') HTTP/1.1" 204 0
2026-03-28 14:08:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DA21SOU/697888020/600 saved to cache
2026-03-28 14:08:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 1534762c-5952-5a28-84f7-7b27016558ac
2026-03-28 14:08:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/TFZ8294/42809548?sv=2020-08-04&st=2026-03-28T14%3A08%3A05Z&se=2026-03-28T14%3A33%3A05Z&sr=b&sp=r&sig=ErLZlBqdyCWgCZpWR0ce5C0%2FBbCxi3QUVQkCi%2FMXrM0%3D> (referer: https://www.bca.co.uk/)
2026-03-28 14:08:10 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FY66OTD/698150753/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698150753>
2026-03-28 14:08:10 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WD19GOC/698733386/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=WD19GOC-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-28 14:08:10 [scrapy.extensions.logstats] INFO: Crawled 214 pages (at 15 pages/min), scraped 423 items (at 63 items/min)
2026-03-28 14:08:10 [scrapy.extensions.memusage] INFO: Peak memory usage is 200MiB
2026-03-28 14:08:10 [bca.uk] INFO: Found listing with ID: AX72%20JJV
2026-03-28 14:08:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27AX72%2520JJV%27 HTTP/1.1" 200 None
2026-03-28 14:08:10 [bca.uk] INFO: Scrape type for AX72%20JJV: 0
2026-03-28 14:08:10 [bca.uk] INFO: Found listing with ID: AF21%20VSG
2026-03-28 14:08:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27AF21%2520VSG%27 HTTP/1.1" 200 None
2026-03-28 14:08:10 [bca.uk] INFO: Scrape type for AF21%20VSG: 0
2026-03-28 14:08:10 [bca.uk] INFO: Found listing with ID: DX23%20TSO
2026-03-28 14:08:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DX23%2520TSO%27 HTTP/1.1" 200 None
2026-03-28 14:08:10 [bca.uk] INFO: Scrape type for DX23%20TSO: 0
2026-03-28 14:08:10 [bca.uk] INFO: Found listing with ID: KN69%20NPV
2026-03-28 14:08:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KN69%2520NPV%27 HTTP/1.1" 200 None
2026-03-28 14:08:10 [bca.uk] INFO: Scrape type for KN69%20NPV: 0
2026-03-28 14:08:10 [bca.uk] INFO: Found listing with ID: YF72%20VKM
2026-03-28 14:08:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YF72%2520VKM%27 HTTP/1.1" 200 None
2026-03-28 14:08:10 [bca.uk] INFO: Scrape type for YF72%20VKM: 0
2026-03-28 14:08:10 [bca.uk] INFO: Found listing with ID: DY72%20BZT
2026-03-28 14:08:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DY72%2520BZT%27 HTTP/1.1" 200 None
2026-03-28 14:08:11 [bca.uk] INFO: Scrape type for DY72%20BZT: 0
2026-03-28 14:08:11 [bca.uk] INFO: Found listing with ID: P123%20PJG
2026-03-28 14:08:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27P123%2520PJG%27 HTTP/1.1" 200 None
2026-03-28 14:08:11 [bca.uk] INFO: Scrape type for P123%20PJG: 0
2026-03-28 14:08:11 [bca.uk] INFO: Found listing with ID: AO22%20TKN
2026-03-28 14:08:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27AO22%2520TKN%27 HTTP/1.1" 200 None
2026-03-28 14:08:11 [bca.uk] INFO: Scrape type for AO22%20TKN: 0
2026-03-28 14:08:11 [bca.uk] INFO: Found listing with ID: AX72%20KAU
2026-03-28 14:08:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27AX72%2520KAU%27 HTTP/1.1" 200 None
2026-03-28 14:08:11 [bca.uk] INFO: Scrape type for AX72%20KAU: 0
2026-03-28 14:08:11 [bca.uk] INFO: Found listing with ID: GY21%20ECT
2026-03-28 14:08:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GY21%2520ECT%27 HTTP/1.1" 200 None
2026-03-28 14:08:11 [bca.uk] INFO: Scrape type for GY21%20ECT: 0
2026-03-28 14:08:11 [bca.uk] INFO: Found listing with ID: GC23%20CTV
2026-03-28 14:08:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GC23%2520CTV%27 HTTP/1.1" 200 None
2026-03-28 14:08:11 [bca.uk] INFO: Scrape type for GC23%20CTV: 0
2026-03-28 14:08:11 [bca.uk] INFO: Found listing with ID: YF68%20ZTR
2026-03-28 14:08:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YF68%2520ZTR%27 HTTP/1.1" 200 None
2026-03-28 14:08:11 [bca.uk] INFO: Scrape type for YF68%20ZTR: 0
2026-03-28 14:08:11 [bca.uk] INFO: Found listing with ID: GV24%20ECT
2026-03-28 14:08:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GV24%2520ECT%27 HTTP/1.1" 200 None
2026-03-28 14:08:11 [bca.uk] INFO: Scrape type for GV24%20ECT: 0
2026-03-28 14:08:11 [bca.uk] INFO: Found listing with ID: GY23%20TYF
2026-03-28 14:08:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GY23%2520TYF%27 HTTP/1.1" 200 None
2026-03-28 14:08:11 [bca.uk] INFO: Scrape type for GY23%20TYF: 0
2026-03-28 14:08:11 [bca.uk] INFO: Found listing with ID: WU18%20RYO
2026-03-28 14:08:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WU18%2520RYO%27 HTTP/1.1" 200 None
2026-03-28 14:08:11 [bca.uk] INFO: Scrape type for WU18%20RYO: 0
2026-03-28 14:08:11 [bca.uk] INFO: Found listing with ID: OV71%20KBY
2026-03-28 14:08:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27OV71%2520KBY%27 HTTP/1.1" 200 None
2026-03-28 14:08:11 [bca.uk] INFO: Scrape type for OV71%20KBY: 0
2026-03-28 14:08:11 [bca.uk] INFO: Found listing with ID: KV72%20VJL
2026-03-28 14:08:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KV72%2520VJL%27 HTTP/1.1" 200 None
2026-03-28 14:08:11 [bca.uk] INFO: Scrape type for KV72%20VJL: 0
2026-03-28 14:08:11 [bca.uk] INFO: Found listing with ID: VO17%20JDK
2026-03-28 14:08:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27VO17%2520JDK%27 HTTP/1.1" 200 None
2026-03-28 14:08:11 [bca.uk] INFO: Scrape type for VO17%20JDK: 0
2026-03-28 14:08:11 [bca.uk] INFO: Found listing with ID: OV21%20JZF
2026-03-28 14:08:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27OV21%2520JZF%27 HTTP/1.1" 200 None
2026-03-28 14:08:11 [bca.uk] INFO: Scrape type for OV21%20JZF: 0
2026-03-28 14:08:11 [bca.uk] INFO: Found listing with ID: DU20%20NZO
2026-03-28 14:08:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DU20%2520NZO%27 HTTP/1.1" 200 None
2026-03-28 14:08:11 [bca.uk] INFO: Scrape type for DU20%20NZO: 2
2026-03-28 14:08:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fc560272-39a3-5e55-b878-8de95f5202b2 with identifier: DU20%20NZO
2026-03-28 14:08:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fc560272-39a3-5e55-b878-8de95f5202b2 with scrape type 2
2026-03-28 14:08:11 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item fc560272-39a3-5e55-b878-8de95f5202b2 with scrape type 2
2026-03-28 14:08:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: fc560272-39a3-5e55-b878-8de95f5202b2, identifier: DU20%20NZO
2026-03-28 14:08:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698733465%27 HTTP/1.1" 200 None
2026-03-28 14:08:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698733465 not downloaded yet
2026-03-28 14:08:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/WB19OHW/42808333?sv=2020-08-04&st=2026-03-28T14%3A08%3A05Z&se=2026-03-28T14%3A33%3A05Z&sr=b&sp=r&sig=1tPrGuzNeNTywf9es7t2uJatudSyGSBqwxwUQUNO5j8%3D> (referer: https://www.bca.co.uk/)
2026-03-28 14:08:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KU19CFH/697551217/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/KU19CFH/42809756?sv=2020-08-04&st=2026-03-28T14%3A03%3A45Z&se=2026-03-28T14%3A28%3A45Z&sr=b&sp=r&sig=1G7eR4FaPr%2BtRdJKW3arikyQmOCuk26xvavIORXr6y8%3D)
2026-03-28 14:08:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LN68RBY/698920267/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LN68RBY/42809684?sv=2020-08-04&st=2026-03-28T14%3A03%3A42Z&se=2026-03-28T14%3A28%3A42Z&sr=b&sp=r&sig=aIYqAxiZsHZDOcTozI0zzgpiaCRiEseqbYSKBZyhWQ4%3D)
2026-03-28 14:08:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DA21SOU/697888006/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/DA21SOU/42810340?sv=2020-08-04&st=2026-03-28T14%3A03%3A42Z&se=2026-03-28T14%3A28%3A42Z&sr=b&sp=r&sig=6%2F4a%2BWc9n6QD4YiOi5mt3dZkPnMZj%2Bfh7208k4Rd3hI%3D)
2026-03-28 14:08:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: fc560272-39a3-5e55-b878-8de95f5202b2 with identifier: DU20%20NZO
2026-03-28 14:08:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: fc560272-39a3-5e55-b878-8de95f5202b2 with identifier: DU20%20NZO
2026-03-28 14:08:11 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: fc560272-39a3-5e55-b878-8de95f5202b2 with identifier: DU20%20NZO to the API
2026-03-28 14:08:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:08:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:08:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=20&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 106,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=DU20%20NZO-GB',
'category': 'Car',
'color': 'grey',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.6L',
'expiration_date': '2026-03-31T10:00:00Z',
'fuel_type': 'Diesel',
'id': 'fc560272-39a3-5e55-b878-8de95f5202b2',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'DU20 NZO',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=DU20%20NZO&vehicleType=*',
'listing': 'auction',
'location': 'Bedford',
'make': 'VAUXHALL',
'model': 'INSIGNIA GS',
'odometer': 49345,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-01-01',
'seller_name': None,
'title': 'VAUXHALL INSIGNIA GS 1.6 TURBO D 136 TECH LINE Hatchback',
'transmission': 'manual',
'trim': 'TURBO D 136 TECH LINE',
'vin': 'W0VZT6EF7L1020989',
'year': 2020}
2026-03-28 14:08:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DU20%2520NZO%27 HTTP/1.1" 200 None
2026-03-28 14:08:11 [bca.uk] INFO: Saving data for DU20%20NZO: {'auction_closing_time': 1774951200.0, 'created_time': 1774523491.903662, 'last_price_update_time': 1774706891.812085}
2026-03-28 14:08:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='DU20%2520NZO') HTTP/1.1" 204 0
2026-03-28 14:08:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698814307%27 HTTP/1.1" 200 None
2026-03-28 14:08:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698814307 not downloaded yet
2026-03-28 14:08:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:08:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c4d3490>
2026-03-28 14:08:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:08:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:08:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:08:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d7b30cd7-3fb2-520c-9629-4539584c6e2c/d7b30cd7-3fb2-520c-9629-4539584c6e2c_image_2.jpg HTTP/1.1" 201 0
2026-03-28 14:08:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FFV17TYW%252F698767940%252F600') HTTP/1.1" 204 0
2026-03-28 14:08:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FV17TYW/698767940/600 saved to cache
2026-03-28 14:08:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item d7b30cd7-3fb2-520c-9629-4539584c6e2c
2026-03-28 14:08:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:08:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2dd86290>
2026-03-28 14:08:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:08:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:08:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:08:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_40999011-32af-5ad3-a840-4cb8242ff02a/40999011-32af-5ad3-a840-4cb8242ff02a_image_2.jpg HTTP/1.1" 201 0
2026-03-28 14:08:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FFY66OTD%252F698150760%252F600') HTTP/1.1" 204 0
2026-03-28 14:08:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FY66OTD/698150760/600 saved to cache
2026-03-28 14:08:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 40999011-32af-5ad3-a840-4cb8242ff02a
2026-03-28 14:08:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:08:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c4d2710>
2026-03-28 14:08:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:08:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:08:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:08:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7708aee7-65e8-597e-aa3d-426819c9c319/7708aee7-65e8-597e-aa3d-426819c9c319_image_2.jpg HTTP/1.1" 201 0
2026-03-28 14:08:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FOY67JPV%252F698107893%252F600') HTTP/1.1" 204 0
2026-03-28 14:08:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/OY67JPV/698107893/600 saved to cache
2026-03-28 14:08:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 7708aee7-65e8-597e-aa3d-426819c9c319
2026-03-28 14:08:12 [bca.uk] INFO: Found listing with ID: VK72%20WFR
2026-03-28 14:08:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27VK72%2520WFR%27 HTTP/1.1" 200 None
2026-03-28 14:08:12 [bca.uk] INFO: Scrape type for VK72%20WFR: 0
2026-03-28 14:08:12 [bca.uk] INFO: Found listing with ID: GD20%20BRZ
2026-03-28 14:08:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GD20%2520BRZ%27 HTTP/1.1" 200 None
2026-03-28 14:08:12 [bca.uk] INFO: Scrape type for GD20%20BRZ: 0
2026-03-28 14:08:12 [bca.uk] INFO: Found listing with ID: FM19%20TZB
2026-03-28 14:08:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FM19%2520TZB%27 HTTP/1.1" 200 None
2026-03-28 14:08:12 [bca.uk] INFO: Scrape type for FM19%20TZB: 0
2026-03-28 14:08:12 [bca.uk] INFO: Found listing with ID: HJ23%20YHS
2026-03-28 14:08:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27HJ23%2520YHS%27 HTTP/1.1" 200 None
2026-03-28 14:08:12 [bca.uk] INFO: Scrape type for HJ23%20YHS: 0
2026-03-28 14:08:12 [bca.uk] INFO: Found listing with ID: KT68%20ENX
2026-03-28 14:08:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KT68%2520ENX%27 HTTP/1.1" 200 None
2026-03-28 14:08:12 [bca.uk] INFO: Scrape type for KT68%20ENX: 0
2026-03-28 14:08:12 [bca.uk] INFO: Found listing with ID: FV18%20YDD
2026-03-28 14:08:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FV18%2520YDD%27 HTTP/1.1" 200 None
2026-03-28 14:08:12 [bca.uk] INFO: Scrape type for FV18%20YDD: 0
2026-03-28 14:08:12 [bca.uk] INFO: Found listing with ID: KD16%20EZL
2026-03-28 14:08:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KD16%2520EZL%27 HTTP/1.1" 200 None
2026-03-28 14:08:12 [bca.uk] INFO: Scrape type for KD16%20EZL: 0
2026-03-28 14:08:12 [bca.uk] INFO: Found listing with ID: YS63%20PYT
2026-03-28 14:08:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YS63%2520PYT%27 HTTP/1.1" 200 None
2026-03-28 14:08:12 [bca.uk] INFO: Scrape type for YS63%20PYT: 0
2026-03-28 14:08:12 [bca.uk] INFO: Found listing with ID: YS08%20YXV
2026-03-28 14:08:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YS08%2520YXV%27 HTTP/1.1" 200 None
2026-03-28 14:08:12 [bca.uk] INFO: Scrape type for YS08%20YXV: 0
2026-03-28 14:08:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698733472%27 HTTP/1.1" 200 None
2026-03-28 14:08:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698733472 not downloaded yet
2026-03-28 14:08:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/OY67JPV/698107879/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/OY67JPV/42810048?sv=2020-08-04&st=2026-03-28T14%3A03%3A48Z&se=2026-03-28T14%3A28%3A48Z&sr=b&sp=r&sig=3IQnxpRCaMGCrWPQZylbi%2BiY%2FkfXKw1FEE36W3dpRwo%3D)
2026-03-28 14:08:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698814326%27 HTTP/1.1" 200 None
2026-03-28 14:08:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698814326 not downloaded yet
2026-03-28 14:08:12 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FV17TYW/698767925/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698767925>
2026-03-28 14:08:12 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LN68RBY/698920244/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698920244>
2026-03-28 14:08:12 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WD19GOC/698733420/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698733420>
2026-03-28 14:08:12 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DA21SOU/697887996/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=697887996>
2026-03-28 14:08:12 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WP63USZ/698814279/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=WP63USZ-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-28 14:08:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698733479%27 HTTP/1.1" 200 None
2026-03-28 14:08:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698733479 not downloaded yet
2026-03-28 14:08:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:08:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c440390>
2026-03-28 14:08:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:08:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:08:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:08:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_18272ae4-7bc4-594a-a0ef-c08da1ce17ad/18272ae4-7bc4-594a-a0ef-c08da1ce17ad_expert_report_file_8f71e1f8-43b2-4e2f-ac11-3cd4cdaa4562.pdf HTTP/1.1" 201 0
2026-03-28 14:08:12 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item 18272ae4-7bc4-594a-a0ef-c08da1ce17ad
2026-03-28 14:08:12 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 18272ae4-7bc4-594a-a0ef-c08da1ce17ad, skipping ID generation
2026-03-28 14:08:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 18272ae4-7bc4-594a-a0ef-c08da1ce17ad
2026-03-28 14:08:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DTFZ8294-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-28 14:08:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=TFZ8294-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-28 14:08:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:08:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c5de250>
2026-03-28 14:08:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:08:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:08:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:08:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_946e6279-6e49-5961-b70a-53fd1b261e3f/946e6279-6e49-5961-b70a-53fd1b261e3f_expert_report_file_b4d02b54-7e20-4664-b1f8-42e3c5aaa0c2.pdf HTTP/1.1" 201 0
2026-03-28 14:08:12 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item 946e6279-6e49-5961-b70a-53fd1b261e3f
2026-03-28 14:08:12 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 946e6279-6e49-5961-b70a-53fd1b261e3f, skipping ID generation
2026-03-28 14:08:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 946e6279-6e49-5961-b70a-53fd1b261e3f
2026-03-28 14:08:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DWB19OHW-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-28 14:08:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=WB19OHW-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-28 14:08:12 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:08:12 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:08:12 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:08:12 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:08:12 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:08:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:08:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c440e10>
2026-03-28 14:08:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:08:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:08:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:08:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b6d51688-b23c-5016-a794-ddfbf11c9378/b6d51688-b23c-5016-a794-ddfbf11c9378_image_6.jpg HTTP/1.1" 201 0
2026-03-28 14:08:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FKU19CFH%252F697551217%252F600') HTTP/1.1" 204 0
2026-03-28 14:08:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KU19CFH/697551217/600 saved to cache
2026-03-28 14:08:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item b6d51688-b23c-5016-a794-ddfbf11c9378
2026-03-28 14:08:12 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:08:12 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:08:12 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:08:12 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:08:12 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:08:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:08:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c38ca90>
2026-03-28 14:08:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:08:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:08:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:08:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_04fa14f2-714c-5033-a1fe-bd0c784e7d7e/04fa14f2-714c-5033-a1fe-bd0c784e7d7e_image_6.jpg HTTP/1.1" 201 0
2026-03-28 14:08:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLN68RBY%252F698920267%252F600') HTTP/1.1" 204 0
2026-03-28 14:08:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LN68RBY/698920267/600 saved to cache
2026-03-28 14:08:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 04fa14f2-714c-5033-a1fe-bd0c784e7d7e
2026-03-28 14:08:12 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:08:12 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:08:12 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:08:12 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:08:12 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:08:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:08:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c127290>
2026-03-28 14:08:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:08:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:08:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:08:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1534762c-5952-5a28-84f7-7b27016558ac/1534762c-5952-5a28-84f7-7b27016558ac_image_6.jpg HTTP/1.1" 201 0
2026-03-28 14:08:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FDA21SOU%252F697888006%252F600') HTTP/1.1" 204 0
2026-03-28 14:08:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DA21SOU/697888006/600 saved to cache
2026-03-28 14:08:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 1534762c-5952-5a28-84f7-7b27016558ac
2026-03-28 14:08:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/RE68RYC/42807274?sv=2020-08-04&st=2026-03-28T14%3A08%3A07Z&se=2026-03-28T14%3A33%3A07Z&sr=b&sp=r&sig=2T9BQlp2w4jq0TOnJ2XRxIlj1g8XZKwhz0v6utga2zA%3D> (referer: https://www.bca.co.uk/)
2026-03-28 14:08:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698814347%27 HTTP/1.1" 200 None
2026-03-28 14:08:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698814347 not downloaded yet
2026-03-28 14:08:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698733484%27 HTTP/1.1" 200 None
2026-03-28 14:08:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698733484 not downloaded yet
2026-03-28 14:08:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698915549%27 HTTP/1.1" 200 None
2026-03-28 14:08:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698915549 not downloaded yet
2026-03-28 14:08:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698813815%27 HTTP/1.1" 200 None
2026-03-28 14:08:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698813815 not downloaded yet
2026-03-28 14:08:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698814361%27 HTTP/1.1" 200 None
2026-03-28 14:08:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698814361 not downloaded yet
2026-03-28 14:08:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:08:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2ca0c7d0>
2026-03-28 14:08:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:08:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:08:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:08:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7708aee7-65e8-597e-aa3d-426819c9c319/7708aee7-65e8-597e-aa3d-426819c9c319_image_1.jpg HTTP/1.1" 201 0
2026-03-28 14:08:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FOY67JPV%252F698107879%252F600') HTTP/1.1" 204 0
2026-03-28 14:08:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/OY67JPV/698107879/600 saved to cache
2026-03-28 14:08:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 7708aee7-65e8-597e-aa3d-426819c9c319
2026-03-28 14:08:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/NY11BJE/42808365?sv=2020-08-04&st=2026-03-28T14%3A08%3A06Z&se=2026-03-28T14%3A33%3A06Z&sr=b&sp=r&sig=BnHSFQIYk3fEUhH4zxeRM80fwfd2ygxBi8EnHswGMU8%3D> (referer: https://www.bca.co.uk/)
2026-03-28 14:08:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WD19GOC/698733386/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/WD19GOC/42806738?sv=2020-08-04&st=2026-03-28T14%3A08%3A02Z&se=2026-03-28T14%3A33%3A02Z&sr=b&sp=r&sig=T9osZMHtKGs6rKBj%2B14p7cPT3e2arLHsziTS%2BIeeX6Q%3D)
2026-03-28 14:08:12 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WD19GOC/698733455/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698733455>
2026-03-28 14:08:12 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WP63USZ/698814293/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698814293>
2026-03-28 14:08:12 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KU19CFH/697551197/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=697551197>
2026-03-28 14:08:12 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WD19GOC/698733444/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698733444>
2026-03-28 14:08:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FY66OTD/698150753/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/FY66OTD/42794791?sv=2020-08-04&st=2026-03-28T14%3A03%3A46Z&se=2026-03-28T14%3A28%3A46Z&sr=b&sp=r&sig=nyWr7cManqycrjqVh9Sq0fegCWU0XCSire1eKcJWKLA%3D)
2026-03-28 14:08:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698733492%27 HTTP/1.1" 200 None
2026-03-28 14:08:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698733492 not downloaded yet
2026-03-28 14:08:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698915566%27 HTTP/1.1" 200 None
2026-03-28 14:08:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698915566 not downloaded yet
2026-03-28 14:08:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698813840%27 HTTP/1.1" 200 None
2026-03-28 14:08:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698813840 not downloaded yet
2026-03-28 14:08:12 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/NG62MFN/42807554?sv=2020-08-04&st=2026-03-28T14%3A08%3A12Z&se=2026-03-28T14%3A33%3A12Z&sr=b&sp=r&sig=FqCCEbePcOVvU3L%2F4Oat9lmdrXLmWMLS0vWT9r6A37Y%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=NG62%20MFN-GB>
2026-03-28 14:08:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698814396%27 HTTP/1.1" 200 None
2026-03-28 14:08:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698814396 not downloaded yet
2026-03-28 14:08:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698733496%27 HTTP/1.1" 200 None
2026-03-28 14:08:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698733496 not downloaded yet
2026-03-28 14:08:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698915585%27 HTTP/1.1" 200 None
2026-03-28 14:08:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698915585 not downloaded yet
2026-03-28 14:08:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698813857%27 HTTP/1.1" 200 None
2026-03-28 14:08:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698813857 not downloaded yet
2026-03-28 14:08:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:08:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2dc01390>
2026-03-28 14:08:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:08:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:08:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:08:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9ca8d44e-82e3-5298-8ffc-858aa7ec23ad/9ca8d44e-82e3-5298-8ffc-858aa7ec23ad_expert_report_file_ba696875-6c30-4cb7-af98-7eb4ee2dd38b.pdf HTTP/1.1" 201 0
2026-03-28 14:08:12 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item 9ca8d44e-82e3-5298-8ffc-858aa7ec23ad
2026-03-28 14:08:12 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 9ca8d44e-82e3-5298-8ffc-858aa7ec23ad, skipping ID generation
2026-03-28 14:08:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 9ca8d44e-82e3-5298-8ffc-858aa7ec23ad
2026-03-28 14:08:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DRE68RYC-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-28 14:08:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=RE68RYC-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-28 14:08:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698814437%27 HTTP/1.1" 200 None
2026-03-28 14:08:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698814437 not downloaded yet
2026-03-28 14:08:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WP63USZ/698814279/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/WP63USZ/42807824?sv=2020-08-04&st=2026-03-28T14%3A08%3A02Z&se=2026-03-28T14%3A33%3A02Z&sr=b&sp=r&sig=5J8P%2B%2BDbXuvBahjgaBANg4jjcUvdaSd%2B3YMnV6APqM0%3D)
2026-03-28 14:08:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FV17TYW/698767925/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/FV17TYW/42807142?sv=2020-08-04&st=2026-03-28T14%3A03%3A46Z&se=2026-03-28T14%3A28%3A46Z&sr=b&sp=r&sig=3LbtNEGnFqYV4bS0F0%2BmsB%2FgfFSYLdditNDmvy7kudU%3D)
2026-03-28 14:08:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LN68RBY/698920244/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LN68RBY/42809684?sv=2020-08-04&st=2026-03-28T14%3A03%3A42Z&se=2026-03-28T14%3A28%3A42Z&sr=b&sp=r&sig=aIYqAxiZsHZDOcTozI0zzgpiaCRiEseqbYSKBZyhWQ4%3D)
2026-03-28 14:08:12 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WP63USZ/698814326/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698814326>
2026-03-28 14:08:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698915606%27 HTTP/1.1" 200 None
2026-03-28 14:08:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698915606 not downloaded yet
2026-03-28 14:08:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698813873%27 HTTP/1.1" 200 None
2026-03-28 14:08:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698813873 not downloaded yet
2026-03-28 14:08:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698766670%27 HTTP/1.1" 200 None
2026-03-28 14:08:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698766670 not downloaded yet
2026-03-28 14:08:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698814469%27 HTTP/1.1" 200 None
2026-03-28 14:08:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698814469 not downloaded yet
2026-03-28 14:08:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:08:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c626a90>
2026-03-28 14:08:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:08:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:08:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:08:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e7822f41-2074-585e-b916-185d4d55fb85/e7822f41-2074-585e-b916-185d4d55fb85_expert_report_file_831c2f35-1f04-4122-8361-9ee134fefead.pdf HTTP/1.1" 201 0
2026-03-28 14:08:13 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item e7822f41-2074-585e-b916-185d4d55fb85
2026-03-28 14:08:13 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: e7822f41-2074-585e-b916-185d4d55fb85, skipping ID generation
2026-03-28 14:08:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item e7822f41-2074-585e-b916-185d4d55fb85
2026-03-28 14:08:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DNY11BJE-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-28 14:08:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=NY11BJE-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-28 14:08:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:08:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2d9bedd0>
2026-03-28 14:08:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:08:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:08:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:08:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a1043301-1d6c-5ef5-8043-fba38100bdea/a1043301-1d6c-5ef5-8043-fba38100bdea_image_0.jpg HTTP/1.1" 201 0
2026-03-28 14:08:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FWD19GOC%252F698733386%252F600') HTTP/1.1" 204 0
2026-03-28 14:08:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WD19GOC/698733386/600 saved to cache
2026-03-28 14:08:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item a1043301-1d6c-5ef5-8043-fba38100bdea
2026-03-28 14:08:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:08:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2d9b18d0>
2026-03-28 14:08:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:08:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:08:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:08:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_40999011-32af-5ad3-a840-4cb8242ff02a/40999011-32af-5ad3-a840-4cb8242ff02a_image_1.jpg HTTP/1.1" 201 0
2026-03-28 14:08:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FFY66OTD%252F698150753%252F600') HTTP/1.1" 204 0
2026-03-28 14:08:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FY66OTD/698150753/600 saved to cache
2026-03-28 14:08:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 40999011-32af-5ad3-a840-4cb8242ff02a
2026-03-28 14:08:13 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WD19GOC/698733472/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698733472>
2026-03-28 14:08:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WD19GOC/698733444/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/WD19GOC/42806738?sv=2020-08-04&st=2026-03-28T14%3A08%3A02Z&se=2026-03-28T14%3A33%3A02Z&sr=b&sp=r&sig=T9osZMHtKGs6rKBj%2B14p7cPT3e2arLHsziTS%2BIeeX6Q%3D)
2026-03-28 14:08:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WD19GOC/698733420/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/WD19GOC/42806738?sv=2020-08-04&st=2026-03-28T14%3A08%3A02Z&se=2026-03-28T14%3A33%3A02Z&sr=b&sp=r&sig=T9osZMHtKGs6rKBj%2B14p7cPT3e2arLHsziTS%2BIeeX6Q%3D)
2026-03-28 14:08:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698915629%27 HTTP/1.1" 200 None
2026-03-28 14:08:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698915629 not downloaded yet
2026-03-28 14:08:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698813883%27 HTTP/1.1" 200 None
2026-03-28 14:08:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698813883 not downloaded yet
2026-03-28 14:08:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698766692%27 HTTP/1.1" 200 None
2026-03-28 14:08:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698766692 not downloaded yet
2026-03-28 14:08:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DA21SOU/697887996/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/DA21SOU/42810340?sv=2020-08-04&st=2026-03-28T14%3A03%3A42Z&se=2026-03-28T14%3A28%3A42Z&sr=b&sp=r&sig=6%2F4a%2BWc9n6QD4YiOi5mt3dZkPnMZj%2Bfh7208k4Rd3hI%3D)
2026-03-28 14:08:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698814502%27 HTTP/1.1" 200 None
2026-03-28 14:08:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698814502 not downloaded yet
2026-03-28 14:08:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698910349%27 HTTP/1.1" 200 None
2026-03-28 14:08:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698910349 not downloaded yet
2026-03-28 14:08:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698915658%27 HTTP/1.1" 200 None
2026-03-28 14:08:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698915658 not downloaded yet
2026-03-28 14:08:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698813902%27 HTTP/1.1" 200 None
2026-03-28 14:08:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698813902 not downloaded yet
2026-03-28 14:08:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698766716%27 HTTP/1.1" 200 None
2026-03-28 14:08:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698766716 not downloaded yet
2026-03-28 14:08:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.bca.co.uk/api/search?q=&pageSize=100&page=21&sort=MostRecentlyAdded> (referer: https://www.bca.co.uk/search) ['zyte-api']
2026-03-28 14:08:13 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WB19OHW/698813815/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698813815>
2026-03-28 14:08:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WP63USZ/698814293/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/WP63USZ/42807824?sv=2020-08-04&st=2026-03-28T14%3A08%3A02Z&se=2026-03-28T14%3A33%3A02Z&sr=b&sp=r&sig=5J8P%2B%2BDbXuvBahjgaBANg4jjcUvdaSd%2B3YMnV6APqM0%3D)
2026-03-28 14:08:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698910375%27 HTTP/1.1" 200 None
2026-03-28 14:08:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698910375 not downloaded yet
2026-03-28 14:08:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KU19CFH/697551197/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/KU19CFH/42809756?sv=2020-08-04&st=2026-03-28T14%3A03%3A45Z&se=2026-03-28T14%3A28%3A45Z&sr=b&sp=r&sig=1G7eR4FaPr%2BtRdJKW3arikyQmOCuk26xvavIORXr6y8%3D)
2026-03-28 14:08:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WD19GOC/698733455/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/WD19GOC/42806738?sv=2020-08-04&st=2026-03-28T14%3A08%3A02Z&se=2026-03-28T14%3A33%3A02Z&sr=b&sp=r&sig=T9osZMHtKGs6rKBj%2B14p7cPT3e2arLHsziTS%2BIeeX6Q%3D)
2026-03-28 14:08:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698915677%27 HTTP/1.1" 200 None
2026-03-28 14:08:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698915677 not downloaded yet
2026-03-28 14:08:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698813922%27 HTTP/1.1" 200 None
2026-03-28 14:08:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698813922 not downloaded yet
2026-03-28 14:08:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698766732%27 HTTP/1.1" 200 None
2026-03-28 14:08:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698766732 not downloaded yet
2026-03-28 14:08:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:08:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2d9b0a50>
2026-03-28 14:08:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:08:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:08:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:08:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_49f7b40c-fae2-5164-be3f-ce9eb1a2514d/49f7b40c-fae2-5164-be3f-ce9eb1a2514d_image_0.jpg HTTP/1.1" 201 0
2026-03-28 14:08:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FWP63USZ%252F698814279%252F600') HTTP/1.1" 204 0
2026-03-28 14:08:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WP63USZ/698814279/600 saved to cache
2026-03-28 14:08:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 49f7b40c-fae2-5164-be3f-ce9eb1a2514d
2026-03-28 14:08:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:08:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c9ebd10>
2026-03-28 14:08:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:08:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:08:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:08:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d7b30cd7-3fb2-520c-9629-4539584c6e2c/d7b30cd7-3fb2-520c-9629-4539584c6e2c_image_1.jpg HTTP/1.1" 201 0
2026-03-28 14:08:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FFV17TYW%252F698767925%252F600') HTTP/1.1" 204 0
2026-03-28 14:08:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FV17TYW/698767925/600 saved to cache
2026-03-28 14:08:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item d7b30cd7-3fb2-520c-9629-4539584c6e2c
2026-03-28 14:08:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:08:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a1fe62310>
2026-03-28 14:08:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:08:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:08:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:08:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_04fa14f2-714c-5033-a1fe-bd0c784e7d7e/04fa14f2-714c-5033-a1fe-bd0c784e7d7e_image_5.jpg HTTP/1.1" 201 0
2026-03-28 14:08:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLN68RBY%252F698920244%252F600') HTTP/1.1" 204 0
2026-03-28 14:08:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LN68RBY/698920244/600 saved to cache
2026-03-28 14:08:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 04fa14f2-714c-5033-a1fe-bd0c784e7d7e
2026-03-28 14:08:13 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WD19GOC/698733484/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698733484>
2026-03-28 14:08:13 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/TFZ8294/698915549/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698915549>
2026-03-28 14:08:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698910400%27 HTTP/1.1" 200 None
2026-03-28 14:08:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698910400 not downloaded yet
2026-03-28 14:08:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WP63USZ/698814326/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/WP63USZ/42807824?sv=2020-08-04&st=2026-03-28T14%3A08%3A02Z&se=2026-03-28T14%3A33%3A02Z&sr=b&sp=r&sig=5J8P%2B%2BDbXuvBahjgaBANg4jjcUvdaSd%2B3YMnV6APqM0%3D)
2026-03-28 14:08:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698915700%27 HTTP/1.1" 200 None
2026-03-28 14:08:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698915700 not downloaded yet
2026-03-28 14:08:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698813932%27 HTTP/1.1" 200 None
2026-03-28 14:08:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698813932 not downloaded yet
2026-03-28 14:08:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698766746%27 HTTP/1.1" 200 None
2026-03-28 14:08:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698766746 not downloaded yet
2026-03-28 14:08:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:08:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c9b0050>
2026-03-28 14:08:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:08:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:08:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:08:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a1043301-1d6c-5ef5-8043-fba38100bdea/a1043301-1d6c-5ef5-8043-fba38100bdea_image_2.jpg HTTP/1.1" 201 0
2026-03-28 14:08:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FWD19GOC%252F698733444%252F600') HTTP/1.1" 204 0
2026-03-28 14:08:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WD19GOC/698733444/600 saved to cache
2026-03-28 14:08:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item a1043301-1d6c-5ef5-8043-fba38100bdea
2026-03-28 14:08:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:08:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2d7373d0>
2026-03-28 14:08:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:08:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:08:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:08:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a1043301-1d6c-5ef5-8043-fba38100bdea/a1043301-1d6c-5ef5-8043-fba38100bdea_image_1.jpg HTTP/1.1" 201 0
2026-03-28 14:08:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FWD19GOC%252F698733420%252F600') HTTP/1.1" 204 0
2026-03-28 14:08:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WD19GOC/698733420/600 saved to cache
2026-03-28 14:08:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item a1043301-1d6c-5ef5-8043-fba38100bdea
2026-03-28 14:08:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:08:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c73cd10>
2026-03-28 14:08:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:08:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:08:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:08:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1534762c-5952-5a28-84f7-7b27016558ac/1534762c-5952-5a28-84f7-7b27016558ac_image_5.jpg HTTP/1.1" 201 0
2026-03-28 14:08:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FDA21SOU%252F697887996%252F600') HTTP/1.1" 204 0
2026-03-28 14:08:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DA21SOU/697887996/600 saved to cache
2026-03-28 14:08:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 1534762c-5952-5a28-84f7-7b27016558ac
2026-03-28 14:08:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698910418%27 HTTP/1.1" 200 None
2026-03-28 14:08:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698910418 not downloaded yet
2026-03-28 14:08:13 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WB19OHW/698813857/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698813857>
2026-03-28 14:08:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WD19GOC/698733472/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/WD19GOC/42806738?sv=2020-08-04&st=2026-03-28T14%3A08%3A02Z&se=2026-03-28T14%3A33%3A02Z&sr=b&sp=r&sig=T9osZMHtKGs6rKBj%2B14p7cPT3e2arLHsziTS%2BIeeX6Q%3D)
2026-03-28 14:08:13 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WP63USZ/698814437/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698814437>
2026-03-28 14:08:13 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RE68RYC/698766657/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=RE68RYC-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-28 14:08:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698915720%27 HTTP/1.1" 200 None
2026-03-28 14:08:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698915720 not downloaded yet
2026-03-28 14:08:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698813943%27 HTTP/1.1" 200 None
2026-03-28 14:08:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698813943 not downloaded yet
2026-03-28 14:08:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698766765%27 HTTP/1.1" 200 None
2026-03-28 14:08:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698766765 not downloaded yet
2026-03-28 14:08:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/NG62MFN/42807554?sv=2020-08-04&st=2026-03-28T14%3A08%3A12Z&se=2026-03-28T14%3A33%3A12Z&sr=b&sp=r&sig=FqCCEbePcOVvU3L%2F4Oat9lmdrXLmWMLS0vWT9r6A37Y%3D> (referer: https://www.bca.co.uk/)
2026-03-28 14:08:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698910433%27 HTTP/1.1" 200 None
2026-03-28 14:08:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698910433 not downloaded yet
2026-03-28 14:08:13 [bca.uk] INFO: Total items found: 100
2026-03-28 14:08:13 [bca.uk] INFO: Requesting URL: https://www.bca.co.uk/api/search?q=&pageSize=100&page=22&sort=MostRecentlyAdded
2026-03-28 14:08:13 [bca.uk] INFO: Sending search API request with Bearer token (length=1492)
2026-03-28 14:08:13 [scrapy_zyte_api._params] WARNING: Request <GET https://www.bca.co.uk/api/search?q=&pageSize=100&page=22&sort=MostRecentlyAdded> defines the Zyte API customHttpRequestHeaders parameter, overriding Request.headers. Use Request.headers instead.
2026-03-28 14:08:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:08:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c8a3d50>
2026-03-28 14:08:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:08:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:08:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:08:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_49f7b40c-fae2-5164-be3f-ce9eb1a2514d/49f7b40c-fae2-5164-be3f-ce9eb1a2514d_image_1.jpg HTTP/1.1" 201 0
2026-03-28 14:08:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FWP63USZ%252F698814293%252F600') HTTP/1.1" 204 0
2026-03-28 14:08:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WP63USZ/698814293/600 saved to cache
2026-03-28 14:08:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 49f7b40c-fae2-5164-be3f-ce9eb1a2514d
2026-03-28 14:08:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:08:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a1fe31710>
2026-03-28 14:08:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:08:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:08:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:08:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b6d51688-b23c-5016-a794-ddfbf11c9378/b6d51688-b23c-5016-a794-ddfbf11c9378_image_5.jpg HTTP/1.1" 201 0
2026-03-28 14:08:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FKU19CFH%252F697551197%252F600') HTTP/1.1" 204 0
2026-03-28 14:08:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KU19CFH/697551197/600 saved to cache
2026-03-28 14:08:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item b6d51688-b23c-5016-a794-ddfbf11c9378
2026-03-28 14:08:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:08:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2ca7fb90>
2026-03-28 14:08:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:08:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:08:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:08:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a1043301-1d6c-5ef5-8043-fba38100bdea/a1043301-1d6c-5ef5-8043-fba38100bdea_image_3.jpg HTTP/1.1" 201 0
2026-03-28 14:08:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FWD19GOC%252F698733455%252F600') HTTP/1.1" 204 0
2026-03-28 14:08:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WD19GOC/698733455/600 saved to cache
2026-03-28 14:08:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item a1043301-1d6c-5ef5-8043-fba38100bdea
2026-03-28 14:08:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:08:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a1fec7d10>
2026-03-28 14:08:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:08:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:08:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:08:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_49f7b40c-fae2-5164-be3f-ce9eb1a2514d/49f7b40c-fae2-5164-be3f-ce9eb1a2514d_image_3.jpg HTTP/1.1" 201 0
2026-03-28 14:08:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FWP63USZ%252F698814326%252F600') HTTP/1.1" 204 0
2026-03-28 14:08:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WP63USZ/698814326/600 saved to cache
2026-03-28 14:08:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 49f7b40c-fae2-5164-be3f-ce9eb1a2514d
2026-03-28 14:08:13 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NY11BJE/698910322/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=NY11BJE-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-28 14:08:13 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RE68RYC/698766670/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698766670>
2026-03-28 14:08:13 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WP63USZ/698814469/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698814469>
2026-03-28 14:08:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698766788%27 HTTP/1.1" 200 None
2026-03-28 14:08:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698766788 not downloaded yet
2026-03-28 14:08:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698910452%27 HTTP/1.1" 200 None
2026-03-28 14:08:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698910452 not downloaded yet
2026-03-28 14:08:13 [bca.uk] INFO: Found listing with ID: YS08%20ZJO
2026-03-28 14:08:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YS08%2520ZJO%27 HTTP/1.1" 200 None
2026-03-28 14:08:13 [bca.uk] INFO: Scrape type for YS08%20ZJO: 0
2026-03-28 14:08:13 [bca.uk] INFO: Found listing with ID: EK71%20HZV
2026-03-28 14:08:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27EK71%2520HZV%27 HTTP/1.1" 200 None
2026-03-28 14:08:13 [bca.uk] INFO: Scrape type for EK71%20HZV: 0
2026-03-28 14:08:13 [bca.uk] INFO: Found listing with ID: BT67%20OWK
2026-03-28 14:08:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BT67%2520OWK%27 HTTP/1.1" 200 None
2026-03-28 14:08:14 [bca.uk] INFO: Scrape type for BT67%20OWK: 0
2026-03-28 14:08:14 [bca.uk] INFO: Found listing with ID: RX65%20HHD
2026-03-28 14:08:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27RX65%2520HHD%27 HTTP/1.1" 200 None
2026-03-28 14:08:14 [bca.uk] INFO: Scrape type for RX65%20HHD: 0
2026-03-28 14:08:14 [bca.uk] INFO: Found listing with ID: VO68%20DSX
2026-03-28 14:08:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27VO68%2520DSX%27 HTTP/1.1" 200 None
2026-03-28 14:08:14 [bca.uk] INFO: Scrape type for VO68%20DSX: 0
2026-03-28 14:08:14 [bca.uk] INFO: Found listing with ID: YO19%20YDJ
2026-03-28 14:08:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YO19%2520YDJ%27 HTTP/1.1" 200 None
2026-03-28 14:08:14 [bca.uk] INFO: Scrape type for YO19%20YDJ: 0
2026-03-28 14:08:14 [bca.uk] INFO: Found listing with ID: KR18%20BKJ
2026-03-28 14:08:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KR18%2520BKJ%27 HTTP/1.1" 200 None
2026-03-28 14:08:14 [bca.uk] INFO: Scrape type for KR18%20BKJ: 0
2026-03-28 14:08:14 [bca.uk] INFO: Found listing with ID: WU13%20UEB
2026-03-28 14:08:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WU13%2520UEB%27 HTTP/1.1" 200 None
2026-03-28 14:08:14 [bca.uk] INFO: Scrape type for WU13%20UEB: 0
2026-03-28 14:08:14 [bca.uk] INFO: Found listing with ID: YN15%20UFJ
2026-03-28 14:08:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YN15%2520UFJ%27 HTTP/1.1" 200 None
2026-03-28 14:08:14 [bca.uk] INFO: Scrape type for YN15%20UFJ: 0
2026-03-28 14:08:14 [bca.uk] INFO: Found listing with ID: LS17%20GEO
2026-03-28 14:08:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LS17%2520GEO%27 HTTP/1.1" 200 None
2026-03-28 14:08:14 [bca.uk] INFO: Scrape type for LS17%20GEO: 0
2026-03-28 14:08:14 [bca.uk] INFO: Found listing with ID: SH14%20WXM
2026-03-28 14:08:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SH14%2520WXM%27 HTTP/1.1" 200 None
2026-03-28 14:08:14 [bca.uk] INFO: Scrape type for SH14%20WXM: 0
2026-03-28 14:08:14 [bca.uk] INFO: Found listing with ID: FX63%20YEF
2026-03-28 14:08:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FX63%2520YEF%27 HTTP/1.1" 200 None
2026-03-28 14:08:14 [bca.uk] INFO: Scrape type for FX63%20YEF: 0
2026-03-28 14:08:14 [bca.uk] INFO: Found listing with ID: FP65%20TEO
2026-03-28 14:08:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FP65%2520TEO%27 HTTP/1.1" 200 None
2026-03-28 14:08:14 [bca.uk] INFO: Scrape type for FP65%20TEO: 0
2026-03-28 14:08:14 [bca.uk] INFO: Found listing with ID: AV68%20GXP
2026-03-28 14:08:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27AV68%2520GXP%27 HTTP/1.1" 200 None
2026-03-28 14:08:14 [bca.uk] INFO: Scrape type for AV68%20GXP: 0
2026-03-28 14:08:14 [bca.uk] INFO: Found listing with ID: SC68%20NNM
2026-03-28 14:08:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SC68%2520NNM%27 HTTP/1.1" 200 None
2026-03-28 14:08:14 [bca.uk] INFO: Scrape type for SC68%20NNM: 0
2026-03-28 14:08:14 [bca.uk] INFO: Found listing with ID: MK61%20GYH
2026-03-28 14:08:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MK61%2520GYH%27 HTTP/1.1" 200 None
2026-03-28 14:08:14 [bca.uk] INFO: Scrape type for MK61%20GYH: 0
2026-03-28 14:08:14 [bca.uk] INFO: Found listing with ID: FV08%20DGX
2026-03-28 14:08:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FV08%2520DGX%27 HTTP/1.1" 200 None
2026-03-28 14:08:14 [bca.uk] INFO: Scrape type for FV08%20DGX: 0
2026-03-28 14:08:14 [bca.uk] INFO: Found listing with ID: FG18%20GHU
2026-03-28 14:08:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FG18%2520GHU%27 HTTP/1.1" 200 None
2026-03-28 14:08:14 [bca.uk] INFO: Scrape type for FG18%20GHU: 0
2026-03-28 14:08:14 [bca.uk] INFO: Found listing with ID: FG64%20LKJ
2026-03-28 14:08:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FG64%2520LKJ%27 HTTP/1.1" 200 None
2026-03-28 14:08:14 [bca.uk] INFO: Scrape type for FG64%20LKJ: 0
2026-03-28 14:08:14 [bca.uk] INFO: Found listing with ID: WX17%20XDB
2026-03-28 14:08:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WX17%2520XDB%27 HTTP/1.1" 200 None
2026-03-28 14:08:14 [bca.uk] INFO: Scrape type for WX17%20XDB: 0
2026-03-28 14:08:14 [bca.uk] INFO: Found listing with ID: YF68%20LHH
2026-03-28 14:08:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YF68%2520LHH%27 HTTP/1.1" 200 None
2026-03-28 14:08:14 [bca.uk] INFO: Scrape type for YF68%20LHH: 0
2026-03-28 14:08:14 [bca.uk] INFO: Found listing with ID: YC17%20AVU
2026-03-28 14:08:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YC17%2520AVU%27 HTTP/1.1" 200 None
2026-03-28 14:08:14 [bca.uk] INFO: Scrape type for YC17%20AVU: 0
2026-03-28 14:08:14 [bca.uk] INFO: Found listing with ID: LV62%20VKA
2026-03-28 14:08:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LV62%2520VKA%27 HTTP/1.1" 200 None
2026-03-28 14:08:14 [bca.uk] INFO: Scrape type for LV62%20VKA: 0
2026-03-28 14:08:14 [bca.uk] INFO: Found listing with ID: MT14%20SOU
2026-03-28 14:08:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MT14%2520SOU%27 HTTP/1.1" 200 None
2026-03-28 14:08:14 [bca.uk] INFO: Scrape type for MT14%20SOU: 0
2026-03-28 14:08:14 [bca.uk] INFO: Found listing with ID: NG63%20RMZ
2026-03-28 14:08:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27NG63%2520RMZ%27 HTTP/1.1" 200 None
2026-03-28 14:08:14 [bca.uk] INFO: Scrape type for NG63%20RMZ: 0
2026-03-28 14:08:14 [bca.uk] INFO: Found listing with ID: VU66%20URO
2026-03-28 14:08:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27VU66%2520URO%27 HTTP/1.1" 200 None
2026-03-28 14:08:14 [bca.uk] INFO: Scrape type for VU66%20URO: 0
2026-03-28 14:08:14 [bca.uk] INFO: Found listing with ID: GX14%20TLV
2026-03-28 14:08:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GX14%2520TLV%27 HTTP/1.1" 200 None
2026-03-28 14:08:14 [bca.uk] INFO: Scrape type for GX14%20TLV: 0
2026-03-28 14:08:14 [bca.uk] INFO: Found listing with ID: NA64%20UVD
2026-03-28 14:08:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27NA64%2520UVD%27 HTTP/1.1" 200 None
2026-03-28 14:08:14 [bca.uk] INFO: Scrape type for NA64%20UVD: 0
2026-03-28 14:08:14 [bca.uk] INFO: Found listing with ID: NJ12%20XTN
2026-03-28 14:08:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27NJ12%2520XTN%27 HTTP/1.1" 200 None
2026-03-28 14:08:14 [bca.uk] INFO: Scrape type for NJ12%20XTN: 0
2026-03-28 14:08:14 [bca.uk] INFO: Found listing with ID: VN14%20HVP
2026-03-28 14:08:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27VN14%2520HVP%27 HTTP/1.1" 200 None
2026-03-28 14:08:14 [bca.uk] INFO: Scrape type for VN14%20HVP: 0
2026-03-28 14:08:14 [bca.uk] INFO: Found listing with ID: NV66%20ZTE
2026-03-28 14:08:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27NV66%2520ZTE%27 HTTP/1.1" 200 None
2026-03-28 14:08:14 [bca.uk] INFO: Scrape type for NV66%20ZTE: 0
2026-03-28 14:08:14 [bca.uk] INFO: Found listing with ID: BF65%20FCL
2026-03-28 14:08:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BF65%2520FCL%27 HTTP/1.1" 200 None
2026-03-28 14:08:14 [bca.uk] INFO: Scrape type for BF65%20FCL: 0
2026-03-28 14:08:14 [bca.uk] INFO: Found listing with ID: CE63%20PBY
2026-03-28 14:08:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27CE63%2520PBY%27 HTTP/1.1" 200 None
2026-03-28 14:08:14 [bca.uk] INFO: Scrape type for CE63%20PBY: 0
2026-03-28 14:08:14 [bca.uk] INFO: Found listing with ID: YY59%20CYA
2026-03-28 14:08:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YY59%2520CYA%27 HTTP/1.1" 200 None
2026-03-28 14:08:14 [bca.uk] INFO: Scrape type for YY59%20CYA: 0
2026-03-28 14:08:14 [bca.uk] INFO: Found listing with ID: HV67%20RZT
2026-03-28 14:08:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27HV67%2520RZT%27 HTTP/1.1" 200 None
2026-03-28 14:08:14 [bca.uk] INFO: Scrape type for HV67%20RZT: 0
2026-03-28 14:08:14 [bca.uk] INFO: Found listing with ID: GJ60%20KJA
2026-03-28 14:08:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GJ60%2520KJA%27 HTTP/1.1" 200 None
2026-03-28 14:08:14 [bca.uk] INFO: Scrape type for GJ60%20KJA: 0
2026-03-28 14:08:14 [bca.uk] INFO: Found listing with ID: SB60%20CNO
2026-03-28 14:08:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SB60%2520CNO%27 HTTP/1.1" 200 None
2026-03-28 14:08:14 [bca.uk] INFO: Scrape type for SB60%20CNO: 0
2026-03-28 14:08:14 [bca.uk] INFO: Found listing with ID: YP06%20NXZ
2026-03-28 14:08:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YP06%2520NXZ%27 HTTP/1.1" 200 None
2026-03-28 14:08:14 [bca.uk] INFO: Scrape type for YP06%20NXZ: 0
2026-03-28 14:08:14 [bca.uk] INFO: Found listing with ID: EJ66%20XPA
2026-03-28 14:08:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27EJ66%2520XPA%27 HTTP/1.1" 200 None
2026-03-28 14:08:14 [bca.uk] INFO: Scrape type for EJ66%20XPA: 0
2026-03-28 14:08:14 [bca.uk] INFO: Found listing with ID: BK13%20TGJ
2026-03-28 14:08:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BK13%2520TGJ%27 HTTP/1.1" 200 None
2026-03-28 14:08:14 [bca.uk] INFO: Scrape type for BK13%20TGJ: 0
2026-03-28 14:08:14 [bca.uk] INFO: Found listing with ID: NU14%20YFL
2026-03-28 14:08:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27NU14%2520YFL%27 HTTP/1.1" 200 None
2026-03-28 14:08:14 [bca.uk] INFO: Scrape type for NU14%20YFL: 0
2026-03-28 14:08:14 [bca.uk] INFO: Found listing with ID: SK12%20HUV
2026-03-28 14:08:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SK12%2520HUV%27 HTTP/1.1" 200 None
2026-03-28 14:08:14 [bca.uk] INFO: Scrape type for SK12%20HUV: 0
2026-03-28 14:08:14 [bca.uk] INFO: Found listing with ID: NU68%20WCD
2026-03-28 14:08:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27NU68%2520WCD%27 HTTP/1.1" 200 None
2026-03-28 14:08:14 [bca.uk] INFO: Scrape type for NU68%20WCD: 0
2026-03-28 14:08:14 [bca.uk] INFO: Found listing with ID: NV11%20BAO
2026-03-28 14:08:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27NV11%2520BAO%27 HTTP/1.1" 200 None
2026-03-28 14:08:14 [bca.uk] INFO: Scrape type for NV11%20BAO: 0
2026-03-28 14:08:14 [bca.uk] INFO: Found listing with ID: NX63%20OSO
2026-03-28 14:08:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27NX63%2520OSO%27 HTTP/1.1" 200 None
2026-03-28 14:08:14 [bca.uk] INFO: Scrape type for NX63%20OSO: 0
2026-03-28 14:08:14 [bca.uk] INFO: Found listing with ID: NU66%20UWF
2026-03-28 14:08:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27NU66%2520UWF%27 HTTP/1.1" 200 None
2026-03-28 14:08:14 [bca.uk] INFO: Scrape type for NU66%20UWF: 0
2026-03-28 14:08:14 [bca.uk] INFO: Found listing with ID: OV19%20NWU
2026-03-28 14:08:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27OV19%2520NWU%27 HTTP/1.1" 200 None
2026-03-28 14:08:14 [bca.uk] INFO: Scrape type for OV19%20NWU: 0
2026-03-28 14:08:14 [bca.uk] INFO: Found listing with ID: DS65%20WCC
2026-03-28 14:08:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DS65%2520WCC%27 HTTP/1.1" 200 None
2026-03-28 14:08:14 [bca.uk] INFO: Scrape type for DS65%20WCC: 0
2026-03-28 14:08:14 [bca.uk] INFO: Found listing with ID: ND12%20FCP
2026-03-28 14:08:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27ND12%2520FCP%27 HTTP/1.1" 200 None
2026-03-28 14:08:14 [bca.uk] INFO: Scrape type for ND12%20FCP: 0
2026-03-28 14:08:14 [bca.uk] INFO: Found listing with ID: VO11%20WKT
2026-03-28 14:08:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27VO11%2520WKT%27 HTTP/1.1" 200 None
2026-03-28 14:08:14 [bca.uk] INFO: Scrape type for VO11%20WKT: 0
2026-03-28 14:08:14 [bca.uk] INFO: Found listing with ID: SJ15%20VEV
2026-03-28 14:08:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SJ15%2520VEV%27 HTTP/1.1" 200 None
2026-03-28 14:08:14 [bca.uk] INFO: Scrape type for SJ15%20VEV: 2
2026-03-28 14:08:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 662da1bf-c0f8-5d45-815d-2e1dfaca361a with identifier: SJ15%20VEV
2026-03-28 14:08:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 662da1bf-c0f8-5d45-815d-2e1dfaca361a with scrape type 2
2026-03-28 14:08:14 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 662da1bf-c0f8-5d45-815d-2e1dfaca361a with scrape type 2
2026-03-28 14:08:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 662da1bf-c0f8-5d45-815d-2e1dfaca361a, identifier: SJ15%20VEV
2026-03-28 14:08:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698766812%27 HTTP/1.1" 200 None
2026-03-28 14:08:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698766812 not downloaded yet
2026-03-28 14:08:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 662da1bf-c0f8-5d45-815d-2e1dfaca361a with identifier: SJ15%20VEV
2026-03-28 14:08:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 662da1bf-c0f8-5d45-815d-2e1dfaca361a with identifier: SJ15%20VEV
2026-03-28 14:08:15 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 662da1bf-c0f8-5d45-815d-2e1dfaca361a with identifier: SJ15%20VEV to the API
2026-03-28 14:08:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:08:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:08:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=21&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 177,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=SJ15%20VEV-GB',
'category': 'Car',
'color': 'black',
'currency': 'GBP',
'doors_number': 5,
'engine': '2.0L',
'expiration_date': '2026-04-01T10:00:00Z',
'fuel_type': 'Petrol',
'id': '662da1bf-c0f8-5d45-815d-2e1dfaca361a',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'SJ15 VEV',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=SJ15%20VEV&vehicleType=*',
'listing': 'auction',
'location': 'Newcastle-u-Tyne',
'make': 'HONDA',
'model': 'CR-V',
'odometer': 92853,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-01-01',
'seller_name': None,
'title': 'HONDA CR-V 2.0 I-VTEC EX 4WD StationWagon',
'transmission': 'manual',
'trim': 'I-VTEC EX 4WD',
'vin': 'SHSRE5790EU016604',
'year': 2015}
2026-03-28 14:08:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SJ15%2520VEV%27 HTTP/1.1" 200 None
2026-03-28 14:08:15 [bca.uk] INFO: Saving data for SJ15%20VEV: {'auction_closing_time': 1775037600.0, 'created_time': 1773837632.042262, 'last_price_update_time': 1774706895.565814}
2026-03-28 14:08:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='SJ15%2520VEV') HTTP/1.1" 204 0
2026-03-28 14:08:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:08:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2ca71810>
2026-03-28 14:08:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:08:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:08:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:08:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a1043301-1d6c-5ef5-8043-fba38100bdea/a1043301-1d6c-5ef5-8043-fba38100bdea_image_5.jpg HTTP/1.1" 201 0
2026-03-28 14:08:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FWD19GOC%252F698733472%252F600') HTTP/1.1" 204 0
2026-03-28 14:08:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WD19GOC/698733472/600 saved to cache
2026-03-28 14:08:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item a1043301-1d6c-5ef5-8043-fba38100bdea
2026-03-28 14:08:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:08:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c474350>
2026-03-28 14:08:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:08:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:08:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:08:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ee540c51-cf33-581e-8fef-9e70457b2cad/ee540c51-cf33-581e-8fef-9e70457b2cad_expert_report_file_a101e0f1-f1ab-4146-a63b-43114c6263eb.pdf HTTP/1.1" 201 0
2026-03-28 14:08:15 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item ee540c51-cf33-581e-8fef-9e70457b2cad
2026-03-28 14:08:15 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: ee540c51-cf33-581e-8fef-9e70457b2cad, skipping ID generation
2026-03-28 14:08:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item ee540c51-cf33-581e-8fef-9e70457b2cad
2026-03-28 14:08:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DNG62MFN-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-28 14:08:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=NG62MFN-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-28 14:08:15 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RE68RYC/698766716/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698766716>
2026-03-28 14:08:15 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WB19OHW/698813902/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698813902>
2026-03-28 14:08:15 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/TFZ8294/698915658/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698915658>
2026-03-28 14:08:15 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NY11BJE/698910349/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698910349>
2026-03-28 14:08:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WB19OHW/698813815/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/WB19OHW/42808333?sv=2020-08-04&st=2026-03-28T14%3A08%3A05Z&se=2026-03-28T14%3A33%3A05Z&sr=b&sp=r&sig=1tPrGuzNeNTywf9es7t2uJatudSyGSBqwxwUQUNO5j8%3D)
2026-03-28 14:08:15 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RE68RYC/698766732/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698766732>
2026-03-28 14:08:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WD19GOC/698733484/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/WD19GOC/42806738?sv=2020-08-04&st=2026-03-28T14%3A08%3A02Z&se=2026-03-28T14%3A33%3A02Z&sr=b&sp=r&sig=T9osZMHtKGs6rKBj%2B14p7cPT3e2arLHsziTS%2BIeeX6Q%3D)
2026-03-28 14:08:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/TFZ8294/698915549/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/TFZ8294/42809548?sv=2020-08-04&st=2026-03-28T14%3A08%3A05Z&se=2026-03-28T14%3A33%3A05Z&sr=b&sp=r&sig=ErLZlBqdyCWgCZpWR0ce5C0%2FBbCxi3QUVQkCi%2FMXrM0%3D)
2026-03-28 14:08:15 [scrapy_zyte_api._params] WARNING: Request <GET https://www.bca.co.uk/api/search?q=&pageSize=100&page=22&sort=MostRecentlyAdded> defines the Zyte API customHttpRequestHeaders parameter, overriding Request.headers. Use Request.headers instead.
2026-03-28 14:08:15 [scrapy_zyte_api._params] WARNING: Request <GET https://www.bca.co.uk/api/search?q=&pageSize=100&page=22&sort=MostRecentlyAdded> defines the Zyte API customHttpRequestHeaders parameter, overriding Request.headers. Use Request.headers instead.
2026-03-28 14:08:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698910477%27 HTTP/1.1" 200 None
2026-03-28 14:08:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698910477 not downloaded yet
2026-03-28 14:08:15 [bca.uk] INFO: Found listing with ID: ND13%20HSY
2026-03-28 14:08:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27ND13%2520HSY%27 HTTP/1.1" 200 None
2026-03-28 14:08:15 [bca.uk] INFO: Scrape type for ND13%20HSY: 0
2026-03-28 14:08:15 [bca.uk] INFO: Found listing with ID: ND15%20SFU
2026-03-28 14:08:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27ND15%2520SFU%27 HTTP/1.1" 200 None
2026-03-28 14:08:15 [bca.uk] INFO: Scrape type for ND15%20SFU: 0
2026-03-28 14:08:15 [bca.uk] INFO: Found listing with ID: ND53%20EJZ
2026-03-28 14:08:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27ND53%2520EJZ%27 HTTP/1.1" 200 None
2026-03-28 14:08:15 [bca.uk] INFO: Scrape type for ND53%20EJZ: 0
2026-03-28 14:08:15 [bca.uk] INFO: Found listing with ID: SL10%20HRP
2026-03-28 14:08:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SL10%2520HRP%27 HTTP/1.1" 200 None
2026-03-28 14:08:15 [bca.uk] INFO: Scrape type for SL10%20HRP: 0
2026-03-28 14:08:15 [bca.uk] INFO: Found listing with ID: FE64%20FGV
2026-03-28 14:08:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FE64%2520FGV%27 HTTP/1.1" 200 None
2026-03-28 14:08:15 [bca.uk] INFO: Scrape type for FE64%20FGV: 0
2026-03-28 14:08:15 [bca.uk] INFO: Found listing with ID: A13%20MVN
2026-03-28 14:08:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27A13%2520MVN%27 HTTP/1.1" 200 None
2026-03-28 14:08:15 [bca.uk] INFO: Scrape type for A13%20MVN: 0
2026-03-28 14:08:15 [bca.uk] INFO: Found listing with ID: AK17%20GUU
2026-03-28 14:08:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27AK17%2520GUU%27 HTTP/1.1" 200 None
2026-03-28 14:08:15 [bca.uk] INFO: Scrape type for AK17%20GUU: 0
2026-03-28 14:08:15 [bca.uk] INFO: Found listing with ID: NG15%20FSV
2026-03-28 14:08:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27NG15%2520FSV%27 HTTP/1.1" 200 None
2026-03-28 14:08:15 [bca.uk] INFO: Scrape type for NG15%20FSV: 0
2026-03-28 14:08:15 [bca.uk] INFO: Found listing with ID: NX64%20XJU
2026-03-28 14:08:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27NX64%2520XJU%27 HTTP/1.1" 200 None
2026-03-28 14:08:15 [bca.uk] INFO: Scrape type for NX64%20XJU: 0
2026-03-28 14:08:15 [bca.uk] INFO: Found listing with ID: PX17%20KLK
2026-03-28 14:08:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27PX17%2520KLK%27 HTTP/1.1" 200 None
2026-03-28 14:08:15 [bca.uk] INFO: Scrape type for PX17%20KLK: 0
2026-03-28 14:08:15 [bca.uk] INFO: Found listing with ID: XJZ%202720
2026-03-28 14:08:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27XJZ%25202720%27 HTTP/1.1" 200 None
2026-03-28 14:08:15 [bca.uk] INFO: Scrape type for XJZ%202720: 0
2026-03-28 14:08:15 [bca.uk] INFO: Found listing with ID: YB66%20XOJ
2026-03-28 14:08:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YB66%2520XOJ%27 HTTP/1.1" 200 None
2026-03-28 14:08:16 [bca.uk] INFO: Scrape type for YB66%20XOJ: 0
2026-03-28 14:08:16 [bca.uk] INFO: Found listing with ID: SB63%20LBV
2026-03-28 14:08:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SB63%2520LBV%27 HTTP/1.1" 200 None
2026-03-28 14:08:16 [bca.uk] INFO: Scrape type for SB63%20LBV: 0
2026-03-28 14:08:16 [bca.uk] INFO: Found listing with ID: NG09%20OHE
2026-03-28 14:08:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27NG09%2520OHE%27 HTTP/1.1" 200 None
2026-03-28 14:08:16 [bca.uk] INFO: Scrape type for NG09%20OHE: 0
2026-03-28 14:08:16 [bca.uk] INFO: Found listing with ID: NL14%20EJE
2026-03-28 14:08:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27NL14%2520EJE%27 HTTP/1.1" 200 None
2026-03-28 14:08:16 [bca.uk] INFO: Scrape type for NL14%20EJE: 0
2026-03-28 14:08:16 [bca.uk] INFO: Found listing with ID: NL64%20FPJ
2026-03-28 14:08:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27NL64%2520FPJ%27 HTTP/1.1" 200 None
2026-03-28 14:08:16 [bca.uk] INFO: Scrape type for NL64%20FPJ: 0
2026-03-28 14:08:16 [bca.uk] INFO: Found listing with ID: SN13%20ZFP
2026-03-28 14:08:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SN13%2520ZFP%27 HTTP/1.1" 200 None
2026-03-28 14:08:16 [bca.uk] INFO: Scrape type for SN13%20ZFP: 0
2026-03-28 14:08:16 [bca.uk] INFO: Found listing with ID: SD20%20GGV
2026-03-28 14:08:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SD20%2520GGV%27 HTTP/1.1" 200 None
2026-03-28 14:08:16 [bca.uk] INFO: Scrape type for SD20%20GGV: 0
2026-03-28 14:08:16 [bca.uk] INFO: Found listing with ID: DT70%20EYC
2026-03-28 14:08:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DT70%2520EYC%27 HTTP/1.1" 200 None
2026-03-28 14:08:16 [bca.uk] INFO: Scrape type for DT70%20EYC: 0
2026-03-28 14:08:16 [bca.uk] INFO: Found listing with ID: NG17%20OYT
2026-03-28 14:08:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27NG17%2520OYT%27 HTTP/1.1" 200 None
2026-03-28 14:08:16 [bca.uk] INFO: Scrape type for NG17%20OYT: 0
2026-03-28 14:08:16 [bca.uk] INFO: Found listing with ID: RV12%20YXK
2026-03-28 14:08:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27RV12%2520YXK%27 HTTP/1.1" 200 None
2026-03-28 14:08:16 [bca.uk] INFO: Scrape type for RV12%20YXK: 0
2026-03-28 14:08:16 [bca.uk] INFO: Found listing with ID: SG16%20NZO
2026-03-28 14:08:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SG16%2520NZO%27 HTTP/1.1" 200 None
2026-03-28 14:08:16 [bca.uk] INFO: Scrape type for SG16%20NZO: 0
2026-03-28 14:08:16 [bca.uk] INFO: Found listing with ID: SH63%20LDY
2026-03-28 14:08:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SH63%2520LDY%27 HTTP/1.1" 200 None
2026-03-28 14:08:16 [bca.uk] INFO: Scrape type for SH63%20LDY: 0
2026-03-28 14:08:16 [bca.uk] INFO: Found listing with ID: NJ58%20LNC
2026-03-28 14:08:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27NJ58%2520LNC%27 HTTP/1.1" 200 None
2026-03-28 14:08:16 [bca.uk] INFO: Scrape type for NJ58%20LNC: 0
2026-03-28 14:08:16 [bca.uk] INFO: Found listing with ID: AF70%20ZNZ
2026-03-28 14:08:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27AF70%2520ZNZ%27 HTTP/1.1" 200 None
2026-03-28 14:08:16 [bca.uk] INFO: Scrape type for AF70%20ZNZ: 0
2026-03-28 14:08:16 [bca.uk] INFO: Found listing with ID: HK66%20JFA
2026-03-28 14:08:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27HK66%2520JFA%27 HTTP/1.1" 200 None
2026-03-28 14:08:16 [bca.uk] INFO: Scrape type for HK66%20JFA: 0
2026-03-28 14:08:16 [bca.uk] INFO: Found listing with ID: PN64%20HCG
2026-03-28 14:08:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27PN64%2520HCG%27 HTTP/1.1" 200 None
2026-03-28 14:08:16 [bca.uk] INFO: Scrape type for PN64%20HCG: 0
2026-03-28 14:08:16 [bca.uk] INFO: Found listing with ID: YA17%20WGF
2026-03-28 14:08:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YA17%2520WGF%27 HTTP/1.1" 200 None
2026-03-28 14:08:16 [bca.uk] INFO: Scrape type for YA17%20WGF: 0
2026-03-28 14:08:16 [bca.uk] INFO: Found listing with ID: DV65%20WKF
2026-03-28 14:08:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DV65%2520WKF%27 HTTP/1.1" 200 None
2026-03-28 14:08:16 [bca.uk] INFO: Scrape type for DV65%20WKF: 0
2026-03-28 14:08:16 [bca.uk] INFO: Found listing with ID: KU66%20ZTZ
2026-03-28 14:08:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KU66%2520ZTZ%27 HTTP/1.1" 200 None
2026-03-28 14:08:16 [bca.uk] INFO: Scrape type for KU66%20ZTZ: 0
2026-03-28 14:08:16 [bca.uk] INFO: Found listing with ID: YR66%20PXG
2026-03-28 14:08:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YR66%2520PXG%27 HTTP/1.1" 200 None
2026-03-28 14:08:16 [bca.uk] INFO: Scrape type for YR66%20PXG: 0
2026-03-28 14:08:16 [bca.uk] INFO: Found listing with ID: AO65%20UZE
2026-03-28 14:08:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27AO65%2520UZE%27 HTTP/1.1" 200 None
2026-03-28 14:08:16 [bca.uk] INFO: Scrape type for AO65%20UZE: 0
2026-03-28 14:08:16 [bca.uk] INFO: Found listing with ID: FA15%20RVP
2026-03-28 14:08:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FA15%2520RVP%27 HTTP/1.1" 200 None
2026-03-28 14:08:16 [bca.uk] INFO: Scrape type for FA15%20RVP: 0
2026-03-28 14:08:16 [bca.uk] INFO: Found listing with ID: AY18%20HNV
2026-03-28 14:08:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27AY18%2520HNV%27 HTTP/1.1" 200 None
2026-03-28 14:08:16 [bca.uk] INFO: Scrape type for AY18%20HNV: 0
2026-03-28 14:08:16 [bca.uk] INFO: Found listing with ID: LL66%20FWD
2026-03-28 14:08:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LL66%2520FWD%27 HTTP/1.1" 200 None
2026-03-28 14:08:16 [bca.uk] INFO: Scrape type for LL66%20FWD: 0
2026-03-28 14:08:16 [bca.uk] INFO: Found listing with ID: AO10%20TKU
2026-03-28 14:08:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27AO10%2520TKU%27 HTTP/1.1" 200 None
2026-03-28 14:08:16 [bca.uk] INFO: Scrape type for AO10%20TKU: 0
2026-03-28 14:08:16 [bca.uk] INFO: Found listing with ID: WG17%20UXC
2026-03-28 14:08:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WG17%2520UXC%27 HTTP/1.1" 200 None
2026-03-28 14:08:16 [bca.uk] INFO: Scrape type for WG17%20UXC: 0
2026-03-28 14:08:16 [bca.uk] INFO: Found listing with ID: YK59%20SRO
2026-03-28 14:08:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YK59%2520SRO%27 HTTP/1.1" 200 None
2026-03-28 14:08:16 [bca.uk] INFO: Scrape type for YK59%20SRO: 0
2026-03-28 14:08:16 [bca.uk] INFO: Found listing with ID: WF67%20DFL
2026-03-28 14:08:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WF67%2520DFL%27 HTTP/1.1" 200 None
2026-03-28 14:08:16 [bca.uk] INFO: Scrape type for WF67%20DFL: 0
2026-03-28 14:08:16 [bca.uk] INFO: Found listing with ID: RX72%20LTT
2026-03-28 14:08:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27RX72%2520LTT%27 HTTP/1.1" 200 None
2026-03-28 14:08:16 [bca.uk] INFO: Scrape type for RX72%20LTT: 0
2026-03-28 14:08:16 [bca.uk] INFO: Found listing with ID: FV10%20XXD
2026-03-28 14:08:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FV10%2520XXD%27 HTTP/1.1" 200 None
2026-03-28 14:08:16 [bca.uk] INFO: Scrape type for FV10%20XXD: 0
2026-03-28 14:08:16 [bca.uk] INFO: Found listing with ID: WK61%20ZTU
2026-03-28 14:08:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WK61%2520ZTU%27 HTTP/1.1" 200 None
2026-03-28 14:08:16 [bca.uk] INFO: Scrape type for WK61%20ZTU: 0
2026-03-28 14:08:16 [bca.uk] INFO: Found listing with ID: BU18%20NGO
2026-03-28 14:08:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BU18%2520NGO%27 HTTP/1.1" 200 None
2026-03-28 14:08:16 [bca.uk] INFO: Scrape type for BU18%20NGO: 0
2026-03-28 14:08:16 [bca.uk] INFO: Found listing with ID: RO63%20YYB
2026-03-28 14:08:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27RO63%2520YYB%27 HTTP/1.1" 200 None
2026-03-28 14:08:16 [bca.uk] INFO: Scrape type for RO63%20YYB: 0
2026-03-28 14:08:16 [bca.uk] INFO: Found listing with ID: OW15%20CWM
2026-03-28 14:08:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27OW15%2520CWM%27 HTTP/1.1" 200 None
2026-03-28 14:08:16 [bca.uk] INFO: Scrape type for OW15%20CWM: 0
2026-03-28 14:08:16 [bca.uk] INFO: Found listing with ID: WD21%20HYN
2026-03-28 14:08:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WD21%2520HYN%27 HTTP/1.1" 200 None
2026-03-28 14:08:16 [bca.uk] INFO: Scrape type for WD21%20HYN: 0
2026-03-28 14:08:16 [bca.uk] INFO: Found listing with ID: VN64%20GJE
2026-03-28 14:08:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27VN64%2520GJE%27 HTTP/1.1" 200 None
2026-03-28 14:08:16 [bca.uk] INFO: Scrape type for VN64%20GJE: 0
2026-03-28 14:08:16 [bca.uk] INFO: Found listing with ID: WA22%20OGO
2026-03-28 14:08:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WA22%2520OGO%27 HTTP/1.1" 200 None
2026-03-28 14:08:16 [bca.uk] INFO: Scrape type for WA22%20OGO: 0
2026-03-28 14:08:16 [bca.uk] INFO: Found listing with ID: WF63%20PZN
2026-03-28 14:08:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WF63%2520PZN%27 HTTP/1.1" 200 None
2026-03-28 14:08:16 [bca.uk] INFO: Scrape type for WF63%20PZN: 0
2026-03-28 14:08:16 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 14:08:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698766839%27 HTTP/1.1" 200 None
2026-03-28 14:08:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698766839 not downloaded yet
2026-03-28 14:08:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698814072%27 HTTP/1.1" 200 None
2026-03-28 14:08:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698814072 not downloaded yet
2026-03-28 14:08:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698910507%27 HTTP/1.1" 200 None
2026-03-28 14:08:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698910507 not downloaded yet
2026-03-28 14:08:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698814088%27 HTTP/1.1" 200 None
2026-03-28 14:08:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698814088 not downloaded yet
2026-03-28 14:08:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698910538%27 HTTP/1.1" 200 None
2026-03-28 14:08:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698910538 not downloaded yet
2026-03-28 14:08:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NY11BJE/698910322/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/NY11BJE/42808365?sv=2020-08-04&st=2026-03-28T14%3A08%3A06Z&se=2026-03-28T14%3A33%3A06Z&sr=b&sp=r&sig=BnHSFQIYk3fEUhH4zxeRM80fwfd2ygxBi8EnHswGMU8%3D)
2026-03-28 14:08:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RE68RYC/698766657/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/RE68RYC/42807274?sv=2020-08-04&st=2026-03-28T14%3A08%3A07Z&se=2026-03-28T14%3A33%3A07Z&sr=b&sp=r&sig=2T9BQlp2w4jq0TOnJ2XRxIlj1g8XZKwhz0v6utga2zA%3D)
2026-03-28 14:08:16 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NY11BJE/698910418/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698910418>
2026-03-28 14:08:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RE68RYC/698766670/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/RE68RYC/42807274?sv=2020-08-04&st=2026-03-28T14%3A08%3A07Z&se=2026-03-28T14%3A33%3A07Z&sr=b&sp=r&sig=2T9BQlp2w4jq0TOnJ2XRxIlj1g8XZKwhz0v6utga2zA%3D)
2026-03-28 14:08:16 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RE68RYC/698766746/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698766746>
2026-03-28 14:08:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698814109%27 HTTP/1.1" 200 None
2026-03-28 14:08:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698814109 not downloaded yet
2026-03-28 14:08:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:08:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a1fd3b990>
2026-03-28 14:08:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:08:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:08:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:08:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_946e6279-6e49-5961-b70a-53fd1b261e3f/946e6279-6e49-5961-b70a-53fd1b261e3f_image_1.jpg HTTP/1.1" 201 0
2026-03-28 14:08:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FWB19OHW%252F698813815%252F600') HTTP/1.1" 204 0
2026-03-28 14:08:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WB19OHW/698813815/600 saved to cache
2026-03-28 14:08:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 946e6279-6e49-5961-b70a-53fd1b261e3f
2026-03-28 14:08:16 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:08:16 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:08:16 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:08:16 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:08:16 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:08:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:08:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2ca702d0>
2026-03-28 14:08:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:08:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:08:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:08:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a1043301-1d6c-5ef5-8043-fba38100bdea/a1043301-1d6c-5ef5-8043-fba38100bdea_image_7.jpg HTTP/1.1" 201 0
2026-03-28 14:08:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FWD19GOC%252F698733484%252F600') HTTP/1.1" 204 0
2026-03-28 14:08:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WD19GOC/698733484/600 saved to cache
2026-03-28 14:08:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item a1043301-1d6c-5ef5-8043-fba38100bdea
2026-03-28 14:08:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:08:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2ddfba90>
2026-03-28 14:08:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:08:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:08:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:08:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_18272ae4-7bc4-594a-a0ef-c08da1ce17ad/18272ae4-7bc4-594a-a0ef-c08da1ce17ad_image_1.jpg HTTP/1.1" 201 0
2026-03-28 14:08:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FTFZ8294%252F698915549%252F600') HTTP/1.1" 204 0
2026-03-28 14:08:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/TFZ8294/698915549/600 saved to cache
2026-03-28 14:08:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 18272ae4-7bc4-594a-a0ef-c08da1ce17ad
2026-03-28 14:08:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WP63USZ/698814469/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/WP63USZ/42807824?sv=2020-08-04&st=2026-03-28T14%3A08%3A02Z&se=2026-03-28T14%3A33%3A02Z&sr=b&sp=r&sig=5J8P%2B%2BDbXuvBahjgaBANg4jjcUvdaSd%2B3YMnV6APqM0%3D)
2026-03-28 14:08:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WB19OHW/698813857/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/WB19OHW/42808333?sv=2020-08-04&st=2026-03-28T14%3A08%3A05Z&se=2026-03-28T14%3A33%3A05Z&sr=b&sp=r&sig=1tPrGuzNeNTywf9es7t2uJatudSyGSBqwxwUQUNO5j8%3D)
2026-03-28 14:08:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WP63USZ/698814437/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/WP63USZ/42807824?sv=2020-08-04&st=2026-03-28T14%3A08%3A02Z&se=2026-03-28T14%3A33%3A02Z&sr=b&sp=r&sig=5J8P%2B%2BDbXuvBahjgaBANg4jjcUvdaSd%2B3YMnV6APqM0%3D)
2026-03-28 14:08:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698814128%27 HTTP/1.1" 200 None
2026-03-28 14:08:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698814128 not downloaded yet
2026-03-28 14:08:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:08:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2d8eee50>
2026-03-28 14:08:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:08:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:08:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:08:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e7822f41-2074-585e-b916-185d4d55fb85/e7822f41-2074-585e-b916-185d4d55fb85_image_0.jpg HTTP/1.1" 201 0
2026-03-28 14:08:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FNY11BJE%252F698910322%252F600') HTTP/1.1" 204 0
2026-03-28 14:08:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NY11BJE/698910322/600 saved to cache
2026-03-28 14:08:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item e7822f41-2074-585e-b916-185d4d55fb85
2026-03-28 14:08:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:08:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2ca45c90>
2026-03-28 14:08:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:08:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:08:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:08:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9ca8d44e-82e3-5298-8ffc-858aa7ec23ad/9ca8d44e-82e3-5298-8ffc-858aa7ec23ad_image_0.jpg HTTP/1.1" 201 0
2026-03-28 14:08:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FRE68RYC%252F698766657%252F600') HTTP/1.1" 204 0
2026-03-28 14:08:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RE68RYC/698766657/600 saved to cache
2026-03-28 14:08:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 9ca8d44e-82e3-5298-8ffc-858aa7ec23ad
2026-03-28 14:08:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:08:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2de56e10>
2026-03-28 14:08:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:08:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:08:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:08:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9ca8d44e-82e3-5298-8ffc-858aa7ec23ad/9ca8d44e-82e3-5298-8ffc-858aa7ec23ad_image_1.jpg HTTP/1.1" 201 0
2026-03-28 14:08:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FRE68RYC%252F698766670%252F600') HTTP/1.1" 204 0
2026-03-28 14:08:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RE68RYC/698766670/600 saved to cache
2026-03-28 14:08:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 9ca8d44e-82e3-5298-8ffc-858aa7ec23ad
2026-03-28 14:08:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698814141%27 HTTP/1.1" 200 None
2026-03-28 14:08:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698814141 not downloaded yet
2026-03-28 14:08:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NY11BJE/698910349/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/NY11BJE/42808365?sv=2020-08-04&st=2026-03-28T14%3A08%3A06Z&se=2026-03-28T14%3A33%3A06Z&sr=b&sp=r&sig=BnHSFQIYk3fEUhH4zxeRM80fwfd2ygxBi8EnHswGMU8%3D)
2026-03-28 14:08:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RE68RYC/698766716/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/RE68RYC/42807274?sv=2020-08-04&st=2026-03-28T14%3A08%3A07Z&se=2026-03-28T14%3A33%3A07Z&sr=b&sp=r&sig=2T9BQlp2w4jq0TOnJ2XRxIlj1g8XZKwhz0v6utga2zA%3D)
2026-03-28 14:08:17 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NY11BJE/698910452/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698910452>
2026-03-28 14:08:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RE68RYC/698766732/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/RE68RYC/42807274?sv=2020-08-04&st=2026-03-28T14%3A08%3A07Z&se=2026-03-28T14%3A33%3A07Z&sr=b&sp=r&sig=2T9BQlp2w4jq0TOnJ2XRxIlj1g8XZKwhz0v6utga2zA%3D)
2026-03-28 14:08:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/TFZ8294/698915658/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/TFZ8294/42809548?sv=2020-08-04&st=2026-03-28T14%3A08%3A05Z&se=2026-03-28T14%3A33%3A05Z&sr=b&sp=r&sig=ErLZlBqdyCWgCZpWR0ce5C0%2FBbCxi3QUVQkCi%2FMXrM0%3D)
2026-03-28 14:08:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WB19OHW/698813902/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/WB19OHW/42808333?sv=2020-08-04&st=2026-03-28T14%3A08%3A05Z&se=2026-03-28T14%3A33%3A05Z&sr=b&sp=r&sig=1tPrGuzNeNTywf9es7t2uJatudSyGSBqwxwUQUNO5j8%3D)
2026-03-28 14:08:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698814179%27 HTTP/1.1" 200 None
2026-03-28 14:08:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698814179 not downloaded yet
2026-03-28 14:08:17 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:08:17 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:08:17 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:08:17 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:08:17 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:08:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:08:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2de54050>
2026-03-28 14:08:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:08:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:08:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:08:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_49f7b40c-fae2-5164-be3f-ce9eb1a2514d/49f7b40c-fae2-5164-be3f-ce9eb1a2514d_image_8.jpg HTTP/1.1" 201 0
2026-03-28 14:08:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FWP63USZ%252F698814469%252F600') HTTP/1.1" 204 0
2026-03-28 14:08:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WP63USZ/698814469/600 saved to cache
2026-03-28 14:08:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 49f7b40c-fae2-5164-be3f-ce9eb1a2514d
2026-03-28 14:08:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:08:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2d83b650>
2026-03-28 14:08:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:08:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:08:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:08:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_946e6279-6e49-5961-b70a-53fd1b261e3f/946e6279-6e49-5961-b70a-53fd1b261e3f_image_3.jpg HTTP/1.1" 201 0
2026-03-28 14:08:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FWB19OHW%252F698813857%252F600') HTTP/1.1" 204 0
2026-03-28 14:08:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WB19OHW/698813857/600 saved to cache
2026-03-28 14:08:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 946e6279-6e49-5961-b70a-53fd1b261e3f
2026-03-28 14:08:17 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:08:17 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:08:17 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:08:17 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:08:17 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:08:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:08:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c9e0910>
2026-03-28 14:08:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:08:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:08:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:08:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_49f7b40c-fae2-5164-be3f-ce9eb1a2514d/49f7b40c-fae2-5164-be3f-ce9eb1a2514d_image_7.jpg HTTP/1.1" 201 0
2026-03-28 14:08:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FWP63USZ%252F698814437%252F600') HTTP/1.1" 204 0
2026-03-28 14:08:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WP63USZ/698814437/600 saved to cache
2026-03-28 14:08:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 49f7b40c-fae2-5164-be3f-ce9eb1a2514d
2026-03-28 14:08:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RE68RYC/698766746/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/RE68RYC/42807274?sv=2020-08-04&st=2026-03-28T14%3A08%3A07Z&se=2026-03-28T14%3A33%3A07Z&sr=b&sp=r&sig=2T9BQlp2w4jq0TOnJ2XRxIlj1g8XZKwhz0v6utga2zA%3D)
2026-03-28 14:08:17 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RE68RYC/698766788/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698766788>
2026-03-28 14:08:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698814205%27 HTTP/1.1" 200 None
2026-03-28 14:08:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698814205 not downloaded yet
2026-03-28 14:08:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698814232%27 HTTP/1.1" 200 None
2026-03-28 14:08:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698814232 not downloaded yet
2026-03-28 14:08:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:08:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c3d1f90>
2026-03-28 14:08:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:08:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:08:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:08:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e7822f41-2074-585e-b916-185d4d55fb85/e7822f41-2074-585e-b916-185d4d55fb85_image_1.jpg HTTP/1.1" 201 0
2026-03-28 14:08:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FNY11BJE%252F698910349%252F600') HTTP/1.1" 204 0
2026-03-28 14:08:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NY11BJE/698910349/600 saved to cache
2026-03-28 14:08:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item e7822f41-2074-585e-b916-185d4d55fb85
2026-03-28 14:08:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:08:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c8ff650>
2026-03-28 14:08:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:08:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:08:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:08:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9ca8d44e-82e3-5298-8ffc-858aa7ec23ad/9ca8d44e-82e3-5298-8ffc-858aa7ec23ad_image_3.jpg HTTP/1.1" 201 0
2026-03-28 14:08:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FRE68RYC%252F698766716%252F600') HTTP/1.1" 204 0
2026-03-28 14:08:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RE68RYC/698766716/600 saved to cache
2026-03-28 14:08:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 9ca8d44e-82e3-5298-8ffc-858aa7ec23ad
2026-03-28 14:08:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:08:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c0f9010>
2026-03-28 14:08:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:08:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:08:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:08:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9ca8d44e-82e3-5298-8ffc-858aa7ec23ad/9ca8d44e-82e3-5298-8ffc-858aa7ec23ad_image_4.jpg HTTP/1.1" 201 0
2026-03-28 14:08:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FRE68RYC%252F698766732%252F600') HTTP/1.1" 204 0
2026-03-28 14:08:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RE68RYC/698766732/600 saved to cache
2026-03-28 14:08:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 9ca8d44e-82e3-5298-8ffc-858aa7ec23ad
2026-03-28 14:08:17 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:08:17 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:08:17 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:08:17 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:08:17 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:08:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:08:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c0fa210>
2026-03-28 14:08:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:08:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:08:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:08:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_18272ae4-7bc4-594a-a0ef-c08da1ce17ad/18272ae4-7bc4-594a-a0ef-c08da1ce17ad_image_6.jpg HTTP/1.1" 201 0
2026-03-28 14:08:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FTFZ8294%252F698915658%252F600') HTTP/1.1" 204 0
2026-03-28 14:08:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/TFZ8294/698915658/600 saved to cache
2026-03-28 14:08:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 18272ae4-7bc4-594a-a0ef-c08da1ce17ad
2026-03-28 14:08:17 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:08:17 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:08:17 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:08:17 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:08:17 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:08:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:08:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c62bc10>
2026-03-28 14:08:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:08:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:08:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:08:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_946e6279-6e49-5961-b70a-53fd1b261e3f/946e6279-6e49-5961-b70a-53fd1b261e3f_image_6.jpg HTTP/1.1" 201 0
2026-03-28 14:08:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FWB19OHW%252F698813902%252F600') HTTP/1.1" 204 0
2026-03-28 14:08:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WB19OHW/698813902/600 saved to cache
2026-03-28 14:08:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 946e6279-6e49-5961-b70a-53fd1b261e3f
2026-03-28 14:08:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698814243%27 HTTP/1.1" 200 None
2026-03-28 14:08:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698814243 not downloaded yet
2026-03-28 14:08:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NY11BJE/698910418/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/NY11BJE/42808365?sv=2020-08-04&st=2026-03-28T14%3A08%3A06Z&se=2026-03-28T14%3A33%3A06Z&sr=b&sp=r&sig=BnHSFQIYk3fEUhH4zxeRM80fwfd2ygxBi8EnHswGMU8%3D)
2026-03-28 14:08:17 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NG62MFN/698814109/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698814109>
2026-03-28 14:08:17 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NY11BJE/698910538/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698910538>
2026-03-28 14:08:17 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NG62MFN/698814088/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698814088>
2026-03-28 14:08:17 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NG62MFN/698814072/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698814072>
2026-03-28 14:08:17 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NY11BJE/698910507/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698910507>
2026-03-28 14:08:17 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RE68RYC/698766839/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698766839>
2026-03-28 14:08:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NY11BJE/698910452/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/NY11BJE/42808365?sv=2020-08-04&st=2026-03-28T14%3A08%3A06Z&se=2026-03-28T14%3A33%3A06Z&sr=b&sp=r&sig=BnHSFQIYk3fEUhH4zxeRM80fwfd2ygxBi8EnHswGMU8%3D)
2026-03-28 14:08:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:08:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a1fd8c290>
2026-03-28 14:08:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:08:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:08:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:08:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9ca8d44e-82e3-5298-8ffc-858aa7ec23ad/9ca8d44e-82e3-5298-8ffc-858aa7ec23ad_image_5.jpg HTTP/1.1" 201 0
2026-03-28 14:08:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FRE68RYC%252F698766746%252F600') HTTP/1.1" 204 0
2026-03-28 14:08:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RE68RYC/698766746/600 saved to cache
2026-03-28 14:08:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 9ca8d44e-82e3-5298-8ffc-858aa7ec23ad
2026-03-28 14:08:17 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RE68RYC/698766812/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698766812>
2026-03-28 14:08:17 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NY11BJE/698910477/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698910477>
2026-03-28 14:08:17 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NG62MFN/698814128/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698814128>
2026-03-28 14:08:17 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NG62MFN/698814179/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698814179>
2026-03-28 14:08:17 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NG62MFN/698814053/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=NG62MFN-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-28 14:08:17 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NG62MFN/698814141/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698814141>
2026-03-28 14:08:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:08:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2d8f2310>
2026-03-28 14:08:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:08:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:08:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:08:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e7822f41-2074-585e-b916-185d4d55fb85/e7822f41-2074-585e-b916-185d4d55fb85_image_4.jpg HTTP/1.1" 201 0
2026-03-28 14:08:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FNY11BJE%252F698910418%252F600') HTTP/1.1" 204 0
2026-03-28 14:08:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NY11BJE/698910418/600 saved to cache
2026-03-28 14:08:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item e7822f41-2074-585e-b916-185d4d55fb85
2026-03-28 14:08:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RE68RYC/698766839/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/RE68RYC/42807274?sv=2020-08-04&st=2026-03-28T14%3A08%3A07Z&se=2026-03-28T14%3A33%3A07Z&sr=b&sp=r&sig=2T9BQlp2w4jq0TOnJ2XRxIlj1g8XZKwhz0v6utga2zA%3D)
2026-03-28 14:08:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RE68RYC/698766788/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/RE68RYC/42807274?sv=2020-08-04&st=2026-03-28T14%3A08%3A07Z&se=2026-03-28T14%3A33%3A07Z&sr=b&sp=r&sig=2T9BQlp2w4jq0TOnJ2XRxIlj1g8XZKwhz0v6utga2zA%3D)
2026-03-28 14:08:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NY11BJE/698910507/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/NY11BJE/42808365?sv=2020-08-04&st=2026-03-28T14%3A08%3A06Z&se=2026-03-28T14%3A33%3A06Z&sr=b&sp=r&sig=BnHSFQIYk3fEUhH4zxeRM80fwfd2ygxBi8EnHswGMU8%3D)
2026-03-28 14:08:17 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NG62MFN/698814232/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698814232>
2026-03-28 14:08:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NG62MFN/698814088/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/NG62MFN/42807554?sv=2020-08-04&st=2026-03-28T14%3A08%3A12Z&se=2026-03-28T14%3A33%3A12Z&sr=b&sp=r&sig=FqCCEbePcOVvU3L%2F4Oat9lmdrXLmWMLS0vWT9r6A37Y%3D)
2026-03-28 14:08:17 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:08:17 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:08:17 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:08:17 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:08:17 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:08:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:08:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2dea8790>
2026-03-28 14:08:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:08:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:08:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:08:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e7822f41-2074-585e-b916-185d4d55fb85/e7822f41-2074-585e-b916-185d4d55fb85_image_6.jpg HTTP/1.1" 201 0
2026-03-28 14:08:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FNY11BJE%252F698910452%252F600') HTTP/1.1" 204 0
2026-03-28 14:08:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NY11BJE/698910452/600 saved to cache
2026-03-28 14:08:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item e7822f41-2074-585e-b916-185d4d55fb85
2026-03-28 14:08:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NY11BJE/698910538/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/NY11BJE/42808365?sv=2020-08-04&st=2026-03-28T14%3A08%3A06Z&se=2026-03-28T14%3A33%3A06Z&sr=b&sp=r&sig=BnHSFQIYk3fEUhH4zxeRM80fwfd2ygxBi8EnHswGMU8%3D)
2026-03-28 14:08:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NG62MFN/698814109/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/NG62MFN/42807554?sv=2020-08-04&st=2026-03-28T14%3A08%3A12Z&se=2026-03-28T14%3A33%3A12Z&sr=b&sp=r&sig=FqCCEbePcOVvU3L%2F4Oat9lmdrXLmWMLS0vWT9r6A37Y%3D)
2026-03-28 14:08:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RE68RYC/698766812/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/RE68RYC/42807274?sv=2020-08-04&st=2026-03-28T14%3A08%3A07Z&se=2026-03-28T14%3A33%3A07Z&sr=b&sp=r&sig=2T9BQlp2w4jq0TOnJ2XRxIlj1g8XZKwhz0v6utga2zA%3D)
2026-03-28 14:08:17 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NG62MFN/698814243/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698814243>
2026-03-28 14:08:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NG62MFN/698814072/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/NG62MFN/42807554?sv=2020-08-04&st=2026-03-28T14%3A08%3A12Z&se=2026-03-28T14%3A33%3A12Z&sr=b&sp=r&sig=FqCCEbePcOVvU3L%2F4Oat9lmdrXLmWMLS0vWT9r6A37Y%3D)
2026-03-28 14:08:17 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:08:17 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:08:17 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:08:17 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:08:17 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:08:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:08:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c938510>
2026-03-28 14:08:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:08:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:08:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:08:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9ca8d44e-82e3-5298-8ffc-858aa7ec23ad/9ca8d44e-82e3-5298-8ffc-858aa7ec23ad_image_9.jpg HTTP/1.1" 201 0
2026-03-28 14:08:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FRE68RYC%252F698766839%252F600') HTTP/1.1" 204 0
2026-03-28 14:08:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RE68RYC/698766839/600 saved to cache
2026-03-28 14:08:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 9ca8d44e-82e3-5298-8ffc-858aa7ec23ad
2026-03-28 14:08:17 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:08:17 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:08:17 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:08:17 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:08:17 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:08:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:08:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c9ff390>
2026-03-28 14:08:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:08:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:08:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:08:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9ca8d44e-82e3-5298-8ffc-858aa7ec23ad/9ca8d44e-82e3-5298-8ffc-858aa7ec23ad_image_7.jpg HTTP/1.1" 201 0
2026-03-28 14:08:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FRE68RYC%252F698766788%252F600') HTTP/1.1" 204 0
2026-03-28 14:08:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RE68RYC/698766788/600 saved to cache
2026-03-28 14:08:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 9ca8d44e-82e3-5298-8ffc-858aa7ec23ad
2026-03-28 14:08:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NG62MFN/698814053/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/NG62MFN/42807554?sv=2020-08-04&st=2026-03-28T14%3A08%3A12Z&se=2026-03-28T14%3A33%3A12Z&sr=b&sp=r&sig=FqCCEbePcOVvU3L%2F4Oat9lmdrXLmWMLS0vWT9r6A37Y%3D)
2026-03-28 14:08:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NG62MFN/698814128/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/NG62MFN/42807554?sv=2020-08-04&st=2026-03-28T14%3A08%3A12Z&se=2026-03-28T14%3A33%3A12Z&sr=b&sp=r&sig=FqCCEbePcOVvU3L%2F4Oat9lmdrXLmWMLS0vWT9r6A37Y%3D)
2026-03-28 14:08:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NY11BJE/698910477/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/NY11BJE/42808365?sv=2020-08-04&st=2026-03-28T14%3A08%3A06Z&se=2026-03-28T14%3A33%3A06Z&sr=b&sp=r&sig=BnHSFQIYk3fEUhH4zxeRM80fwfd2ygxBi8EnHswGMU8%3D)
2026-03-28 14:08:17 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NY11BJE/698910433/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698910433>
2026-03-28 14:08:17 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NG62MFN/698814205/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698814205>
2026-03-28 14:08:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NG62MFN/698814141/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/NG62MFN/42807554?sv=2020-08-04&st=2026-03-28T14%3A08%3A12Z&se=2026-03-28T14%3A33%3A12Z&sr=b&sp=r&sig=FqCCEbePcOVvU3L%2F4Oat9lmdrXLmWMLS0vWT9r6A37Y%3D)
2026-03-28 14:08:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NG62MFN/698814179/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/NG62MFN/42807554?sv=2020-08-04&st=2026-03-28T14%3A08%3A12Z&se=2026-03-28T14%3A33%3A12Z&sr=b&sp=r&sig=FqCCEbePcOVvU3L%2F4Oat9lmdrXLmWMLS0vWT9r6A37Y%3D)
2026-03-28 14:08:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NG62MFN/698814232/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/NG62MFN/42807554?sv=2020-08-04&st=2026-03-28T14%3A08%3A12Z&se=2026-03-28T14%3A33%3A12Z&sr=b&sp=r&sig=FqCCEbePcOVvU3L%2F4Oat9lmdrXLmWMLS0vWT9r6A37Y%3D)
2026-03-28 14:08:17 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:08:17 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:08:17 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:08:17 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:08:17 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:08:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:08:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2d63f390>
2026-03-28 14:08:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:08:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:08:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:08:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e7822f41-2074-585e-b916-185d4d55fb85/e7822f41-2074-585e-b916-185d4d55fb85_image_8.jpg HTTP/1.1" 201 0
2026-03-28 14:08:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FNY11BJE%252F698910507%252F600') HTTP/1.1" 204 0
2026-03-28 14:08:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NY11BJE/698910507/600 saved to cache
2026-03-28 14:08:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item e7822f41-2074-585e-b916-185d4d55fb85
2026-03-28 14:08:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:08:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c9b5110>
2026-03-28 14:08:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:08:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:08:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:08:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ee540c51-cf33-581e-8fef-9e70457b2cad/ee540c51-cf33-581e-8fef-9e70457b2cad_image_2.jpg HTTP/1.1" 201 0
2026-03-28 14:08:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FNG62MFN%252F698814088%252F600') HTTP/1.1" 204 0
2026-03-28 14:08:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NG62MFN/698814088/600 saved to cache
2026-03-28 14:08:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item ee540c51-cf33-581e-8fef-9e70457b2cad
2026-03-28 14:08:17 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:08:17 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:08:17 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:08:17 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:08:17 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:08:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:08:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2d884d90>
2026-03-28 14:08:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:08:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:08:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:08:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e7822f41-2074-585e-b916-185d4d55fb85/e7822f41-2074-585e-b916-185d4d55fb85_image_9.jpg HTTP/1.1" 201 0
2026-03-28 14:08:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FNY11BJE%252F698910538%252F600') HTTP/1.1" 204 0
2026-03-28 14:08:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NY11BJE/698910538/600 saved to cache
2026-03-28 14:08:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item e7822f41-2074-585e-b916-185d4d55fb85
2026-03-28 14:08:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:08:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2d887810>
2026-03-28 14:08:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:08:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:08:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:08:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ee540c51-cf33-581e-8fef-9e70457b2cad/ee540c51-cf33-581e-8fef-9e70457b2cad_image_3.jpg HTTP/1.1" 201 0
2026-03-28 14:08:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FNG62MFN%252F698814109%252F600') HTTP/1.1" 204 0
2026-03-28 14:08:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NG62MFN/698814109/600 saved to cache
2026-03-28 14:08:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item ee540c51-cf33-581e-8fef-9e70457b2cad
2026-03-28 14:08:17 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:08:17 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:08:17 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:08:17 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:08:17 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:08:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:08:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2ddfa5d0>
2026-03-28 14:08:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:08:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:08:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:08:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9ca8d44e-82e3-5298-8ffc-858aa7ec23ad/9ca8d44e-82e3-5298-8ffc-858aa7ec23ad_image_8.jpg HTTP/1.1" 201 0
2026-03-28 14:08:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FRE68RYC%252F698766812%252F600') HTTP/1.1" 204 0
2026-03-28 14:08:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RE68RYC/698766812/600 saved to cache
2026-03-28 14:08:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 9ca8d44e-82e3-5298-8ffc-858aa7ec23ad
2026-03-28 14:08:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:08:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2dccbb10>
2026-03-28 14:08:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:08:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:08:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:08:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ee540c51-cf33-581e-8fef-9e70457b2cad/ee540c51-cf33-581e-8fef-9e70457b2cad_image_1.jpg HTTP/1.1" 201 0
2026-03-28 14:08:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FNG62MFN%252F698814072%252F600') HTTP/1.1" 204 0
2026-03-28 14:08:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NG62MFN/698814072/600 saved to cache
2026-03-28 14:08:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item ee540c51-cf33-581e-8fef-9e70457b2cad
2026-03-28 14:08:18 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/TFZ8294/698915700/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698915700>
2026-03-28 14:08:18 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/TFZ8294/698915720/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698915720>
2026-03-28 14:08:18 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RE68RYC/698766765/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698766765>
2026-03-28 14:08:18 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WB19OHW/698813932/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698813932>
2026-03-28 14:08:18 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WB19OHW/698813943/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698813943>
2026-03-28 14:08:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NG62MFN/698814243/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/NG62MFN/42807554?sv=2020-08-04&st=2026-03-28T14%3A08%3A12Z&se=2026-03-28T14%3A33%3A12Z&sr=b&sp=r&sig=FqCCEbePcOVvU3L%2F4Oat9lmdrXLmWMLS0vWT9r6A37Y%3D)
2026-03-28 14:08:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:08:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c149590>
2026-03-28 14:08:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:08:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:08:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:08:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ee540c51-cf33-581e-8fef-9e70457b2cad/ee540c51-cf33-581e-8fef-9e70457b2cad_image_0.jpg HTTP/1.1" 201 0
2026-03-28 14:08:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FNG62MFN%252F698814053%252F600') HTTP/1.1" 204 0
2026-03-28 14:08:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NG62MFN/698814053/600 saved to cache
2026-03-28 14:08:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item ee540c51-cf33-581e-8fef-9e70457b2cad
2026-03-28 14:08:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:08:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c9e2410>
2026-03-28 14:08:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:08:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:08:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:08:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ee540c51-cf33-581e-8fef-9e70457b2cad/ee540c51-cf33-581e-8fef-9e70457b2cad_image_4.jpg HTTP/1.1" 201 0
2026-03-28 14:08:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FNG62MFN%252F698814128%252F600') HTTP/1.1" 204 0
2026-03-28 14:08:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NG62MFN/698814128/600 saved to cache
2026-03-28 14:08:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item ee540c51-cf33-581e-8fef-9e70457b2cad
2026-03-28 14:08:18 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:08:18 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:08:18 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:08:18 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:08:18 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:08:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:08:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2ca710d0>
2026-03-28 14:08:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:08:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:08:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:08:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e7822f41-2074-585e-b916-185d4d55fb85/e7822f41-2074-585e-b916-185d4d55fb85_image_7.jpg HTTP/1.1" 201 0
2026-03-28 14:08:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FNY11BJE%252F698910477%252F600') HTTP/1.1" 204 0
2026-03-28 14:08:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NY11BJE/698910477/600 saved to cache
2026-03-28 14:08:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item e7822f41-2074-585e-b916-185d4d55fb85
2026-03-28 14:08:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:08:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c98d0d0>
2026-03-28 14:08:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:08:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:08:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:08:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ee540c51-cf33-581e-8fef-9e70457b2cad/ee540c51-cf33-581e-8fef-9e70457b2cad_image_5.jpg HTTP/1.1" 201 0
2026-03-28 14:08:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FNG62MFN%252F698814141%252F600') HTTP/1.1" 204 0
2026-03-28 14:08:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NG62MFN/698814141/600 saved to cache
2026-03-28 14:08:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item ee540c51-cf33-581e-8fef-9e70457b2cad
2026-03-28 14:08:18 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:08:18 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:08:18 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:08:18 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:08:18 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:08:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:08:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c9e0790>
2026-03-28 14:08:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:08:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:08:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:08:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ee540c51-cf33-581e-8fef-9e70457b2cad/ee540c51-cf33-581e-8fef-9e70457b2cad_image_6.jpg HTTP/1.1" 201 0
2026-03-28 14:08:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FNG62MFN%252F698814179%252F600') HTTP/1.1" 204 0
2026-03-28 14:08:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NG62MFN/698814179/600 saved to cache
2026-03-28 14:08:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item ee540c51-cf33-581e-8fef-9e70457b2cad
2026-03-28 14:08:18 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:08:18 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:08:18 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:08:18 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:08:18 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:08:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:08:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2dd14150>
2026-03-28 14:08:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:08:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:08:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:08:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ee540c51-cf33-581e-8fef-9e70457b2cad/ee540c51-cf33-581e-8fef-9e70457b2cad_image_8.jpg HTTP/1.1" 201 0
2026-03-28 14:08:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FNG62MFN%252F698814232%252F600') HTTP/1.1" 204 0
2026-03-28 14:08:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NG62MFN/698814232/600 saved to cache
2026-03-28 14:08:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item ee540c51-cf33-581e-8fef-9e70457b2cad
2026-03-28 14:08:18 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NY11BJE/698910400/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698910400>
2026-03-28 14:08:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NY11BJE/698910433/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/NY11BJE/42808365?sv=2020-08-04&st=2026-03-28T14%3A08%3A06Z&se=2026-03-28T14%3A33%3A06Z&sr=b&sp=r&sig=BnHSFQIYk3fEUhH4zxeRM80fwfd2ygxBi8EnHswGMU8%3D)
2026-03-28 14:08:18 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WB19OHW/698813922/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698813922>
2026-03-28 14:08:18 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NY11BJE/698910375/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698910375>
2026-03-28 14:08:18 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WP63USZ/698814502/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698814502>
2026-03-28 14:08:18 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/TFZ8294/698915677/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698915677>
2026-03-28 14:08:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NG62MFN/698814205/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/NG62MFN/42807554?sv=2020-08-04&st=2026-03-28T14%3A08%3A12Z&se=2026-03-28T14%3A33%3A12Z&sr=b&sp=r&sig=FqCCEbePcOVvU3L%2F4Oat9lmdrXLmWMLS0vWT9r6A37Y%3D)
2026-03-28 14:08:18 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:08:18 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:08:18 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:08:18 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:08:18 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:08:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:08:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c750b50>
2026-03-28 14:08:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:08:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:08:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:08:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ee540c51-cf33-581e-8fef-9e70457b2cad/ee540c51-cf33-581e-8fef-9e70457b2cad_image_9.jpg HTTP/1.1" 201 0
2026-03-28 14:08:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FNG62MFN%252F698814243%252F600') HTTP/1.1" 204 0
2026-03-28 14:08:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NG62MFN/698814243/600 saved to cache
2026-03-28 14:08:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item ee540c51-cf33-581e-8fef-9e70457b2cad
2026-03-28 14:08:18 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RE68RYC/698766692/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698766692>
2026-03-28 14:08:18 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WB19OHW/698813883/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698813883>
2026-03-28 14:08:18 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/TFZ8294/698915629/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698915629>
2026-03-28 14:08:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WB19OHW/698813932/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/WB19OHW/42808333?sv=2020-08-04&st=2026-03-28T14%3A08%3A05Z&se=2026-03-28T14%3A33%3A05Z&sr=b&sp=r&sig=1tPrGuzNeNTywf9es7t2uJatudSyGSBqwxwUQUNO5j8%3D)
2026-03-28 14:08:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/TFZ8294/698915700/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/TFZ8294/42809548?sv=2020-08-04&st=2026-03-28T14%3A08%3A05Z&se=2026-03-28T14%3A33%3A05Z&sr=b&sp=r&sig=ErLZlBqdyCWgCZpWR0ce5C0%2FBbCxi3QUVQkCi%2FMXrM0%3D)
2026-03-28 14:08:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:08:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2ca57f90>
2026-03-28 14:08:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:08:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:08:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:08:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e7822f41-2074-585e-b916-185d4d55fb85/e7822f41-2074-585e-b916-185d4d55fb85_image_5.jpg HTTP/1.1" 201 0
2026-03-28 14:08:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FNY11BJE%252F698910433%252F600') HTTP/1.1" 204 0
2026-03-28 14:08:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NY11BJE/698910433/600 saved to cache
2026-03-28 14:08:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item e7822f41-2074-585e-b916-185d4d55fb85
2026-03-28 14:08:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RE68RYC/698766765/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/RE68RYC/42807274?sv=2020-08-04&st=2026-03-28T14%3A08%3A07Z&se=2026-03-28T14%3A33%3A07Z&sr=b&sp=r&sig=2T9BQlp2w4jq0TOnJ2XRxIlj1g8XZKwhz0v6utga2zA%3D)
2026-03-28 14:08:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WB19OHW/698813943/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/WB19OHW/42808333?sv=2020-08-04&st=2026-03-28T14%3A08%3A05Z&se=2026-03-28T14%3A33%3A05Z&sr=b&sp=r&sig=1tPrGuzNeNTywf9es7t2uJatudSyGSBqwxwUQUNO5j8%3D)
2026-03-28 14:08:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NY11BJE/698910400/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/NY11BJE/42808365?sv=2020-08-04&st=2026-03-28T14%3A08%3A06Z&se=2026-03-28T14%3A33%3A06Z&sr=b&sp=r&sig=BnHSFQIYk3fEUhH4zxeRM80fwfd2ygxBi8EnHswGMU8%3D)
2026-03-28 14:08:18 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:08:18 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:08:18 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:08:18 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:08:18 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:08:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:08:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2ca1c110>
2026-03-28 14:08:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:08:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:08:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:08:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ee540c51-cf33-581e-8fef-9e70457b2cad/ee540c51-cf33-581e-8fef-9e70457b2cad_image_7.jpg HTTP/1.1" 201 0
2026-03-28 14:08:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FNG62MFN%252F698814205%252F600') HTTP/1.1" 204 0
2026-03-28 14:08:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NG62MFN/698814205/600 saved to cache
2026-03-28 14:08:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item ee540c51-cf33-581e-8fef-9e70457b2cad
2026-03-28 14:08:18 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: ee540c51-cf33-581e-8fef-9e70457b2cad, skipping ID generation
2026-03-28 14:08:18 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item ee540c51-cf33-581e-8fef-9e70457b2cad sending to next pipeline
2026-03-28 14:08:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: ee540c51-cf33-581e-8fef-9e70457b2cad, identifier: NG62%20MFN
2026-03-28 14:08:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NY11BJE/698910375/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/NY11BJE/42808365?sv=2020-08-04&st=2026-03-28T14%3A08%3A06Z&se=2026-03-28T14%3A33%3A06Z&sr=b&sp=r&sig=BnHSFQIYk3fEUhH4zxeRM80fwfd2ygxBi8EnHswGMU8%3D)
2026-03-28 14:08:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: ee540c51-cf33-581e-8fef-9e70457b2cad with identifier: NG62%20MFN
2026-03-28 14:08:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: ee540c51-cf33-581e-8fef-9e70457b2cad with identifier: NG62%20MFN
2026-03-28 14:08:19 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: ee540c51-cf33-581e-8fef-9e70457b2cad with identifier: NG62%20MFN to the API
2026-03-28 14:08:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:08:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:08:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NG62MFN/698814205/600>
{'auction_title': '',
'c_o_2_emission_value': 157,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ee540c51-cf33-581e-8fef-9e70457b2cad/ee540c51-cf33-581e-8fef-9e70457b2cad_expert_report_file_a101e0f1-f1ab-4146-a63b-43114c6263eb.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=NG62%20MFN-GB',
'category': 'Car',
'color': 'red',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.6L',
'expiration_date': '2026-03-29T10:00:00Z',
'fuel_type': 'Petrol',
'id': 'ee540c51-cf33-581e-8fef-9e70457b2cad',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'NG62 MFN',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=NG62%20MFN&vehicleType=*',
'listing': 'auction',
'location': 'Manchester',
'make': 'VAUXHALL',
'model': 'ZAFIRA',
'odometer': 90477,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 11,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ee540c51-cf33-581e-8fef-9e70457b2cad/ee540c51-cf33-581e-8fef-9e70457b2cad_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 48948,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NG62MFN/698814053/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ee540c51-cf33-581e-8fef-9e70457b2cad/ee540c51-cf33-581e-8fef-9e70457b2cad_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 48081,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NG62MFN/698814072/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ee540c51-cf33-581e-8fef-9e70457b2cad/ee540c51-cf33-581e-8fef-9e70457b2cad_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 46242,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NG62MFN/698814088/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ee540c51-cf33-581e-8fef-9e70457b2cad/ee540c51-cf33-581e-8fef-9e70457b2cad_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 47527,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NG62MFN/698814109/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ee540c51-cf33-581e-8fef-9e70457b2cad/ee540c51-cf33-581e-8fef-9e70457b2cad_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 47912,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NG62MFN/698814128/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ee540c51-cf33-581e-8fef-9e70457b2cad/ee540c51-cf33-581e-8fef-9e70457b2cad_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 44588,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NG62MFN/698814141/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ee540c51-cf33-581e-8fef-9e70457b2cad/ee540c51-cf33-581e-8fef-9e70457b2cad_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 101221,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NG62MFN/698814179/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ee540c51-cf33-581e-8fef-9e70457b2cad/ee540c51-cf33-581e-8fef-9e70457b2cad_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 75984,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NG62MFN/698814205/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ee540c51-cf33-581e-8fef-9e70457b2cad/ee540c51-cf33-581e-8fef-9e70457b2cad_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 87051,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NG62MFN/698814232/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ee540c51-cf33-581e-8fef-9e70457b2cad/ee540c51-cf33-581e-8fef-9e70457b2cad_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 96956,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NG62MFN/698814243/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2013-01-01',
'seller_name': None,
'title': 'VAUXHALL ZAFIRA 1.6 VVT 115 EXCLUSIV MPV',
'transmission': 'manual',
'trim': 'VVT 115 EXCLUSIV',
'vin': 'W0L0AHM75D2051706',
'year': 2013}
2026-03-28 14:08:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27NG62%2520MFN%27 HTTP/1.1" 200 None
2026-03-28 14:08:19 [bca.uk] INFO: Saving data for NG62%20MFN: {'created_time': 1774706899.393682, 'last_price_update_time': 1774706899.393694, 'auction_closing_time': 1774778400.0}
2026-03-28 14:08:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='NG62%2520MFN') HTTP/1.1" 204 0
2026-03-28 14:08:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WB19OHW/698813922/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/WB19OHW/42808333?sv=2020-08-04&st=2026-03-28T14%3A08%3A05Z&se=2026-03-28T14%3A33%3A05Z&sr=b&sp=r&sig=1tPrGuzNeNTywf9es7t2uJatudSyGSBqwxwUQUNO5j8%3D)
2026-03-28 14:08:19 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/TFZ8294/698915606/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698915606>
2026-03-28 14:08:19 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WB19OHW/698813873/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698813873>
2026-03-28 14:08:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RE68RYC/698766692/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/RE68RYC/42807274?sv=2020-08-04&st=2026-03-28T14%3A08%3A07Z&se=2026-03-28T14%3A33%3A07Z&sr=b&sp=r&sig=2T9BQlp2w4jq0TOnJ2XRxIlj1g8XZKwhz0v6utga2zA%3D)
2026-03-28 14:08:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WP63USZ/698814502/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/WP63USZ/42807824?sv=2020-08-04&st=2026-03-28T14%3A08%3A02Z&se=2026-03-28T14%3A33%3A02Z&sr=b&sp=r&sig=5J8P%2B%2BDbXuvBahjgaBANg4jjcUvdaSd%2B3YMnV6APqM0%3D)
2026-03-28 14:08:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/TFZ8294/698915677/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/TFZ8294/42809548?sv=2020-08-04&st=2026-03-28T14%3A08%3A05Z&se=2026-03-28T14%3A33%3A05Z&sr=b&sp=r&sig=ErLZlBqdyCWgCZpWR0ce5C0%2FBbCxi3QUVQkCi%2FMXrM0%3D)
2026-03-28 14:08:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/TFZ8294/698915720/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/TFZ8294/42809548?sv=2020-08-04&st=2026-03-28T14%3A08%3A05Z&se=2026-03-28T14%3A33%3A05Z&sr=b&sp=r&sig=ErLZlBqdyCWgCZpWR0ce5C0%2FBbCxi3QUVQkCi%2FMXrM0%3D)
2026-03-28 14:08:19 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:08:19 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:08:19 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:08:19 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:08:19 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:08:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:08:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2eb12450>
2026-03-28 14:08:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:08:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:08:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:08:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_946e6279-6e49-5961-b70a-53fd1b261e3f/946e6279-6e49-5961-b70a-53fd1b261e3f_image_8.jpg HTTP/1.1" 201 0
2026-03-28 14:08:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FWB19OHW%252F698813932%252F600') HTTP/1.1" 204 0
2026-03-28 14:08:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WB19OHW/698813932/600 saved to cache
2026-03-28 14:08:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 946e6279-6e49-5961-b70a-53fd1b261e3f
2026-03-28 14:08:19 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:08:19 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:08:19 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:08:19 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:08:19 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:08:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:08:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2d839690>
2026-03-28 14:08:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:08:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:08:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:08:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_18272ae4-7bc4-594a-a0ef-c08da1ce17ad/18272ae4-7bc4-594a-a0ef-c08da1ce17ad_image_8.jpg HTTP/1.1" 201 0
2026-03-28 14:08:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FTFZ8294%252F698915700%252F600') HTTP/1.1" 204 0
2026-03-28 14:08:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/TFZ8294/698915700/600 saved to cache
2026-03-28 14:08:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 18272ae4-7bc4-594a-a0ef-c08da1ce17ad
2026-03-28 14:08:19 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:08:19 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:08:19 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:08:19 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:08:19 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:08:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:08:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c9a10d0>
2026-03-28 14:08:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:08:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:08:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:08:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9ca8d44e-82e3-5298-8ffc-858aa7ec23ad/9ca8d44e-82e3-5298-8ffc-858aa7ec23ad_image_6.jpg HTTP/1.1" 201 0
2026-03-28 14:08:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FRE68RYC%252F698766765%252F600') HTTP/1.1" 204 0
2026-03-28 14:08:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RE68RYC/698766765/600 saved to cache
2026-03-28 14:08:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 9ca8d44e-82e3-5298-8ffc-858aa7ec23ad
2026-03-28 14:08:19 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:08:19 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:08:19 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:08:19 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:08:19 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:08:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:08:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c938e50>
2026-03-28 14:08:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:08:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:08:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:08:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_946e6279-6e49-5961-b70a-53fd1b261e3f/946e6279-6e49-5961-b70a-53fd1b261e3f_image_9.jpg HTTP/1.1" 201 0
2026-03-28 14:08:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FWB19OHW%252F698813943%252F600') HTTP/1.1" 204 0
2026-03-28 14:08:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WB19OHW/698813943/600 saved to cache
2026-03-28 14:08:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 946e6279-6e49-5961-b70a-53fd1b261e3f
2026-03-28 14:08:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:08:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c519710>
2026-03-28 14:08:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:08:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:08:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:08:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e7822f41-2074-585e-b916-185d4d55fb85/e7822f41-2074-585e-b916-185d4d55fb85_image_3.jpg HTTP/1.1" 201 0
2026-03-28 14:08:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FNY11BJE%252F698910400%252F600') HTTP/1.1" 204 0
2026-03-28 14:08:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NY11BJE/698910400/600 saved to cache
2026-03-28 14:08:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item e7822f41-2074-585e-b916-185d4d55fb85
2026-03-28 14:08:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:08:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c6b5690>
2026-03-28 14:08:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:08:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:08:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:08:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e7822f41-2074-585e-b916-185d4d55fb85/e7822f41-2074-585e-b916-185d4d55fb85_image_2.jpg HTTP/1.1" 201 0
2026-03-28 14:08:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FNY11BJE%252F698910375%252F600') HTTP/1.1" 204 0
2026-03-28 14:08:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NY11BJE/698910375/600 saved to cache
2026-03-28 14:08:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item e7822f41-2074-585e-b916-185d4d55fb85
2026-03-28 14:08:19 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: e7822f41-2074-585e-b916-185d4d55fb85, skipping ID generation
2026-03-28 14:08:19 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item e7822f41-2074-585e-b916-185d4d55fb85 sending to next pipeline
2026-03-28 14:08:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: e7822f41-2074-585e-b916-185d4d55fb85, identifier: NY11%20BJE
2026-03-28 14:08:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: e7822f41-2074-585e-b916-185d4d55fb85 with identifier: NY11%20BJE
2026-03-28 14:08:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: e7822f41-2074-585e-b916-185d4d55fb85 with identifier: NY11%20BJE
2026-03-28 14:08:19 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: e7822f41-2074-585e-b916-185d4d55fb85 with identifier: NY11%20BJE to the API
2026-03-28 14:08:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:08:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:08:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NY11BJE/698910375/600>
{'auction_title': '',
'c_o_2_emission_value': 124,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e7822f41-2074-585e-b916-185d4d55fb85/e7822f41-2074-585e-b916-185d4d55fb85_expert_report_file_831c2f35-1f04-4122-8361-9ee134fefead.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=NY11%20BJE-GB',
'category': 'Car',
'color': 'red',
'currency': 'GBP',
'doors_number': 3,
'engine': '1.2L',
'expiration_date': '2026-03-29T10:00:00Z',
'fuel_type': 'Petrol',
'id': 'e7822f41-2074-585e-b916-185d4d55fb85',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'NY11 BJE',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=NY11%20BJE&vehicleType=*',
'listing': 'auction',
'location': 'Manchester',
'make': 'VAUXHALL',
'model': 'CORSA',
'odometer': 94015,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 11,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e7822f41-2074-585e-b916-185d4d55fb85/e7822f41-2074-585e-b916-185d4d55fb85_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 44749,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NY11BJE/698910322/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e7822f41-2074-585e-b916-185d4d55fb85/e7822f41-2074-585e-b916-185d4d55fb85_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 44216,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NY11BJE/698910349/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e7822f41-2074-585e-b916-185d4d55fb85/e7822f41-2074-585e-b916-185d4d55fb85_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 44309,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NY11BJE/698910375/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e7822f41-2074-585e-b916-185d4d55fb85/e7822f41-2074-585e-b916-185d4d55fb85_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 44653,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NY11BJE/698910400/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e7822f41-2074-585e-b916-185d4d55fb85/e7822f41-2074-585e-b916-185d4d55fb85_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 42739,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NY11BJE/698910418/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e7822f41-2074-585e-b916-185d4d55fb85/e7822f41-2074-585e-b916-185d4d55fb85_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 42065,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NY11BJE/698910433/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e7822f41-2074-585e-b916-185d4d55fb85/e7822f41-2074-585e-b916-185d4d55fb85_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 118864,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NY11BJE/698910452/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e7822f41-2074-585e-b916-185d4d55fb85/e7822f41-2074-585e-b916-185d4d55fb85_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 42346,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NY11BJE/698910477/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e7822f41-2074-585e-b916-185d4d55fb85/e7822f41-2074-585e-b916-185d4d55fb85_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 86687,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NY11BJE/698910507/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e7822f41-2074-585e-b916-185d4d55fb85/e7822f41-2074-585e-b916-185d4d55fb85_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 79879,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NY11BJE/698910538/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2011-01-01',
'seller_name': None,
'title': 'VAUXHALL CORSA 1.2 16V LIMITED EDITION Hatchback',
'transmission': 'manual',
'trim': '16V LIMITED EDITION',
'vin': 'W0L0SDL08B6126967',
'year': 2011}
2026-03-28 14:08:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27NY11%2520BJE%27 HTTP/1.1" 200 None
2026-03-28 14:08:20 [bca.uk] INFO: Saving data for NY11%20BJE: {'created_time': 1774706900.257199, 'last_price_update_time': 1774706900.257212, 'auction_closing_time': 1774778400.0}
2026-03-28 14:08:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='NY11%2520BJE') HTTP/1.1" 204 0
2026-03-28 14:08:20 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/TFZ8294/698915585/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698915585>
2026-03-28 14:08:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/TFZ8294/698915629/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/TFZ8294/42809548?sv=2020-08-04&st=2026-03-28T14%3A08%3A05Z&se=2026-03-28T14%3A33%3A05Z&sr=b&sp=r&sig=ErLZlBqdyCWgCZpWR0ce5C0%2FBbCxi3QUVQkCi%2FMXrM0%3D)
2026-03-28 14:08:20 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WD19GOC/698733496/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698733496>
2026-03-28 14:08:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WB19OHW/698813883/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/WB19OHW/42808333?sv=2020-08-04&st=2026-03-28T14%3A08%3A05Z&se=2026-03-28T14%3A33%3A05Z&sr=b&sp=r&sig=1tPrGuzNeNTywf9es7t2uJatudSyGSBqwxwUQUNO5j8%3D)
2026-03-28 14:08:20 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WB19OHW/698813840/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698813840>
2026-03-28 14:08:20 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/TFZ8294/698915566/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698915566>
2026-03-28 14:08:20 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WP63USZ/698814396/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698814396>
2026-03-28 14:08:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WB19OHW/698813873/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/WB19OHW/42808333?sv=2020-08-04&st=2026-03-28T14%3A08%3A05Z&se=2026-03-28T14%3A33%3A05Z&sr=b&sp=r&sig=1tPrGuzNeNTywf9es7t2uJatudSyGSBqwxwUQUNO5j8%3D)
2026-03-28 14:08:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.bca.co.uk/api/search?q=&pageSize=100&page=22&sort=MostRecentlyAdded> (referer: https://www.bca.co.uk/search) ['zyte-api']
2026-03-28 14:08:20 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:08:20 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:08:20 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:08:20 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:08:20 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:08:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:08:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2dd54950>
2026-03-28 14:08:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:08:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:08:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:08:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_946e6279-6e49-5961-b70a-53fd1b261e3f/946e6279-6e49-5961-b70a-53fd1b261e3f_image_7.jpg HTTP/1.1" 201 0
2026-03-28 14:08:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FWB19OHW%252F698813922%252F600') HTTP/1.1" 204 0
2026-03-28 14:08:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WB19OHW/698813922/600 saved to cache
2026-03-28 14:08:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 946e6279-6e49-5961-b70a-53fd1b261e3f
2026-03-28 14:08:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:08:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2dd81450>
2026-03-28 14:08:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:08:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:08:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:08:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9ca8d44e-82e3-5298-8ffc-858aa7ec23ad/9ca8d44e-82e3-5298-8ffc-858aa7ec23ad_image_2.jpg HTTP/1.1" 201 0
2026-03-28 14:08:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FRE68RYC%252F698766692%252F600') HTTP/1.1" 204 0
2026-03-28 14:08:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RE68RYC/698766692/600 saved to cache
2026-03-28 14:08:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 9ca8d44e-82e3-5298-8ffc-858aa7ec23ad
2026-03-28 14:08:20 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 9ca8d44e-82e3-5298-8ffc-858aa7ec23ad, skipping ID generation
2026-03-28 14:08:20 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 9ca8d44e-82e3-5298-8ffc-858aa7ec23ad sending to next pipeline
2026-03-28 14:08:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 9ca8d44e-82e3-5298-8ffc-858aa7ec23ad, identifier: RE68%20RYC
2026-03-28 14:08:20 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:08:20 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:08:20 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:08:20 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:08:20 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:08:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:08:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2dd4c750>
2026-03-28 14:08:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:08:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:08:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:08:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_49f7b40c-fae2-5164-be3f-ce9eb1a2514d/49f7b40c-fae2-5164-be3f-ce9eb1a2514d_image_9.jpg HTTP/1.1" 201 0
2026-03-28 14:08:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FWP63USZ%252F698814502%252F600') HTTP/1.1" 204 0
2026-03-28 14:08:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WP63USZ/698814502/600 saved to cache
2026-03-28 14:08:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 49f7b40c-fae2-5164-be3f-ce9eb1a2514d
2026-03-28 14:08:20 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:08:20 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:08:20 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:08:20 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:08:20 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:08:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:08:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2dd540d0>
2026-03-28 14:08:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:08:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:08:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:08:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_18272ae4-7bc4-594a-a0ef-c08da1ce17ad/18272ae4-7bc4-594a-a0ef-c08da1ce17ad_image_7.jpg HTTP/1.1" 201 0
2026-03-28 14:08:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FTFZ8294%252F698915677%252F600') HTTP/1.1" 204 0
2026-03-28 14:08:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/TFZ8294/698915677/600 saved to cache
2026-03-28 14:08:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 18272ae4-7bc4-594a-a0ef-c08da1ce17ad
2026-03-28 14:08:20 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 14:08:20 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 14:08:20 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:08:20 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 14:08:20 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 14:08:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:08:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2c93a090>
2026-03-28 14:08:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:08:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:08:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:08:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_18272ae4-7bc4-594a-a0ef-c08da1ce17ad/18272ae4-7bc4-594a-a0ef-c08da1ce17ad_image_9.jpg HTTP/1.1" 201 0
2026-03-28 14:08:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FTFZ8294%252F698915720%252F600') HTTP/1.1" 204 0
2026-03-28 14:08:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/TFZ8294/698915720/600 saved to cache
2026-03-28 14:08:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 18272ae4-7bc4-594a-a0ef-c08da1ce17ad
2026-03-28 14:08:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 9ca8d44e-82e3-5298-8ffc-858aa7ec23ad with identifier: RE68%20RYC
2026-03-28 14:08:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 9ca8d44e-82e3-5298-8ffc-858aa7ec23ad with identifier: RE68%20RYC
2026-03-28 14:08:20 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 9ca8d44e-82e3-5298-8ffc-858aa7ec23ad with identifier: RE68%20RYC to the API
2026-03-28 14:08:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:08:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:08:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RE68RYC/698766692/600>
{'auction_title': '',
'c_o_2_emission_value': 121,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9ca8d44e-82e3-5298-8ffc-858aa7ec23ad/9ca8d44e-82e3-5298-8ffc-858aa7ec23ad_expert_report_file_ba696875-6c30-4cb7-af98-7eb4ee2dd38b.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=RE68%20RYC-GB',
'category': 'Car',
'color': 'black',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.6L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Diesel',
'id': '9ca8d44e-82e3-5298-8ffc-858aa7ec23ad',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'RE68 RYC',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=RE68%20RYC&vehicleType=*',
'listing': 'auction',
'location': 'Bridgwater',
'make': 'KIA',
'model': 'OPTIMA SP/WAGON',
'odometer': 56209,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 11,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9ca8d44e-82e3-5298-8ffc-858aa7ec23ad/9ca8d44e-82e3-5298-8ffc-858aa7ec23ad_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 54401,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RE68RYC/698766657/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9ca8d44e-82e3-5298-8ffc-858aa7ec23ad/9ca8d44e-82e3-5298-8ffc-858aa7ec23ad_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 54106,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RE68RYC/698766670/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9ca8d44e-82e3-5298-8ffc-858aa7ec23ad/9ca8d44e-82e3-5298-8ffc-858aa7ec23ad_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 51656,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RE68RYC/698766692/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9ca8d44e-82e3-5298-8ffc-858aa7ec23ad/9ca8d44e-82e3-5298-8ffc-858aa7ec23ad_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 51549,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RE68RYC/698766716/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9ca8d44e-82e3-5298-8ffc-858aa7ec23ad/9ca8d44e-82e3-5298-8ffc-858aa7ec23ad_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 45459,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RE68RYC/698766732/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9ca8d44e-82e3-5298-8ffc-858aa7ec23ad/9ca8d44e-82e3-5298-8ffc-858aa7ec23ad_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 47098,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RE68RYC/698766746/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9ca8d44e-82e3-5298-8ffc-858aa7ec23ad/9ca8d44e-82e3-5298-8ffc-858aa7ec23ad_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 90331,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RE68RYC/698766765/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9ca8d44e-82e3-5298-8ffc-858aa7ec23ad/9ca8d44e-82e3-5298-8ffc-858aa7ec23ad_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 83511,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RE68RYC/698766788/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9ca8d44e-82e3-5298-8ffc-858aa7ec23ad/9ca8d44e-82e3-5298-8ffc-858aa7ec23ad_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 98072,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RE68RYC/698766812/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9ca8d44e-82e3-5298-8ffc-858aa7ec23ad/9ca8d44e-82e3-5298-8ffc-858aa7ec23ad_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 77783,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RE68RYC/698766839/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-01-01',
'seller_name': None,
'title': 'KIA OPTIMA SP/WAGON 1.6 CRDI 136 3 ISG Estate',
'transmission': 'manual',
'trim': 'CRDI 136 3 ISG',
'vin': 'KNAGU819LK5283173',
'year': 2018}
2026-03-28 14:08:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27RE68%2520RYC%27 HTTP/1.1" 200 None
2026-03-28 14:08:21 [bca.uk] INFO: Saving data for RE68%20RYC: {'created_time': 1774706901.10897, 'last_price_update_time': 1774706901.108985, 'auction_closing_time': 1774864800.0}
2026-03-28 14:08:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='RE68%2520RYC') HTTP/1.1" 204 0
2026-03-28 14:08:21 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WP63USZ/698814361/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698814361>
2026-03-28 14:08:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/TFZ8294/698915606/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/TFZ8294/42809548?sv=2020-08-04&st=2026-03-28T14%3A08%3A05Z&se=2026-03-28T14%3A33%3A05Z&sr=b&sp=r&sig=ErLZlBqdyCWgCZpWR0ce5C0%2FBbCxi3QUVQkCi%2FMXrM0%3D)
2026-03-28 14:08:21 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WB19OHW/698813800/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=WB19OHW-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-28 14:08:21 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WD19GOC/698733492/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698733492>
2026-03-28 14:08:21 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WP63USZ/698814347/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698814347>
2026-03-28 14:08:21 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WD19GOC/698733479/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698733479>
2026-03-28 14:08:21 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/TFZ8294/698915530/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=TFZ8294-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-28 14:08:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:08:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2d990510>
2026-03-28 14:08:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:08:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:08:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:08:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_18272ae4-7bc4-594a-a0ef-c08da1ce17ad/18272ae4-7bc4-594a-a0ef-c08da1ce17ad_image_5.jpg HTTP/1.1" 201 0
2026-03-28 14:08:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FTFZ8294%252F698915629%252F600') HTTP/1.1" 204 0
2026-03-28 14:08:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/TFZ8294/698915629/600 saved to cache
2026-03-28 14:08:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 18272ae4-7bc4-594a-a0ef-c08da1ce17ad
2026-03-28 14:08:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:08:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a2d8728d0>
2026-03-28 14:08:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:08:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:08:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:08:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_946e6279-6e49-5961-b70a-53fd1b261e3f/946e6279-6e49-5961-b70a-53fd1b261e3f_image_5.jpg HTTP/1.1" 201 0
2026-03-28 14:08:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FWB19OHW%252F698813883%252F600') HTTP/1.1" 204 0
2026-03-28 14:08:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WB19OHW/698813883/600 saved to cache
2026-03-28 14:08:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 946e6279-6e49-5961-b70a-53fd1b261e3f
2026-03-28 14:08:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:08:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3a1fe80bd0>
2026-03-28 14:08:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:08:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:08:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:08:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_946e6279-6e49-5961-b70a-53fd1b261e3f/946e6279-6e49-5961-b70a-53fd1b261e3f_image_4.jpg HTTP/1.1" 201 0
2026-03-28 14:08:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FWB19OHW%252F698813873%252F600') HTTP/1.1" 204 0
2026-03-28 14:08:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WB19OHW/698813873/600 saved to cache
2026-03-28 14:08:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 946e6279-6e49-5961-b70a-53fd1b261e3f
2026-03-28 14:08:21 [bca.uk] INFO: Total items found: 100
2026-03-28 14:08:21 [bca.uk] INFO: Requesting URL: https://www.bca.co.uk/api/search?q=&pageSize=100&page=23&sort=MostRecentlyAdded
2026-03-28 14:08:21 [bca.uk] INFO: Sending search API request with Bearer token (length=1492)
2026-03-28 14:08:21 [scrapy_zyte_api._params] WARNING: Request <GET https://www.bca.co.uk/api/search?q=&pageSize=100&page=23&sort=MostRecentlyAdded> defines the Zyte API customHttpRequestHeaders parameter, overriding Request.headers. Use Request.headers instead.
2026-03-28 14:08:21 [bca.uk] INFO: Found listing with ID: CF16%20VCC
2026-03-28 14:08:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27CF16%2520VCC%27 HTTP/1.1" 200 None
2026-03-28 14:08:21 [bca.uk] INFO: Scrape type for CF16%20VCC: 0
2026-03-28 14:08:21 [bca.uk] INFO: Found listing with ID: YF23%20UNU
2026-03-28 14:08:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YF23%2520UNU%27 HTTP/1.1" 200 None
2026-03-28 14:08:21 [bca.uk] INFO: Scrape type for YF23%20UNU: 0
2026-03-28 14:08:21 [bca.uk] INFO: Found listing with ID: CE67%20DUA
2026-03-28 14:08:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27CE67%2520DUA%27 HTTP/1.1" 200 None
2026-03-28 14:08:21 [bca.uk] INFO: Scrape type for CE67%20DUA: 0
2026-03-28 14:08:21 [bca.uk] INFO: Found listing with ID: VA15%20PGV
2026-03-28 14:08:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27VA15%2520PGV%27 HTTP/1.1" 200 None
2026-03-28 14:08:21 [bca.uk] INFO: Scrape type for VA15%20PGV: 0
2026-03-28 14:08:21 [bca.uk] INFO: Found listing with ID: WF62%20FHV
2026-03-28 14:08:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WF62%2520FHV%27 HTTP/1.1" 200 None
2026-03-28 14:08:21 [bca.uk] INFO: Scrape type for WF62%20FHV: 0
2026-03-28 14:08:21 [bca.uk] INFO: Found listing with ID: WP64%20OMX
2026-03-28 14:08:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WP64%2520OMX%27 HTTP/1.1" 200 None
2026-03-28 14:08:21 [bca.uk] INFO: Scrape type for WP64%20OMX: 0
2026-03-28 14:08:21 [bca.uk] INFO: Found listing with ID: KT17%20GKL
2026-03-28 14:08:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KT17%2520GKL%27 HTTP/1.1" 200 None
2026-03-28 14:08:21 [bca.uk] INFO: Scrape type for KT17%20GKL: 0
2026-03-28 14:08:21 [bca.uk] INFO: Found listing with ID: HP08%20CJP
2026-03-28 14:08:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27HP08%2520CJP%27 HTTP/1.1" 200 None
2026-03-28 14:08:21 [bca.uk] INFO: Scrape type for HP08%20CJP: 0
2026-03-28 14:08:21 [bca.uk] INFO: Found listing with ID: SG15%20DHC
2026-03-28 14:08:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SG15%2520DHC%27 HTTP/1.1" 200 None
2026-03-28 14:08:21 [bca.uk] INFO: Scrape type for SG15%20DHC: 0
2026-03-28 14:08:21 [bca.uk] INFO: Found listing with ID: FD17%20YNY
2026-03-28 14:08:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FD17%2520YNY%27 HTTP/1.1" 200 None
2026-03-28 14:08:21 [bca.uk] INFO: Scrape type for FD17%20YNY: 0
2026-03-28 14:08:21 [bca.uk] INFO: Found listing with ID: WR62%20NLM
2026-03-28 14:08:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WR62%2520NLM%27 HTTP/1.1" 200 None
2026-03-28 14:08:21 [bca.uk] INFO: Scrape type for WR62%20NLM: 0
2026-03-28 14:08:21 [bca.uk] INFO: Found listing with ID: NA14%20BWZ
2026-03-28 14:08:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27NA14%2520BWZ%27 HTTP/1.1" 200 None
2026-03-28 14:08:21 [bca.uk] INFO: Scrape type for NA14%20BWZ: 0
2026-03-28 14:08:21 [bca.uk] INFO: Found listing with ID: BD03%20HWG
2026-03-28 14:08:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BD03%2520HWG%27 HTTP/1.1" 200 None
2026-03-28 14:08:21 [bca.uk] INFO: Scrape type for BD03%20HWG: 0
2026-03-28 14:08:21 [bca.uk] INFO: Found listing with ID: BG68%20PDX
2026-03-28 14:08:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BG68%2520PDX%27 HTTP/1.1" 200 None
2026-03-28 14:08:21 [bca.uk] INFO: Scrape type for BG68%20PDX: 0
2026-03-28 14:08:21 [bca.uk] INFO: Found listing with ID: OE04%20DZX
2026-03-28 14:08:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27OE04%2520DZX%27 HTTP/1.1" 200 None
2026-03-28 14:08:21 [bca.uk] INFO: Scrape type for OE04%20DZX: 0
2026-03-28 14:08:21 [bca.uk] INFO: Found listing with ID: VO64%20EHR
2026-03-28 14:08:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27VO64%2520EHR%27 HTTP/1.1" 200 None
2026-03-28 14:08:21 [bca.uk] INFO: Scrape type for VO64%20EHR: 0
2026-03-28 14:08:21 [bca.uk] INFO: Found listing with ID: ND63%20LNP
2026-03-28 14:08:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27ND63%2520LNP%27 HTTP/1.1" 200 None
2026-03-28 14:08:21 [bca.uk] INFO: Scrape type for ND63%20LNP: 0
2026-03-28 14:08:21 [bca.uk] INFO: Found listing with ID: SL64%20FZK
2026-03-28 14:08:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SL64%2520FZK%27 HTTP/1.1" 200 None
2026-03-28 14:08:21 [bca.uk] INFO: Scrape type for SL64%20FZK: 0
2026-03-28 14:08:21 [bca.uk] INFO: Found listing with ID: AU56%20WCK
2026-03-28 14:08:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27AU56%2520WCK%27 HTTP/1.1" 200 None
2026-03-28 14:08:21 [bca.uk] INFO: Scrape type for AU56%20WCK: 0
2026-03-28 14:08:21 [bca.uk] INFO: Found listing with ID: FM56%20CRV
2026-03-28 14:08:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FM56%2520CRV%27 HTTP/1.1" 200 None
2026-03-28 14:08:21 [bca.uk] INFO: Scrape type for FM56%20CRV: 0
2026-03-28 14:08:21 [bca.uk] INFO: Found listing with ID: ML67%20ONM
2026-03-28 14:08:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27ML67%2520ONM%27 HTTP/1.1" 200 None
2026-03-28 14:08:21 [bca.uk] INFO: Scrape type for ML67%20ONM: 0
2026-03-28 14:08:21 [bca.uk] INFO: Found listing with ID: PK17%20EOC
2026-03-28 14:08:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27PK17%2520EOC%27 HTTP/1.1" 200 None
2026-03-28 14:08:21 [bca.uk] INFO: Scrape type for PK17%20EOC: 0
2026-03-28 14:08:21 [bca.uk] INFO: Found listing with ID: YC68%20CCO
2026-03-28 14:08:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YC68%2520CCO%27 HTTP/1.1" 200 None
2026-03-28 14:08:21 [bca.uk] INFO: Scrape type for YC68%20CCO: 0
2026-03-28 14:08:21 [bca.uk] INFO: Found listing with ID: YK19%20YDN
2026-03-28 14:08:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YK19%2520YDN%27 HTTP/1.1" 200 None
2026-03-28 14:08:21 [bca.uk] INFO: Scrape type for YK19%20YDN: 0
2026-03-28 14:08:21 [bca.uk] INFO: Found listing with ID: VO24%20YPP
2026-03-28 14:08:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27VO24%2520YPP%27 HTTP/1.1" 200 None
2026-03-28 14:08:21 [bca.uk] INFO: Scrape type for VO24%20YPP: 0
2026-03-28 14:08:21 [bca.uk] INFO: Found listing with ID: SL63%20OXM
2026-03-28 14:08:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SL63%2520OXM%27 HTTP/1.1" 200 None
2026-03-28 14:08:21 [bca.uk] INFO: Scrape type for SL63%20OXM: 0
2026-03-28 14:08:21 [bca.uk] INFO: Found listing with ID: YH63%20SRO
2026-03-28 14:08:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YH63%2520SRO%27 HTTP/1.1" 200 None
2026-03-28 14:08:21 [bca.uk] INFO: Scrape type for YH63%20SRO: 0
2026-03-28 14:08:21 [bca.uk] INFO: Found listing with ID: OY16%20GVN
2026-03-28 14:08:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27OY16%2520GVN%27 HTTP/1.1" 200 None
2026-03-28 14:08:21 [bca.uk] INFO: Scrape type for OY16%20GVN: 0
2026-03-28 14:08:21 [bca.uk] INFO: Found listing with ID: YD16%20XEJ
2026-03-28 14:08:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YD16%2520XEJ%27 HTTP/1.1" 200 None
2026-03-28 14:08:21 [bca.uk] INFO: Scrape type for YD16%20XEJ: 0
2026-03-28 14:08:21 [bca.uk] INFO: Found listing with ID: VO24%20ONM
2026-03-28 14:08:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27VO24%2520ONM%27 HTTP/1.1" 200 None
2026-03-28 14:08:21 [bca.uk] INFO: Scrape type for VO24%20ONM: 0
2026-03-28 14:08:21 [bca.uk] INFO: Found listing with ID: YB17%20SGV
2026-03-28 14:08:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YB17%2520SGV%27 HTTP/1.1" 200 None
2026-03-28 14:08:21 [bca.uk] INFO: Scrape type for YB17%20SGV: 0
2026-03-28 14:08:21 [bca.uk] INFO: Found listing with ID: MW54%20PAS
2026-03-28 14:08:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MW54%2520PAS%27 HTTP/1.1" 200 None
2026-03-28 14:08:21 [bca.uk] INFO: Scrape type for MW54%20PAS: 0
2026-03-28 14:08:21 [bca.uk] INFO: Found listing with ID: CK18%20CFX
2026-03-28 14:08:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27CK18%2520CFX%27 HTTP/1.1" 200 None
2026-03-28 14:08:21 [bca.uk] INFO: Scrape type for CK18%20CFX: 0
2026-03-28 14:08:21 [bca.uk] INFO: Found listing with ID: DF64%20XZL
2026-03-28 14:08:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DF64%2520XZL%27 HTTP/1.1" 200 None
2026-03-28 14:08:21 [bca.uk] INFO: Scrape type for DF64%20XZL: 0
2026-03-28 14:08:21 [bca.uk] INFO: Found listing with ID: VN24%20OFL
2026-03-28 14:08:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27VN24%2520OFL%27 HTTP/1.1" 200 None
2026-03-28 14:08:21 [bca.uk] INFO: Scrape type for VN24%20OFL: 0
2026-03-28 14:08:21 [bca.uk] INFO: Found listing with ID: DV18%20UGL
2026-03-28 14:08:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DV18%2520UGL%27 HTTP/1.1" 200 None
2026-03-28 14:08:21 [bca.uk] INFO: Scrape type for DV18%20UGL: 0
2026-03-28 14:08:21 [bca.uk] INFO: Found listing with ID: PF68%20UBR
2026-03-28 14:08:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27PF68%2520UBR%27 HTTP/1.1" 200 None
2026-03-28 14:08:21 [bca.uk] INFO: Scrape type for PF68%20UBR: 0
2026-03-28 14:08:21 [bca.uk] INFO: Found listing with ID: FG64%20CDE
2026-03-28 14:08:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FG64%2520CDE%27 HTTP/1.1" 200 None
2026-03-28 14:08:21 [bca.uk] INFO: Scrape type for FG64%20CDE: 2
2026-03-28 14:08:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 32b32c61-3fb3-575f-b3cf-5d14cab25e17 with identifier: FG64%20CDE
2026-03-28 14:08:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 32b32c61-3fb3-575f-b3cf-5d14cab25e17 with scrape type 2
2026-03-28 14:08:21 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 32b32c61-3fb3-575f-b3cf-5d14cab25e17 with scrape type 2
2026-03-28 14:08:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 32b32c61-3fb3-575f-b3cf-5d14cab25e17, identifier: FG64%20CDE
2026-03-28 14:08:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WP63USZ/698814396/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/WP63USZ/42807824?sv=2020-08-04&st=2026-03-28T14%3A08%3A02Z&se=2026-03-28T14%3A33%3A02Z&sr=b&sp=r&sig=5J8P%2B%2BDbXuvBahjgaBANg4jjcUvdaSd%2B3YMnV6APqM0%3D)
2026-03-28 14:08:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 32b32c61-3fb3-575f-b3cf-5d14cab25e17 with identifier: FG64%20CDE
2026-03-28 14:08:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 32b32c61-3fb3-575f-b3cf-5d14cab25e17 with identifier: FG64%20CDE
2026-03-28 14:08:22 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 32b32c61-3fb3-575f-b3cf-5d14cab25e17 with identifier: FG64%20CDE to the API
2026-03-28 14:08:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:08:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:08:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=22&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 99,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=FG64%20CDE-GB',
'category': 'Car',
'color': 'red',
'currency': 'GBP',
'doors_number': 3,
'engine': '1.2L',
'expiration_date': '2026-03-29T10:00:00Z',
'fuel_type': 'Petrol',
'id': '32b32c61-3fb3-575f-b3cf-5d14cab25e17',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'FG64 CDE',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=FG64%20CDE&vehicleType=*',
'listing': 'auction',
'location': 'Bristol',
'make': 'PEUGEOT',
'model': '108',
'odometer': 64489,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2014-01-01',
'seller_name': None,
'title': 'PEUGEOT 108 1.2 VTI ALLURE Hatchback',
'transmission': 'manual',
'trim': 'VTI ALLURE',
'vin': 'VF3PAHMTBER257895',
'year': 2014}
2026-03-28 14:08:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FG64%2520CDE%27 HTTP/1.1" 200 None
2026-03-28 14:08:22 [bca.uk] INFO: Saving data for FG64%20CDE: {'auction_closing_time': 1774778400.0, 'created_time': 1774391142.222122, 'last_price_update_time': 1774706902.518692}
2026-03-28 14:08:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1"